[2025-09-23T17:00:01.617145] [INFO ] [MAIN ] Using last completed trading day: 2025-09-23 [2025-09-23T17:00:01.617885] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-09-23T17:00:01.618051] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-09-23T17:00:01.618128] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-09-23T17:00:03.164767] [DEBUG] [SYMBOL ] Found 2424 valid NYSE symbols. [2025-09-23T17:00:03.164943] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-09-23T17:00:03.165148] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-09-23T17:00:03.165953] [INFO ] [LOCAL ] Symbols cache updated with 2372 symbols. [2025-09-23T17:00:03.166010] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-09-23T17:00:03.166041] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-09-23T17:00:03.166099] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-09-23T17:00:03.166193] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-23T17:00:03.166586] [DEBUG] [LOCAL ] Found 2372 symbols in cached list. [2025-09-23T17:00:03.166638] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-23T17:00:03.166858] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-09-23T17:00:03.166913] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2372 valid symbols. [2025-09-23T17:00:03.166945] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-09-23T17:00:03.166975] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-09-23T17:00:03.192085] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/BRFS.csv (symbol BRFS no longer active). [2025-09-23T17:00:03.194536] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-09-23T17:00:03.218512] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/derivative_storage/BRFS.csv (symbol BRFS no longer active). [2025-09-23T17:00:03.220970] [INFO ] [LOCAL ] Deleted 2 obsolete data files. [2025-09-23T17:00:03.221025] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-09-23T17:00:03.221056] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-09-23T17:00:03.221083] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-09-23T17:00:03.221360] [WARN ] [STATE ] State set to: RUNNING [2025-09-23T17:00:03.221483] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-23T17:00:03.221890] [DEBUG] [LOCAL ] Found 2372 symbols in cached list. [2025-09-23T17:00:03.221941] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-23T17:00:03.221972] [INFO ] [MAIN ] Starting incremental update for 2372 symbols. [2025-09-23T17:00:03.222000] [INFO ] [MAIN ] Running in parallel mode [2025-09-23T17:00:03.222178] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2372 symbols [2025-09-23T17:00:03.852613] [INFO ] [MAIN ] AACT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:00:03.890727] [DEBUG] [LOCAL ] AACT: No existing data file found in primary storage. [2025-09-23T17:00:03.933955] [WARN ] [MAIN ] AACT: No existing data found, performing full refresh instead. [2025-09-23T17:00:04.036201] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:00:04.043386] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:00:04.072402] [INFO ] [MAIN ] AACT: Wiping existing primary data before full refresh. [2025-09-23T17:00:04.114515] [INFO ] [LOCAL ] AACT: Starting deletion of primary data. [2025-09-23T17:00:04.115845] [DEBUG] [LOCAL ] AACT: No primary data file found to delete. [2025-09-23T17:00:04.116743] [INFO ] [MAIN ] AACT: Starting full primary refresh. [2025-09-23T17:00:04.114430] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:00:04.136065] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-09-23T17:00:04.167446] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-09-23T17:00:04.180992] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-09-23T17:00:04.205867] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-09-23T17:00:04.211716] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-09-23T17:00:04.211829] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-09-23T17:00:04.682265] [DEBUG] [LOCAL ] A: Loaded 50829 existing records from primary storage. [2025-09-23T17:00:04.710624] [INFO ] [MAIN ] A: Loaded 50829 existing records. [2025-09-23T17:00:04.744236] [DEBUG] [LOCAL ] AA: Loaded 53614 existing records from primary storage. [2025-09-23T17:00:04.880601] [INFO ] [MAIN ] AA: Loaded 53614 existing records. [2025-09-23T17:00:04.917617] [INFO ] [REMOTE ] AACT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:00:05.002056] [INFO ] [REMOTE ] AACT: Fetching primary data for 2024-12. [2025-09-23T17:00:05.408852] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:00:05.392516] [WARN ] [MAIN ] A: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:00:05.430139] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-09-23T17:00:05.430292] [WARN ] [MAIN ] AA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:00:05.430428] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-09-23T17:00:05.430748] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-09-23T17:00:05.424302] [INFO ] [REMOTE ] AAM: Fetching primary data for 2024-12. [2025-09-23T17:00:05.430856] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-09-23T17:00:05.432203] [DEBUG] [LOCAL ] A: Deleted primary data file. [2025-09-23T17:00:05.432268] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-09-23T17:00:05.443677] [DEBUG] [LOCAL ] AA: Deleted primary data file. [2025-09-23T17:00:05.454106] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-09-23T17:00:06.146063] [INFO ] [REMOTE ] AA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:00:06.172590] [INFO ] [REMOTE ] AA: Fetching primary data for 2024-12. [2025-09-23T17:00:06.172303] [INFO ] [REMOTE ] A: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:00:06.173049] [INFO ] [REMOTE ] A: Fetching primary data for 2024-12. [2025-09-23T17:00:06.972953] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-23T17:00:06.974129] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-09-23T17:00:07.666790] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2024-12 (2.66 seconds). [2025-09-23T17:00:07.667834] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-01. [2025-09-23T17:00:08.207857] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-23T17:00:08.209072] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-09-23T17:00:08.230112] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-23T17:00:08.231297] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-02. [2025-09-23T17:00:08.557921] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-23T17:00:08.559836] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-03. [2025-09-23T17:00:08.597878] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-23T17:00:08.599260] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-09-23T17:00:09.074787] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-23T17:00:09.075998] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-09-23T17:00:09.102639] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-23T17:00:09.105146] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-04. [2025-09-23T17:00:09.316383] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2024-12 (3.14 seconds). [2025-09-23T17:00:09.327857] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-01. [2025-09-23T17:00:09.364210] [INFO ] [REMOTE ] A: Incremental fetch complete for 2024-12 (3.19 seconds). [2025-09-23T17:00:09.374410] [INFO ] [REMOTE ] A: Fetching primary data for 2025-01. [2025-09-23T17:00:09.382454] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-09-23T17:00:09.383449] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-09-23T17:00:09.638081] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-09-23T17:00:09.639082] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-09-23T17:00:09.682049] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-23T17:00:09.684675] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-05. [2025-09-23T17:00:09.888108] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-09-23T17:00:09.889015] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-09-23T17:00:10.142694] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-09-23T17:00:10.143845] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-09-23T17:00:10.196949] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-23T17:00:10.199478] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-06. [2025-09-23T17:00:10.456012] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-23T17:00:10.457131] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-09-23T17:00:10.881834] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-23T17:00:10.882672] [INFO ] [REMOTE ] AAM: Full fetch complete (961 records). [2025-09-23T17:00:10.882759] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-09-23T17:00:10.883296] [FATAL] [VALIDATOR ] AAM: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:00:10.883395] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:00:10.883463] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:00:10.883534] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-09-23T17:00:10.883624] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-09-23T17:00:10.883713] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-09-23T17:00:10.883774] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-09-23T17:00:10.883844] [INFO ] [MAIN ] Update Progress: 1/2372 symbols completed. AAM took 7.6s. Estimated remaining: 5h 2m 46s. Rate: 7.8 symbols/min [2025-09-23T17:00:11.066209] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:00:11.066532] [DEBUG] [LOCAL ] AAMI: No existing data file found in primary storage. [2025-09-23T17:00:11.066933] [WARN ] [MAIN ] AAMI: No existing data found, performing full refresh instead. [2025-09-23T17:00:11.067622] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-09-23T17:00:11.067888] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-09-23T17:00:11.068003] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-09-23T17:00:11.068065] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-09-23T17:00:11.306008] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-23T17:00:11.405978] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-09-23T17:00:11.434993] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-23T17:00:11.500932] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-23T17:00:11.499868] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-09-23T17:00:11.561109] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:00:11.561529] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-07. [2025-09-23T17:00:11.562603] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2024-12. [2025-09-23T17:00:11.765949] [DEBUG] [REMOTE ] AAMI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:00:11.766358] [WARN ] [REMOTE ] AAMI: No data returned for month 2024-12 [2025-09-23T17:00:11.766983] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-01. [2025-09-23T17:00:12.067662] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-23T17:00:12.070668] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-08. [2025-09-23T17:00:12.833499] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-23T17:00:12.837550] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-02. [2025-09-23T17:00:12.900006] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-23T17:00:12.902998] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-09. [2025-09-23T17:00:13.144469] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-23T17:00:13.154311] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-09-23T17:00:13.214611] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-23T17:00:13.224978] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-09-23T17:00:13.611992] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-23T17:00:13.615919] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-03. [2025-09-23T17:00:14.645026] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-23T17:00:14.656978] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-09-23T17:00:14.750136] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-23T17:00:14.762349] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-09-23T17:00:15.058597] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-23T17:00:15.063667] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-04. [2025-09-23T17:00:15.763779] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-09 (2.86 seconds). [2025-09-23T17:00:15.767200] [INFO ] [REMOTE ] AACT: Full fetch complete (11003 records). [2025-09-23T17:00:15.767275] [DEBUG] [VALIDATOR ] AACT: Validating primary data. [2025-09-23T17:00:15.957958] [WARN ] [VALIDATOR ] AACT: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-23T17:00:15.958313] [FATAL] [MAIN ] AACT: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:00:15.958434] [WARN ] [MAIN ] AACT: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:00:15.958596] [INFO ] [LOCAL ] AACT: Starting deletion of primary data. [2025-09-23T17:00:15.958764] [DEBUG] [LOCAL ] AACT: No primary data file found to delete. [2025-09-23T17:00:15.958854] [INFO ] [LOCAL ] AACT: Starting deletion of derivative data. [2025-09-23T17:00:15.958918] [DEBUG] [LOCAL ] AACT: No derivative data file found to delete. [2025-09-23T17:00:15.958982] [INFO ] [MAIN ] Update Progress: 2/2372 symbols completed. AACT took 12.7s. Estimated remaining: 4h 11m 33s. Rate: 9.4 symbols/min [2025-09-23T17:00:16.135137] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:00:16.204470] [DEBUG] [LOCAL ] AAP: Loaded 52149 existing records from primary storage. [2025-09-23T17:00:16.204606] [INFO ] [MAIN ] AAP: Loaded 52149 existing records. [2025-09-23T17:00:16.383549] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-23T17:00:16.423992] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-09-23T17:00:16.424106] [WARN ] [MAIN ] AAP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:00:16.425211] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-09-23T17:00:16.425261] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-09-23T17:00:16.426686] [DEBUG] [LOCAL ] AAP: Deleted primary data file. [2025-09-23T17:00:16.426748] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-09-23T17:00:16.791077] [INFO ] [REMOTE ] AAP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:00:16.791931] [INFO ] [REMOTE ] AAP: Fetching primary data for 2024-12. [2025-09-23T17:00:16.941424] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-23T17:00:16.947881] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-05. [2025-09-23T17:00:17.131170] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-09-23T17:00:17.143041] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-09-23T17:00:17.931208] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-23T17:00:17.937435] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-06. [2025-09-23T17:00:18.025388] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-23T17:00:18.036222] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-09-23T17:00:18.257794] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-23T17:00:18.268027] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-01. [2025-09-23T17:00:19.421540] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-23T17:00:19.426626] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-07. [2025-09-23T17:00:19.879803] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-23T17:00:19.890439] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-09-23T17:00:19.978053] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-23T17:00:19.989264] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-09-23T17:00:20.179446] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-23T17:00:20.185724] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-08. [2025-09-23T17:00:20.572454] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (3.43 seconds). [2025-09-23T17:00:20.584699] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-09-23T17:00:21.318787] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-23T17:00:21.329000] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-09-23T17:00:21.448235] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-23T17:00:21.461061] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-09-23T17:00:21.795084] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-23T17:00:21.801903] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-09. [2025-09-23T17:00:22.145994] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-23T17:00:22.160118] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-09-23T17:00:22.790628] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-23T17:00:22.803176] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-09-23T17:00:22.944121] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-23T17:00:22.960951] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-09-23T17:00:23.215019] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-23T17:00:23.221013] [INFO ] [REMOTE ] AAMI: Full fetch complete (30270 records). [2025-09-23T17:00:23.221112] [DEBUG] [VALIDATOR ] AAMI: Validating primary data. [2025-09-23T17:00:23.428215] [WARN ] [VALIDATOR ] AAMI: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-23T17:00:23.428775] [FATAL] [MAIN ] AAMI: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:00:23.428869] [WARN ] [MAIN ] AAMI: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:00:23.428957] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-09-23T17:00:23.429071] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-09-23T17:00:23.429129] [INFO ] [LOCAL ] AAMI: Starting deletion of derivative data. [2025-09-23T17:00:23.429174] [DEBUG] [LOCAL ] AAMI: No derivative data file found to delete. [2025-09-23T17:00:23.429289] [INFO ] [MAIN ] Update Progress: 3/2372 symbols completed. AAMI took 12.5s. Estimated remaining: 4h 25m 57s. Rate: 8.9 symbols/min [2025-09-23T17:00:23.628018] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:00:23.668255] [DEBUG] [LOCAL ] AAT: Loaded 30600 existing records from primary storage. [2025-09-23T17:00:23.668428] [INFO ] [MAIN ] AAT: Loaded 30600 existing records. [2025-09-23T17:00:23.854200] [WARN ] [MAIN ] AAT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:00:23.854504] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-09-23T17:00:23.854566] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-09-23T17:00:23.855868] [DEBUG] [LOCAL ] AAT: Deleted primary data file. [2025-09-23T17:00:23.855967] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-09-23T17:00:24.208627] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-23T17:00:24.304343] [INFO ] [REMOTE ] AAT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:00:24.300958] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-09-23T17:00:24.307393] [INFO ] [REMOTE ] AAT: Fetching primary data for 2024-12. [2025-09-23T17:00:24.408811] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-23T17:00:24.413780] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-23T17:00:24.431968] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-09-23T17:00:24.447033] [INFO ] [REMOTE ] A: Full fetch complete (72727 records). [2025-09-23T17:00:24.447295] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-09-23T17:00:24.449862] [FATAL] [VALIDATOR ] A: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:00:24.450103] [FATAL] [MAIN ] A: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:00:24.450212] [WARN ] [MAIN ] A: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:00:24.450309] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-09-23T17:00:24.450426] [DEBUG] [LOCAL ] A: No primary data file found to delete. [2025-09-23T17:00:24.450496] [INFO ] [LOCAL ] A: Starting deletion of derivative data. [2025-09-23T17:00:24.451131] [DEBUG] [LOCAL ] A: Deleted derivative data file. [2025-09-23T17:00:24.451930] [INFO ] [MAIN ] Update Progress: 4/2372 symbols completed. A took 21.2s. Estimated remaining: 3h 29m 28s. Rate: 11.3 symbols/min [2025-09-23T17:00:24.630518] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:00:24.630855] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-09-23T17:00:24.630916] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-09-23T17:00:24.631084] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-09-23T17:00:24.631186] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-09-23T17:00:24.631239] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-09-23T17:00:24.631275] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-09-23T17:00:25.018664] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:00:25.019111] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2024-12. [2025-09-23T17:00:25.225257] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:00:25.225771] [WARN ] [REMOTE ] AAUC: No data returned for month 2024-12 [2025-09-23T17:00:25.226353] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-01. [2025-09-23T17:00:25.411917] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-23T17:00:25.419152] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-01. [2025-09-23T17:00:25.460036] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:00:25.460548] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-01 [2025-09-23T17:00:25.461209] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-02. [2025-09-23T17:00:25.676247] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:00:25.676608] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-02 [2025-09-23T17:00:25.677086] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-03. [2025-09-23T17:00:25.901477] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:00:25.901834] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-03 [2025-09-23T17:00:25.902296] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-04. [2025-09-23T17:00:25.943563] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-23T17:00:25.955075] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-09-23T17:00:26.048529] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-23T17:00:26.059604] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-09-23T17:00:26.129460] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:00:26.129773] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-04 [2025-09-23T17:00:26.130208] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-05. [2025-09-23T17:00:26.306197] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-23T17:00:26.311860] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-09-23T17:00:26.515207] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:00:26.515536] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-05 [2025-09-23T17:00:26.516140] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-06. [2025-09-23T17:00:27.301019] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-23T17:00:27.303314] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-07. [2025-09-23T17:00:27.322887] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-23T17:00:27.330149] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-09-23T17:00:27.404182] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-23T17:00:27.418048] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-09-23T17:00:27.621287] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-23T17:00:27.635523] [INFO ] [REMOTE ] AA: Full fetch complete (77520 records). [2025-09-23T17:00:27.635756] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-09-23T17:00:27.966968] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-23T17:00:27.976400] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-08. [2025-09-23T17:00:28.076314] [DEBUG] [VALIDATOR ] AA: All expected trading days are present. [2025-09-23T17:00:28.076402] [DEBUG] [VALIDATOR ] AA: Primary data validation passed. [2025-09-23T17:00:28.077798] [INFO ] [MAIN ] AA: Fetched primary data is valid. [2025-09-23T17:00:28.077913] [DEBUG] [LOCAL ] AA: Saving primary data. [2025-09-23T17:00:28.081540] [DEBUG] [LOCAL ] AA: Trimmed 77520 records to 53614 (keeping 200 days of data) [2025-09-23T17:00:28.448999] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-23T17:00:28.458118] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-09-23T17:00:28.457779] [DEBUG] [LOCAL ] AA: Primary data saved (53614 records). [2025-09-23T17:00:28.459044] [INFO ] [MAIN ] AA: Full history saved. [2025-09-23T17:00:28.459600] [INFO ] [MAIN ] Update Progress: 5/2372 symbols completed. AA took 25.2s. Estimated remaining: 3h 19m 7s. Rate: 11.9 symbols/min [2025-09-23T17:00:28.640620] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:00:28.651746] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-23T17:00:28.662036] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-09. [2025-09-23T17:00:28.696635] [DEBUG] [LOCAL ] AB: Loaded 28542 existing records from primary storage. [2025-09-23T17:00:28.696806] [INFO ] [MAIN ] AB: Loaded 28542 existing records. [2025-09-23T17:00:28.879447] [WARN ] [MAIN ] AB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:00:28.879803] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-09-23T17:00:28.879969] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-09-23T17:00:28.881092] [DEBUG] [LOCAL ] AB: Deleted primary data file. [2025-09-23T17:00:28.881241] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-09-23T17:00:29.267095] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-23T17:00:29.272194] [INFO ] [REMOTE ] AB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:00:29.283058] [INFO ] [REMOTE ] AB: Fetching primary data for 2024-12. [2025-09-23T17:00:29.287045] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-09-23T17:00:29.421538] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-23T17:00:29.425182] [INFO ] [REMOTE ] AAUC: Full fetch complete (7322 records). [2025-09-23T17:00:29.425256] [DEBUG] [VALIDATOR ] AAUC: Validating primary data. [2025-09-23T17:00:29.607523] [WARN ] [VALIDATOR ] AAUC: Validation failed - insufficient historical data. Have 74 unique days, need 200 days [2025-09-23T17:00:29.607834] [FATAL] [MAIN ] AAUC: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:00:29.607947] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:00:29.608073] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-09-23T17:00:29.608325] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-09-23T17:00:29.608465] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-09-23T17:00:29.608629] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-09-23T17:00:29.608811] [INFO ] [MAIN ] Update Progress: 6/2372 symbols completed. AAUC took 5.2s. Estimated remaining: 2h 53m 25s. Rate: 13.6 symbols/min [2025-09-23T17:00:29.782375] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:00:29.807050] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-23T17:00:29.816296] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-09-23T17:00:29.896972] [DEBUG] [LOCAL ] ABBV: Loaded 53687 existing records from primary storage. [2025-09-23T17:00:29.897365] [INFO ] [MAIN ] ABBV: Loaded 53687 existing records. [2025-09-23T17:00:30.074547] [WARN ] [MAIN ] ABBV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:00:30.074931] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-09-23T17:00:30.074987] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-09-23T17:00:30.076519] [DEBUG] [LOCAL ] ABBV: Deleted primary data file. [2025-09-23T17:00:30.076582] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-09-23T17:00:30.427495] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:00:30.427849] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2024-12. [2025-09-23T17:00:31.209172] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-23T17:00:31.216208] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-01. [2025-09-23T17:00:31.598617] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-09-23T17:00:31.609478] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-09-23T17:00:31.681979] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-23T17:00:31.688460] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-09-23T17:00:32.498493] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-23T17:00:32.505971] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-09-23T17:00:32.727895] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-23T17:00:32.734396] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-09-23T17:00:33.062036] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2024-12 (2.63 seconds). [2025-09-23T17:00:33.073274] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-01. [2025-09-23T17:00:33.482013] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-23T17:00:33.489964] [INFO ] [REMOTE ] AAP: Full fetch complete (74822 records). [2025-09-23T17:00:33.490104] [DEBUG] [VALIDATOR ] AAP: Validating primary data. [2025-09-23T17:00:33.490852] [FATAL] [VALIDATOR ] AAP: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:00:33.490955] [FATAL] [MAIN ] AAP: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:00:33.491034] [WARN ] [MAIN ] AAP: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:00:33.491129] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-09-23T17:00:33.491211] [DEBUG] [LOCAL ] AAP: No primary data file found to delete. [2025-09-23T17:00:33.491250] [INFO ] [LOCAL ] AAP: Starting deletion of derivative data. [2025-09-23T17:00:33.491797] [DEBUG] [LOCAL ] AAP: Deleted derivative data file. [2025-09-23T17:00:33.492190] [INFO ] [MAIN ] Update Progress: 7/2372 symbols completed. AAP took 17.5s. Estimated remaining: 2h 50m 27s. Rate: 13.9 symbols/min [2025-09-23T17:00:33.682601] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:00:33.725342] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-23T17:00:33.739668] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-23T17:00:33.738469] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-09-23T17:00:33.750735] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-09-23T17:00:33.783033] [DEBUG] [LOCAL ] ABCB: Loaded 30792 existing records from primary storage. [2025-09-23T17:00:33.783195] [INFO ] [MAIN ] ABCB: Loaded 30792 existing records. [2025-09-23T17:00:33.968540] [WARN ] [MAIN ] ABCB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:00:33.968856] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-09-23T17:00:33.968914] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-09-23T17:00:33.969989] [DEBUG] [LOCAL ] ABCB: Deleted primary data file. [2025-09-23T17:00:33.970051] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-09-23T17:00:34.325988] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:00:34.326346] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2024-12. [2025-09-23T17:00:34.689334] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-23T17:00:34.695999] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-09-23T17:00:35.093909] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-23T17:00:35.103790] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-09-23T17:00:35.224573] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-23T17:00:35.235637] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-09-23T17:00:35.736627] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-23T17:00:35.743248] [INFO ] [REMOTE ] AAT: Full fetch complete (42765 records). [2025-09-23T17:00:35.743387] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-09-23T17:00:35.869092] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-23T17:00:35.891736] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-01. [2025-09-23T17:00:36.150906] [DEBUG] [VALIDATOR ] AAT: All expected trading days are present. [2025-09-23T17:00:36.151001] [DEBUG] [VALIDATOR ] AAT: Primary data validation passed. [2025-09-23T17:00:36.151427] [INFO ] [MAIN ] AAT: Fetched primary data is valid. [2025-09-23T17:00:36.151473] [DEBUG] [LOCAL ] AAT: Saving primary data. [2025-09-23T17:00:36.152527] [DEBUG] [LOCAL ] AAT: Trimmed 42765 records to 30651 (keeping 200 days of data) [2025-09-23T17:00:36.364452] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-23T17:00:36.374571] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-09-23T17:00:36.397018] [DEBUG] [LOCAL ] AAT: Primary data saved (30651 records). [2025-09-23T17:00:36.397395] [INFO ] [MAIN ] AAT: Full history saved. [2025-09-23T17:00:36.397500] [INFO ] [MAIN ] Update Progress: 8/2372 symbols completed. AAT took 13.0s. Estimated remaining: 2h 43m 23s. Rate: 14.5 symbols/min [2025-09-23T17:00:36.567306] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:00:36.625515] [DEBUG] [LOCAL ] ABEV: Loaded 53275 existing records from primary storage. [2025-09-23T17:00:36.625758] [INFO ] [MAIN ] ABEV: Loaded 53275 existing records. [2025-09-23T17:00:36.815560] [WARN ] [MAIN ] ABEV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:00:36.816115] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-09-23T17:00:36.816290] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-09-23T17:00:36.818122] [DEBUG] [LOCAL ] ABEV: Deleted primary data file. [2025-09-23T17:00:36.818302] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-09-23T17:00:36.970340] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-23T17:00:37.005174] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-09-23T17:00:37.196152] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-23T17:00:37.256444] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-09-23T17:00:37.309211] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:00:37.309702] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2024-12. [2025-09-23T17:00:37.327871] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-23T17:00:37.334525] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-09-23T17:00:37.991047] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-23T17:00:37.997729] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-09-23T17:00:38.393608] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-23T17:00:38.399291] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-09-23T17:00:38.843443] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-23T17:00:38.854382] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-01. [2025-09-23T17:00:39.076708] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-23T17:00:39.084424] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-09-23T17:00:39.250342] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-23T17:00:39.260197] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-09-23T17:00:39.300543] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-23T17:00:39.312947] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-09-23T17:00:40.044585] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-23T17:00:40.051109] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-09-23T17:00:40.231505] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-23T17:00:40.239628] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-09-23T17:00:40.268214] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-23T17:00:40.278899] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-09-23T17:00:41.144005] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-23T17:00:41.151289] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-09-23T17:00:41.224696] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-23T17:00:41.229330] [INFO ] [REMOTE ] AB: Full fetch complete (46023 records). [2025-09-23T17:00:41.229425] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-09-23T17:00:41.649778] [DEBUG] [VALIDATOR ] AB: All expected trading days are present. [2025-09-23T17:00:41.652862] [DEBUG] [VALIDATOR ] AB: Primary data validation passed. [2025-09-23T17:00:41.653489] [INFO ] [MAIN ] AB: Fetched primary data is valid. [2025-09-23T17:00:41.653805] [DEBUG] [LOCAL ] AB: Saving primary data. [2025-09-23T17:00:41.655708] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-09-23T17:00:41.668119] [DEBUG] [LOCAL ] AB: Trimmed 46023 records to 28399 (keeping 200 days of data) [2025-09-23T17:00:41.668009] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-09-23T17:00:41.874425] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-23T17:00:41.886811] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-09-23T17:00:41.891483] [DEBUG] [LOCAL ] AB: Primary data saved (28399 records). [2025-09-23T17:00:41.891569] [INFO ] [MAIN ] AB: Full history saved. [2025-09-23T17:00:41.893306] [INFO ] [MAIN ] Update Progress: 9/2372 symbols completed. AB took 13.4s. Estimated remaining: 2h 49m 13s. Rate: 14.0 symbols/min [2025-09-23T17:00:42.073424] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:00:42.090536] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-23T17:00:42.096825] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-09-23T17:00:42.114942] [DEBUG] [LOCAL ] ABG: Loaded 18829 existing records from primary storage. [2025-09-23T17:00:42.115092] [INFO ] [MAIN ] ABG: Loaded 18829 existing records. [2025-09-23T17:00:42.305236] [WARN ] [MAIN ] ABG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:00:42.305507] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-09-23T17:00:42.305556] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-09-23T17:00:42.306215] [DEBUG] [LOCAL ] ABG: Deleted primary data file. [2025-09-23T17:00:42.306277] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-09-23T17:00:42.662795] [INFO ] [REMOTE ] ABG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:00:42.663127] [INFO ] [REMOTE ] ABG: Fetching primary data for 2024-12. [2025-09-23T17:00:43.094829] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-23T17:00:43.102195] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-09-23T17:00:44.205526] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-23T17:00:44.209003] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-01. [2025-09-23T17:00:44.702541] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (2.82 seconds). [2025-09-23T17:00:44.715160] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-09-23T17:00:44.788609] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (3.12 seconds). [2025-09-23T17:00:44.801400] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-09-23T17:00:45.194728] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-23T17:00:45.201833] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-09-23T17:00:45.709994] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-23T17:00:45.714350] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-09-23T17:00:46.463706] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-23T17:00:46.475029] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-09-23T17:00:46.489543] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-23T17:00:46.496566] [INFO ] [REMOTE ] ABCB: Full fetch complete (44327 records). [2025-09-23T17:00:46.496770] [DEBUG] [VALIDATOR ] ABCB: Validating primary data. [2025-09-23T17:00:46.562874] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-23T17:00:46.653572] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-09-23T17:00:46.794634] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-23T17:00:46.896098] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-09-23T17:00:46.996981] [DEBUG] [VALIDATOR ] ABCB: All expected trading days are present. [2025-09-23T17:00:46.997079] [DEBUG] [VALIDATOR ] ABCB: Primary data validation passed. [2025-09-23T17:00:46.997543] [INFO ] [MAIN ] ABCB: Fetched primary data is valid. [2025-09-23T17:00:46.997590] [DEBUG] [LOCAL ] ABCB: Saving primary data. [2025-09-23T17:00:46.998901] [DEBUG] [LOCAL ] ABCB: Trimmed 44327 records to 30812 (keeping 200 days of data) [2025-09-23T17:00:47.181132] [DEBUG] [LOCAL ] ABCB: Primary data saved (30812 records). [2025-09-23T17:00:47.181321] [INFO ] [MAIN ] ABCB: Full history saved. [2025-09-23T17:00:47.181416] [INFO ] [MAIN ] Update Progress: 10/2372 symbols completed. ABCB took 13.7s. Estimated remaining: 2h 53m 3s. Rate: 13.6 symbols/min [2025-09-23T17:00:47.352713] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:00:47.369241] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-23T17:00:47.374417] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-04. [2025-09-23T17:00:47.402254] [DEBUG] [LOCAL ] ABM: Loaded 32357 existing records from primary storage. [2025-09-23T17:00:47.402428] [INFO ] [MAIN ] ABM: Loaded 32357 existing records. [2025-09-23T17:00:47.578514] [WARN ] [MAIN ] ABM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:00:47.578781] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-09-23T17:00:47.578833] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-09-23T17:00:47.579738] [DEBUG] [LOCAL ] ABM: Deleted primary data file. [2025-09-23T17:00:47.579799] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-09-23T17:00:47.932474] [INFO ] [REMOTE ] ABM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:00:47.932842] [INFO ] [REMOTE ] ABM: Fetching primary data for 2024-12. [2025-09-23T17:00:48.080305] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-23T17:00:48.091708] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-09-23T17:00:48.402611] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-23T17:00:48.408829] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-05. [2025-09-23T17:00:48.630348] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-23T17:00:48.642140] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-09-23T17:00:48.946773] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-23T17:00:48.952610] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-01. [2025-09-23T17:00:48.975594] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-23T17:00:48.979059] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-06. [2025-09-23T17:00:49.638803] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-23T17:00:49.649716] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-07. [2025-09-23T17:00:49.713717] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-23T17:00:49.718123] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-07. [2025-09-23T17:00:49.837476] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-23T17:00:49.843370] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-09-23T17:00:50.448792] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-23T17:00:50.465543] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-09-23T17:00:50.473275] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-23T17:00:50.478152] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-08. [2025-09-23T17:00:50.882907] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-23T17:00:50.888069] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-09-23T17:00:51.015090] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-23T17:00:51.026584] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-08. [2025-09-23T17:00:51.235240] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-23T17:00:51.402335] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-09-23T17:00:51.912818] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-23T17:00:52.069992] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-23T17:00:52.078349] [INFO ] [REMOTE ] ABG: Full fetch complete (26356 records). [2025-09-23T17:00:52.078620] [DEBUG] [VALIDATOR ] ABG: Validating primary data. [2025-09-23T17:00:52.207452] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-09-23T17:00:52.317612] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-23T17:00:52.364102] [INFO ] [REMOTE ] ABBV: Full fetch complete (77720 records). [2025-09-23T17:00:52.369864] [DEBUG] [VALIDATOR ] ABBV: Validating primary data. [2025-09-23T17:00:52.916423] [DEBUG] [VALIDATOR ] ABG: All expected trading days are present. [2025-09-23T17:00:52.925805] [DEBUG] [VALIDATOR ] ABG: Primary data validation passed. [2025-09-23T17:00:52.958940] [INFO ] [MAIN ] ABG: Fetched primary data is valid. [2025-09-23T17:00:52.985595] [DEBUG] [LOCAL ] ABG: Saving primary data. [2025-09-23T17:00:53.097576] [DEBUG] [LOCAL ] ABG: Trimmed 26356 records to 18794 (keeping 200 days of data) [2025-09-23T17:00:53.122112] [DEBUG] [VALIDATOR ] ABBV: All expected trading days are present. [2025-09-23T17:00:53.122672] [DEBUG] [VALIDATOR ] ABBV: Primary data validation passed. [2025-09-23T17:00:53.123431] [INFO ] [MAIN ] ABBV: Fetched primary data is valid. [2025-09-23T17:00:53.123841] [DEBUG] [LOCAL ] ABBV: Saving primary data. [2025-09-23T17:00:53.239985] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-23T17:00:53.249533] [DEBUG] [LOCAL ] ABBV: Trimmed 77720 records to 53686 (keeping 200 days of data) [2025-09-23T17:00:53.257751] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-09-23T17:00:53.397588] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-23T17:00:53.437820] [DEBUG] [LOCAL ] ABG: Primary data saved (18794 records). [2025-09-23T17:00:53.438400] [INFO ] [MAIN ] ABG: Full history saved. [2025-09-23T17:00:53.438797] [INFO ] [MAIN ] Update Progress: 11/2372 symbols completed. ABG took 11.5s. Estimated remaining: 2h 59m 38s. Rate: 13.1 symbols/min [2025-09-23T17:00:53.621748] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:00:53.807482] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-09-23T17:00:53.871665] [DEBUG] [LOCAL ] ABBV: Primary data saved (53686 records). [2025-09-23T17:00:53.872081] [INFO ] [MAIN ] ABBV: Full history saved. [2025-09-23T17:00:53.874029] [INFO ] [MAIN ] Update Progress: 12/2372 symbols completed. ABBV took 24.3s. Estimated remaining: 2h 46m 2s. Rate: 14.2 symbols/min [2025-09-23T17:00:53.875191] [DEBUG] [LOCAL ] ABR: Loaded 52125 existing records from primary storage. [2025-09-23T17:00:53.920601] [INFO ] [MAIN ] ABR: Loaded 52125 existing records. [2025-09-23T17:00:54.286271] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:00:54.346971] [WARN ] [MAIN ] ABR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:00:54.347256] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-09-23T17:00:54.347332] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-09-23T17:00:54.349518] [DEBUG] [LOCAL ] ABR: Deleted primary data file. [2025-09-23T17:00:54.349609] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-09-23T17:00:54.707960] [DEBUG] [LOCAL ] ABT: Loaded 53620 existing records from primary storage. [2025-09-23T17:00:54.708401] [INFO ] [MAIN ] ABT: Loaded 53620 existing records. [2025-09-23T17:00:54.900559] [INFO ] [REMOTE ] ABR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:00:54.917215] [INFO ] [REMOTE ] ABR: Fetching primary data for 2024-12. [2025-09-23T17:00:55.001347] [WARN ] [MAIN ] ABT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:00:55.003907] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-23T17:00:55.009519] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-09-23T17:00:55.010198] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-09-23T17:00:55.034020] [DEBUG] [LOCAL ] ABT: Deleted primary data file. [2025-09-23T17:00:55.034217] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-09-23T17:00:55.109009] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-23T17:00:55.153490] [INFO ] [REMOTE ] ABEV: Full fetch complete (77199 records). [2025-09-23T17:00:55.153702] [DEBUG] [VALIDATOR ] ABEV: Validating primary data. [2025-09-23T17:00:55.413841] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-09-23T17:00:55.818418] [INFO ] [REMOTE ] ABT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:00:55.862949] [DEBUG] [VALIDATOR ] ABEV: All expected trading days are present. [2025-09-23T17:00:55.863039] [DEBUG] [VALIDATOR ] ABEV: Primary data validation passed. [2025-09-23T17:00:55.863761] [INFO ] [MAIN ] ABEV: Fetched primary data is valid. [2025-09-23T17:00:55.863827] [DEBUG] [LOCAL ] ABEV: Saving primary data. [2025-09-23T17:00:55.865454] [DEBUG] [LOCAL ] ABEV: Trimmed 77199 records to 53274 (keeping 200 days of data) [2025-09-23T17:00:56.177358] [DEBUG] [LOCAL ] ABEV: Primary data saved (53274 records). [2025-09-23T17:00:56.177499] [INFO ] [MAIN ] ABEV: Full history saved. [2025-09-23T17:00:56.179087] [INFO ] [MAIN ] Update Progress: 13/2372 symbols completed. ABEV took 19.8s. Estimated remaining: 2h 40m 10s. Rate: 14.7 symbols/min [2025-09-23T17:00:56.214262] [INFO ] [REMOTE ] ABT: Fetching primary data for 2024-12. [2025-09-23T17:00:56.356336] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:00:56.383821] [DEBUG] [LOCAL ] ACA: Loaded 23948 existing records from primary storage. [2025-09-23T17:00:56.383974] [INFO ] [MAIN ] ACA: Loaded 23948 existing records. [2025-09-23T17:00:56.569269] [WARN ] [MAIN ] ACA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:00:56.569544] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-09-23T17:00:56.569593] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-09-23T17:00:56.570517] [DEBUG] [LOCAL ] ACA: Deleted primary data file. [2025-09-23T17:00:56.570593] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-09-23T17:00:56.935424] [INFO ] [REMOTE ] ACA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:00:56.983184] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-23T17:00:57.008928] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-01. [2025-09-23T17:00:57.022878] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-23T17:00:57.752705] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-23T17:00:57.802201] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-01. [2025-09-23T17:00:58.404034] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-23T17:00:58.602262] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-09-23T17:00:59.397897] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-23T17:00:59.407520] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-09-23T17:01:00.202182] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-09-23T17:01:00.479109] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-23T17:01:00.512308] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-23T17:01:01.002247] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-09-23T17:01:01.718959] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-23T17:01:01.802253] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-09-23T17:01:02.076404] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-23T17:01:02.602233] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-09-23T17:01:03.295978] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-23T17:01:03.402215] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-09-23T17:01:03.722604] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-23T17:01:03.729318] [INFO ] [REMOTE ] ABM: Full fetch complete (44481 records). [2025-09-23T17:01:03.729449] [DEBUG] [VALIDATOR ] ABM: Validating primary data. [2025-09-23T17:01:04.125149] [DEBUG] [VALIDATOR ] ABM: All expected trading days are present. [2025-09-23T17:01:04.125269] [DEBUG] [VALIDATOR ] ABM: Primary data validation passed. [2025-09-23T17:01:04.125769] [INFO ] [MAIN ] ABM: Fetched primary data is valid. [2025-09-23T17:01:04.125832] [DEBUG] [LOCAL ] ABM: Saving primary data. [2025-09-23T17:01:04.126967] [DEBUG] [LOCAL ] ABM: Trimmed 44481 records to 32493 (keeping 200 days of data) [2025-09-23T17:01:04.214309] [INFO ] [REMOTE ] ACA: Fetching primary data for 2024-12. [2025-09-23T17:01:04.327271] [DEBUG] [LOCAL ] ABM: Primary data saved (32493 records). [2025-09-23T17:01:04.327429] [INFO ] [MAIN ] ABM: Full history saved. [2025-09-23T17:01:04.327522] [INFO ] [MAIN ] Update Progress: 14/2372 symbols completed. ABM took 17.1s. Estimated remaining: 2h 51m 32s. Rate: 13.7 symbols/min [2025-09-23T17:01:04.502585] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:01:04.502787] [DEBUG] [LOCAL ] ACCO: No existing data file found in primary storage. [2025-09-23T17:01:04.502851] [WARN ] [MAIN ] ACCO: No existing data found, performing full refresh instead. [2025-09-23T17:01:04.503033] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-09-23T17:01:04.503076] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-09-23T17:01:04.503119] [DEBUG] [LOCAL ] ACCO: No primary data file found to delete. [2025-09-23T17:01:04.503158] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-09-23T17:01:04.883692] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:01:04.987975] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-23T17:01:05.002184] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2024-12. [2025-09-23T17:01:05.131335] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-23T17:01:05.802201] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-09-23T17:01:06.500246] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-23T17:01:06.602200] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-09-23T17:01:07.407539] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-01. [2025-09-23T17:01:07.413003] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-23T17:01:08.186795] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-23T17:01:08.202215] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-09-23T17:01:08.309605] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-23T17:01:09.002288] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-09-23T17:01:09.083614] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-23T17:01:09.802263] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-09-23T17:01:10.404997] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-23T17:01:10.602191] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-09-23T17:01:11.402169] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-01. [2025-09-23T17:01:11.952318] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-23T17:01:12.202189] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-09-23T17:01:12.240282] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-23T17:01:12.432320] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-23T17:01:13.002216] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-09-23T17:01:13.168314] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-23T17:01:13.802211] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-09-23T17:01:14.602229] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-09-23T17:01:14.729443] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-23T17:01:14.876623] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-23T17:01:15.402198] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-09-23T17:01:16.012549] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-23T17:01:16.202191] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-09-23T17:01:17.002209] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-09-23T17:01:17.164779] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-23T17:01:17.480417] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-23T17:01:17.802203] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-09-23T17:01:18.602232] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-09-23T17:01:18.809914] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-23T17:01:18.818395] [INFO ] [REMOTE ] ABR: Full fetch complete (75169 records). [2025-09-23T17:01:18.818539] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-09-23T17:01:19.206048] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-23T17:01:19.273877] [DEBUG] [VALIDATOR ] ABR: All expected trading days are present. [2025-09-23T17:01:19.274501] [DEBUG] [VALIDATOR ] ABR: Primary data validation passed. [2025-09-23T17:01:19.275410] [INFO ] [MAIN ] ABR: Fetched primary data is valid. [2025-09-23T17:01:19.275499] [DEBUG] [LOCAL ] ABR: Saving primary data. [2025-09-23T17:01:19.277378] [DEBUG] [LOCAL ] ABR: Trimmed 75169 records to 52103 (keeping 200 days of data) [2025-09-23T17:01:19.474873] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-23T17:01:19.407310] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-09-23T17:01:19.613101] [DEBUG] [LOCAL ] ABR: Primary data saved (52103 records). [2025-09-23T17:01:19.613273] [INFO ] [MAIN ] ABR: Full history saved. [2025-09-23T17:01:19.614394] [INFO ] [MAIN ] Update Progress: 15/2372 symbols completed. ABR took 26.2s. Estimated remaining: 3h 20m 4s. Rate: 11.8 symbols/min [2025-09-23T17:01:19.788842] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:01:19.817688] [DEBUG] [LOCAL ] ACEL: Loaded 27250 existing records from primary storage. [2025-09-23T17:01:19.817828] [INFO ] [MAIN ] ACEL: Loaded 27250 existing records. [2025-09-23T17:01:19.996766] [WARN ] [MAIN ] ACEL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:01:19.997039] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-09-23T17:01:19.997086] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-09-23T17:01:19.998071] [DEBUG] [LOCAL ] ACEL: Deleted primary data file. [2025-09-23T17:01:19.998134] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-09-23T17:01:20.207337] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-09-23T17:01:20.352127] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:01:21.002203] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-23T17:01:21.002417] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2024-12. [2025-09-23T17:01:21.802200] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-09-23T17:01:21.870491] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-23T17:01:21.994705] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-23T17:01:22.602205] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-01. [2025-09-23T17:01:22.717847] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-23T17:01:23.402196] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-09-23T17:01:23.457093] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-23T17:01:24.202194] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-09-23T17:01:24.522497] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-23T17:01:25.002222] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-09-23T17:01:25.534369] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-23T17:01:25.802203] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-09-23T17:01:26.153200] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-23T17:01:26.602198] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-09-23T17:01:27.301040] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-23T17:01:27.402199] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-09-23T17:01:28.202154] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-09-23T17:01:28.246044] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-23T17:01:28.302914] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-23T17:01:29.002203] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-09-23T17:01:29.742827] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-23T17:01:29.751407] [INFO ] [REMOTE ] ABT: Full fetch complete (77194 records). [2025-09-23T17:01:29.751572] [DEBUG] [VALIDATOR ] ABT: Validating primary data. [2025-09-23T17:01:29.752514] [FATAL] [VALIDATOR ] ABT: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:01:29.752620] [FATAL] [MAIN ] ABT: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:01:29.752709] [WARN ] [MAIN ] ABT: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:01:29.752773] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-09-23T17:01:29.752836] [DEBUG] [LOCAL ] ABT: No primary data file found to delete. [2025-09-23T17:01:29.752873] [INFO ] [LOCAL ] ABT: Starting deletion of derivative data. [2025-09-23T17:01:29.753333] [DEBUG] [LOCAL ] ABT: Deleted derivative data file. [2025-09-23T17:01:29.753441] [INFO ] [MAIN ] Update Progress: 16/2372 symbols completed. ABT took 35.9s. Estimated remaining: 3h 32m 22s. Rate: 11.1 symbols/min [2025-09-23T17:01:29.810755] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-09-23T17:01:29.951813] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:01:29.952208] [DEBUG] [LOCAL ] ACHR: No existing data file found in primary storage. [2025-09-23T17:01:29.952284] [WARN ] [MAIN ] ACHR: No existing data found, performing full refresh instead. [2025-09-23T17:01:29.952546] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-09-23T17:01:29.952680] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-09-23T17:01:29.952816] [DEBUG] [LOCAL ] ACHR: No primary data file found to delete. [2025-09-23T17:01:29.952872] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-09-23T17:01:30.280533] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-23T17:01:30.326307] [INFO ] [REMOTE ] ACA: Full fetch complete (34272 records). [2025-09-23T17:01:30.337954] [DEBUG] [VALIDATOR ] ACA: Validating primary data. [2025-09-23T17:01:30.359332] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:01:30.608103] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-09-23T17:01:30.746507] [DEBUG] [VALIDATOR ] ACA: All expected trading days are present. [2025-09-23T17:01:30.746752] [DEBUG] [VALIDATOR ] ACA: Primary data validation passed. [2025-09-23T17:01:30.747305] [INFO ] [MAIN ] ACA: Fetched primary data is valid. [2025-09-23T17:01:30.747437] [DEBUG] [LOCAL ] ACA: Saving primary data. [2025-09-23T17:01:30.748370] [DEBUG] [LOCAL ] ACA: Trimmed 34272 records to 23871 (keeping 200 days of data) [2025-09-23T17:01:30.857355] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-23T17:01:30.919874] [DEBUG] [LOCAL ] ACA: Primary data saved (23871 records). [2025-09-23T17:01:30.920017] [INFO ] [MAIN ] ACA: Full history saved. [2025-09-23T17:01:30.920119] [INFO ] [MAIN ] Update Progress: 17/2372 symbols completed. ACA took 34.7s. Estimated remaining: 3h 22m 29s. Rate: 11.6 symbols/min [2025-09-23T17:01:31.091243] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:01:31.146574] [DEBUG] [LOCAL ] ACI: Loaded 53272 existing records from primary storage. [2025-09-23T17:01:31.146764] [INFO ] [MAIN ] ACI: Loaded 53272 existing records. [2025-09-23T17:01:31.340839] [WARN ] [MAIN ] ACI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:01:31.341116] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-09-23T17:01:31.341166] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-09-23T17:01:31.342599] [DEBUG] [LOCAL ] ACI: Deleted primary data file. [2025-09-23T17:01:31.342691] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-09-23T17:01:31.409064] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-09-23T17:01:31.732420] [INFO ] [REMOTE ] ACI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:01:31.926033] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-23T17:01:32.202187] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-09-23T17:01:32.941037] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-23T17:01:33.002142] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-09-23T17:01:33.207483] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-23T17:01:33.802198] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2024-12. [2025-09-23T17:01:33.977273] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-23T17:01:34.602201] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-09-23T17:01:35.402175] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-09-23T17:01:35.662152] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-23T17:01:36.202173] [INFO ] [REMOTE ] ACI: Fetching primary data for 2024-12. [2025-09-23T17:01:36.293432] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-09-23T17:01:36.390838] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-23T17:01:36.400474] [INFO ] [REMOTE ] ACCO: Full fetch complete (54177 records). [2025-09-23T17:01:36.400676] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-09-23T17:01:36.797218] [DEBUG] [VALIDATOR ] ACCO: All expected trading days are present. [2025-09-23T17:01:36.797337] [DEBUG] [VALIDATOR ] ACCO: Primary data validation passed. [2025-09-23T17:01:36.797886] [INFO ] [MAIN ] ACCO: Fetched primary data is valid. [2025-09-23T17:01:36.797956] [DEBUG] [LOCAL ] ACCO: Saving primary data. [2025-09-23T17:01:36.799219] [DEBUG] [LOCAL ] ACCO: Trimmed 54177 records to 37773 (keeping 200 days of data) [2025-09-23T17:01:37.006490] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-01. [2025-09-23T17:01:37.015689] [DEBUG] [LOCAL ] ACCO: Primary data saved (37773 records). [2025-09-23T17:01:37.015905] [INFO ] [MAIN ] ACCO: Full history saved. [2025-09-23T17:01:37.016061] [INFO ] [MAIN ] Update Progress: 18/2372 symbols completed. ACCO took 32.7s. Estimated remaining: 3h 24m 26s. Rate: 11.5 symbols/min [2025-09-23T17:01:37.195136] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:01:37.245010] [DEBUG] [LOCAL ] ACM: Loaded 43137 existing records from primary storage. [2025-09-23T17:01:37.245209] [INFO ] [MAIN ] ACM: Loaded 43137 existing records. [2025-09-23T17:01:37.427160] [WARN ] [MAIN ] ACM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:01:37.427496] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-09-23T17:01:37.427553] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-09-23T17:01:37.428723] [DEBUG] [LOCAL ] ACM: Deleted primary data file. [2025-09-23T17:01:37.428787] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-09-23T17:01:37.815233] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-09-23T17:01:37.815144] [INFO ] [REMOTE ] ACM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:01:37.853989] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-23T17:01:38.602237] [INFO ] [REMOTE ] ACM: Fetching primary data for 2024-12. [2025-09-23T17:01:38.678373] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-23T17:01:39.402175] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-01. [2025-09-23T17:01:39.847945] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-23T17:01:39.973358] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-01 (2.97 seconds). [2025-09-23T17:01:40.202192] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-01. [2025-09-23T17:01:41.002277] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-09-23T17:01:41.143290] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-23T17:01:41.489040] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-23T17:01:41.784753] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-23T17:01:41.802152] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-09-23T17:01:42.602449] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-09-23T17:01:43.021600] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-23T17:01:43.025926] [INFO ] [REMOTE ] ACEL: Full fetch complete (38792 records). [2025-09-23T17:01:43.026034] [DEBUG] [VALIDATOR ] ACEL: Validating primary data. [2025-09-23T17:01:43.026880] [FATAL] [VALIDATOR ] ACEL: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:01:43.026965] [FATAL] [MAIN ] ACEL: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:01:43.027010] [WARN ] [MAIN ] ACEL: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:01:43.027094] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-09-23T17:01:43.027197] [DEBUG] [LOCAL ] ACEL: No primary data file found to delete. [2025-09-23T17:01:43.027269] [INFO ] [LOCAL ] ACEL: Starting deletion of derivative data. [2025-09-23T17:01:43.028001] [DEBUG] [LOCAL ] ACEL: Deleted derivative data file. [2025-09-23T17:01:43.028114] [INFO ] [MAIN ] Update Progress: 19/2372 symbols completed. ACEL took 23.4s. Estimated remaining: 3h 26m 0s. Rate: 11.4 symbols/min [2025-09-23T17:01:43.200205] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:01:43.200454] [DEBUG] [LOCAL ] ACN: No existing data file found in primary storage. [2025-09-23T17:01:43.200509] [WARN ] [MAIN ] ACN: No existing data found, performing full refresh instead. [2025-09-23T17:01:43.200699] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-09-23T17:01:43.200753] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-09-23T17:01:43.200841] [DEBUG] [LOCAL ] ACN: No primary data file found to delete. [2025-09-23T17:01:43.200896] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-09-23T17:01:43.410034] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-09-23T17:01:43.560608] [INFO ] [REMOTE ] ACN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:01:43.840207] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-23T17:01:44.202204] [INFO ] [REMOTE ] ACN: Fetching primary data for 2024-12. [2025-09-23T17:01:45.002270] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-09-23T17:01:45.145968] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-23T17:01:45.802251] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-09-23T17:01:45.864265] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-23T17:01:46.602235] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-01. [2025-09-23T17:01:47.183804] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-23T17:01:47.229388] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-23T17:01:47.402219] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-09-23T17:01:48.202202] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-09-23T17:01:48.238625] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-23T17:01:49.002245] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-09-23T17:01:49.488555] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-23T17:01:49.733255] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-09-23T17:01:49.802238] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-09-23T17:01:50.516122] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-23T17:01:50.602197] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-09-23T17:01:51.402282] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-09-23T17:01:52.194390] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-23T17:01:52.205781] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-09-23T17:01:52.294187] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-09-23T17:01:53.019946] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-09-23T17:01:53.041919] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-23T17:01:53.704204] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-23T17:01:53.802207] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-09-23T17:01:54.602222] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-09-23T17:01:55.408507] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-09-23T17:01:55.432887] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-23T17:01:55.650420] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (2.63 seconds). [2025-09-23T17:01:56.202190] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-09-23T17:01:56.702928] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-23T17:01:56.731765] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-23T17:01:57.002222] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-09-23T17:01:57.802176] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-09-23T17:01:57.925102] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-23T17:01:58.213201] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-23T17:01:58.602224] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-09-23T17:01:59.014075] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-23T17:01:59.402198] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-09-23T17:02:00.202234] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-09-23T17:02:00.980271] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-09-23T17:02:01.002188] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-09-23T17:02:01.083272] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-23T17:02:01.802224] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-09-23T17:02:02.171587] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-23T17:02:02.218936] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-23T17:02:02.602217] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-09-23T17:02:03.402232] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-09-23T17:02:03.615203] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-23T17:02:03.945611] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-23T17:02:04.202203] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-09-23T17:02:05.002216] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-09-23T17:02:05.807354] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-09-23T17:02:05.827450] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-09-23T17:02:06.042337] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-23T17:02:06.351935] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-23T17:02:06.360929] [INFO ] [REMOTE ] ACM: Full fetch complete (62584 records). [2025-09-23T17:02:06.361113] [DEBUG] [VALIDATOR ] ACM: Validating primary data. [2025-09-23T17:02:06.610755] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-09-23T17:02:06.753666] [DEBUG] [VALIDATOR ] ACM: All expected trading days are present. [2025-09-23T17:02:06.753764] [DEBUG] [VALIDATOR ] ACM: Primary data validation passed. [2025-09-23T17:02:06.754357] [INFO ] [MAIN ] ACM: Fetched primary data is valid. [2025-09-23T17:02:06.754403] [DEBUG] [LOCAL ] ACM: Saving primary data. [2025-09-23T17:02:06.755870] [DEBUG] [LOCAL ] ACM: Trimmed 62584 records to 43154 (keeping 200 days of data) [2025-09-23T17:02:07.055990] [DEBUG] [LOCAL ] ACM: Primary data saved (43154 records). [2025-09-23T17:02:07.056261] [INFO ] [MAIN ] ACM: Full history saved. [2025-09-23T17:02:07.056503] [INFO ] [MAIN ] Update Progress: 20/2372 symbols completed. ACM took 30.0s. Estimated remaining: 4h 2m 43s. Rate: 9.7 symbols/min [2025-09-23T17:02:07.235001] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:02:07.267958] [DEBUG] [LOCAL ] ACP: Loaded 31322 existing records from primary storage. [2025-09-23T17:02:07.268093] [INFO ] [MAIN ] ACP: Loaded 31322 existing records. [2025-09-23T17:02:07.407361] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-09-23T17:02:07.454087] [WARN ] [MAIN ] ACP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:02:07.454618] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-09-23T17:02:07.454739] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-09-23T17:02:07.455723] [DEBUG] [LOCAL ] ACP: Deleted primary data file. [2025-09-23T17:02:07.455794] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-09-23T17:02:07.836764] [INFO ] [REMOTE ] ACP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:02:07.870383] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-23T17:02:08.182129] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-23T17:02:08.194911] [INFO ] [REMOTE ] ACI: Full fetch complete (77029 records). [2025-09-23T17:02:08.195050] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-09-23T17:02:08.211477] [INFO ] [REMOTE ] ACP: Fetching primary data for 2024-12. [2025-09-23T17:02:08.676620] [DEBUG] [VALIDATOR ] ACI: All expected trading days are present. [2025-09-23T17:02:08.676769] [DEBUG] [VALIDATOR ] ACI: Primary data validation passed. [2025-09-23T17:02:08.678154] [INFO ] [MAIN ] ACI: Fetched primary data is valid. [2025-09-23T17:02:08.678260] [DEBUG] [LOCAL ] ACI: Saving primary data. [2025-09-23T17:02:08.680210] [DEBUG] [LOCAL ] ACI: Trimmed 77029 records to 53272 (keeping 200 days of data) [2025-09-23T17:02:09.013718] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-09-23T17:02:09.039364] [DEBUG] [LOCAL ] ACI: Primary data saved (53272 records). [2025-09-23T17:02:09.039516] [INFO ] [MAIN ] ACI: Full history saved. [2025-09-23T17:02:09.042412] [INFO ] [MAIN ] Update Progress: 21/2372 symbols completed. ACI took 38.1s. Estimated remaining: 3h 54m 46s. Rate: 10.0 symbols/min [2025-09-23T17:02:09.235698] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:02:09.247435] [DEBUG] [LOCAL ] ACR: Loaded 6375 existing records from primary storage. [2025-09-23T17:02:09.247606] [INFO ] [MAIN ] ACR: Loaded 6375 existing records. [2025-09-23T17:02:09.456259] [WARN ] [MAIN ] ACR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:02:09.456751] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-09-23T17:02:09.457272] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-09-23T17:02:09.457928] [DEBUG] [LOCAL ] ACR: Deleted primary data file. [2025-09-23T17:02:09.458088] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-09-23T17:02:09.720108] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-23T17:02:09.807340] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-01. [2025-09-23T17:02:09.882487] [INFO ] [REMOTE ] ACR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:02:10.138225] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (2.73 seconds). [2025-09-23T17:02:10.602216] [INFO ] [REMOTE ] ACR: Fetching primary data for 2024-12. [2025-09-23T17:02:10.814467] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-23T17:02:10.826961] [INFO ] [REMOTE ] ACN: Full fetch complete (77100 records). [2025-09-23T17:02:10.827218] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-09-23T17:02:11.318397] [DEBUG] [VALIDATOR ] ACN: All expected trading days are present. [2025-09-23T17:02:11.331203] [DEBUG] [VALIDATOR ] ACN: Primary data validation passed. [2025-09-23T17:02:11.332144] [INFO ] [MAIN ] ACN: Fetched primary data is valid. [2025-09-23T17:02:11.332267] [DEBUG] [LOCAL ] ACN: Saving primary data. [2025-09-23T17:02:11.336364] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-23T17:02:11.351473] [DEBUG] [LOCAL ] ACN: Trimmed 77100 records to 53424 (keeping 200 days of data) [2025-09-23T17:02:11.435739] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-09-23T17:02:11.727057] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-23T17:02:11.756513] [DEBUG] [LOCAL ] ACN: Primary data saved (53424 records). [2025-09-23T17:02:11.756717] [INFO ] [MAIN ] ACN: Full history saved. [2025-09-23T17:02:11.756854] [INFO ] [MAIN ] Update Progress: 22/2372 symbols completed. ACN took 28.7s. Estimated remaining: 3h 48m 50s. Rate: 10.3 symbols/min [2025-09-23T17:02:11.957925] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:02:11.958124] [DEBUG] [LOCAL ] ACRE: No existing data file found in primary storage. [2025-09-23T17:02:11.958247] [WARN ] [MAIN ] ACRE: No existing data found, performing full refresh instead. [2025-09-23T17:02:11.958570] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-09-23T17:02:11.958684] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-09-23T17:02:11.958773] [DEBUG] [LOCAL ] ACRE: No primary data file found to delete. [2025-09-23T17:02:11.958816] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-09-23T17:02:12.213262] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-09-23T17:02:12.329916] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:02:13.002202] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2024-12. [2025-09-23T17:02:13.610279] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-23T17:02:13.802207] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-01. [2025-09-23T17:02:13.830022] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-09-23T17:02:13.843318] [INFO ] [REMOTE ] ACHR: Full fetch complete (77608 records). [2025-09-23T17:02:13.843527] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-09-23T17:02:13.844573] [FATAL] [VALIDATOR ] ACHR: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:02:13.844722] [FATAL] [MAIN ] ACHR: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:02:13.844810] [WARN ] [MAIN ] ACHR: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:02:13.844925] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-09-23T17:02:13.844996] [DEBUG] [LOCAL ] ACHR: No primary data file found to delete. [2025-09-23T17:02:13.845048] [INFO ] [LOCAL ] ACHR: Starting deletion of derivative data. [2025-09-23T17:02:13.845117] [DEBUG] [LOCAL ] ACHR: No derivative data file found to delete. [2025-09-23T17:02:13.845197] [INFO ] [MAIN ] Update Progress: 23/2372 symbols completed. ACHR took 44.1s. Estimated remaining: 3h 42m 21s. Rate: 10.6 symbols/min [2025-09-23T17:02:14.032994] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:02:14.042721] [DEBUG] [LOCAL ] ACV: Loaded 6905 existing records from primary storage. [2025-09-23T17:02:14.042890] [INFO ] [MAIN ] ACV: Loaded 6905 existing records. [2025-09-23T17:02:14.242263] [WARN ] [MAIN ] ACV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:02:14.242738] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-09-23T17:02:14.242795] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-09-23T17:02:14.243332] [DEBUG] [LOCAL ] ACV: Deleted primary data file. [2025-09-23T17:02:14.243394] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-09-23T17:02:14.607567] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-09-23T17:02:14.635959] [INFO ] [REMOTE ] ACV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:02:14.641833] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-23T17:02:14.728912] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-23T17:02:15.402200] [INFO ] [REMOTE ] ACV: Fetching primary data for 2024-12. [2025-09-23T17:02:15.564586] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-23T17:02:15.898677] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-23T17:02:16.202192] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-09-23T17:02:16.613394] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-23T17:02:17.002218] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-01. [2025-09-23T17:02:17.412697] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-23T17:02:17.802216] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-01. [2025-09-23T17:02:18.602401] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-09-23T17:02:18.841169] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-23T17:02:19.163318] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-23T17:02:19.402200] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-09-23T17:02:20.180061] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-23T17:02:20.202152] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-09-23T17:02:20.605988] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-23T17:02:21.002199] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-09-23T17:02:21.802240] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-09-23T17:02:22.363964] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-23T17:02:22.602181] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-07. [2025-09-23T17:02:22.642013] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-23T17:02:23.035124] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-23T17:02:23.402197] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-09-23T17:02:24.202201] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-09-23T17:02:24.537281] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-23T17:02:24.855059] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-23T17:02:25.002211] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-09-23T17:02:25.802257] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-09-23T17:02:26.097265] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-23T17:02:26.371536] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-23T17:02:26.602250] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-09-23T17:02:27.402217] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-09-23T17:02:28.202260] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-08. [2025-09-23T17:02:28.271958] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-23T17:02:28.644077] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-23T17:02:28.928164] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-23T17:02:29.002169] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-09. [2025-09-23T17:02:29.466546] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-23T17:02:29.467922] [INFO ] [REMOTE ] ACR: Full fetch complete (8564 records). [2025-09-23T17:02:29.468001] [DEBUG] [VALIDATOR ] ACR: Validating primary data. [2025-09-23T17:02:29.803949] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-09-23T17:02:29.888874] [DEBUG] [VALIDATOR ] ACR: All expected trading days are present. [2025-09-23T17:02:29.888971] [DEBUG] [VALIDATOR ] ACR: Primary data validation passed. [2025-09-23T17:02:29.889199] [INFO ] [MAIN ] ACR: Fetched primary data is valid. [2025-09-23T17:02:29.889241] [DEBUG] [LOCAL ] ACR: Saving primary data. [2025-09-23T17:02:29.889744] [DEBUG] [LOCAL ] ACR: Trimmed 8564 records to 6346 (keeping 200 days of data) [2025-09-23T17:02:29.930636] [DEBUG] [LOCAL ] ACR: Primary data saved (6346 records). [2025-09-23T17:02:29.930819] [INFO ] [MAIN ] ACR: Full history saved. [2025-09-23T17:02:29.930909] [INFO ] [MAIN ] Update Progress: 24/2372 symbols completed. ACR took 20.9s. Estimated remaining: 3h 59m 13s. Rate: 9.8 symbols/min [2025-09-23T17:02:30.098947] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:02:30.160609] [DEBUG] [LOCAL ] ACVA: Loaded 49361 existing records from primary storage. [2025-09-23T17:02:30.160860] [INFO ] [MAIN ] ACVA: Loaded 49361 existing records. [2025-09-23T17:02:30.342465] [WARN ] [MAIN ] ACVA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:02:30.342877] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-09-23T17:02:30.342942] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-09-23T17:02:30.344239] [DEBUG] [LOCAL ] ACVA: Deleted primary data file. [2025-09-23T17:02:30.344304] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-09-23T17:02:30.607385] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-09-23T17:02:30.712053] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:02:31.062553] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-23T17:02:31.402205] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-09-23T17:02:31.526734] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-23T17:02:32.202201] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2024-12. [2025-09-23T17:02:32.334507] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-23T17:02:33.002231] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-07. [2025-09-23T17:02:33.716739] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-23T17:02:33.802224] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-01. [2025-09-23T17:02:34.033462] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-23T17:02:34.602238] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-09-23T17:02:34.938093] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-23T17:02:35.082449] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-23T17:02:35.402231] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-09-23T17:02:36.202196] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-08. [2025-09-23T17:02:36.528594] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-23T17:02:37.002260] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-09-23T17:02:37.038242] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-23T17:02:37.802220] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-09-23T17:02:38.382573] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-23T17:02:38.602255] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-09-23T17:02:38.793826] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-23T17:02:39.227299] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-23T17:02:39.402230] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-09. [2025-09-23T17:02:40.202233] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-09-23T17:02:40.409770] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-23T17:02:40.414807] [INFO ] [REMOTE ] ACP: Full fetch complete (47616 records). [2025-09-23T17:02:40.414992] [DEBUG] [VALIDATOR ] ACP: Validating primary data. [2025-09-23T17:02:40.415753] [FATAL] [VALIDATOR ] ACP: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:02:40.415873] [FATAL] [MAIN ] ACP: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:02:40.415919] [WARN ] [MAIN ] ACP: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:02:40.415960] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-09-23T17:02:40.416034] [DEBUG] [LOCAL ] ACP: No primary data file found to delete. [2025-09-23T17:02:40.416090] [INFO ] [LOCAL ] ACP: Starting deletion of derivative data. [2025-09-23T17:02:40.416789] [DEBUG] [LOCAL ] ACP: Deleted derivative data file. [2025-09-23T17:02:40.416888] [INFO ] [MAIN ] Update Progress: 25/2372 symbols completed. ACP took 33.4s. Estimated remaining: 4h 5m 57s. Rate: 9.5 symbols/min [2025-09-23T17:02:40.628231] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:02:40.628418] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-09-23T17:02:40.628457] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-09-23T17:02:40.628608] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-09-23T17:02:40.628679] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-09-23T17:02:40.628744] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-09-23T17:02:40.628780] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-09-23T17:02:40.922821] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-23T17:02:41.003819] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:02:41.003946] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-09-23T17:02:41.802236] [INFO ] [REMOTE ] AD: Fetching primary data for 2024-12. [2025-09-23T17:02:42.020112] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:02:42.028343] [WARN ] [REMOTE ] AD: No data returned for month 2024-12 [2025-09-23T17:02:42.031842] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-23T17:02:42.602238] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-01. [2025-09-23T17:02:42.818026] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:02:42.818317] [WARN ] [REMOTE ] AD: No data returned for month 2025-01 [2025-09-23T17:02:43.402237] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-02. [2025-09-23T17:02:43.611979] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:02:43.612289] [WARN ] [REMOTE ] AD: No data returned for month 2025-02 [2025-09-23T17:02:44.202224] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-03. [2025-09-23T17:02:44.403866] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:02:44.404221] [WARN ] [REMOTE ] AD: No data returned for month 2025-03 [2025-09-23T17:02:45.002245] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-04. [2025-09-23T17:02:45.230808] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:02:45.231141] [WARN ] [REMOTE ] AD: No data returned for month 2025-04 [2025-09-23T17:02:45.802222] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-05. [2025-09-23T17:02:46.005028] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:02:46.005360] [WARN ] [REMOTE ] AD: No data returned for month 2025-05 [2025-09-23T17:02:46.602214] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-09-23T17:02:47.402274] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-09-23T17:02:47.914377] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-23T17:02:47.917277] [INFO ] [REMOTE ] ACV: Full fetch complete (9672 records). [2025-09-23T17:02:47.917475] [DEBUG] [VALIDATOR ] ACV: Validating primary data. [2025-09-23T17:02:48.212733] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-06. [2025-09-23T17:02:48.384066] [DEBUG] [VALIDATOR ] ACV: All expected trading days are present. [2025-09-23T17:02:48.384633] [DEBUG] [VALIDATOR ] ACV: Primary data validation passed. [2025-09-23T17:02:48.386441] [INFO ] [MAIN ] ACV: Fetched primary data is valid. [2025-09-23T17:02:48.386531] [DEBUG] [LOCAL ] ACV: Saving primary data. [2025-09-23T17:02:48.386075] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-23T17:02:48.387284] [DEBUG] [LOCAL ] ACV: Trimmed 9672 records to 6930 (keeping 200 days of data) [2025-09-23T17:02:48.442351] [DEBUG] [LOCAL ] ACV: Primary data saved (6930 records). [2025-09-23T17:02:48.442497] [INFO ] [MAIN ] ACV: Full history saved. [2025-09-23T17:02:48.442592] [INFO ] [MAIN ] Update Progress: 26/2372 symbols completed. ACV took 34.6s. Estimated remaining: 4h 8m 28s. Rate: 9.4 symbols/min [2025-09-23T17:02:48.616803] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:02:48.617020] [DEBUG] [LOCAL ] ADC: No existing data file found in primary storage. [2025-09-23T17:02:48.617058] [WARN ] [MAIN ] ADC: No existing data found, performing full refresh instead. [2025-09-23T17:02:48.617206] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-09-23T17:02:48.617248] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-09-23T17:02:48.617289] [DEBUG] [LOCAL ] ADC: No primary data file found to delete. [2025-09-23T17:02:48.617320] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-09-23T17:02:48.661581] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:02:48.696384] [WARN ] [REMOTE ] AD: No data returned for month 2025-06 [2025-09-23T17:02:49.004713] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-09-23T17:02:49.008729] [INFO ] [REMOTE ] ADC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:02:49.802201] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-07. [2025-09-23T17:02:49.999038] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:02:49.999362] [WARN ] [REMOTE ] AD: No data returned for month 2025-07 [2025-09-23T17:02:50.560909] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-23T17:02:50.602194] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-09-23T17:02:51.402231] [INFO ] [REMOTE ] ADC: Fetching primary data for 2024-12. [2025-09-23T17:02:51.813507] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-23T17:02:51.821528] [INFO ] [REMOTE ] ACRE: Full fetch complete (50413 records). [2025-09-23T17:02:51.821770] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-09-23T17:02:52.203010] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-08. [2025-09-23T17:02:52.253827] [DEBUG] [VALIDATOR ] ACRE: All expected trading days are present. [2025-09-23T17:02:52.253922] [DEBUG] [VALIDATOR ] ACRE: Primary data validation passed. [2025-09-23T17:02:52.254438] [INFO ] [MAIN ] ACRE: Fetched primary data is valid. [2025-09-23T17:02:52.254482] [DEBUG] [LOCAL ] ACRE: Saving primary data. [2025-09-23T17:02:52.255768] [DEBUG] [LOCAL ] ACRE: Trimmed 50413 records to 33501 (keeping 200 days of data) [2025-09-23T17:02:52.470187] [DEBUG] [LOCAL ] ACRE: Primary data saved (33501 records). [2025-09-23T17:02:52.470375] [INFO ] [MAIN ] ACRE: Full history saved. [2025-09-23T17:02:52.470475] [INFO ] [MAIN ] Update Progress: 27/2372 symbols completed. ACRE took 40.7s. Estimated remaining: 4h 4m 60s. Rate: 9.6 symbols/min [2025-09-23T17:02:52.707123] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:02:52.747472] [DEBUG] [LOCAL ] ADCT: Loaded 33810 existing records from primary storage. [2025-09-23T17:02:52.747676] [INFO ] [MAIN ] ADCT: Loaded 33810 existing records. [2025-09-23T17:02:52.952797] [WARN ] [MAIN ] ADCT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:02:52.967046] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-09-23T17:02:52.967308] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-09-23T17:02:52.968550] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-23T17:02:52.968622] [DEBUG] [LOCAL ] ADCT: Deleted primary data file. [2025-09-23T17:02:52.977577] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-09-23T17:02:53.009700] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-01. [2025-09-23T17:02:53.326845] [INFO ] [REMOTE ] AD: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-23T17:02:53.402236] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:02:53.802273] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2024-12. [2025-09-23T17:02:54.206109] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-23T17:02:54.602245] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-09. [2025-09-23T17:02:55.171130] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-23T17:02:55.402243] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-01. [2025-09-23T17:02:55.847494] [INFO ] [REMOTE ] AD: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-23T17:02:55.852194] [INFO ] [REMOTE ] AD: Full fetch complete (5930 records). [2025-09-23T17:02:55.852337] [DEBUG] [VALIDATOR ] AD: Validating primary data. [2025-09-23T17:02:56.112307] [WARN ] [VALIDATOR ] AD: Validation failed - insufficient historical data. Have 30 unique days, need 200 days [2025-09-23T17:02:56.112557] [FATAL] [MAIN ] AD: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:02:56.112628] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:02:56.112713] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-09-23T17:02:56.112780] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-09-23T17:02:56.112817] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-09-23T17:02:56.112857] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-09-23T17:02:56.112913] [INFO ] [MAIN ] Update Progress: 28/2372 symbols completed. AD took 15.7s. Estimated remaining: 4h 1m 13s. Rate: 9.7 symbols/min [2025-09-23T17:02:56.208297] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-09-23T17:02:56.295940] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:02:56.357180] [DEBUG] [LOCAL ] ADM: Loaded 53397 existing records from primary storage. [2025-09-23T17:02:56.357351] [INFO ] [MAIN ] ADM: Loaded 53397 existing records. [2025-09-23T17:02:56.571019] [WARN ] [MAIN ] ADM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:02:56.571512] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-09-23T17:02:56.571627] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-09-23T17:02:56.581536] [DEBUG] [LOCAL ] ADM: Deleted primary data file. [2025-09-23T17:02:56.599308] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-09-23T17:02:56.608181] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-23T17:02:57.007505] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-09-23T17:02:57.169551] [INFO ] [REMOTE ] ADM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:02:57.395127] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-23T17:02:57.802260] [INFO ] [REMOTE ] ADM: Fetching primary data for 2024-12. [2025-09-23T17:02:58.338993] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-23T17:02:58.602320] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-09-23T17:02:59.250733] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-23T17:02:59.402201] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-01. [2025-09-23T17:02:59.550136] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-23T17:03:00.202197] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-09-23T17:03:01.002253] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-09-23T17:03:01.508937] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-23T17:03:01.802217] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-09-23T17:03:02.548607] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-09-23T17:03:02.602144] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-09-23T17:03:03.402278] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-09-23T17:03:03.481282] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (2.48 seconds). [2025-09-23T17:03:04.202260] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-09-23T17:03:05.018331] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-09-23T17:03:05.030951] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-09-23T17:03:05.054398] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-23T17:03:05.538357] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (3.74 seconds). [2025-09-23T17:03:05.744698] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-23T17:03:05.802208] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-09-23T17:03:06.217380] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-23T17:03:06.602223] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-09-23T17:03:06.869027] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-23T17:03:07.402202] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-09-23T17:03:08.202199] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-09-23T17:03:08.507029] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-23T17:03:08.872467] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-23T17:03:09.002200] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-09-23T17:03:09.810994] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-09-23T17:03:09.829269] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-23T17:03:10.361037] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-23T17:03:10.602206] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-09-23T17:03:11.402214] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-09-23T17:03:11.570605] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-23T17:03:12.202195] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-09-23T17:03:12.287898] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-23T17:03:13.002204] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-09-23T17:03:13.296405] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-23T17:03:13.755664] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-23T17:03:13.802207] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-09-23T17:03:14.268515] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-23T17:03:14.602218] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-09-23T17:03:15.402222] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-09-23T17:03:16.202264] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-09-23T17:03:16.559992] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-23T17:03:16.568930] [INFO ] [REMOTE ] ACVA: Full fetch complete (70185 records). [2025-09-23T17:03:16.569079] [DEBUG] [VALIDATOR ] ACVA: Validating primary data. [2025-09-23T17:03:16.848941] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (3.05 seconds). [2025-09-23T17:03:17.051057] [DEBUG] [VALIDATOR ] ACVA: All expected trading days are present. [2025-09-23T17:03:17.052345] [DEBUG] [VALIDATOR ] ACVA: Primary data validation passed. [2025-09-23T17:03:17.052273] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-23T17:03:17.058955] [INFO ] [MAIN ] ACVA: Fetched primary data is valid. [2025-09-23T17:03:17.019452] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-09-23T17:03:17.060730] [DEBUG] [LOCAL ] ACVA: Saving primary data. [2025-09-23T17:03:17.061029] [INFO ] [REMOTE ] ADCT: Full fetch complete (51593 records). [2025-09-23T17:03:17.061114] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-09-23T17:03:17.153688] [DEBUG] [LOCAL ] ACVA: Trimmed 70185 records to 49359 (keeping 200 days of data) [2025-09-23T17:03:17.567256] [DEBUG] [VALIDATOR ] ADCT: All expected trading days are present. [2025-09-23T17:03:17.567581] [DEBUG] [VALIDATOR ] ADCT: Primary data validation passed. [2025-09-23T17:03:17.568736] [INFO ] [MAIN ] ADCT: Fetched primary data is valid. [2025-09-23T17:03:17.569208] [DEBUG] [LOCAL ] ADCT: Saving primary data. [2025-09-23T17:03:17.578037] [DEBUG] [LOCAL ] ADCT: Trimmed 51593 records to 33951 (keeping 200 days of data) [2025-09-23T17:03:17.882592] [DEBUG] [LOCAL ] ADCT: Primary data saved (33951 records). [2025-09-23T17:03:17.883626] [INFO ] [MAIN ] ADCT: Full history saved. [2025-09-23T17:03:17.885712] [INFO ] [MAIN ] Update Progress: 29/2372 symbols completed. ADCT took 25.4s. Estimated remaining: 4h 22m 7s. Rate: 8.9 symbols/min [2025-09-23T17:03:18.144134] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:03:18.148163] [DEBUG] [LOCAL ] ACVA: Primary data saved (49359 records). [2025-09-23T17:03:18.148275] [INFO ] [MAIN ] ACVA: Full history saved. [2025-09-23T17:03:18.149478] [INFO ] [MAIN ] Update Progress: 30/2372 symbols completed. ACVA took 48.2s. Estimated remaining: 4h 13m 37s. Rate: 9.2 symbols/min [2025-09-23T17:03:18.367828] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:03:18.380918] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-23T17:03:18.392680] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-09-23T17:03:18.411158] [DEBUG] [LOCAL ] ADNT: Loaded 47567 existing records from primary storage. [2025-09-23T17:03:18.411299] [INFO ] [MAIN ] ADNT: Loaded 47567 existing records. [2025-09-23T17:03:18.625306] [WARN ] [MAIN ] ADNT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:03:18.626170] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-09-23T17:03:18.640561] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-09-23T17:03:18.641697] [DEBUG] [LOCAL ] ADT: Loaded 53479 existing records from primary storage. [2025-09-23T17:03:18.641954] [INFO ] [MAIN ] ADT: Loaded 53479 existing records. [2025-09-23T17:03:18.664060] [DEBUG] [LOCAL ] ADNT: Deleted primary data file. [2025-09-23T17:03:18.675243] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-09-23T17:03:18.977591] [WARN ] [MAIN ] ADT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:03:19.013995] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-23T17:03:19.067496] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-09-23T17:03:19.113547] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-09-23T17:03:19.138530] [DEBUG] [LOCAL ] ADT: Deleted primary data file. [2025-09-23T17:03:19.157893] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-09-23T17:03:19.163481] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-09-23T17:03:19.430875] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:03:19.449816] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2024-12. [2025-09-23T17:03:19.652989] [INFO ] [REMOTE ] ADT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:03:19.992451] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-23T17:03:20.202198] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-09-23T17:03:20.517155] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-23T17:03:21.002198] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-09-23T17:03:21.144733] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-23T17:03:21.802266] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-01. [2025-09-23T17:03:21.837379] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-23T17:03:22.348457] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-23T17:03:22.355827] [INFO ] [REMOTE ] ADC: Full fetch complete (65918 records). [2025-09-23T17:03:22.355948] [DEBUG] [VALIDATOR ] ADC: Validating primary data. [2025-09-23T17:03:22.607393] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-09-23T17:03:22.771260] [DEBUG] [VALIDATOR ] ADC: All expected trading days are present. [2025-09-23T17:03:22.771344] [DEBUG] [VALIDATOR ] ADC: Primary data validation passed. [2025-09-23T17:03:22.772073] [INFO ] [MAIN ] ADC: Fetched primary data is valid. [2025-09-23T17:03:22.772140] [DEBUG] [LOCAL ] ADC: Saving primary data. [2025-09-23T17:03:22.773540] [DEBUG] [LOCAL ] ADC: Trimmed 65918 records to 46374 (keeping 200 days of data) [2025-09-23T17:03:23.120237] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-23T17:03:23.137099] [DEBUG] [LOCAL ] ADC: Primary data saved (46374 records). [2025-09-23T17:03:23.137266] [INFO ] [MAIN ] ADC: Full history saved. [2025-09-23T17:03:23.137355] [INFO ] [MAIN ] Update Progress: 31/2372 symbols completed. ADC took 34.7s. Estimated remaining: 4h 11m 37s. Rate: 9.3 symbols/min [2025-09-23T17:03:23.306936] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:03:23.342824] [DEBUG] [LOCAL ] ADX: Loaded 27927 existing records from primary storage. [2025-09-23T17:03:23.342956] [INFO ] [MAIN ] ADX: Loaded 27927 existing records. [2025-09-23T17:03:23.407398] [INFO ] [REMOTE ] ADT: Fetching primary data for 2024-12. [2025-09-23T17:03:23.523408] [WARN ] [MAIN ] ADX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:03:23.523729] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-09-23T17:03:23.523785] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-09-23T17:03:23.524604] [DEBUG] [LOCAL ] ADX: Deleted primary data file. [2025-09-23T17:03:23.524700] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-09-23T17:03:23.888083] [INFO ] [REMOTE ] ADX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:03:24.202231] [INFO ] [REMOTE ] ADX: Fetching primary data for 2024-12. [2025-09-23T17:03:24.275940] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-23T17:03:24.285014] [INFO ] [REMOTE ] ADM: Full fetch complete (77218 records). [2025-09-23T17:03:24.285165] [DEBUG] [VALIDATOR ] ADM: Validating primary data. [2025-09-23T17:03:24.679363] [DEBUG] [VALIDATOR ] ADM: All expected trading days are present. [2025-09-23T17:03:24.679444] [DEBUG] [VALIDATOR ] ADM: Primary data validation passed. [2025-09-23T17:03:24.680219] [INFO ] [MAIN ] ADM: Fetched primary data is valid. [2025-09-23T17:03:24.680285] [DEBUG] [LOCAL ] ADM: Saving primary data. [2025-09-23T17:03:24.681876] [DEBUG] [LOCAL ] ADM: Trimmed 77218 records to 53397 (keeping 200 days of data) [2025-09-23T17:03:25.002179] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-09-23T17:03:25.016327] [DEBUG] [LOCAL ] ADM: Primary data saved (53397 records). [2025-09-23T17:03:25.016478] [INFO ] [MAIN ] ADM: Full history saved. [2025-09-23T17:03:25.016595] [INFO ] [MAIN ] Update Progress: 32/2372 symbols completed. ADM took 28.9s. Estimated remaining: 4h 5m 56s. Rate: 9.5 symbols/min [2025-09-23T17:03:25.188220] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-23T17:03:25.245946] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:03:25.272983] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-23T17:03:25.324212] [DEBUG] [LOCAL ] AEE: Loaded 50205 existing records from primary storage. [2025-09-23T17:03:25.324356] [INFO ] [MAIN ] AEE: Loaded 50205 existing records. [2025-09-23T17:03:25.506022] [WARN ] [MAIN ] AEE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:03:25.506313] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-09-23T17:03:25.506363] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-09-23T17:03:25.507544] [DEBUG] [LOCAL ] AEE: Deleted primary data file. [2025-09-23T17:03:25.507605] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-09-23T17:03:25.807358] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-01. [2025-09-23T17:03:25.866797] [INFO ] [REMOTE ] AEE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:03:26.173847] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-23T17:03:26.602201] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-09-23T17:03:27.128235] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-23T17:03:27.402181] [INFO ] [REMOTE ] AEE: Fetching primary data for 2024-12. [2025-09-23T17:03:28.108373] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-23T17:03:28.202164] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-09-23T17:03:29.002226] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-01. [2025-09-23T17:03:29.212216] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-23T17:03:29.446882] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-23T17:03:29.802234] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-01. [2025-09-23T17:03:30.481139] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-23T17:03:30.602210] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-09-23T17:03:31.058915] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-23T17:03:31.402206] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-09-23T17:03:31.543883] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-23T17:03:32.202208] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-09-23T17:03:32.799499] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-23T17:03:33.002233] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-09-23T17:03:33.116113] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-23T17:03:33.802211] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-09-23T17:03:34.295291] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-23T17:03:34.602243] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-09-23T17:03:35.402295] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-09-23T17:03:35.567087] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-23T17:03:35.813531] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-23T17:03:36.202195] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-09-23T17:03:36.754882] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-23T17:03:37.002207] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-09-23T17:03:37.078196] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-23T17:03:37.802205] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-09-23T17:03:38.602237] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-09-23T17:03:38.752284] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-23T17:03:39.236289] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-23T17:03:39.402203] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-09-23T17:03:39.500714] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-23T17:03:40.202197] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-09-23T17:03:41.002207] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-09-23T17:03:41.241943] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-23T17:03:41.265483] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-23T17:03:41.802207] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-09-23T17:03:42.207221] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-23T17:03:42.602233] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-09-23T17:03:42.734195] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-23T17:03:43.402233] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-09-23T17:03:43.955696] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-23T17:03:44.202202] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-09-23T17:03:44.718872] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-23T17:03:44.725949] [INFO ] [REMOTE ] ADNT: Full fetch complete (67782 records). [2025-09-23T17:03:44.726056] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-09-23T17:03:44.726890] [FATAL] [VALIDATOR ] ADNT: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:03:44.726985] [FATAL] [MAIN ] ADNT: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:03:44.727028] [WARN ] [MAIN ] ADNT: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:03:44.727065] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-09-23T17:03:44.727146] [DEBUG] [LOCAL ] ADNT: No primary data file found to delete. [2025-09-23T17:03:44.727201] [INFO ] [LOCAL ] ADNT: Starting deletion of derivative data. [2025-09-23T17:03:44.727675] [DEBUG] [LOCAL ] ADNT: Deleted derivative data file. [2025-09-23T17:03:44.728324] [INFO ] [MAIN ] Update Progress: 33/2372 symbols completed. ADNT took 26.8s. Estimated remaining: 4h 21m 40s. Rate: 8.9 symbols/min [2025-09-23T17:03:44.897060] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:03:44.907974] [DEBUG] [LOCAL ] AEFC: Loaded 8633 existing records from primary storage. [2025-09-23T17:03:44.908095] [INFO ] [MAIN ] AEFC: Loaded 8633 existing records. [2025-09-23T17:03:45.007906] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-09-23T17:03:45.086795] [WARN ] [MAIN ] AEFC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:03:45.087014] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-09-23T17:03:45.087060] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-09-23T17:03:45.087454] [DEBUG] [LOCAL ] AEFC: Deleted primary data file. [2025-09-23T17:03:45.087514] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-09-23T17:03:45.394163] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-23T17:03:45.441119] [INFO ] [REMOTE ] ADX: Full fetch complete (42179 records). [2025-09-23T17:03:45.462387] [DEBUG] [VALIDATOR ] ADX: Validating primary data. [2025-09-23T17:03:45.487341] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:03:45.814991] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2024-12. [2025-09-23T17:03:45.868714] [DEBUG] [VALIDATOR ] ADX: All expected trading days are present. [2025-09-23T17:03:45.868811] [DEBUG] [VALIDATOR ] ADX: Primary data validation passed. [2025-09-23T17:03:45.869316] [INFO ] [MAIN ] ADX: Fetched primary data is valid. [2025-09-23T17:03:45.869380] [DEBUG] [LOCAL ] ADX: Saving primary data. [2025-09-23T17:03:45.870357] [DEBUG] [LOCAL ] ADX: Trimmed 42179 records to 27857 (keeping 200 days of data) [2025-09-23T17:03:46.045590] [DEBUG] [LOCAL ] ADX: Primary data saved (27857 records). [2025-09-23T17:03:46.045756] [INFO ] [MAIN ] ADX: Full history saved. [2025-09-23T17:03:46.047170] [INFO ] [MAIN ] Update Progress: 34/2372 symbols completed. ADX took 22.9s. Estimated remaining: 4h 15m 23s. Rate: 9.2 symbols/min [2025-09-23T17:03:46.227202] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:03:46.280423] [DEBUG] [LOCAL ] AEG: Loaded 49596 existing records from primary storage. [2025-09-23T17:03:46.280568] [INFO ] [MAIN ] AEG: Loaded 49596 existing records. [2025-09-23T17:03:46.471200] [WARN ] [MAIN ] AEG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:03:46.471493] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-09-23T17:03:46.471550] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-09-23T17:03:46.472708] [DEBUG] [LOCAL ] AEG: Deleted primary data file. [2025-09-23T17:03:46.472779] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-09-23T17:03:46.607336] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-09-23T17:03:46.860549] [INFO ] [REMOTE ] AEG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:03:46.869510] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-23T17:03:46.903270] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-23T17:03:47.402227] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-09-23T17:03:48.202148] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-01. [2025-09-23T17:03:48.280091] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-23T17:03:48.627003] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-23T17:03:49.002255] [INFO ] [REMOTE ] AEG: Fetching primary data for 2024-12. [2025-09-23T17:03:49.227381] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-23T17:03:49.802328] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-09-23T17:03:50.225447] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-23T17:03:50.602200] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-09-23T17:03:51.073081] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-23T17:03:51.092032] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-23T17:03:51.402215] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-09-23T17:03:51.872846] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-23T17:03:52.202217] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-09-23T17:03:53.002283] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-09-23T17:03:53.539932] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-23T17:03:53.802165] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-01. [2025-09-23T17:03:54.136247] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-23T17:03:54.602250] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-09-23T17:03:55.062978] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-23T17:03:55.402217] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-09-23T17:03:56.011249] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-23T17:03:56.202198] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-09-23T17:03:57.007308] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-09-23T17:03:57.023075] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-23T17:03:57.597885] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-23T17:03:57.638680] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-23T17:03:57.802215] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-09-23T17:03:58.602228] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-09-23T17:03:59.402233] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-09-23T17:03:59.490390] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-23T17:04:00.157572] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-23T17:04:00.202143] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-09-23T17:04:01.002222] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-09-23T17:04:01.082326] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-23T17:04:01.516559] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-23T17:04:01.602311] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-23T17:04:01.612355] [INFO ] [REMOTE ] ADT: Full fetch complete (76816 records). [2025-09-23T17:04:01.612555] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-09-23T17:04:01.613395] [FATAL] [VALIDATOR ] ADT: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:04:01.613490] [FATAL] [MAIN ] ADT: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:04:01.613534] [WARN ] [MAIN ] ADT: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:04:01.613574] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-09-23T17:04:01.613634] [DEBUG] [LOCAL ] ADT: No primary data file found to delete. [2025-09-23T17:04:01.613728] [INFO ] [LOCAL ] ADT: Starting deletion of derivative data. [2025-09-23T17:04:01.614394] [DEBUG] [LOCAL ] ADT: Deleted derivative data file. [2025-09-23T17:04:01.618440] [INFO ] [MAIN ] Update Progress: 35/2372 symbols completed. ADT took 43.5s. Estimated remaining: 4h 25m 18s. Rate: 8.8 symbols/min [2025-09-23T17:04:01.800900] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:04:01.802294] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-09-23T17:04:01.867127] [DEBUG] [LOCAL ] AEM: Loaded 53465 existing records from primary storage. [2025-09-23T17:04:01.867277] [INFO ] [MAIN ] AEM: Loaded 53465 existing records. [2025-09-23T17:04:02.063532] [WARN ] [MAIN ] AEM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:04:02.063873] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-09-23T17:04:02.063932] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-09-23T17:04:02.065436] [DEBUG] [LOCAL ] AEM: Deleted primary data file. [2025-09-23T17:04:02.065500] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-09-23T17:04:02.398753] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-23T17:04:02.477921] [INFO ] [REMOTE ] AEM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:04:02.602248] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-09-23T17:04:03.402239] [INFO ] [REMOTE ] AEM: Fetching primary data for 2024-12. [2025-09-23T17:04:03.680273] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-23T17:04:04.202199] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-09-23T17:04:05.002216] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-09-23T17:04:05.802258] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-09-23T17:04:06.016589] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-23T17:04:06.018160] [INFO ] [REMOTE ] AEFC: Full fetch complete (12401 records). [2025-09-23T17:04:06.018229] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-09-23T17:04:06.382397] [DEBUG] [VALIDATOR ] AEFC: All expected trading days are present. [2025-09-23T17:04:06.382492] [DEBUG] [VALIDATOR ] AEFC: Primary data validation passed. [2025-09-23T17:04:06.382737] [INFO ] [MAIN ] AEFC: Fetched primary data is valid. [2025-09-23T17:04:06.382798] [DEBUG] [LOCAL ] AEFC: Saving primary data. [2025-09-23T17:04:06.383329] [DEBUG] [LOCAL ] AEFC: Trimmed 12401 records to 8595 (keeping 200 days of data) [2025-09-23T17:04:06.440812] [DEBUG] [LOCAL ] AEFC: Primary data saved (8595 records). [2025-09-23T17:04:06.440953] [INFO ] [MAIN ] AEFC: Full history saved. [2025-09-23T17:04:06.441038] [INFO ] [MAIN ] Update Progress: 36/2372 symbols completed. AEFC took 21.7s. Estimated remaining: 4h 23m 2s. Rate: 8.9 symbols/min [2025-09-23T17:04:06.613007] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:04:06.674390] [DEBUG] [LOCAL ] AEO: Loaded 53558 existing records from primary storage. [2025-09-23T17:04:06.674562] [INFO ] [MAIN ] AEO: Loaded 53558 existing records. [2025-09-23T17:04:06.857313] [WARN ] [MAIN ] AEO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:04:06.857749] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-09-23T17:04:06.857874] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-09-23T17:04:06.859099] [DEBUG] [LOCAL ] AEO: Deleted primary data file. [2025-09-23T17:04:06.859162] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-09-23T17:04:07.286011] [INFO ] [REMOTE ] AEO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:04:07.286802] [INFO ] [REMOTE ] AEO: Fetching primary data for 2024-12. [2025-09-23T17:04:07.290750] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2024-12 (3.89 seconds). [2025-09-23T17:04:07.356692] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-09-23T17:04:07.402162] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-09-23T17:04:07.465310] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-23T17:04:07.476531] [INFO ] [REMOTE ] AEE: Full fetch complete (72172 records). [2025-09-23T17:04:07.476709] [DEBUG] [VALIDATOR ] AEE: Validating primary data. [2025-09-23T17:04:07.478883] [FATAL] [VALIDATOR ] AEE: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:04:07.478976] [FATAL] [MAIN ] AEE: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:04:07.479020] [WARN ] [MAIN ] AEE: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:04:07.479090] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-09-23T17:04:07.479171] [DEBUG] [LOCAL ] AEE: No primary data file found to delete. [2025-09-23T17:04:07.479228] [INFO ] [LOCAL ] AEE: Starting deletion of derivative data. [2025-09-23T17:04:07.479786] [DEBUG] [LOCAL ] AEE: Deleted derivative data file. [2025-09-23T17:04:07.479888] [INFO ] [MAIN ] Update Progress: 37/2372 symbols completed. AEE took 42.5s. Estimated remaining: 4h 16m 55s. Rate: 9.1 symbols/min [2025-09-23T17:04:08.202287] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-01. [2025-09-23T17:04:08.815049] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-23T17:04:08.844591] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-23T17:04:09.002170] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-01. [2025-09-23T17:04:09.593290] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-23T17:04:09.802194] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-09-23T17:04:10.602232] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-09-23T17:04:10.860688] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-23T17:04:11.402171] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-09-23T17:04:11.452612] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-23T17:04:12.207261] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-09-23T17:04:12.221676] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-23T17:04:12.636359] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-23T17:04:13.002215] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-09-23T17:04:13.802203] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-09-23T17:04:13.841019] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-23T17:04:14.602189] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-09-23T17:04:14.694942] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-23T17:04:15.402214] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-09-23T17:04:15.436015] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-23T17:04:16.202249] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-09-23T17:04:16.808066] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-23T17:04:16.848095] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-23T17:04:17.002188] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-09-23T17:04:17.631999] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-23T17:04:17.802182] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-09-23T17:04:18.602218] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-09-23T17:04:19.652104] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (2.65 seconds). [2025-09-23T17:04:19.664139] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-09-23T17:04:19.851530] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-23T17:04:20.202232] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-09-23T17:04:21.151926] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (2.55 seconds). [2025-09-23T17:04:21.162940] [INFO ] [REMOTE ] AEG: Full fetch complete (69830 records). [2025-09-23T17:04:21.163105] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-09-23T17:04:21.164019] [FATAL] [VALIDATOR ] AEG: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:04:21.164113] [FATAL] [MAIN ] AEG: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:04:21.164156] [WARN ] [MAIN ] AEG: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:04:21.164220] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-09-23T17:04:21.164284] [DEBUG] [LOCAL ] AEG: No primary data file found to delete. [2025-09-23T17:04:21.164318] [INFO ] [LOCAL ] AEG: Starting deletion of derivative data. [2025-09-23T17:04:21.164635] [DEBUG] [LOCAL ] AEG: Deleted derivative data file. [2025-09-23T17:04:21.167788] [INFO ] [MAIN ] Update Progress: 38/2372 symbols completed. AEG took 35.1s. Estimated remaining: 4h 24m 3s. Rate: 8.8 symbols/min [2025-09-23T17:04:21.256404] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-23T17:04:21.267498] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-09-23T17:04:21.997149] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-23T17:04:22.008376] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-09-23T17:04:22.958553] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-23T17:04:22.970569] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-09-23T17:04:23.747160] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-23T17:04:23.759129] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-09-23T17:04:24.500460] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-23T17:04:24.512143] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-09-23T17:04:25.543156] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-23T17:04:25.555946] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-09-23T17:04:26.258771] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-23T17:04:26.267610] [INFO ] [REMOTE ] AEM: Full fetch complete (77123 records). [2025-09-23T17:04:26.267782] [DEBUG] [VALIDATOR ] AEM: Validating primary data. [2025-09-23T17:04:26.669389] [DEBUG] [VALIDATOR ] AEM: All expected trading days are present. [2025-09-23T17:04:26.669487] [DEBUG] [VALIDATOR ] AEM: Primary data validation passed. [2025-09-23T17:04:26.670277] [INFO ] [MAIN ] AEM: Fetched primary data is valid. [2025-09-23T17:04:26.670364] [DEBUG] [LOCAL ] AEM: Saving primary data. [2025-09-23T17:04:26.672090] [DEBUG] [LOCAL ] AEM: Trimmed 77123 records to 53465 (keeping 200 days of data) [2025-09-23T17:04:27.018047] [DEBUG] [LOCAL ] AEM: Primary data saved (53465 records). [2025-09-23T17:04:27.018464] [INFO ] [MAIN ] AEM: Full history saved. [2025-09-23T17:04:27.019746] [INFO ] [MAIN ] Update Progress: 39/2372 symbols completed. AEM took 25.4s. Estimated remaining: 4h 23m 1s. Rate: 8.9 symbols/min [2025-09-23T17:04:27.971607] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-09-23T17:04:27.981672] [INFO ] [REMOTE ] AEO: Full fetch complete (77445 records). [2025-09-23T17:04:27.981905] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-09-23T17:04:28.412077] [DEBUG] [VALIDATOR ] AEO: All expected trading days are present. [2025-09-23T17:04:28.412157] [DEBUG] [VALIDATOR ] AEO: Primary data validation passed. [2025-09-23T17:04:28.412914] [INFO ] [MAIN ] AEO: Fetched primary data is valid. [2025-09-23T17:04:28.412979] [DEBUG] [LOCAL ] AEO: Saving primary data. [2025-09-23T17:04:28.414624] [DEBUG] [LOCAL ] AEO: Trimmed 77445 records to 53557 (keeping 200 days of data) [2025-09-23T17:04:28.770675] [DEBUG] [LOCAL ] AEO: Primary data saved (53557 records). [2025-09-23T17:04:28.770962] [INFO ] [MAIN ] AEO: Full history saved. [2025-09-23T17:04:28.773482] [INFO ] [MAIN ] Update Progress: 40/2372 symbols completed. AEO took 22.3s. Estimated remaining: 4h 18m 2s. Rate: 9.0 symbols/min [2025-09-23T17:04:29.450234] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:04:29.500886] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:04:29.496760] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:04:29.502201] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:04:29.502841] [DEBUG] [LOCAL ] AER: No existing data file found in primary storage. [2025-09-23T17:04:29.503097] [WARN ] [MAIN ] AER: No existing data found, performing full refresh instead. [2025-09-23T17:04:29.503813] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-09-23T17:04:29.504378] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-09-23T17:04:29.504547] [DEBUG] [LOCAL ] AER: No primary data file found to delete. [2025-09-23T17:04:29.504620] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-09-23T17:04:29.638092] [DEBUG] [LOCAL ] AFB: Loaded 11445 existing records from primary storage. [2025-09-23T17:04:29.638837] [INFO ] [MAIN ] AFB: Loaded 11445 existing records. [2025-09-23T17:04:30.027531] [DEBUG] [LOCAL ] AES: Loaded 53672 existing records from primary storage. [2025-09-23T17:04:30.067309] [INFO ] [MAIN ] AES: Loaded 53672 existing records. [2025-09-23T17:04:30.078490] [DEBUG] [LOCAL ] AESI: Loaded 49488 existing records from primary storage. [2025-09-23T17:04:30.151838] [INFO ] [MAIN ] AESI: Loaded 49488 existing records. [2025-09-23T17:04:30.141606] [WARN ] [MAIN ] AFB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:04:30.293206] [INFO ] [REMOTE ] AER: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:04:30.349722] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-09-23T17:04:30.376029] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-09-23T17:04:30.355273] [INFO ] [REMOTE ] AER: Fetching primary data for 2024-12. [2025-09-23T17:04:30.414423] [DEBUG] [LOCAL ] AFB: Deleted primary data file. [2025-09-23T17:04:30.440561] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-09-23T17:04:30.617205] [WARN ] [MAIN ] AES: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:04:30.656284] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-09-23T17:04:30.656206] [WARN ] [MAIN ] AESI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:04:30.661531] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-09-23T17:04:30.678850] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-09-23T17:04:30.678906] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-09-23T17:04:30.685160] [DEBUG] [LOCAL ] AESI: Deleted primary data file. [2025-09-23T17:04:30.690373] [DEBUG] [LOCAL ] AES: Deleted primary data file. [2025-09-23T17:04:30.690481] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-09-23T17:04:30.695703] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-09-23T17:04:31.522603] [INFO ] [REMOTE ] AFB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:04:31.540103] [INFO ] [REMOTE ] AFB: Fetching primary data for 2024-12. [2025-09-23T17:04:31.719430] [INFO ] [REMOTE ] AESI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:04:31.736764] [INFO ] [REMOTE ] AESI: Fetching primary data for 2024-12. [2025-09-23T17:04:31.742509] [INFO ] [REMOTE ] AES: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:04:31.743919] [INFO ] [REMOTE ] AES: Fetching primary data for 2024-12. [2025-09-23T17:04:32.073942] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-23T17:04:32.082839] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-01. [2025-09-23T17:04:32.259682] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-23T17:04:32.262579] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-01. [2025-09-23T17:04:32.834345] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-23T17:04:32.837742] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-09-23T17:04:32.968516] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-23T17:04:32.977980] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-01. [2025-09-23T17:04:33.298270] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-23T17:04:33.301183] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-09-23T17:04:33.411324] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-23T17:04:33.420781] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-09-23T17:04:33.779951] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-23T17:04:33.802143] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-01. [2025-09-23T17:04:33.894806] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-23T17:04:34.188529] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-23T17:04:34.602237] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-09-23T17:04:35.177343] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-23T17:04:35.196116] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-23T17:04:35.402172] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-09-23T17:04:35.443385] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-23T17:04:36.202235] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-09-23T17:04:36.911789] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-23T17:04:37.002269] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-09-23T17:04:37.769002] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-23T17:04:37.802192] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-09-23T17:04:38.602182] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-09-23T17:04:38.863303] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-23T17:04:39.402166] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-09-23T17:04:39.664157] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-23T17:04:39.920208] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-23T17:04:40.202212] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-09-23T17:04:40.854740] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-23T17:04:41.002196] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-09-23T17:04:41.609402] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-23T17:04:41.637557] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-23T17:04:41.802271] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-09-23T17:04:42.602262] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-09-23T17:04:43.234152] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-23T17:04:43.266415] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-23T17:04:43.402206] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-09-23T17:04:44.202190] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-09-23T17:04:45.002253] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-09-23T17:04:45.484062] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-23T17:04:45.802209] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-09-23T17:04:45.942741] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (2.54 seconds). [2025-09-23T17:04:46.602211] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-09-23T17:04:46.769209] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-23T17:04:47.213906] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-23T17:04:47.232356] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-23T17:04:47.402258] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-09-23T17:04:48.202215] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-09-23T17:04:48.661109] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-23T17:04:48.950374] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-23T17:04:49.002173] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-09-23T17:04:49.802209] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-09-23T17:04:50.309223] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-23T17:04:50.321777] [INFO ] [REMOTE ] AER: Full fetch complete (69498 records). [2025-09-23T17:04:50.321926] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-09-23T17:04:50.603061] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-09-23T17:04:50.581254] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-23T17:04:50.635838] [INFO ] [REMOTE ] AFB: Full fetch complete (16525 records). [2025-09-23T17:04:50.647446] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-09-23T17:04:50.875853] [DEBUG] [VALIDATOR ] AER: All expected trading days are present. [2025-09-23T17:04:50.881077] [DEBUG] [VALIDATOR ] AER: Primary data validation passed. [2025-09-23T17:04:50.886968] [INFO ] [MAIN ] AER: Fetched primary data is valid. [2025-09-23T17:04:50.887050] [DEBUG] [LOCAL ] AER: Saving primary data. [2025-09-23T17:04:50.942738] [DEBUG] [LOCAL ] AER: Trimmed 69498 records to 48687 (keeping 200 days of data) [2025-09-23T17:04:51.272602] [DEBUG] [VALIDATOR ] AFB: All expected trading days are present. [2025-09-23T17:04:51.272733] [DEBUG] [VALIDATOR ] AFB: Primary data validation passed. [2025-09-23T17:04:51.273017] [INFO ] [MAIN ] AFB: Fetched primary data is valid. [2025-09-23T17:04:51.273091] [DEBUG] [LOCAL ] AFB: Saving primary data. [2025-09-23T17:04:51.273741] [DEBUG] [LOCAL ] AFB: Trimmed 16525 records to 11406 (keeping 200 days of data) [2025-09-23T17:04:51.415472] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-09-23T17:04:51.530455] [DEBUG] [LOCAL ] AER: Primary data saved (48687 records). [2025-09-23T17:04:51.531955] [DEBUG] [LOCAL ] AFB: Primary data saved (11406 records). [2025-09-23T17:04:51.532190] [INFO ] [MAIN ] AER: Full history saved. [2025-09-23T17:04:51.532330] [INFO ] [MAIN ] Update Progress: 41/2372 symbols completed. AER took 22.8s. Estimated remaining: 4h 33m 11s. Rate: 8.5 symbols/min [2025-09-23T17:04:51.532442] [INFO ] [MAIN ] AFB: Full history saved. [2025-09-23T17:04:51.532986] [INFO ] [MAIN ] Update Progress: 42/2372 symbols completed. AFB took 22.8s. Estimated remaining: 4h 26m 34s. Rate: 8.7 symbols/min [2025-09-23T17:04:51.872121] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:04:51.888862] [DEBUG] [LOCAL ] AFG: No existing data file found in primary storage. [2025-09-23T17:04:51.890056] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:04:51.890123] [WARN ] [MAIN ] AFG: No existing data found, performing full refresh instead. [2025-09-23T17:04:51.890962] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-09-23T17:04:51.891040] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-09-23T17:04:51.891107] [DEBUG] [LOCAL ] AFG: No primary data file found to delete. [2025-09-23T17:04:51.891144] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-09-23T17:04:51.986788] [DEBUG] [LOCAL ] AFGB: Loaded 2450 existing records from primary storage. [2025-09-23T17:04:52.002256] [INFO ] [MAIN ] AFGB: Loaded 2450 existing records. [2025-09-23T17:04:52.320558] [WARN ] [MAIN ] AFGB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:04:52.377879] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-09-23T17:04:52.416512] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-09-23T17:04:52.427119] [DEBUG] [LOCAL ] AFGB: Deleted primary data file. [2025-09-23T17:04:52.442903] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-09-23T17:04:52.552113] [INFO ] [REMOTE ] AFG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:04:52.613308] [INFO ] [REMOTE ] AFG: Fetching primary data for 2024-12. [2025-09-23T17:04:52.909907] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-09-23T17:04:52.958920] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:04:52.995789] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-23T17:04:53.007293] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2024-12. [2025-09-23T17:04:53.434818] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-23T17:04:53.676739] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-23T17:04:53.802206] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-09-23T17:04:54.602204] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-01. [2025-09-23T17:04:54.966608] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-23T17:04:55.133601] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-23T17:04:55.402240] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-09-23T17:04:56.202190] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-09-23T17:04:56.741944] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-23T17:04:57.002203] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-09-23T17:04:57.802182] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-01. [2025-09-23T17:04:57.907771] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-23T17:04:58.602180] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-09-23T17:04:58.806009] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-23T17:04:58.814951] [INFO ] [REMOTE ] AESI: Full fetch complete (70216 records). [2025-09-23T17:04:58.815096] [DEBUG] [VALIDATOR ] AESI: Validating primary data. [2025-09-23T17:04:59.030819] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-23T17:04:59.277039] [DEBUG] [VALIDATOR ] AESI: All expected trading days are present. [2025-09-23T17:04:59.277132] [DEBUG] [VALIDATOR ] AESI: Primary data validation passed. [2025-09-23T17:04:59.277848] [INFO ] [MAIN ] AESI: Fetched primary data is valid. [2025-09-23T17:04:59.277914] [DEBUG] [LOCAL ] AESI: Saving primary data. [2025-09-23T17:04:59.281812] [DEBUG] [LOCAL ] AESI: Trimmed 70216 records to 49508 (keeping 200 days of data) [2025-09-23T17:04:59.402255] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-09-23T17:04:59.591317] [DEBUG] [LOCAL ] AESI: Primary data saved (49508 records). [2025-09-23T17:04:59.591475] [INFO ] [MAIN ] AESI: Full history saved. [2025-09-23T17:04:59.593238] [INFO ] [MAIN ] Update Progress: 43/2372 symbols completed. AESI took 30.8s. Estimated remaining: 4h 27m 32s. Rate: 8.7 symbols/min [2025-09-23T17:04:59.772173] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:04:59.775307] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-23T17:04:59.781094] [DEBUG] [LOCAL ] AFGC: Loaded 2558 existing records from primary storage. [2025-09-23T17:04:59.781228] [INFO ] [MAIN ] AFGC: Loaded 2558 existing records. [2025-09-23T17:05:00.020131] [WARN ] [MAIN ] AFGC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:05:00.020371] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-09-23T17:05:00.020419] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-09-23T17:05:00.020638] [DEBUG] [LOCAL ] AFGC: Deleted primary data file. [2025-09-23T17:05:00.020725] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-09-23T17:05:00.207452] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-09-23T17:05:00.379800] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:05:00.430852] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-23T17:05:01.002245] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-09-23T17:05:01.541445] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-23T17:05:01.760043] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-23T17:05:01.802144] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-09-23T17:05:02.602203] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2024-12. [2025-09-23T17:05:03.402250] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-09-23T17:05:03.749089] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-23T17:05:03.798356] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-23T17:05:04.202207] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-09-23T17:05:04.675833] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-23T17:05:05.002212] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-09-23T17:05:05.356239] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-23T17:05:05.532026] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-23T17:05:05.802213] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-09-23T17:05:06.174316] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-23T17:05:06.602246] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-01. [2025-09-23T17:05:07.371541] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-23T17:05:07.402229] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-09-23T17:05:07.787605] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-09-23T17:05:08.202195] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-09-23T17:05:09.002205] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-09-23T17:05:09.344631] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-23T17:05:09.378082] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-23T17:05:09.802339] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-09-23T17:05:10.602449] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-09-23T17:05:11.402224] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-09-23T17:05:11.632933] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-23T17:05:11.643113] [INFO ] [REMOTE ] AES: Full fetch complete (77724 records). [2025-09-23T17:05:11.643290] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-09-23T17:05:11.755414] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-23T17:05:11.861401] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-23T17:05:12.119911] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-09-23T17:05:12.120004] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-09-23T17:05:12.120736] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-09-23T17:05:12.120803] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-09-23T17:05:12.122763] [DEBUG] [LOCAL ] AES: Trimmed 77724 records to 53672 (keeping 200 days of data) [2025-09-23T17:05:12.214184] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-09-23T17:05:12.452238] [DEBUG] [LOCAL ] AES: Primary data saved (53672 records). [2025-09-23T17:05:12.452397] [INFO ] [MAIN ] AES: Full history saved. [2025-09-23T17:05:12.452499] [INFO ] [MAIN ] Update Progress: 44/2372 symbols completed. AES took 43.7s. Estimated remaining: 4h 32m 41s. Rate: 8.5 symbols/min [2025-09-23T17:05:12.637779] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:05:12.641927] [DEBUG] [LOCAL ] AFGD: Loaded 1879 existing records from primary storage. [2025-09-23T17:05:12.642014] [INFO ] [MAIN ] AFGD: Loaded 1879 existing records. [2025-09-23T17:05:12.817763] [WARN ] [MAIN ] AFGD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:05:12.818023] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-09-23T17:05:12.818105] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-09-23T17:05:12.818345] [DEBUG] [LOCAL ] AFGD: Deleted primary data file. [2025-09-23T17:05:12.818408] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-09-23T17:05:13.008424] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-09-23T17:05:13.183974] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:05:13.439292] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-23T17:05:13.488190] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-23T17:05:13.489306] [INFO ] [REMOTE ] AFGB: Full fetch complete (3641 records). [2025-09-23T17:05:13.489379] [DEBUG] [VALIDATOR ] AFGB: Validating primary data. [2025-09-23T17:05:13.814600] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2024-12. [2025-09-23T17:05:13.856392] [DEBUG] [VALIDATOR ] AFGB: All expected trading days are present. [2025-09-23T17:05:13.856467] [DEBUG] [VALIDATOR ] AFGB: Primary data validation passed. [2025-09-23T17:05:13.856586] [INFO ] [MAIN ] AFGB: Fetched primary data is valid. [2025-09-23T17:05:13.856623] [DEBUG] [LOCAL ] AFGB: Saving primary data. [2025-09-23T17:05:13.857013] [DEBUG] [LOCAL ] AFGB: Trimmed 3641 records to 2417 (keeping 200 days of data) [2025-09-23T17:05:13.872370] [DEBUG] [LOCAL ] AFGB: Primary data saved (2417 records). [2025-09-23T17:05:13.872443] [INFO ] [MAIN ] AFGB: Full history saved. [2025-09-23T17:05:13.872514] [INFO ] [MAIN ] Update Progress: 45/2372 symbols completed. AFGB took 22.3s. Estimated remaining: 4h 27m 44s. Rate: 8.7 symbols/min [2025-09-23T17:05:14.038432] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:05:14.042428] [DEBUG] [LOCAL ] AFGE: Loaded 2534 existing records from primary storage. [2025-09-23T17:05:14.042499] [INFO ] [MAIN ] AFGE: Loaded 2534 existing records. [2025-09-23T17:05:14.225550] [WARN ] [MAIN ] AFGE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:05:14.225870] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-09-23T17:05:14.225923] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-09-23T17:05:14.226173] [DEBUG] [LOCAL ] AFGE: Deleted primary data file. [2025-09-23T17:05:14.226246] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-09-23T17:05:14.431925] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-23T17:05:14.607303] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-01. [2025-09-23T17:05:14.653974] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:05:14.972369] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-09-23T17:05:15.402205] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-09-23T17:05:16.202202] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-09-23T17:05:16.465055] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-23T17:05:16.621055] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-23T17:05:17.002216] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2024-12. [2025-09-23T17:05:17.437207] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-23T17:05:17.802200] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-09-23T17:05:18.102888] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-09-23T17:05:18.602242] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-09-23T17:05:19.402208] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-09-23T17:05:19.700705] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-09-23T17:05:19.767498] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-23T17:05:20.202201] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-09-23T17:05:20.521392] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-23T17:05:21.002212] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-01. [2025-09-23T17:05:21.332955] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-23T17:05:21.802194] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-09-23T17:05:22.173043] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-23T17:05:22.602192] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-09-23T17:05:22.895184] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-09-23T17:05:23.402261] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-09-23T17:05:23.851982] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-23T17:05:24.202276] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-09-23T17:05:24.505229] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-09-23T17:05:25.002214] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-09. [2025-09-23T17:05:25.802203] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-09-23T17:05:26.297789] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-23T17:05:26.303569] [INFO ] [REMOTE ] AFG: Full fetch complete (45744 records). [2025-09-23T17:05:26.303706] [DEBUG] [VALIDATOR ] AFG: Validating primary data. [2025-09-23T17:05:26.412033] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-23T17:05:26.607301] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-09-23T17:05:26.720913] [DEBUG] [VALIDATOR ] AFG: All expected trading days are present. [2025-09-23T17:05:26.721008] [DEBUG] [VALIDATOR ] AFG: Primary data validation passed. [2025-09-23T17:05:26.721509] [INFO ] [MAIN ] AFG: Fetched primary data is valid. [2025-09-23T17:05:26.721570] [DEBUG] [LOCAL ] AFG: Saving primary data. [2025-09-23T17:05:26.722608] [DEBUG] [LOCAL ] AFG: Trimmed 45744 records to 32602 (keeping 200 days of data) [2025-09-23T17:05:26.925861] [DEBUG] [LOCAL ] AFG: Primary data saved (32602 records). [2025-09-23T17:05:26.926002] [INFO ] [MAIN ] AFG: Full history saved. [2025-09-23T17:05:26.926080] [INFO ] [MAIN ] Update Progress: 46/2372 symbols completed. AFG took 35.4s. Estimated remaining: 4h 32m 48s. Rate: 8.5 symbols/min [2025-09-23T17:05:27.104524] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:05:27.164383] [DEBUG] [LOCAL ] AFL: Loaded 53151 existing records from primary storage. [2025-09-23T17:05:27.168215] [INFO ] [MAIN ] AFL: Loaded 53151 existing records. [2025-09-23T17:05:27.168131] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-23T17:05:27.351723] [WARN ] [MAIN ] AFL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:05:27.351981] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-09-23T17:05:27.352030] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-09-23T17:05:27.353486] [DEBUG] [LOCAL ] AFL: Deleted primary data file. [2025-09-23T17:05:27.353716] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-09-23T17:05:27.409938] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-09-23T17:05:27.722273] [INFO ] [REMOTE ] AFL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:05:28.202234] [INFO ] [REMOTE ] AFL: Fetching primary data for 2024-12. [2025-09-23T17:05:29.002238] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-09-23T17:05:29.452933] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-23T17:05:29.802248] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-09-23T17:05:30.120362] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-23T17:05:30.236554] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-23T17:05:30.602200] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-01. [2025-09-23T17:05:31.006975] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (3.60 seconds). [2025-09-23T17:05:31.402261] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-09-23T17:05:31.810886] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-23T17:05:32.202173] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-09-23T17:05:32.274898] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-23T17:05:32.539350] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-23T17:05:33.002198] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-09-23T17:05:33.649604] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-23T17:05:33.802259] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-09-23T17:05:34.204339] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-23T17:05:34.205981] [INFO ] [REMOTE ] AFGD: Full fetch complete (3219 records). [2025-09-23T17:05:34.206078] [DEBUG] [VALIDATOR ] AFGD: Validating primary data. [2025-09-23T17:05:34.206675] [FATAL] [VALIDATOR ] AFGD: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:05:34.206784] [FATAL] [MAIN ] AFGD: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:05:34.206880] [WARN ] [MAIN ] AFGD: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:05:34.206973] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-09-23T17:05:34.207065] [DEBUG] [LOCAL ] AFGD: No primary data file found to delete. [2025-09-23T17:05:34.207262] [INFO ] [LOCAL ] AFGD: Starting deletion of derivative data. [2025-09-23T17:05:34.207802] [DEBUG] [LOCAL ] AFGD: Deleted derivative data file. [2025-09-23T17:05:34.207930] [INFO ] [MAIN ] Update Progress: 47/2372 symbols completed. AFGD took 21.8s. Estimated remaining: 4h 32m 53s. Rate: 8.5 symbols/min [2025-09-23T17:05:34.457290] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:05:34.537099] [DEBUG] [LOCAL ] AG: Loaded 53643 existing records from primary storage. [2025-09-23T17:05:34.537297] [INFO ] [MAIN ] AG: Loaded 53643 existing records. [2025-09-23T17:05:34.611559] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-09-23T17:05:34.824366] [WARN ] [MAIN ] AG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:05:34.824781] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-09-23T17:05:34.824888] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-09-23T17:05:34.826711] [DEBUG] [LOCAL ] AG: Deleted primary data file. [2025-09-23T17:05:34.826796] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-09-23T17:05:35.187392] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-23T17:05:35.295337] [INFO ] [REMOTE ] AG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:05:35.402190] [INFO ] [REMOTE ] AG: Fetching primary data for 2024-12. [2025-09-23T17:05:36.202198] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-09-23T17:05:36.620268] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-23T17:05:36.621396] [INFO ] [REMOTE ] AFGC: Full fetch complete (3705 records). [2025-09-23T17:05:36.621465] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-09-23T17:05:36.990972] [DEBUG] [VALIDATOR ] AFGC: All expected trading days are present. [2025-09-23T17:05:36.991182] [DEBUG] [VALIDATOR ] AFGC: Primary data validation passed. [2025-09-23T17:05:36.991394] [INFO ] [MAIN ] AFGC: Fetched primary data is valid. [2025-09-23T17:05:36.991468] [DEBUG] [LOCAL ] AFGC: Saving primary data. [2025-09-23T17:05:36.992022] [DEBUG] [LOCAL ] AFGC: Trimmed 3705 records to 2566 (keeping 200 days of data) [2025-09-23T17:05:37.004370] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-09-23T17:05:37.011429] [DEBUG] [LOCAL ] AFGC: Primary data saved (2566 records). [2025-09-23T17:05:37.011677] [INFO ] [MAIN ] AFGC: Full history saved. [2025-09-23T17:05:37.011869] [INFO ] [MAIN ] Update Progress: 48/2372 symbols completed. AFGC took 37.4s. Estimated remaining: 4h 29m 21s. Rate: 8.6 symbols/min [2025-09-23T17:05:37.153733] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-23T17:05:37.234879] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:05:37.301524] [DEBUG] [LOCAL ] AGCO: Loaded 42600 existing records from primary storage. [2025-09-23T17:05:37.301725] [INFO ] [MAIN ] AGCO: Loaded 42600 existing records. [2025-09-23T17:05:37.482326] [WARN ] [MAIN ] AGCO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:05:37.482599] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-09-23T17:05:37.482672] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-09-23T17:05:37.484055] [DEBUG] [LOCAL ] AGCO: Deleted primary data file. [2025-09-23T17:05:37.484118] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-09-23T17:05:37.810343] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-01. [2025-09-23T17:05:37.841853] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:05:38.602206] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-09-23T17:05:38.796734] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-23T17:05:38.889389] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-09-23T17:05:39.383603] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-23T17:05:39.402151] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-09-23T17:05:40.202191] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2024-12. [2025-09-23T17:05:41.002214] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-09-23T17:05:41.376784] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-23T17:05:41.592770] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-23T17:05:41.802223] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-09-23T17:05:42.552271] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-23T17:05:42.602147] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-09-23T17:05:43.402172] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-01. [2025-09-23T17:05:43.822794] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-23T17:05:44.161713] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-23T17:05:44.202152] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-09-23T17:05:44.618356] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-23T17:05:45.002196] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-09-23T17:05:45.670810] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-23T17:05:45.802196] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-06. [2025-09-23T17:05:46.112386] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-23T17:05:46.602207] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-09-23T17:05:47.279026] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-23T17:05:47.402218] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-07. [2025-09-23T17:05:47.925459] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-23T17:05:48.202287] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-09-23T17:05:48.636862] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-23T17:05:48.885412] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-23T17:05:49.002182] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-08. [2025-09-23T17:05:49.802201] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-09-23T17:05:50.172082] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-23T17:05:50.387123] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-23T17:05:50.602237] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-09-23T17:05:51.402241] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-04. [2025-09-23T17:05:51.959205] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-23T17:05:51.968531] [INFO ] [REMOTE ] AFL: Full fetch complete (76927 records). [2025-09-23T17:05:51.968752] [DEBUG] [VALIDATOR ] AFL: Validating primary data. [2025-09-23T17:05:52.207325] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-09-23T17:05:52.428916] [DEBUG] [VALIDATOR ] AFL: All expected trading days are present. [2025-09-23T17:05:52.429002] [DEBUG] [VALIDATOR ] AFL: Primary data validation passed. [2025-09-23T17:05:52.429721] [INFO ] [MAIN ] AFL: Fetched primary data is valid. [2025-09-23T17:05:52.429805] [DEBUG] [LOCAL ] AFL: Saving primary data. [2025-09-23T17:05:52.431464] [DEBUG] [LOCAL ] AFL: Trimmed 76927 records to 53146 (keeping 200 days of data) [2025-09-23T17:05:52.761422] [DEBUG] [LOCAL ] AFL: Primary data saved (53146 records). [2025-09-23T17:05:52.761564] [INFO ] [MAIN ] AFL: Full history saved. [2025-09-23T17:05:52.761675] [INFO ] [MAIN ] Update Progress: 49/2372 symbols completed. AFL took 25.8s. Estimated remaining: 4h 36m 11s. Rate: 8.4 symbols/min [2025-09-23T17:05:52.935306] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:05:52.935520] [DEBUG] [LOCAL ] AGD: No existing data file found in primary storage. [2025-09-23T17:05:52.935573] [WARN ] [MAIN ] AGD: No existing data found, performing full refresh instead. [2025-09-23T17:05:52.935759] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-09-23T17:05:52.935807] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-09-23T17:05:52.935849] [DEBUG] [LOCAL ] AGD: No primary data file found to delete. [2025-09-23T17:05:52.935882] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-09-23T17:05:53.009801] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-09-23T17:05:53.332873] [INFO ] [REMOTE ] AGD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:05:53.406030] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-23T17:05:53.448274] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-23T17:05:53.449415] [INFO ] [REMOTE ] AFGE: Full fetch complete (3490 records). [2025-09-23T17:05:53.449487] [DEBUG] [VALIDATOR ] AFGE: Validating primary data. [2025-09-23T17:05:53.802385] [INFO ] [REMOTE ] AGD: Fetching primary data for 2024-12. [2025-09-23T17:05:53.878117] [DEBUG] [VALIDATOR ] AFGE: All expected trading days are present. [2025-09-23T17:05:53.878263] [DEBUG] [VALIDATOR ] AFGE: Primary data validation passed. [2025-09-23T17:05:53.878412] [INFO ] [MAIN ] AFGE: Fetched primary data is valid. [2025-09-23T17:05:53.878492] [DEBUG] [LOCAL ] AFGE: Saving primary data. [2025-09-23T17:05:53.879257] [DEBUG] [LOCAL ] AFGE: Trimmed 3490 records to 2518 (keeping 200 days of data) [2025-09-23T17:05:53.895401] [DEBUG] [LOCAL ] AFGE: Primary data saved (2518 records). [2025-09-23T17:05:53.895550] [INFO ] [MAIN ] AFGE: Full history saved. [2025-09-23T17:05:53.895723] [INFO ] [MAIN ] Update Progress: 50/2372 symbols completed. AFGE took 40.0s. Estimated remaining: 4h 31m 25s. Rate: 8.6 symbols/min [2025-09-23T17:05:54.089196] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:05:54.120748] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-23T17:05:54.195363] [DEBUG] [LOCAL ] AGI: Loaded 53418 existing records from primary storage. [2025-09-23T17:05:54.195517] [INFO ] [MAIN ] AGI: Loaded 53418 existing records. [2025-09-23T17:05:54.402163] [WARN ] [MAIN ] AGI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:05:54.402400] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-09-23T17:05:54.402450] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-09-23T17:05:54.403839] [DEBUG] [LOCAL ] AGI: Deleted primary data file. [2025-09-23T17:05:54.403902] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-09-23T17:05:54.612257] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-09-23T17:05:54.743835] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-23T17:05:54.776599] [INFO ] [REMOTE ] AGI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:05:55.402204] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-01. [2025-09-23T17:05:55.800105] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-23T17:05:56.054592] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-23T17:05:56.202207] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-09-23T17:05:56.721221] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-23T17:05:57.002191] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-09-23T17:05:57.802157] [INFO ] [REMOTE ] AGI: Fetching primary data for 2024-12. [2025-09-23T17:05:57.954291] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-23T17:05:58.602223] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-09-23T17:05:59.129226] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-23T17:05:59.402200] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-01. [2025-09-23T17:05:59.635182] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-23T17:06:00.202243] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-09-23T17:06:00.962622] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-23T17:06:01.002190] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-09-23T17:06:01.596779] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-23T17:06:01.802208] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-09-23T17:06:02.001812] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-23T17:06:02.602232] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-09-23T17:06:03.402233] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-05. [2025-09-23T17:06:04.202191] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-09-23T17:06:04.367632] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (2.57 seconds). [2025-09-23T17:06:05.002193] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-09-23T17:06:05.354141] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (2.75 seconds). [2025-09-23T17:06:05.444363] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-23T17:06:05.511130] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-23T17:06:05.802210] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-06. [2025-09-23T17:06:06.378905] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-23T17:06:06.602228] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-09-23T17:06:07.402251] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-09-23T17:06:07.915756] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-23T17:06:07.923181] [INFO ] [REMOTE ] AGCO: Full fetch complete (62016 records). [2025-09-23T17:06:07.923351] [DEBUG] [VALIDATOR ] AGCO: Validating primary data. [2025-09-23T17:06:08.207184] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-09-23T17:06:08.215231] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-09-23T17:06:08.412997] [DEBUG] [VALIDATOR ] AGCO: All expected trading days are present. [2025-09-23T17:06:08.413086] [DEBUG] [VALIDATOR ] AGCO: Primary data validation passed. [2025-09-23T17:06:08.413702] [INFO ] [MAIN ] AGCO: Fetched primary data is valid. [2025-09-23T17:06:08.413766] [DEBUG] [LOCAL ] AGCO: Saving primary data. [2025-09-23T17:06:08.415278] [DEBUG] [LOCAL ] AGCO: Trimmed 62016 records to 42493 (keeping 200 days of data) [2025-09-23T17:06:08.678445] [DEBUG] [LOCAL ] AGCO: Primary data saved (42493 records). [2025-09-23T17:06:08.678602] [INFO ] [MAIN ] AGCO: Full history saved. [2025-09-23T17:06:08.679497] [INFO ] [MAIN ] Update Progress: 51/2372 symbols completed. AGCO took 31.7s. Estimated remaining: 4h 37m 12s. Rate: 8.4 symbols/min [2025-09-23T17:06:08.850664] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:06:08.914080] [DEBUG] [LOCAL ] AGL: Loaded 52417 existing records from primary storage. [2025-09-23T17:06:08.914265] [INFO ] [MAIN ] AGL: Loaded 52417 existing records. [2025-09-23T17:06:09.011299] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-07. [2025-09-23T17:06:09.112330] [WARN ] [MAIN ] AGL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:06:09.112810] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-09-23T17:06:09.112983] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-09-23T17:06:09.114334] [DEBUG] [LOCAL ] AGL: Deleted primary data file. [2025-09-23T17:06:09.114399] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-09-23T17:06:09.421639] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-23T17:06:09.467248] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-23T17:06:09.545723] [INFO ] [REMOTE ] AGL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:06:09.802272] [INFO ] [REMOTE ] AGL: Fetching primary data for 2024-12. [2025-09-23T17:06:10.602238] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-09-23T17:06:10.811556] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-23T17:06:11.046241] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-23T17:06:11.402235] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-01. [2025-09-23T17:06:12.202188] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-08. [2025-09-23T17:06:12.733331] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-23T17:06:12.854046] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-09-23T17:06:13.002193] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-09-23T17:06:13.802166] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-09-23T17:06:13.873569] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-23T17:06:14.117522] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-23T17:06:14.602168] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-09-23T17:06:14.759291] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-23T17:06:15.402180] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-09-23T17:06:15.761150] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-23T17:06:16.199957] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-23T17:06:16.204011] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-09-23T17:06:17.002213] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-09. [2025-09-23T17:06:17.649017] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-23T17:06:17.802207] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-09-23T17:06:18.602157] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-09-23T17:06:18.749591] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-23T17:06:18.754106] [INFO ] [REMOTE ] AGD: Full fetch complete (25307 records). [2025-09-23T17:06:18.754188] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-09-23T17:06:19.090862] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-23T17:06:19.158512] [INFO ] [REMOTE ] AG: Full fetch complete (77182 records). [2025-09-23T17:06:19.221126] [DEBUG] [VALIDATOR ] AGD: All expected trading days are present. [2025-09-23T17:06:19.220908] [DEBUG] [VALIDATOR ] AG: Validating primary data. [2025-09-23T17:06:19.221333] [DEBUG] [VALIDATOR ] AGD: Primary data validation passed. [2025-09-23T17:06:19.221790] [INFO ] [MAIN ] AGD: Fetched primary data is valid. [2025-09-23T17:06:19.222158] [DEBUG] [LOCAL ] AGD: Saving primary data. [2025-09-23T17:06:19.223411] [FATAL] [VALIDATOR ] AG: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:06:19.223973] [FATAL] [MAIN ] AG: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:06:19.223855] [DEBUG] [LOCAL ] AGD: Trimmed 25307 records to 17730 (keeping 200 days of data) [2025-09-23T17:06:19.224195] [WARN ] [MAIN ] AG: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:06:19.224637] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-09-23T17:06:19.224771] [DEBUG] [LOCAL ] AG: No primary data file found to delete. [2025-09-23T17:06:19.224817] [INFO ] [LOCAL ] AG: Starting deletion of derivative data. [2025-09-23T17:06:19.225700] [DEBUG] [LOCAL ] AG: Deleted derivative data file. [2025-09-23T17:06:19.225827] [INFO ] [MAIN ] Update Progress: 52/2372 symbols completed. AG took 45.0s. Estimated remaining: 4h 39m 36s. Rate: 8.3 symbols/min [2025-09-23T17:06:19.403768] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-09-23T17:06:19.517035] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:06:19.531930] [DEBUG] [LOCAL ] AGM: Loaded 9877 existing records from primary storage. [2025-09-23T17:06:19.532551] [INFO ] [MAIN ] AGM: Loaded 9877 existing records. [2025-09-23T17:06:19.732296] [WARN ] [MAIN ] AGM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:06:19.734122] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-09-23T17:06:19.734412] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-09-23T17:06:19.735541] [DEBUG] [LOCAL ] AGM: Deleted primary data file. [2025-09-23T17:06:19.736104] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-09-23T17:06:19.856533] [DEBUG] [LOCAL ] AGD: Primary data saved (17730 records). [2025-09-23T17:06:19.866945] [INFO ] [MAIN ] AGD: Full history saved. [2025-09-23T17:06:19.886131] [INFO ] [MAIN ] Update Progress: 53/2372 symbols completed. AGD took 27.1s. Estimated remaining: 4h 34m 41s. Rate: 8.4 symbols/min [2025-09-23T17:06:20.268357] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:06:20.304283] [INFO ] [REMOTE ] AGM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:06:20.304907] [INFO ] [REMOTE ] AGM: Fetching primary data for 2024-12. [2025-09-23T17:06:20.334471] [DEBUG] [LOCAL ] AGO: Loaded 28128 existing records from primary storage. [2025-09-23T17:06:20.334609] [INFO ] [MAIN ] AGO: Loaded 28128 existing records. [2025-09-23T17:06:20.556705] [WARN ] [MAIN ] AGO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:06:20.558803] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-23T17:06:20.558880] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-09-23T17:06:20.569361] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-09-23T17:06:20.571376] [DEBUG] [LOCAL ] AGO: Deleted primary data file. [2025-09-23T17:06:20.571487] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-09-23T17:06:20.948369] [INFO ] [REMOTE ] AGO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:06:20.971298] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-23T17:06:21.002193] [INFO ] [REMOTE ] AGO: Fetching primary data for 2024-12. [2025-09-23T17:06:21.238396] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-23T17:06:21.745516] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-23T17:06:21.802160] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-01. [2025-09-23T17:06:22.602219] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-01. [2025-09-23T17:06:22.723076] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-23T17:06:23.173565] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-23T17:06:23.402220] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-09-23T17:06:24.202232] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-09-23T17:06:24.291819] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-23T17:06:25.002247] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-09-23T17:06:25.802232] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-09-23T17:06:26.602259] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-09-23T17:06:26.789782] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-23T17:06:26.949594] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (2.75 seconds). [2025-09-23T17:06:27.402165] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-09-23T17:06:27.673791] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-23T17:06:28.202201] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-09-23T17:06:28.255211] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-23T17:06:28.651129] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-23T17:06:28.688485] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-23T17:06:29.002213] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-09-23T17:06:29.802205] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-09-23T17:06:30.299032] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-23T17:06:30.602186] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-09-23T17:06:30.718250] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-23T17:06:31.402248] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-09-23T17:06:31.733854] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-23T17:06:32.202230] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-09-23T17:06:32.893139] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-23T17:06:33.002197] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-09-23T17:06:33.802220] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-09-23T17:06:34.258511] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-23T17:06:34.273838] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-23T17:06:34.276743] [INFO ] [REMOTE ] AGI: Full fetch complete (76697 records). [2025-09-23T17:06:34.276873] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-09-23T17:06:34.607944] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-09-23T17:06:34.692208] [DEBUG] [VALIDATOR ] AGI: All expected trading days are present. [2025-09-23T17:06:34.692319] [DEBUG] [VALIDATOR ] AGI: Primary data validation passed. [2025-09-23T17:06:34.693190] [INFO ] [MAIN ] AGI: Fetched primary data is valid. [2025-09-23T17:06:34.693286] [DEBUG] [LOCAL ] AGI: Saving primary data. [2025-09-23T17:06:34.718216] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-23T17:06:34.727220] [DEBUG] [LOCAL ] AGI: Trimmed 76697 records to 53418 (keeping 200 days of data) [2025-09-23T17:06:34.728517] [INFO ] [REMOTE ] AGL: Full fetch complete (75410 records). [2025-09-23T17:06:34.728680] [DEBUG] [VALIDATOR ] AGL: Validating primary data. [2025-09-23T17:06:35.273734] [DEBUG] [VALIDATOR ] AGL: All expected trading days are present. [2025-09-23T17:06:35.274737] [DEBUG] [VALIDATOR ] AGL: Primary data validation passed. [2025-09-23T17:06:35.277004] [INFO ] [MAIN ] AGL: Fetched primary data is valid. [2025-09-23T17:06:35.277468] [DEBUG] [LOCAL ] AGL: Saving primary data. [2025-09-23T17:06:35.283118] [DEBUG] [LOCAL ] AGL: Trimmed 75410 records to 52423 (keeping 200 days of data) [2025-09-23T17:06:35.405889] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-09-23T17:06:35.787533] [DEBUG] [LOCAL ] AGL: Primary data saved (52423 records). [2025-09-23T17:06:35.788256] [INFO ] [MAIN ] AGL: Full history saved. [2025-09-23T17:06:35.792553] [INFO ] [MAIN ] Update Progress: 54/2372 symbols completed. AGL took 27.1s. Estimated remaining: 4h 40m 51s. Rate: 8.3 symbols/min [2025-09-23T17:06:35.995188] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:06:36.008479] [DEBUG] [LOCAL ] AGI: Primary data saved (53418 records). [2025-09-23T17:06:36.008745] [INFO ] [MAIN ] AGI: Full history saved. [2025-09-23T17:06:36.010813] [INFO ] [MAIN ] Update Progress: 55/2372 symbols completed. AGI took 42.1s. Estimated remaining: 4h 35m 47s. Rate: 8.4 symbols/min [2025-09-23T17:06:36.188863] [DEBUG] [LOCAL ] AGRO: Loaded 33821 existing records from primary storage. [2025-09-23T17:06:36.214189] [INFO ] [MAIN ] AGRO: Loaded 33821 existing records. [2025-09-23T17:06:36.218186] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:06:36.218671] [DEBUG] [LOCAL ] AGX: No existing data file found in primary storage. [2025-09-23T17:06:36.224018] [WARN ] [MAIN ] AGX: No existing data found, performing full refresh instead. [2025-09-23T17:06:36.255924] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-09-23T17:06:36.261274] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-09-23T17:06:36.298762] [DEBUG] [LOCAL ] AGX: No primary data file found to delete. [2025-09-23T17:06:36.334384] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-09-23T17:06:36.341703] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-23T17:06:36.348545] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-09-23T17:06:36.521416] [WARN ] [MAIN ] AGRO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:06:36.545966] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-09-23T17:06:36.551697] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-09-23T17:06:36.587794] [DEBUG] [LOCAL ] AGRO: Deleted primary data file. [2025-09-23T17:06:36.587989] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-09-23T17:06:36.863467] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-23T17:06:37.011859] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-09-23T17:06:37.105164] [INFO ] [REMOTE ] AGX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:06:37.265780] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:06:37.759400] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-23T17:06:37.802140] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-09-23T17:06:38.182037] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-23T17:06:38.602197] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-09-23T17:06:39.369372] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-23T17:06:39.402275] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-09-23T17:06:39.588111] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-23T17:06:39.982570] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-23T17:06:39.986138] [INFO ] [REMOTE ] AGM: Full fetch complete (12522 records). [2025-09-23T17:06:39.986260] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-09-23T17:06:40.207529] [INFO ] [REMOTE ] AGX: Fetching primary data for 2024-12. [2025-09-23T17:06:40.402152] [DEBUG] [VALIDATOR ] AGM: All expected trading days are present. [2025-09-23T17:06:40.402241] [DEBUG] [VALIDATOR ] AGM: Primary data validation passed. [2025-09-23T17:06:40.402503] [INFO ] [MAIN ] AGM: Fetched primary data is valid. [2025-09-23T17:06:40.402576] [DEBUG] [LOCAL ] AGM: Saving primary data. [2025-09-23T17:06:40.403569] [DEBUG] [LOCAL ] AGM: Trimmed 12522 records to 9921 (keeping 200 days of data) [2025-09-23T17:06:40.477824] [DEBUG] [LOCAL ] AGM: Primary data saved (9921 records). [2025-09-23T17:06:40.478183] [INFO ] [MAIN ] AGM: Full history saved. [2025-09-23T17:06:40.478621] [INFO ] [MAIN ] Update Progress: 56/2372 symbols completed. AGM took 21.3s. Estimated remaining: 4h 33m 49s. Rate: 8.5 symbols/min [2025-09-23T17:06:40.662061] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:06:40.714808] [DEBUG] [LOCAL ] AHH: Loaded 41463 existing records from primary storage. [2025-09-23T17:06:40.715021] [INFO ] [MAIN ] AHH: Loaded 41463 existing records. [2025-09-23T17:06:40.893459] [WARN ] [MAIN ] AHH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:06:40.893791] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-09-23T17:06:40.893868] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-09-23T17:06:40.894967] [DEBUG] [LOCAL ] AHH: Deleted primary data file. [2025-09-23T17:06:40.895030] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-09-23T17:06:41.004844] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2024-12. [2025-09-23T17:06:41.309784] [INFO ] [REMOTE ] AHH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:06:41.513807] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-23T17:06:41.802214] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-01. [2025-09-23T17:06:42.431341] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-23T17:06:42.602212] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-01. [2025-09-23T17:06:43.021203] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-23T17:06:43.402199] [INFO ] [REMOTE ] AHH: Fetching primary data for 2024-12. [2025-09-23T17:06:43.588061] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-23T17:06:44.202275] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-09-23T17:06:44.619681] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-23T17:06:45.002280] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-09-23T17:06:45.757988] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-23T17:06:45.802232] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-09-23T17:06:46.602217] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-01. [2025-09-23T17:06:46.892591] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-23T17:06:46.925960] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-23T17:06:47.402207] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-09-23T17:06:47.598365] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-23T17:06:48.202199] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-09-23T17:06:48.346487] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-23T17:06:48.353597] [INFO ] [REMOTE ] AGO: Full fetch complete (39291 records). [2025-09-23T17:06:48.353810] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-09-23T17:06:48.739210] [DEBUG] [VALIDATOR ] AGO: All expected trading days are present. [2025-09-23T17:06:48.739287] [DEBUG] [VALIDATOR ] AGO: Primary data validation passed. [2025-09-23T17:06:48.739728] [INFO ] [MAIN ] AGO: Fetched primary data is valid. [2025-09-23T17:06:48.739820] [DEBUG] [LOCAL ] AGO: Saving primary data. [2025-09-23T17:06:48.740758] [DEBUG] [LOCAL ] AGO: Trimmed 39291 records to 28103 (keeping 200 days of data) [2025-09-23T17:06:48.940879] [DEBUG] [LOCAL ] AGO: Primary data saved (28103 records). [2025-09-23T17:06:48.941086] [INFO ] [MAIN ] AGO: Full history saved. [2025-09-23T17:06:48.941295] [INFO ] [MAIN ] Update Progress: 57/2372 symbols completed. AGO took 29.0s. Estimated remaining: 4h 34m 38s. Rate: 8.4 symbols/min [2025-09-23T17:06:49.008009] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-09-23T17:06:49.134566] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:06:49.134902] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-09-23T17:06:49.135043] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-09-23T17:06:49.135325] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-09-23T17:06:49.135473] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-09-23T17:06:49.135597] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-09-23T17:06:49.135707] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-09-23T17:06:49.486412] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-23T17:06:49.539799] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:06:49.802225] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-09-23T17:06:50.352203] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-23T17:06:50.602166] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-09-23T17:06:51.413802] [INFO ] [REMOTE ] AHL: Fetching primary data for 2024-12. [2025-09-23T17:06:51.416417] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-23T17:06:51.583094] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-23T17:06:51.622910] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:06:51.623216] [WARN ] [REMOTE ] AHL: No data returned for month 2024-12 [2025-09-23T17:06:52.202264] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-09-23T17:06:53.002236] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-09-23T17:06:53.261699] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-23T17:06:53.802210] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-01. [2025-09-23T17:06:54.036510] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:06:54.036905] [WARN ] [REMOTE ] AHL: No data returned for month 2025-01 [2025-09-23T17:06:54.337626] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-23T17:06:54.602207] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-09-23T17:06:55.402226] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-09-23T17:06:56.111372] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-23T17:06:56.202198] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-09-23T17:06:56.393271] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-23T17:06:57.002228] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-09-23T17:06:57.568900] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-23T17:06:57.802193] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-09-23T17:06:58.309361] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-23T17:06:58.602196] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-02. [2025-09-23T17:06:58.818711] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:06:58.820217] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-23T17:06:58.828275] [WARN ] [REMOTE ] AHL: No data returned for month 2025-02 [2025-09-23T17:06:59.402203] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-09-23T17:07:00.211920] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-09-23T17:07:00.214396] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-23T17:07:01.002212] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-03. [2025-09-23T17:07:01.229293] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:07:01.229613] [WARN ] [REMOTE ] AHL: No data returned for month 2025-03 [2025-09-23T17:07:01.313514] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-23T17:07:01.802195] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-09-23T17:07:02.602237] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-04. [2025-09-23T17:07:03.141419] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:07:03.141837] [WARN ] [REMOTE ] AHL: No data returned for month 2025-04 [2025-09-23T17:07:03.173175] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-23T17:07:03.178980] [INFO ] [REMOTE ] AGX: Full fetch complete (49004 records). [2025-09-23T17:07:03.179088] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-09-23T17:07:03.407767] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-09-23T17:07:03.578428] [DEBUG] [VALIDATOR ] AGX: All expected trading days are present. [2025-09-23T17:07:03.578571] [DEBUG] [VALIDATOR ] AGX: Primary data validation passed. [2025-09-23T17:07:03.579128] [INFO ] [MAIN ] AGX: Fetched primary data is valid. [2025-09-23T17:07:03.579191] [DEBUG] [LOCAL ] AGX: Saving primary data. [2025-09-23T17:07:03.583531] [DEBUG] [LOCAL ] AGX: Trimmed 49004 records to 33512 (keeping 200 days of data) [2025-09-23T17:07:03.808594] [DEBUG] [LOCAL ] AGX: Primary data saved (33512 records). [2025-09-23T17:07:03.808787] [INFO ] [MAIN ] AGX: Full history saved. [2025-09-23T17:07:03.808941] [INFO ] [MAIN ] Update Progress: 58/2372 symbols completed. AGX took 27.8s. Estimated remaining: 4h 39m 40s. Rate: 8.3 symbols/min [2025-09-23T17:07:03.982001] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:07:04.038173] [DEBUG] [LOCAL ] AHR: Loaded 49322 existing records from primary storage. [2025-09-23T17:07:04.038342] [INFO ] [MAIN ] AHR: Loaded 49322 existing records. [2025-09-23T17:07:04.211763] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-05. [2025-09-23T17:07:04.216735] [WARN ] [MAIN ] AHR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:07:04.218034] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-09-23T17:07:04.218091] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-09-23T17:07:04.219451] [DEBUG] [LOCAL ] AHR: Deleted primary data file. [2025-09-23T17:07:04.219516] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-09-23T17:07:04.585841] [INFO ] [REMOTE ] AHR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:07:04.931704] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-23T17:07:05.002200] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-09-23T17:07:05.025931] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-23T17:07:05.802239] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-06. [2025-09-23T17:07:06.093802] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-23T17:07:06.474497] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-23T17:07:06.602198] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-07. [2025-09-23T17:07:07.182348] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-23T17:07:07.402194] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-08. [2025-09-23T17:07:08.202206] [INFO ] [REMOTE ] AHR: Fetching primary data for 2024-12. [2025-09-23T17:07:08.272956] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-23T17:07:09.002201] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-09-23T17:07:09.587828] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-23T17:07:09.802199] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-09. [2025-09-23T17:07:10.468404] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-23T17:07:10.602174] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-09-23T17:07:10.914257] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-23T17:07:10.920495] [INFO ] [REMOTE ] AHL: Full fetch complete (17265 records). [2025-09-23T17:07:10.920573] [DEBUG] [VALIDATOR ] AHL: Validating primary data. [2025-09-23T17:07:11.107709] [WARN ] [VALIDATOR ] AHL: Validation failed - insufficient historical data. Have 95 unique days, need 200 days [2025-09-23T17:07:11.108068] [FATAL] [MAIN ] AHL: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:07:11.108152] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:07:11.108227] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-09-23T17:07:11.108295] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-09-23T17:07:11.108344] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-09-23T17:07:11.108424] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-09-23T17:07:11.108507] [INFO ] [MAIN ] Update Progress: 59/2372 symbols completed. AHL took 22.2s. Estimated remaining: 4h 39m 35s. Rate: 8.3 symbols/min [2025-09-23T17:07:11.274522] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:07:11.274733] [DEBUG] [LOCAL ] AHT: No existing data file found in primary storage. [2025-09-23T17:07:11.274787] [WARN ] [MAIN ] AHT: No existing data found, performing full refresh instead. [2025-09-23T17:07:11.274960] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-09-23T17:07:11.275020] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-09-23T17:07:11.275064] [DEBUG] [LOCAL ] AHT: No primary data file found to delete. [2025-09-23T17:07:11.275096] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-09-23T17:07:11.416631] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-01. [2025-09-23T17:07:11.639551] [INFO ] [REMOTE ] AHT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:07:11.734380] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-23T17:07:12.202197] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-09-23T17:07:12.690679] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-23T17:07:13.002209] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-02. [2025-09-23T17:07:13.488831] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-23T17:07:13.494503] [INFO ] [REMOTE ] AGRO: Full fetch complete (49918 records). [2025-09-23T17:07:13.494628] [DEBUG] [VALIDATOR ] AGRO: Validating primary data. [2025-09-23T17:07:13.804315] [INFO ] [REMOTE ] AHT: Fetching primary data for 2024-12. [2025-09-23T17:07:13.896735] [DEBUG] [VALIDATOR ] AGRO: All expected trading days are present. [2025-09-23T17:07:13.896829] [DEBUG] [VALIDATOR ] AGRO: Primary data validation passed. [2025-09-23T17:07:13.897428] [INFO ] [MAIN ] AGRO: Fetched primary data is valid. [2025-09-23T17:07:13.897513] [DEBUG] [LOCAL ] AGRO: Saving primary data. [2025-09-23T17:07:13.899747] [DEBUG] [LOCAL ] AGRO: Trimmed 49918 records to 33795 (keeping 200 days of data) [2025-09-23T17:07:14.118846] [DEBUG] [LOCAL ] AGRO: Primary data saved (33795 records). [2025-09-23T17:07:14.118996] [INFO ] [MAIN ] AGRO: Full history saved. [2025-09-23T17:07:14.119122] [INFO ] [MAIN ] Update Progress: 60/2372 symbols completed. AGRO took 38.3s. Estimated remaining: 4h 36m 44s. Rate: 8.4 symbols/min [2025-09-23T17:07:14.332569] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-23T17:07:14.336327] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:07:14.408433] [DEBUG] [LOCAL ] AI: Loaded 53749 existing records from primary storage. [2025-09-23T17:07:14.408659] [INFO ] [MAIN ] AI: Loaded 53749 existing records. [2025-09-23T17:07:14.561480] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-23T17:07:14.612356] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-01. [2025-09-23T17:07:14.619363] [WARN ] [MAIN ] AI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:07:14.620221] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-09-23T17:07:14.620275] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-09-23T17:07:14.621778] [DEBUG] [LOCAL ] AI: Deleted primary data file. [2025-09-23T17:07:14.621841] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-09-23T17:07:14.970631] [INFO ] [REMOTE ] AI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:07:15.111893] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-23T17:07:15.402209] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-09-23T17:07:16.095520] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-23T17:07:16.202244] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-03. [2025-09-23T17:07:17.002215] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-09-23T17:07:17.372195] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-23T17:07:17.804797] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-09-23T17:07:17.814740] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-23T17:07:18.463989] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-23T17:07:18.602216] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-09-23T17:07:19.402218] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-09-23T17:07:20.166714] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-23T17:07:20.192634] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-23T17:07:20.202116] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-09-23T17:07:21.002259] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-04. [2025-09-23T17:07:21.276888] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-23T17:07:21.802219] [INFO ] [REMOTE ] AI: Fetching primary data for 2024-12. [2025-09-23T17:07:22.602178] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-09-23T17:07:22.863541] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-23T17:07:23.402290] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-09-23T17:07:23.746287] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-23T17:07:23.752910] [INFO ] [REMOTE ] AHH: Full fetch complete (60367 records). [2025-09-23T17:07:23.753070] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-09-23T17:07:23.930012] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-23T17:07:24.159192] [DEBUG] [VALIDATOR ] AHH: All expected trading days are present. [2025-09-23T17:07:24.159341] [DEBUG] [VALIDATOR ] AHH: Primary data validation passed. [2025-09-23T17:07:24.160260] [INFO ] [MAIN ] AHH: Fetched primary data is valid. [2025-09-23T17:07:24.160350] [DEBUG] [LOCAL ] AHH: Saving primary data. [2025-09-23T17:07:24.162721] [DEBUG] [LOCAL ] AHH: Trimmed 60367 records to 41438 (keeping 200 days of data) [2025-09-23T17:07:24.222459] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-05. [2025-09-23T17:07:24.300171] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2024-12 (2.50 seconds). [2025-09-23T17:07:24.461080] [DEBUG] [LOCAL ] AHH: Primary data saved (41438 records). [2025-09-23T17:07:24.461218] [INFO ] [MAIN ] AHH: Full history saved. [2025-09-23T17:07:24.461302] [INFO ] [MAIN ] Update Progress: 61/2372 symbols completed. AHH took 44.0s. Estimated remaining: 4h 38m 36s. Rate: 8.3 symbols/min [2025-09-23T17:07:24.630181] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:07:24.682589] [DEBUG] [LOCAL ] AIG: Loaded 53478 existing records from primary storage. [2025-09-23T17:07:24.682772] [INFO ] [MAIN ] AIG: Loaded 53478 existing records. [2025-09-23T17:07:24.864569] [WARN ] [MAIN ] AIG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:07:24.864916] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-09-23T17:07:24.864975] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-09-23T17:07:24.866520] [DEBUG] [LOCAL ] AIG: Deleted primary data file. [2025-09-23T17:07:24.866583] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-09-23T17:07:25.007353] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-01. [2025-09-23T17:07:25.233749] [INFO ] [REMOTE ] AIG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:07:25.494794] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-23T17:07:25.802269] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-06. [2025-09-23T17:07:26.602194] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-09-23T17:07:27.107227] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-23T17:07:27.190588] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-23T17:07:27.402179] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-09-23T17:07:27.479849] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-01 (2.47 seconds). [2025-09-23T17:07:27.956006] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-23T17:07:28.202228] [INFO ] [REMOTE ] AIG: Fetching primary data for 2024-12. [2025-09-23T17:07:29.002200] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-09-23T17:07:29.395085] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-23T17:07:29.802196] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-01. [2025-09-23T17:07:30.602221] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-07. [2025-09-23T17:07:31.177471] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-23T17:07:31.316881] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-23T17:07:31.402157] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-09-23T17:07:31.921302] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-23T17:07:32.202206] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-08. [2025-09-23T17:07:32.747805] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-23T17:07:33.002259] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-09-23T17:07:33.546740] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-23T17:07:33.548893] [INFO ] [REMOTE ] AHT: Full fetch complete (9501 records). [2025-09-23T17:07:33.549000] [DEBUG] [VALIDATOR ] AHT: Validating primary data. [2025-09-23T17:07:33.810033] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-09-23T17:07:33.955237] [DEBUG] [VALIDATOR ] AHT: All expected trading days are present. [2025-09-23T17:07:33.955441] [DEBUG] [VALIDATOR ] AHT: Primary data validation passed. [2025-09-23T17:07:33.955781] [INFO ] [MAIN ] AHT: Fetched primary data is valid. [2025-09-23T17:07:33.955922] [DEBUG] [LOCAL ] AHT: Saving primary data. [2025-09-23T17:07:33.987765] [DEBUG] [LOCAL ] AHT: Trimmed 9501 records to 6041 (keeping 200 days of data) [2025-09-23T17:07:34.004989] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-23T17:07:34.039807] [DEBUG] [LOCAL ] AHT: Primary data saved (6041 records). [2025-09-23T17:07:34.039997] [INFO ] [MAIN ] AHT: Full history saved. [2025-09-23T17:07:34.040094] [INFO ] [MAIN ] Update Progress: 62/2372 symbols completed. AHT took 22.9s. Estimated remaining: 4h 39m 57s. Rate: 8.3 symbols/min [2025-09-23T17:07:34.220437] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:07:34.220739] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-09-23T17:07:34.220789] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-09-23T17:07:34.220951] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-09-23T17:07:34.220993] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-09-23T17:07:34.221035] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-09-23T17:07:34.221125] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-09-23T17:07:34.587942] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:07:34.602145] [INFO ] [REMOTE ] AII: Fetching primary data for 2024-12. [2025-09-23T17:07:34.790532] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:07:34.790950] [WARN ] [REMOTE ] AII: No data returned for month 2024-12 [2025-09-23T17:07:35.316634] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-23T17:07:35.402254] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-09-23T17:07:36.202224] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-01. [2025-09-23T17:07:36.446812] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:07:36.447085] [WARN ] [REMOTE ] AII: No data returned for month 2025-01 [2025-09-23T17:07:36.936996] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-23T17:07:37.002233] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-09-23T17:07:37.802240] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-09. [2025-09-23T17:07:38.602278] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-02. [2025-09-23T17:07:38.830061] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:07:38.830742] [WARN ] [REMOTE ] AII: No data returned for month 2025-02 [2025-09-23T17:07:39.017089] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-23T17:07:39.028144] [INFO ] [REMOTE ] AHR: Full fetch complete (71039 records). [2025-09-23T17:07:39.028538] [DEBUG] [VALIDATOR ] AHR: Validating primary data. [2025-09-23T17:07:39.376249] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-09-23T17:07:39.405464] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-03. [2025-09-23T17:07:39.581117] [DEBUG] [VALIDATOR ] AHR: All expected trading days are present. [2025-09-23T17:07:39.581256] [DEBUG] [VALIDATOR ] AHR: Primary data validation passed. [2025-09-23T17:07:39.582129] [INFO ] [MAIN ] AHR: Fetched primary data is valid. [2025-09-23T17:07:39.582196] [DEBUG] [LOCAL ] AHR: Saving primary data. [2025-09-23T17:07:39.584169] [DEBUG] [LOCAL ] AHR: Trimmed 71039 records to 49330 (keeping 200 days of data) [2025-09-23T17:07:39.711714] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:07:39.714707] [WARN ] [REMOTE ] AII: No data returned for month 2025-03 [2025-09-23T17:07:39.900131] [DEBUG] [LOCAL ] AHR: Primary data saved (49330 records). [2025-09-23T17:07:39.900349] [INFO ] [MAIN ] AHR: Full history saved. [2025-09-23T17:07:39.901221] [INFO ] [MAIN ] Update Progress: 63/2372 symbols completed. AHR took 36.1s. Estimated remaining: 4h 38m 58s. Rate: 8.3 symbols/min [2025-09-23T17:07:40.082393] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:07:40.112584] [DEBUG] [LOCAL ] AIN: Loaded 24581 existing records from primary storage. [2025-09-23T17:07:40.112845] [INFO ] [MAIN ] AIN: Loaded 24581 existing records. [2025-09-23T17:07:40.207421] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-09-23T17:07:40.310976] [WARN ] [MAIN ] AIN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:07:40.311435] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-09-23T17:07:40.311492] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-09-23T17:07:40.312516] [DEBUG] [LOCAL ] AIN: Deleted primary data file. [2025-09-23T17:07:40.312583] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-09-23T17:07:40.685355] [INFO ] [REMOTE ] AIN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:07:41.002214] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-04. [2025-09-23T17:07:41.206160] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:07:41.206525] [WARN ] [REMOTE ] AII: No data returned for month 2025-04 [2025-09-23T17:07:41.802242] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-05. [2025-09-23T17:07:42.412507] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-23T17:07:42.569100] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-09-23T17:07:42.602189] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-09-23T17:07:43.402211] [INFO ] [REMOTE ] AIN: Fetching primary data for 2024-12. [2025-09-23T17:07:44.202219] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-06. [2025-09-23T17:07:44.291033] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-23T17:07:44.616698] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-23T17:07:44.869122] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-23T17:07:45.002201] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-07. [2025-09-23T17:07:45.484824] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-23T17:07:45.802195] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-08. [2025-09-23T17:07:46.322540] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-23T17:07:46.602241] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-06. [2025-09-23T17:07:47.402207] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-01. [2025-09-23T17:07:48.083111] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-23T17:07:48.202207] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-02. [2025-09-23T17:07:48.554158] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-23T17:07:48.824023] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-23T17:07:49.002183] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-03. [2025-09-23T17:07:49.802243] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-07. [2025-09-23T17:07:49.856355] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-23T17:07:50.602195] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-04. [2025-09-23T17:07:51.402204] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-09-23T17:07:51.771781] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-23T17:07:52.072390] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-09-23T17:07:52.202222] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-05. [2025-09-23T17:07:53.002212] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-08. [2025-09-23T17:07:53.055237] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-23T17:07:53.101319] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-23T17:07:53.802246] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-06. [2025-09-23T17:07:54.602208] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-09. [2025-09-23T17:07:55.056876] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-23T17:07:55.269223] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-09-23T17:07:55.402209] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-09-23T17:07:55.476608] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-23T17:07:55.480055] [INFO ] [REMOTE ] AII: Full fetch complete (10403 records). [2025-09-23T17:07:55.480128] [DEBUG] [VALIDATOR ] AII: Validating primary data. [2025-09-23T17:07:55.660825] [WARN ] [VALIDATOR ] AII: Validation failed - insufficient historical data. Have 95 unique days, need 200 days [2025-09-23T17:07:55.661082] [FATAL] [MAIN ] AII: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:07:55.661149] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:07:55.661220] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-09-23T17:07:55.661284] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-09-23T17:07:55.661319] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-09-23T17:07:55.661358] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-09-23T17:07:55.661415] [INFO ] [MAIN ] Update Progress: 64/2372 symbols completed. AII took 21.6s. Estimated remaining: 4h 43m 57s. Rate: 8.1 symbols/min [2025-09-23T17:07:55.838742] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:07:55.859195] [DEBUG] [LOCAL ] AIO: Loaded 13283 existing records from primary storage. [2025-09-23T17:07:55.859344] [INFO ] [MAIN ] AIO: Loaded 13283 existing records. [2025-09-23T17:07:56.052168] [WARN ] [MAIN ] AIO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:07:56.052427] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-09-23T17:07:56.052474] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-09-23T17:07:56.052962] [DEBUG] [LOCAL ] AIO: Deleted primary data file. [2025-09-23T17:07:56.053022] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-09-23T17:07:56.212329] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-07. [2025-09-23T17:07:56.430639] [INFO ] [REMOTE ] AIO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:07:57.002216] [INFO ] [REMOTE ] AIO: Fetching primary data for 2024-12. [2025-09-23T17:07:57.115800] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-23T17:07:57.739501] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-23T17:07:57.802180] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-01. [2025-09-23T17:07:57.870272] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-09-23T17:07:57.879371] [INFO ] [REMOTE ] AI: Full fetch complete (77896 records). [2025-09-23T17:07:57.879530] [DEBUG] [VALIDATOR ] AI: Validating primary data. [2025-09-23T17:07:58.279970] [DEBUG] [VALIDATOR ] AI: All expected trading days are present. [2025-09-23T17:07:58.280048] [DEBUG] [VALIDATOR ] AI: Primary data validation passed. [2025-09-23T17:07:58.280777] [INFO ] [MAIN ] AI: Fetched primary data is valid. [2025-09-23T17:07:58.280840] [DEBUG] [LOCAL ] AI: Saving primary data. [2025-09-23T17:07:58.282366] [DEBUG] [LOCAL ] AI: Trimmed 77896 records to 53749 (keeping 200 days of data) [2025-09-23T17:07:58.413944] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-23T17:07:58.602737] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-09-23T17:07:58.625037] [DEBUG] [LOCAL ] AI: Primary data saved (53749 records). [2025-09-23T17:07:58.625220] [INFO ] [MAIN ] AI: Full history saved. [2025-09-23T17:07:58.625322] [INFO ] [MAIN ] Update Progress: 65/2372 symbols completed. AI took 44.5s. Estimated remaining: 4h 41m 13s. Rate: 8.2 symbols/min [2025-09-23T17:07:58.794222] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:07:58.821918] [DEBUG] [LOCAL ] AIR: Loaded 27260 existing records from primary storage. [2025-09-23T17:07:58.822080] [INFO ] [MAIN ] AIR: Loaded 27260 existing records. [2025-09-23T17:07:58.996477] [WARN ] [MAIN ] AIR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:07:58.996788] [INFO ] [MAIN ] AIR: Wiping existing primary data before full refresh. [2025-09-23T17:07:58.996841] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-09-23T17:07:58.997620] [DEBUG] [LOCAL ] AIR: Deleted primary data file. [2025-09-23T17:07:58.997727] [INFO ] [MAIN ] AIR: Starting full primary refresh. [2025-09-23T17:07:59.355454] [INFO ] [REMOTE ] AIR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:07:59.402158] [INFO ] [REMOTE ] AIR: Fetching primary data for 2024-12. [2025-09-23T17:08:00.202184] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-08. [2025-09-23T17:08:00.371454] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-23T17:08:00.500530] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-23T17:08:01.002203] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-02. [2025-09-23T17:08:01.105800] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-23T17:08:01.560587] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-23T17:08:01.802242] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-03. [2025-09-23T17:08:02.396378] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-23T17:08:02.602193] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-04. [2025-09-23T17:08:03.210235] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-23T17:08:03.402229] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-05. [2025-09-23T17:08:03.899713] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-23T17:08:04.202199] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-09. [2025-09-23T17:08:05.002248] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-09-23T17:08:05.075350] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-23T17:08:05.079514] [INFO ] [REMOTE ] AIN: Full fetch complete (33249 records). [2025-09-23T17:08:05.079605] [DEBUG] [VALIDATOR ] AIN: Validating primary data. [2025-09-23T17:08:05.469309] [DEBUG] [VALIDATOR ] AIN: All expected trading days are present. [2025-09-23T17:08:05.469433] [DEBUG] [VALIDATOR ] AIN: Primary data validation passed. [2025-09-23T17:08:05.469875] [INFO ] [MAIN ] AIN: Fetched primary data is valid. [2025-09-23T17:08:05.469937] [DEBUG] [LOCAL ] AIN: Saving primary data. [2025-09-23T17:08:05.470786] [DEBUG] [LOCAL ] AIN: Trimmed 33249 records to 24626 (keeping 200 days of data) [2025-09-23T17:08:05.626443] [DEBUG] [LOCAL ] AIN: Primary data saved (24626 records). [2025-09-23T17:08:05.626576] [INFO ] [MAIN ] AIN: Full history saved. [2025-09-23T17:08:05.626677] [INFO ] [MAIN ] Update Progress: 66/2372 symbols completed. AIN took 25.7s. Estimated remaining: 4h 40m 55s. Rate: 8.2 symbols/min [2025-09-23T17:08:05.800036] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:08:05.800234] [DEBUG] [LOCAL ] AIT: No existing data file found in primary storage. [2025-09-23T17:08:05.800272] [WARN ] [MAIN ] AIT: No existing data found, performing full refresh instead. [2025-09-23T17:08:05.800464] [INFO ] [MAIN ] AIT: Wiping existing primary data before full refresh. [2025-09-23T17:08:05.800513] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-09-23T17:08:05.800556] [DEBUG] [LOCAL ] AIT: No primary data file found to delete. [2025-09-23T17:08:05.800591] [INFO ] [MAIN ] AIT: Starting full primary refresh. [2025-09-23T17:08:05.811930] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-06. [2025-09-23T17:08:06.162126] [INFO ] [REMOTE ] AIT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:08:06.449565] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-23T17:08:06.602155] [INFO ] [REMOTE ] AIT: Fetching primary data for 2024-12. [2025-09-23T17:08:06.694483] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-23T17:08:07.402191] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-07. [2025-09-23T17:08:07.608364] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-23T17:08:08.016039] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-23T17:08:08.202202] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-01. [2025-09-23T17:08:09.002224] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-01. [2025-09-23T17:08:09.033297] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-23T17:08:09.802199] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-02. [2025-09-23T17:08:09.978146] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-23T17:08:10.602200] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-08. [2025-09-23T17:08:10.717885] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-23T17:08:11.082714] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-23T17:08:11.402205] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-02. [2025-09-23T17:08:12.202203] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-09. [2025-09-23T17:08:12.559507] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-23T17:08:12.809314] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-23T17:08:12.811900] [INFO ] [REMOTE ] AIO: Full fetch complete (20060 records). [2025-09-23T17:08:12.811979] [DEBUG] [VALIDATOR ] AIO: Validating primary data. [2025-09-23T17:08:13.021501] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-03. [2025-09-23T17:08:13.231284] [DEBUG] [VALIDATOR ] AIO: All expected trading days are present. [2025-09-23T17:08:13.231367] [DEBUG] [VALIDATOR ] AIO: Primary data validation passed. [2025-09-23T17:08:13.231636] [INFO ] [MAIN ] AIO: Fetched primary data is valid. [2025-09-23T17:08:13.231716] [DEBUG] [LOCAL ] AIO: Saving primary data. [2025-09-23T17:08:13.232315] [DEBUG] [LOCAL ] AIO: Trimmed 20060 records to 13260 (keeping 200 days of data) [2025-09-23T17:08:13.314455] [DEBUG] [LOCAL ] AIO: Primary data saved (13260 records). [2025-09-23T17:08:13.314611] [INFO ] [MAIN ] AIO: Full history saved. [2025-09-23T17:08:13.314730] [INFO ] [MAIN ] Update Progress: 67/2372 symbols completed. AIO took 17.7s. Estimated remaining: 4h 41m 1s. Rate: 8.2 symbols/min [2025-09-23T17:08:13.483204] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:08:13.525485] [DEBUG] [LOCAL ] AIV: Loaded 40199 existing records from primary storage. [2025-09-23T17:08:13.525669] [INFO ] [MAIN ] AIV: Loaded 40199 existing records. [2025-09-23T17:08:13.703523] [WARN ] [MAIN ] AIV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:08:13.703896] [INFO ] [MAIN ] AIV: Wiping existing primary data before full refresh. [2025-09-23T17:08:13.703956] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-09-23T17:08:13.705026] [DEBUG] [LOCAL ] AIV: Deleted primary data file. [2025-09-23T17:08:13.705088] [INFO ] [MAIN ] AIV: Starting full primary refresh. [2025-09-23T17:08:13.805946] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-09-23T17:08:14.079980] [INFO ] [REMOTE ] AIV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:08:14.098883] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-23T17:08:14.602234] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-04. [2025-09-23T17:08:15.287513] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-23T17:08:15.402190] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-09-23T17:08:15.490976] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-23T17:08:16.202239] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-05. [2025-09-23T17:08:16.899096] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-23T17:08:16.908124] [INFO ] [REMOTE ] AIG: Full fetch complete (77372 records). [2025-09-23T17:08:16.908288] [DEBUG] [VALIDATOR ] AIG: Validating primary data. [2025-09-23T17:08:17.012462] [INFO ] [REMOTE ] AIV: Fetching primary data for 2024-12. [2025-09-23T17:08:17.226523] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-23T17:08:17.331897] [DEBUG] [VALIDATOR ] AIG: All expected trading days are present. [2025-09-23T17:08:17.331994] [DEBUG] [VALIDATOR ] AIG: Primary data validation passed. [2025-09-23T17:08:17.332741] [INFO ] [MAIN ] AIG: Fetched primary data is valid. [2025-09-23T17:08:17.332808] [DEBUG] [LOCAL ] AIG: Saving primary data. [2025-09-23T17:08:17.334419] [DEBUG] [LOCAL ] AIG: Trimmed 77372 records to 53475 (keeping 200 days of data) [2025-09-23T17:08:17.677699] [DEBUG] [LOCAL ] AIG: Primary data saved (53475 records). [2025-09-23T17:08:17.677953] [INFO ] [MAIN ] AIG: Full history saved. [2025-09-23T17:08:17.678056] [INFO ] [MAIN ] Update Progress: 68/2372 symbols completed. AIG took 53.2s. Estimated remaining: 4h 39m 13s. Rate: 8.3 symbols/min [2025-09-23T17:08:17.817532] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-06. [2025-09-23T17:08:17.852129] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:08:17.884596] [DEBUG] [LOCAL ] AIZ: Loaded 30228 existing records from primary storage. [2025-09-23T17:08:17.884755] [INFO ] [MAIN ] AIZ: Loaded 30228 existing records. [2025-09-23T17:08:18.063017] [WARN ] [MAIN ] AIZ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:08:18.063344] [INFO ] [MAIN ] AIZ: Wiping existing primary data before full refresh. [2025-09-23T17:08:18.063402] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-09-23T17:08:18.064337] [DEBUG] [LOCAL ] AIZ: Deleted primary data file. [2025-09-23T17:08:18.064400] [INFO ] [MAIN ] AIZ: Starting full primary refresh. [2025-09-23T17:08:18.437211] [INFO ] [REMOTE ] AIZ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:08:18.451948] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-23T17:08:18.546175] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-23T17:08:18.602142] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-07. [2025-09-23T17:08:19.402215] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-01. [2025-09-23T17:08:19.871501] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-23T17:08:20.202220] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-03. [2025-09-23T17:08:20.563262] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-23T17:08:21.002230] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-08. [2025-09-23T17:08:21.357385] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-23T17:08:21.802190] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2024-12. [2025-09-23T17:08:22.148535] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-23T17:08:22.602206] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-09-23T17:08:22.734567] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-23T17:08:23.402231] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-01. [2025-09-23T17:08:23.889496] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-23T17:08:23.894838] [INFO ] [REMOTE ] AIR: Full fetch complete (37686 records). [2025-09-23T17:08:23.895012] [DEBUG] [VALIDATOR ] AIR: Validating primary data. [2025-09-23T17:08:24.207305] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-02. [2025-09-23T17:08:24.274118] [DEBUG] [VALIDATOR ] AIR: All expected trading days are present. [2025-09-23T17:08:24.274206] [DEBUG] [VALIDATOR ] AIR: Primary data validation passed. [2025-09-23T17:08:24.274631] [INFO ] [MAIN ] AIR: Fetched primary data is valid. [2025-09-23T17:08:24.274708] [DEBUG] [LOCAL ] AIR: Saving primary data. [2025-09-23T17:08:24.275768] [DEBUG] [LOCAL ] AIR: Trimmed 37686 records to 27416 (keeping 200 days of data) [2025-09-23T17:08:24.443665] [DEBUG] [LOCAL ] AIR: Primary data saved (27416 records). [2025-09-23T17:08:24.443816] [INFO ] [MAIN ] AIR: Full history saved. [2025-09-23T17:08:24.443905] [INFO ] [MAIN ] Update Progress: 69/2372 symbols completed. AIR took 25.8s. Estimated remaining: 4h 38m 49s. Rate: 8.3 symbols/min [2025-09-23T17:08:24.609015] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-23T17:08:24.642615] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:08:24.649540] [DEBUG] [LOCAL ] AIZN: Loaded 3925 existing records from primary storage. [2025-09-23T17:08:24.649673] [INFO ] [MAIN ] AIZN: Loaded 3925 existing records. [2025-09-23T17:08:24.836121] [WARN ] [MAIN ] AIZN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:08:24.836423] [INFO ] [MAIN ] AIZN: Wiping existing primary data before full refresh. [2025-09-23T17:08:24.836476] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-09-23T17:08:24.836842] [DEBUG] [LOCAL ] AIZN: Deleted primary data file. [2025-09-23T17:08:24.836905] [INFO ] [MAIN ] AIZN: Starting full primary refresh. [2025-09-23T17:08:25.009345] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-04. [2025-09-23T17:08:25.193609] [INFO ] [REMOTE ] AIZN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:08:25.666310] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-23T17:08:25.802242] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-03. [2025-09-23T17:08:26.184136] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-23T17:08:26.602238] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-02. [2025-09-23T17:08:26.889603] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-23T17:08:27.402214] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-05. [2025-09-23T17:08:28.001241] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-23T17:08:28.202194] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2024-12. [2025-09-23T17:08:28.513158] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-23T17:08:28.699573] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-23T17:08:29.002204] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-01. [2025-09-23T17:08:29.483834] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-23T17:08:29.802196] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-02. [2025-09-23T17:08:30.167438] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-23T17:08:30.602261] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-03. [2025-09-23T17:08:31.216446] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-23T17:08:31.402359] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-04. [2025-09-23T17:08:32.202201] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-03. [2025-09-23T17:08:32.978507] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-23T17:08:33.002160] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-05. [2025-09-23T17:08:33.283738] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-23T17:08:33.802209] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-04. [2025-09-23T17:08:33.883357] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-23T17:08:34.602269] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-06. [2025-09-23T17:08:35.402206] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-06. [2025-09-23T17:08:35.552989] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-23T17:08:35.643052] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-23T17:08:36.202202] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-07. [2025-09-23T17:08:36.481377] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-23T17:08:37.002172] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-07. [2025-09-23T17:08:37.105277] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-23T17:08:37.802242] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-05. [2025-09-23T17:08:38.326438] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-23T17:08:38.602200] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-04. [2025-09-23T17:08:39.077260] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-23T17:08:39.326972] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-23T17:08:39.402244] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-08. [2025-09-23T17:08:40.202193] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-06. [2025-09-23T17:08:40.618325] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-23T17:08:41.002228] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-09-23T17:08:41.235984] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-23T17:08:41.802442] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-07. [2025-09-23T17:08:42.214175] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-23T17:08:42.221811] [INFO ] [REMOTE ] AIV: Full fetch complete (59118 records). [2025-09-23T17:08:42.221948] [DEBUG] [VALIDATOR ] AIV: Validating primary data. [2025-09-23T17:08:42.605186] [DEBUG] [VALIDATOR ] AIV: All expected trading days are present. [2025-09-23T17:08:42.604902] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-08. [2025-09-23T17:08:42.606221] [DEBUG] [VALIDATOR ] AIV: Primary data validation passed. [2025-09-23T17:08:42.606855] [INFO ] [MAIN ] AIV: Fetched primary data is valid. [2025-09-23T17:08:42.606920] [DEBUG] [LOCAL ] AIV: Saving primary data. [2025-09-23T17:08:42.608276] [DEBUG] [LOCAL ] AIV: Trimmed 59118 records to 40198 (keeping 200 days of data) [2025-09-23T17:08:42.851850] [DEBUG] [LOCAL ] AIV: Primary data saved (40198 records). [2025-09-23T17:08:42.851990] [INFO ] [MAIN ] AIV: Full history saved. [2025-09-23T17:08:42.852078] [INFO ] [MAIN ] Update Progress: 70/2372 symbols completed. AIV took 29.5s. Estimated remaining: 4h 44m 48s. Rate: 8.1 symbols/min [2025-09-23T17:08:43.038762] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:08:43.090163] [DEBUG] [LOCAL ] AJG: Loaded 47141 existing records from primary storage. [2025-09-23T17:08:43.090337] [INFO ] [MAIN ] AJG: Loaded 47141 existing records. [2025-09-23T17:08:43.289234] [WARN ] [MAIN ] AJG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:08:43.289688] [INFO ] [MAIN ] AJG: Wiping existing primary data before full refresh. [2025-09-23T17:08:43.289861] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-09-23T17:08:43.299352] [DEBUG] [LOCAL ] AJG: Deleted primary data file. [2025-09-23T17:08:43.307821] [INFO ] [MAIN ] AJG: Starting full primary refresh. [2025-09-23T17:08:43.308381] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-23T17:08:43.407309] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-05. [2025-09-23T17:08:43.705762] [INFO ] [REMOTE ] AJG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:08:43.721575] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-23T17:08:43.831028] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-23T17:08:44.202215] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-06. [2025-09-23T17:08:44.755049] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-23T17:08:45.002203] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-09-23T17:08:45.802235] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-08. [2025-09-23T17:08:45.961680] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-23T17:08:45.965363] [INFO ] [REMOTE ] AIT: Full fetch complete (39522 records). [2025-09-23T17:08:45.965474] [DEBUG] [VALIDATOR ] AIT: Validating primary data. [2025-09-23T17:08:46.350226] [DEBUG] [VALIDATOR ] AIT: All expected trading days are present. [2025-09-23T17:08:46.350330] [DEBUG] [VALIDATOR ] AIT: Primary data validation passed. [2025-09-23T17:08:46.350797] [INFO ] [MAIN ] AIT: Fetched primary data is valid. [2025-09-23T17:08:46.350862] [DEBUG] [LOCAL ] AIT: Saving primary data. [2025-09-23T17:08:46.351807] [DEBUG] [LOCAL ] AIT: Trimmed 39522 records to 28113 (keeping 200 days of data) [2025-09-23T17:08:46.523664] [DEBUG] [LOCAL ] AIT: Primary data saved (28113 records). [2025-09-23T17:08:46.523806] [INFO ] [MAIN ] AIT: Full history saved. [2025-09-23T17:08:46.523884] [INFO ] [MAIN ] Update Progress: 71/2372 symbols completed. AIT took 40.9s. Estimated remaining: 4h 42m 39s. Rate: 8.1 symbols/min [2025-09-23T17:08:46.607325] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-07. [2025-09-23T17:08:46.700166] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:08:46.700329] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-09-23T17:08:46.700368] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-09-23T17:08:46.700516] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-09-23T17:08:46.700561] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-09-23T17:08:46.700606] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-09-23T17:08:46.700700] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-09-23T17:08:47.025688] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-23T17:08:47.095577] [INFO ] [REMOTE ] AKA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:08:47.351522] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-23T17:08:47.402247] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-09-23T17:08:48.202192] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-08. [2025-09-23T17:08:48.406562] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-23T17:08:48.411258] [INFO ] [REMOTE ] AIZ: Full fetch complete (42985 records). [2025-09-23T17:08:48.411340] [DEBUG] [VALIDATOR ] AIZ: Validating primary data. [2025-09-23T17:08:48.703800] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-23T17:08:48.797554] [DEBUG] [VALIDATOR ] AIZ: All expected trading days are present. [2025-09-23T17:08:48.797674] [DEBUG] [VALIDATOR ] AIZ: Primary data validation passed. [2025-09-23T17:08:48.798216] [INFO ] [MAIN ] AIZ: Fetched primary data is valid. [2025-09-23T17:08:48.798261] [DEBUG] [LOCAL ] AIZ: Saving primary data. [2025-09-23T17:08:48.799207] [DEBUG] [LOCAL ] AIZ: Trimmed 42985 records to 30174 (keeping 200 days of data) [2025-09-23T17:08:49.002934] [DEBUG] [LOCAL ] AIZ: Primary data saved (30174 records). [2025-09-23T17:08:49.002377] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-09-23T17:08:49.004903] [INFO ] [MAIN ] AIZ: Full history saved. [2025-09-23T17:08:49.005103] [INFO ] [MAIN ] Update Progress: 72/2372 symbols completed. AIZ took 31.3s. Estimated remaining: 4h 39m 56s. Rate: 8.2 symbols/min [2025-09-23T17:08:49.179727] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:08:49.227119] [DEBUG] [LOCAL ] AKR: Loaded 45691 existing records from primary storage. [2025-09-23T17:08:49.227265] [INFO ] [MAIN ] AKR: Loaded 45691 existing records. [2025-09-23T17:08:49.406041] [WARN ] [MAIN ] AKR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:08:49.406325] [INFO ] [MAIN ] AKR: Wiping existing primary data before full refresh. [2025-09-23T17:08:49.406385] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-09-23T17:08:49.407669] [DEBUG] [LOCAL ] AKR: Deleted primary data file. [2025-09-23T17:08:49.407731] [INFO ] [MAIN ] AKR: Starting full primary refresh. [2025-09-23T17:08:49.615625] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-23T17:08:49.665432] [INFO ] [REMOTE ] AIZN: Full fetch complete (5723 records). [2025-09-23T17:08:49.691607] [DEBUG] [VALIDATOR ] AIZN: Validating primary data. [2025-09-23T17:08:49.805005] [INFO ] [REMOTE ] AJG: Fetching primary data for 2024-12. [2025-09-23T17:08:49.997534] [INFO ] [REMOTE ] AKR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:08:50.200703] [DEBUG] [VALIDATOR ] AIZN: All expected trading days are present. [2025-09-23T17:08:50.200789] [DEBUG] [VALIDATOR ] AIZN: Primary data validation passed. [2025-09-23T17:08:50.200964] [INFO ] [MAIN ] AIZN: Fetched primary data is valid. [2025-09-23T17:08:50.201043] [DEBUG] [LOCAL ] AIZN: Saving primary data. [2025-09-23T17:08:50.201467] [DEBUG] [LOCAL ] AIZN: Trimmed 5723 records to 3919 (keeping 200 days of data) [2025-09-23T17:08:50.225017] [DEBUG] [LOCAL ] AIZN: Primary data saved (3919 records). [2025-09-23T17:08:50.225102] [INFO ] [MAIN ] AIZN: Full history saved. [2025-09-23T17:08:50.225245] [INFO ] [MAIN ] Update Progress: 73/2372 symbols completed. AIZN took 25.8s. Estimated remaining: 4h 36m 37s. Rate: 8.3 symbols/min [2025-09-23T17:08:50.393626] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:08:50.444163] [DEBUG] [LOCAL ] AL: Loaded 44012 existing records from primary storage. [2025-09-23T17:08:50.444308] [INFO ] [MAIN ] AL: Loaded 44012 existing records. [2025-09-23T17:08:50.613370] [INFO ] [REMOTE ] AKR: Fetching primary data for 2024-12. [2025-09-23T17:08:50.640077] [WARN ] [MAIN ] AL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:08:50.640451] [INFO ] [MAIN ] AL: Wiping existing primary data before full refresh. [2025-09-23T17:08:50.640548] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-09-23T17:08:50.643183] [DEBUG] [LOCAL ] AL: Deleted primary data file. [2025-09-23T17:08:50.643267] [INFO ] [MAIN ] AL: Starting full primary refresh. [2025-09-23T17:08:51.002120] [INFO ] [REMOTE ] AL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:08:51.402235] [INFO ] [REMOTE ] AKA: Fetching primary data for 2024-12. [2025-09-23T17:08:51.792116] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-23T17:08:51.889977] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-23T17:08:51.925367] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-23T17:08:52.202215] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-01. [2025-09-23T17:08:53.002253] [INFO ] [REMOTE ] AL: Fetching primary data for 2024-12. [2025-09-23T17:08:53.802193] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-09-23T17:08:53.916848] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-23T17:08:54.135887] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-23T17:08:54.180041] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-23T17:08:54.602215] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-02. [2025-09-23T17:08:55.402210] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-01. [2025-09-23T17:08:56.032903] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-23T17:08:56.202212] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-03. [2025-09-23T17:08:56.890326] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-23T17:08:57.002196] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-02. [2025-09-23T17:08:57.686764] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-23T17:08:57.802213] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-04. [2025-09-23T17:08:58.602172] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-09-23T17:08:58.772153] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-23T17:08:58.997971] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-23T17:08:59.266802] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-23T17:08:59.402185] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-05. [2025-09-23T17:09:00.202219] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-01. [2025-09-23T17:09:01.001198] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-23T17:09:01.010036] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-03. [2025-09-23T17:09:01.521366] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-23T17:09:01.802198] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-06. [2025-09-23T17:09:02.602250] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-02. [2025-09-23T17:09:03.195913] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-23T17:09:03.402230] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-04. [2025-09-23T17:09:04.202181] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-09-23T17:09:04.680470] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-23T17:09:04.730984] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-23T17:09:05.002246] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-09-23T17:09:05.566142] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-23T17:09:05.660012] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-23T17:09:05.704412] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-06 (3.90 seconds). [2025-09-23T17:09:05.802240] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-07. [2025-09-23T17:09:06.602193] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-03. [2025-09-23T17:09:06.949596] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-23T17:09:07.402187] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-05. [2025-09-23T17:09:07.605559] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-23T17:09:08.202189] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-04. [2025-09-23T17:09:08.454981] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-23T17:09:09.002203] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-06. [2025-09-23T17:09:09.115893] [DEBUG] [REMOTE ] AKR: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-09-23T17:09:09.116191] [WARN ] [REMOTE ] AKR: No data returned for month 2025-06 [2025-09-23T17:09:09.480555] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-23T17:09:09.802199] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-05. [2025-09-23T17:09:10.602205] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-07. [2025-09-23T17:09:10.942159] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-23T17:09:11.402196] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-08. [2025-09-23T17:09:12.202226] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-06. [2025-09-23T17:09:12.327152] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-23T17:09:13.002215] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-09-23T17:09:13.245241] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-23T17:09:13.802238] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-08. [2025-09-23T17:09:14.167288] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-23T17:09:14.288864] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-23T17:09:14.602195] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-09-23T17:09:15.081018] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-23T17:09:15.402188] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-09-23T17:09:15.982275] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-23T17:09:16.202241] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-07. [2025-09-23T17:09:17.002165] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-09-23T17:09:17.076310] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-23T17:09:17.084253] [INFO ] [REMOTE ] AJG: Full fetch complete (69439 records). [2025-09-23T17:09:17.084434] [DEBUG] [VALIDATOR ] AJG: Validating primary data. [2025-09-23T17:09:17.085835] [FATAL] [VALIDATOR ] AJG: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:09:17.085964] [FATAL] [MAIN ] AJG: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:09:17.086051] [WARN ] [MAIN ] AJG: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:09:17.086148] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-09-23T17:09:17.086234] [DEBUG] [LOCAL ] AJG: No primary data file found to delete. [2025-09-23T17:09:17.086287] [INFO ] [LOCAL ] AJG: Starting deletion of derivative data. [2025-09-23T17:09:17.086806] [DEBUG] [LOCAL ] AJG: Deleted derivative data file. [2025-09-23T17:09:17.088335] [INFO ] [MAIN ] Update Progress: 74/2372 symbols completed. AJG took 34.2s. Estimated remaining: 4h 46m 40s. Rate: 8.0 symbols/min [2025-09-23T17:09:17.262101] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:09:17.339235] [DEBUG] [LOCAL ] ALB: Loaded 53228 existing records from primary storage. [2025-09-23T17:09:17.339425] [INFO ] [MAIN ] ALB: Loaded 53228 existing records. [2025-09-23T17:09:17.582992] [WARN ] [MAIN ] ALB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:09:17.583406] [INFO ] [MAIN ] ALB: Wiping existing primary data before full refresh. [2025-09-23T17:09:17.583550] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-09-23T17:09:17.584940] [DEBUG] [LOCAL ] ALB: Deleted primary data file. [2025-09-23T17:09:17.585006] [INFO ] [MAIN ] ALB: Starting full primary refresh. [2025-09-23T17:09:17.767103] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-23T17:09:17.816828] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-08. [2025-09-23T17:09:18.012041] [INFO ] [REMOTE ] ALB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:09:18.602273] [INFO ] [REMOTE ] ALB: Fetching primary data for 2024-12. [2025-09-23T17:09:18.845609] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-23T17:09:18.853632] [INFO ] [REMOTE ] AKR: Full fetch complete (58598 records). [2025-09-23T17:09:18.853802] [DEBUG] [VALIDATOR ] AKR: Validating primary data. [2025-09-23T17:09:19.058376] [WARN ] [VALIDATOR ] AKR: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-23T17:09:19.059364] [FATAL] [MAIN ] AKR: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:09:19.059497] [WARN ] [MAIN ] AKR: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:09:19.059690] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-09-23T17:09:19.059807] [DEBUG] [LOCAL ] AKR: No primary data file found to delete. [2025-09-23T17:09:19.059879] [INFO ] [LOCAL ] AKR: Starting deletion of derivative data. [2025-09-23T17:09:19.060506] [DEBUG] [LOCAL ] AKR: Deleted derivative data file. [2025-09-23T17:09:19.060626] [INFO ] [MAIN ] Update Progress: 75/2372 symbols completed. AKR took 30.1s. Estimated remaining: 4h 43m 43s. Rate: 8.1 symbols/min [2025-09-23T17:09:19.278488] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:09:19.282926] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-23T17:09:19.351487] [DEBUG] [LOCAL ] ALC: Loaded 50771 existing records from primary storage. [2025-09-23T17:09:19.351672] [INFO ] [MAIN ] ALC: Loaded 50771 existing records. [2025-09-23T17:09:19.407453] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-09-23T17:09:19.550886] [WARN ] [MAIN ] ALC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:09:19.551167] [INFO ] [MAIN ] ALC: Wiping existing primary data before full refresh. [2025-09-23T17:09:19.551256] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-09-23T17:09:19.552780] [DEBUG] [LOCAL ] ALC: Deleted primary data file. [2025-09-23T17:09:19.552844] [INFO ] [MAIN ] ALC: Starting full primary refresh. [2025-09-23T17:09:19.824029] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-23T17:09:19.922383] [INFO ] [REMOTE ] ALC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:09:20.204512] [INFO ] [REMOTE ] ALC: Fetching primary data for 2024-12. [2025-09-23T17:09:20.207891] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-23T17:09:21.002254] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-01. [2025-09-23T17:09:21.503261] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-23T17:09:21.802196] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-01. [2025-09-23T17:09:22.602204] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-09-23T17:09:22.788978] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-23T17:09:22.908768] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-23T17:09:23.402285] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-02. [2025-09-23T17:09:23.470744] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-23T17:09:24.202289] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-09-23T17:09:25.002203] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-09-23T17:09:25.380971] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-23T17:09:25.494682] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-23T17:09:25.495499] [INFO ] [REMOTE ] AKA: Full fetch complete (2426 records). [2025-09-23T17:09:25.495572] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-09-23T17:09:25.687456] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-23T17:09:25.687854] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:09:25.687926] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:09:25.687996] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-09-23T17:09:25.688079] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-09-23T17:09:25.688135] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-09-23T17:09:25.688181] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-09-23T17:09:25.688238] [INFO ] [MAIN ] Update Progress: 76/2372 symbols completed. AKA took 39.2s. Estimated remaining: 4h 43m 12s. Rate: 8.1 symbols/min [2025-09-23T17:09:25.807279] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-02. [2025-09-23T17:09:25.860379] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:09:25.926198] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-23T17:09:25.944166] [INFO ] [REMOTE ] AL: Full fetch complete (62092 records). [2025-09-23T17:09:25.944808] [DEBUG] [LOCAL ] ALE: Loaded 30184 existing records from primary storage. [2025-09-23T17:09:25.944332] [DEBUG] [VALIDATOR ] AL: Validating primary data. [2025-09-23T17:09:25.945054] [INFO ] [MAIN ] ALE: Loaded 30184 existing records. [2025-09-23T17:09:26.323577] [WARN ] [MAIN ] ALE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:09:26.408077] [INFO ] [MAIN ] ALE: Wiping existing primary data before full refresh. [2025-09-23T17:09:26.438609] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-09-23T17:09:26.447253] [DEBUG] [LOCAL ] ALE: Deleted primary data file. [2025-09-23T17:09:26.467791] [INFO ] [MAIN ] ALE: Starting full primary refresh. [2025-09-23T17:09:26.607672] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-03. [2025-09-23T17:09:26.654261] [DEBUG] [VALIDATOR ] AL: All expected trading days are present. [2025-09-23T17:09:26.654425] [DEBUG] [VALIDATOR ] AL: Primary data validation passed. [2025-09-23T17:09:26.655100] [INFO ] [MAIN ] AL: Fetched primary data is valid. [2025-09-23T17:09:26.655496] [DEBUG] [LOCAL ] AL: Saving primary data. [2025-09-23T17:09:26.814963] [DEBUG] [LOCAL ] AL: Trimmed 62092 records to 44068 (keeping 200 days of data) [2025-09-23T17:09:27.014231] [INFO ] [REMOTE ] ALE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:09:27.182677] [DEBUG] [LOCAL ] AL: Primary data saved (44068 records). [2025-09-23T17:09:27.182812] [INFO ] [MAIN ] AL: Full history saved. [2025-09-23T17:09:27.185366] [INFO ] [MAIN ] Update Progress: 77/2372 symbols completed. AL took 37.0s. Estimated remaining: 4h 40m 9s. Rate: 8.2 symbols/min [2025-09-23T17:09:27.337048] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-23T17:09:27.402155] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-03. [2025-09-23T17:09:28.202176] [INFO ] [REMOTE ] ALE: Fetching primary data for 2024-12. [2025-09-23T17:09:28.304040] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-23T17:09:29.002298] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-04. [2025-09-23T17:09:29.211008] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-23T17:09:29.640354] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-23T17:09:29.802214] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-04. [2025-09-23T17:09:30.602216] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-01. [2025-09-23T17:09:31.200747] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-23T17:09:31.301493] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-23T17:09:31.402264] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-05. [2025-09-23T17:09:31.802494] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-23T17:09:32.202205] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-02. [2025-09-23T17:09:33.002219] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-05. [2025-09-23T17:09:34.036007] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-23T17:09:34.041349] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-03. [2025-09-23T17:09:34.253770] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-05 (2.85 seconds). [2025-09-23T17:09:34.602210] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-06. [2025-09-23T17:09:35.026484] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-23T17:09:35.402252] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-04. [2025-09-23T17:09:35.502266] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-09-23T17:09:36.202220] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-06. [2025-09-23T17:09:36.433815] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-23T17:09:36.465359] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-23T17:09:37.002261] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-05. [2025-09-23T17:09:37.515443] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-23T17:09:37.802250] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-07. [2025-09-23T17:09:37.943683] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-23T17:09:38.602241] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-06. [2025-09-23T17:09:39.251758] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-23T17:09:39.402214] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-08. [2025-09-23T17:09:39.438222] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-23T17:09:40.202209] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-07. [2025-09-23T17:09:40.935731] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-23T17:09:41.002165] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-09-23T17:09:41.802297] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-07. [2025-09-23T17:09:42.511314] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-23T17:09:42.519729] [INFO ] [REMOTE ] ALC: Full fetch complete (72170 records). [2025-09-23T17:09:42.519899] [DEBUG] [VALIDATOR ] ALC: Validating primary data. [2025-09-23T17:09:42.520826] [FATAL] [VALIDATOR ] ALC: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:09:42.520926] [FATAL] [MAIN ] ALC: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:09:42.520968] [WARN ] [MAIN ] ALC: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:09:42.521006] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-09-23T17:09:42.521065] [DEBUG] [LOCAL ] ALC: No primary data file found to delete. [2025-09-23T17:09:42.521100] [INFO ] [LOCAL ] ALC: Starting deletion of derivative data. [2025-09-23T17:09:42.521796] [DEBUG] [LOCAL ] ALC: Deleted derivative data file. [2025-09-23T17:09:42.521901] [INFO ] [MAIN ] Update Progress: 78/2372 symbols completed. ALC took 23.5s. Estimated remaining: 4h 43m 57s. Rate: 8.1 symbols/min [2025-09-23T17:09:42.650387] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-09-23T17:09:42.662334] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-08. [2025-09-23T17:09:42.823025] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-23T17:09:43.402203] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-08. [2025-09-23T17:09:44.473879] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-23T17:09:44.507475] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-23T17:09:44.506486] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-09-23T17:09:45.002195] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-09-23T17:09:46.417889] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-23T17:09:46.423468] [INFO ] [REMOTE ] ALE: Full fetch complete (41972 records). [2025-09-23T17:09:46.423557] [DEBUG] [VALIDATOR ] ALE: Validating primary data. [2025-09-23T17:09:46.424100] [FATAL] [VALIDATOR ] ALE: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:09:46.424183] [FATAL] [MAIN ] ALE: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:09:46.424226] [WARN ] [MAIN ] ALE: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:09:46.424290] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-09-23T17:09:46.424354] [DEBUG] [LOCAL ] ALE: No primary data file found to delete. [2025-09-23T17:09:46.424390] [INFO ] [LOCAL ] ALE: Starting deletion of derivative data. [2025-09-23T17:09:46.424780] [DEBUG] [LOCAL ] ALE: Deleted derivative data file. [2025-09-23T17:09:46.426090] [INFO ] [MAIN ] Update Progress: 79/2372 symbols completed. ALE took 20.7s. Estimated remaining: 4h 42m 8s. Rate: 8.1 symbols/min [2025-09-23T17:09:46.670126] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-23T17:09:46.678868] [INFO ] [REMOTE ] ALB: Full fetch complete (76760 records). [2025-09-23T17:09:46.678998] [DEBUG] [VALIDATOR ] ALB: Validating primary data. [2025-09-23T17:09:47.084132] [DEBUG] [VALIDATOR ] ALB: All expected trading days are present. [2025-09-23T17:09:47.084228] [DEBUG] [VALIDATOR ] ALB: Primary data validation passed. [2025-09-23T17:09:47.085184] [INFO ] [MAIN ] ALB: Fetched primary data is valid. [2025-09-23T17:09:47.085271] [DEBUG] [LOCAL ] ALB: Saving primary data. [2025-09-23T17:09:47.086841] [DEBUG] [LOCAL ] ALB: Trimmed 76760 records to 53222 (keeping 200 days of data) [2025-09-23T17:09:47.412796] [DEBUG] [LOCAL ] ALB: Primary data saved (53222 records). [2025-09-23T17:09:47.412946] [INFO ] [MAIN ] ALB: Full history saved. [2025-09-23T17:09:47.413046] [INFO ] [MAIN ] Update Progress: 80/2372 symbols completed. ALB took 30.3s. Estimated remaining: 4h 38m 57s. Rate: 8.2 symbols/min [2025-09-23T17:09:47.966568] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:09:48.126820] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:09:48.170908] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:09:48.166861] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:09:48.204689] [DEBUG] [LOCAL ] ALG: Loaded 10523 existing records from primary storage. [2025-09-23T17:09:48.204845] [INFO ] [MAIN ] ALG: Loaded 10523 existing records. [2025-09-23T17:09:48.311017] [DEBUG] [LOCAL ] ALEX: Loaded 31417 existing records from primary storage. [2025-09-23T17:09:48.343318] [INFO ] [MAIN ] ALEX: Loaded 31417 existing records. [2025-09-23T17:09:48.511714] [DEBUG] [LOCAL ] ALK: Loaded 53078 existing records from primary storage. [2025-09-23T17:09:48.586397] [INFO ] [MAIN ] ALK: Loaded 53078 existing records. [2025-09-23T17:09:48.589731] [WARN ] [MAIN ] ALG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:09:48.591271] [DEBUG] [LOCAL ] ALIT: Loaded 52759 existing records from primary storage. [2025-09-23T17:09:48.591970] [INFO ] [MAIN ] ALIT: Loaded 52759 existing records. [2025-09-23T17:09:48.591855] [INFO ] [MAIN ] ALG: Wiping existing primary data before full refresh. [2025-09-23T17:09:48.613199] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-09-23T17:09:48.744574] [DEBUG] [LOCAL ] ALG: Deleted primary data file. [2025-09-23T17:09:48.836246] [INFO ] [MAIN ] ALG: Starting full primary refresh. [2025-09-23T17:09:48.851880] [WARN ] [MAIN ] ALEX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:09:48.932439] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-09-23T17:09:48.951794] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-09-23T17:09:49.109253] [DEBUG] [LOCAL ] ALEX: Deleted primary data file. [2025-09-23T17:09:49.168883] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-09-23T17:09:49.172933] [WARN ] [MAIN ] ALK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:09:49.168769] [WARN ] [MAIN ] ALIT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:09:49.233366] [INFO ] [MAIN ] ALIT: Wiping existing primary data before full refresh. [2025-09-23T17:09:49.257268] [INFO ] [MAIN ] ALK: Wiping existing primary data before full refresh. [2025-09-23T17:09:49.295114] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-09-23T17:09:49.322951] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-09-23T17:09:49.418712] [DEBUG] [LOCAL ] ALIT: Deleted primary data file. [2025-09-23T17:09:49.410241] [DEBUG] [LOCAL ] ALK: Deleted primary data file. [2025-09-23T17:09:49.428086] [INFO ] [MAIN ] ALK: Starting full primary refresh. [2025-09-23T17:09:49.418872] [INFO ] [MAIN ] ALIT: Starting full primary refresh. [2025-09-23T17:09:50.035069] [INFO ] [REMOTE ] ALG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:09:50.083416] [INFO ] [REMOTE ] ALG: Fetching primary data for 2024-12. [2025-09-23T17:09:50.223064] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:09:50.313997] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2024-12. [2025-09-23T17:09:50.539487] [INFO ] [REMOTE ] ALK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:09:50.563489] [INFO ] [REMOTE ] ALK: Fetching primary data for 2024-12. [2025-09-23T17:09:50.604581] [INFO ] [REMOTE ] ALIT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:09:50.604915] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2024-12. [2025-09-23T17:09:51.021812] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-23T17:09:51.024618] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-01. [2025-09-23T17:09:51.586224] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-23T17:09:51.589225] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-02. [2025-09-23T17:09:51.948108] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-23T17:09:51.959385] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-01. [2025-09-23T17:09:52.054602] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-23T17:09:52.065521] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-01. [2025-09-23T17:09:52.113853] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-23T17:09:52.145473] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-23T17:09:52.202164] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-03. [2025-09-23T17:09:52.878119] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-23T17:09:53.002189] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-04. [2025-09-23T17:09:53.439700] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-23T17:09:53.733364] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-23T17:09:53.802207] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-02. [2025-09-23T17:09:53.940702] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-23T17:09:54.602264] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-01. [2025-09-23T17:09:55.353916] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-23T17:09:55.402379] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-03. [2025-09-23T17:09:55.483058] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-23T17:09:56.202218] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-02. [2025-09-23T17:09:57.002230] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-09-23T17:09:57.511391] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-23T17:09:57.791350] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-23T17:09:57.802152] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-03. [2025-09-23T17:09:58.212319] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-23T17:09:58.602206] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-05. [2025-09-23T17:09:59.122770] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-23T17:09:59.230775] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-23T17:09:59.402208] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-04. [2025-09-23T17:10:00.202226] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-04. [2025-09-23T17:10:01.002189] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-06. [2025-09-23T17:10:01.278021] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-23T17:10:01.802188] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-05. [2025-09-23T17:10:01.857759] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-23T17:10:02.004101] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-23T17:10:02.602406] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-07. [2025-09-23T17:10:03.150387] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-23T17:10:03.407337] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-05. [2025-09-23T17:10:03.422463] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-23T17:10:04.202212] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-08. [2025-09-23T17:10:04.748121] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-23T17:10:04.972758] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-23T17:10:05.002164] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-06. [2025-09-23T17:10:05.802205] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-09-23T17:10:06.396430] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-23T17:10:06.398508] [INFO ] [REMOTE ] ALG: Full fetch complete (15857 records). [2025-09-23T17:10:06.398675] [DEBUG] [VALIDATOR ] ALG: Validating primary data. [2025-09-23T17:10:06.607367] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-09-23T17:10:06.773503] [DEBUG] [VALIDATOR ] ALG: All expected trading days are present. [2025-09-23T17:10:06.773693] [DEBUG] [VALIDATOR ] ALG: Primary data validation passed. [2025-09-23T17:10:06.773995] [INFO ] [MAIN ] ALG: Fetched primary data is valid. [2025-09-23T17:10:06.774076] [DEBUG] [LOCAL ] ALG: Saving primary data. [2025-09-23T17:10:06.774834] [DEBUG] [LOCAL ] ALG: Trimmed 15857 records to 10456 (keeping 200 days of data) [2025-09-23T17:10:06.843093] [DEBUG] [LOCAL ] ALG: Primary data saved (10456 records). [2025-09-23T17:10:06.843244] [INFO ] [MAIN ] ALG: Full history saved. [2025-09-23T17:10:06.843331] [INFO ] [MAIN ] Update Progress: 81/2372 symbols completed. ALG took 19.4s. Estimated remaining: 4h 44m 33s. Rate: 8.1 symbols/min [2025-09-23T17:10:07.046207] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-23T17:10:07.050612] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:10:07.117072] [DEBUG] [LOCAL ] ALL: Loaded 50217 existing records from primary storage. [2025-09-23T17:10:07.117202] [INFO ] [MAIN ] ALL: Loaded 50217 existing records. [2025-09-23T17:10:07.302965] [WARN ] [MAIN ] ALL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:10:07.303376] [INFO ] [MAIN ] ALL: Wiping existing primary data before full refresh. [2025-09-23T17:10:07.303433] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-09-23T17:10:07.305813] [DEBUG] [LOCAL ] ALL: Deleted primary data file. [2025-09-23T17:10:07.305875] [INFO ] [MAIN ] ALL: Starting full primary refresh. [2025-09-23T17:10:07.406876] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-06. [2025-09-23T17:10:07.697878] [INFO ] [REMOTE ] ALL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:10:08.202187] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-07. [2025-09-23T17:10:08.266933] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-23T17:10:08.825059] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-23T17:10:09.002451] [INFO ] [REMOTE ] ALL: Fetching primary data for 2024-12. [2025-09-23T17:10:09.725638] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-23T17:10:09.802220] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-08. [2025-09-23T17:10:10.602271] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-09-23T17:10:11.059591] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-23T17:10:11.402304] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-07. [2025-09-23T17:10:11.643816] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-23T17:10:11.704074] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-23T17:10:12.202233] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-09-23T17:10:12.862804] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-23T17:10:13.002198] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-01. [2025-09-23T17:10:13.086248] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-23T17:10:13.802204] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-08. [2025-09-23T17:10:14.602163] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-09. [2025-09-23T17:10:14.718822] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-23T17:10:15.402236] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-02. [2025-09-23T17:10:15.706842] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-23T17:10:16.202233] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-09. [2025-09-23T17:10:16.629071] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-23T17:10:16.637469] [INFO ] [REMOTE ] ALK: Full fetch complete (76432 records). [2025-09-23T17:10:16.637621] [DEBUG] [VALIDATOR ] ALK: Validating primary data. [2025-09-23T17:10:16.638537] [FATAL] [VALIDATOR ] ALK: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:10:16.638689] [FATAL] [MAIN ] ALK: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:10:16.638743] [WARN ] [MAIN ] ALK: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:10:16.638785] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-09-23T17:10:16.638844] [DEBUG] [LOCAL ] ALK: No primary data file found to delete. [2025-09-23T17:10:16.638879] [INFO ] [LOCAL ] ALK: Starting deletion of derivative data. [2025-09-23T17:10:16.639318] [DEBUG] [LOCAL ] ALK: Deleted derivative data file. [2025-09-23T17:10:16.639421] [INFO ] [MAIN ] Update Progress: 82/2372 symbols completed. ALK took 29.2s. Estimated remaining: 4h 45m 31s. Rate: 8.0 symbols/min [2025-09-23T17:10:16.823772] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:10:16.873174] [DEBUG] [LOCAL ] ALLE: Loaded 45317 existing records from primary storage. [2025-09-23T17:10:16.873351] [INFO ] [MAIN ] ALLE: Loaded 45317 existing records. [2025-09-23T17:10:17.006588] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-09-23T17:10:17.029800] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-23T17:10:17.106890] [WARN ] [MAIN ] ALLE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:10:17.107276] [INFO ] [MAIN ] ALLE: Wiping existing primary data before full refresh. [2025-09-23T17:10:17.107380] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-09-23T17:10:17.108944] [DEBUG] [LOCAL ] ALLE: Deleted primary data file. [2025-09-23T17:10:17.109006] [INFO ] [MAIN ] ALLE: Starting full primary refresh. [2025-09-23T17:10:17.467637] [INFO ] [REMOTE ] ALLE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:10:17.623259] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-23T17:10:17.632140] [INFO ] [REMOTE ] ALIT: Full fetch complete (76416 records). [2025-09-23T17:10:17.632264] [DEBUG] [VALIDATOR ] ALIT: Validating primary data. [2025-09-23T17:10:17.808222] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-03. [2025-09-23T17:10:18.034180] [DEBUG] [VALIDATOR ] ALIT: All expected trading days are present. [2025-09-23T17:10:18.034437] [DEBUG] [VALIDATOR ] ALIT: Primary data validation passed. [2025-09-23T17:10:18.035545] [INFO ] [MAIN ] ALIT: Fetched primary data is valid. [2025-09-23T17:10:18.035860] [DEBUG] [LOCAL ] ALIT: Saving primary data. [2025-09-23T17:10:18.038123] [DEBUG] [LOCAL ] ALIT: Trimmed 76416 records to 52761 (keeping 200 days of data) [2025-09-23T17:10:18.149572] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-23T17:10:18.390201] [DEBUG] [LOCAL ] ALIT: Primary data saved (52761 records). [2025-09-23T17:10:18.390337] [INFO ] [MAIN ] ALIT: Full history saved. [2025-09-23T17:10:18.391008] [INFO ] [MAIN ] Update Progress: 83/2372 symbols completed. ALIT took 31.0s. Estimated remaining: 4h 42m 45s. Rate: 8.1 symbols/min [2025-09-23T17:10:18.570305] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:10:18.603458] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2024-12. [2025-09-23T17:10:18.625186] [DEBUG] [LOCAL ] ALLY: Loaded 53218 existing records from primary storage. [2025-09-23T17:10:18.625333] [INFO ] [MAIN ] ALLY: Loaded 53218 existing records. [2025-09-23T17:10:18.813604] [WARN ] [MAIN ] ALLY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:10:18.813891] [INFO ] [MAIN ] ALLY: Wiping existing primary data before full refresh. [2025-09-23T17:10:18.813940] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-09-23T17:10:18.815696] [DEBUG] [LOCAL ] ALLY: Deleted primary data file. [2025-09-23T17:10:18.815761] [INFO ] [MAIN ] ALLY: Starting full primary refresh. [2025-09-23T17:10:19.179055] [INFO ] [REMOTE ] ALLY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:10:19.402150] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2024-12. [2025-09-23T17:10:19.657731] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-23T17:10:20.108532] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-23T17:10:20.202235] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-01. [2025-09-23T17:10:20.958175] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-23T17:10:21.002143] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-01. [2025-09-23T17:10:21.449743] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-23T17:10:21.802271] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-09-23T17:10:22.477571] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-23T17:10:22.602152] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-02. [2025-09-23T17:10:23.102814] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-23T17:10:23.402212] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-04. [2025-09-23T17:10:24.031113] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-23T17:10:24.202188] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-03. [2025-09-23T17:10:25.002201] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-09-23T17:10:25.070604] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-23T17:10:25.790768] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-23T17:10:25.802143] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-09-23T17:10:25.858280] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-23T17:10:26.602231] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-02. [2025-09-23T17:10:26.805371] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-23T17:10:26.814030] [INFO ] [REMOTE ] ALEX: Full fetch complete (44567 records). [2025-09-23T17:10:26.814198] [DEBUG] [VALIDATOR ] ALEX: Validating primary data. [2025-09-23T17:10:27.197019] [DEBUG] [VALIDATOR ] ALEX: All expected trading days are present. [2025-09-23T17:10:27.197131] [DEBUG] [VALIDATOR ] ALEX: Primary data validation passed. [2025-09-23T17:10:27.197671] [INFO ] [MAIN ] ALEX: Fetched primary data is valid. [2025-09-23T17:10:27.197736] [DEBUG] [LOCAL ] ALEX: Saving primary data. [2025-09-23T17:10:27.199303] [DEBUG] [LOCAL ] ALEX: Trimmed 44567 records to 31336 (keeping 200 days of data) [2025-09-23T17:10:27.395038] [DEBUG] [LOCAL ] ALEX: Primary data saved (31336 records). [2025-09-23T17:10:27.395172] [INFO ] [MAIN ] ALEX: Full history saved. [2025-09-23T17:10:27.395257] [INFO ] [MAIN ] Update Progress: 84/2372 symbols completed. ALEX took 40.0s. Estimated remaining: 4h 43m 21s. Rate: 8.1 symbols/min [2025-09-23T17:10:27.407268] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-04. [2025-09-23T17:10:27.578364] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:10:27.621778] [DEBUG] [LOCAL ] ALSN: Loaded 43348 existing records from primary storage. [2025-09-23T17:10:27.621924] [INFO ] [MAIN ] ALSN: Loaded 43348 existing records. [2025-09-23T17:10:27.810883] [WARN ] [MAIN ] ALSN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:10:27.811147] [INFO ] [MAIN ] ALSN: Wiping existing primary data before full refresh. [2025-09-23T17:10:27.811196] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-09-23T17:10:27.812793] [DEBUG] [LOCAL ] ALSN: Deleted primary data file. [2025-09-23T17:10:27.812859] [INFO ] [MAIN ] ALSN: Starting full primary refresh. [2025-09-23T17:10:28.195877] [INFO ] [REMOTE ] ALSN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:10:28.202139] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-05. [2025-09-23T17:10:28.416724] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-23T17:10:29.002214] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-03. [2025-09-23T17:10:29.048976] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-23T17:10:29.567517] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-23T17:10:29.802203] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-05. [2025-09-23T17:10:30.602211] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2024-12. [2025-09-23T17:10:30.896580] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-23T17:10:31.275212] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-23T17:10:31.402192] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-06. [2025-09-23T17:10:32.202179] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-06. [2025-09-23T17:10:32.300070] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-23T17:10:33.007350] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-04. [2025-09-23T17:10:33.024505] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-23T17:10:33.802165] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-07. [2025-09-23T17:10:33.985044] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-23T17:10:34.334282] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-23T17:10:34.602259] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-05. [2025-09-23T17:10:35.402193] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-01. [2025-09-23T17:10:35.496886] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-23T17:10:36.013530] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-23T17:10:36.202193] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-08. [2025-09-23T17:10:36.554315] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-23T17:10:37.002208] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-02. [2025-09-23T17:10:37.593610] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-23T17:10:37.802202] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-09-23T17:10:38.602224] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-06. [2025-09-23T17:10:38.738333] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-23T17:10:39.321889] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-23T17:10:39.330665] [INFO ] [REMOTE ] ALLY: Full fetch complete (76880 records). [2025-09-23T17:10:39.330792] [DEBUG] [VALIDATOR ] ALLY: Validating primary data. [2025-09-23T17:10:39.407921] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-03. [2025-09-23T17:10:39.737171] [DEBUG] [VALIDATOR ] ALLY: All expected trading days are present. [2025-09-23T17:10:39.737290] [DEBUG] [VALIDATOR ] ALLY: Primary data validation passed. [2025-09-23T17:10:39.738122] [INFO ] [MAIN ] ALLY: Fetched primary data is valid. [2025-09-23T17:10:39.738201] [DEBUG] [LOCAL ] ALLY: Saving primary data. [2025-09-23T17:10:39.739964] [DEBUG] [LOCAL ] ALLY: Trimmed 76880 records to 53218 (keeping 200 days of data) [2025-09-23T17:10:39.898695] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-23T17:10:40.106023] [DEBUG] [LOCAL ] ALLY: Primary data saved (53218 records). [2025-09-23T17:10:40.106166] [INFO ] [MAIN ] ALLY: Full history saved. [2025-09-23T17:10:40.106249] [INFO ] [MAIN ] Update Progress: 85/2372 symbols completed. ALLY took 21.7s. Estimated remaining: 4h 45m 36s. Rate: 8.0 symbols/min [2025-09-23T17:10:40.207353] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-07. [2025-09-23T17:10:40.292364] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:10:40.314904] [DEBUG] [LOCAL ] ALTG: Loaded 24033 existing records from primary storage. [2025-09-23T17:10:40.315074] [INFO ] [MAIN ] ALTG: Loaded 24033 existing records. [2025-09-23T17:10:40.495585] [WARN ] [MAIN ] ALTG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:10:40.495878] [INFO ] [MAIN ] ALTG: Wiping existing primary data before full refresh. [2025-09-23T17:10:40.495927] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-09-23T17:10:40.496597] [DEBUG] [LOCAL ] ALTG: Deleted primary data file. [2025-09-23T17:10:40.496717] [INFO ] [MAIN ] ALTG: Starting full primary refresh. [2025-09-23T17:10:40.868334] [INFO ] [REMOTE ] ALTG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:10:40.938285] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-23T17:10:41.002244] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2024-12. [2025-09-23T17:10:41.755631] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-23T17:10:41.802188] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-08. [2025-09-23T17:10:42.052710] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-23T17:10:42.602215] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-07. [2025-09-23T17:10:42.983372] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-23T17:10:43.402282] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-04. [2025-09-23T17:10:44.202232] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-09-23T17:10:44.743170] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-23T17:10:44.832769] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-23T17:10:45.002202] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-01. [2025-09-23T17:10:45.488107] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-23T17:10:45.495437] [INFO ] [REMOTE ] ALLE: Full fetch complete (65031 records). [2025-09-23T17:10:45.495554] [DEBUG] [VALIDATOR ] ALLE: Validating primary data. [2025-09-23T17:10:45.808086] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-08. [2025-09-23T17:10:45.905079] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-23T17:10:45.929050] [DEBUG] [VALIDATOR ] ALLE: All expected trading days are present. [2025-09-23T17:10:45.929121] [DEBUG] [VALIDATOR ] ALLE: Primary data validation passed. [2025-09-23T17:10:45.929854] [INFO ] [MAIN ] ALLE: Fetched primary data is valid. [2025-09-23T17:10:45.929918] [DEBUG] [LOCAL ] ALLE: Saving primary data. [2025-09-23T17:10:45.931299] [DEBUG] [LOCAL ] ALLE: Trimmed 65031 records to 45201 (keeping 200 days of data) [2025-09-23T17:10:46.227735] [DEBUG] [LOCAL ] ALLE: Primary data saved (45201 records). [2025-09-23T17:10:46.227876] [INFO ] [MAIN ] ALLE: Full history saved. [2025-09-23T17:10:46.228610] [INFO ] [MAIN ] Update Progress: 86/2372 symbols completed. ALLE took 29.6s. Estimated remaining: 4h 44m 52s. Rate: 8.0 symbols/min [2025-09-23T17:10:46.396757] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:10:46.410328] [DEBUG] [LOCAL ] ALUR: Loaded 10934 existing records from primary storage. [2025-09-23T17:10:46.410456] [INFO ] [MAIN ] ALUR: Loaded 10934 existing records. [2025-09-23T17:10:46.607391] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-05. [2025-09-23T17:10:46.613513] [WARN ] [MAIN ] ALUR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:10:46.615094] [INFO ] [MAIN ] ALUR: Wiping existing primary data before full refresh. [2025-09-23T17:10:46.615163] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-09-23T17:10:46.615745] [DEBUG] [LOCAL ] ALUR: Deleted primary data file. [2025-09-23T17:10:46.615815] [INFO ] [MAIN ] ALUR: Starting full primary refresh. [2025-09-23T17:10:46.981540] [INFO ] [REMOTE ] ALUR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:10:47.402170] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2024-12. [2025-09-23T17:10:47.473985] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-23T17:10:47.766625] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-23T17:10:48.202193] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-06. [2025-09-23T17:10:48.529975] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-23T17:10:49.002207] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-09-23T17:10:49.513093] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-23T17:10:49.802203] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-01. [2025-09-23T17:10:50.330344] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-23T17:10:50.339686] [INFO ] [REMOTE ] ALL: Full fetch complete (72560 records). [2025-09-23T17:10:50.339809] [DEBUG] [VALIDATOR ] ALL: Validating primary data. [2025-09-23T17:10:50.608898] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-02. [2025-09-23T17:10:50.734402] [DEBUG] [VALIDATOR ] ALL: All expected trading days are present. [2025-09-23T17:10:50.735158] [DEBUG] [VALIDATOR ] ALL: Primary data validation passed. [2025-09-23T17:10:50.736072] [INFO ] [MAIN ] ALL: Fetched primary data is valid. [2025-09-23T17:10:50.736158] [DEBUG] [LOCAL ] ALL: Saving primary data. [2025-09-23T17:10:50.739258] [DEBUG] [LOCAL ] ALL: Trimmed 72560 records to 50241 (keeping 200 days of data) [2025-09-23T17:10:50.884282] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-23T17:10:51.084203] [DEBUG] [LOCAL ] ALL: Primary data saved (50241 records). [2025-09-23T17:10:51.084343] [INFO ] [MAIN ] ALL: Full history saved. [2025-09-23T17:10:51.084425] [INFO ] [MAIN ] Update Progress: 87/2372 symbols completed. ALL took 44.2s. Estimated remaining: 4h 43m 36s. Rate: 8.1 symbols/min [2025-09-23T17:10:51.251501] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:10:51.294198] [DEBUG] [LOCAL ] ALV: Loaded 42725 existing records from primary storage. [2025-09-23T17:10:51.294342] [INFO ] [MAIN ] ALV: Loaded 42725 existing records. [2025-09-23T17:10:51.405576] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-02. [2025-09-23T17:10:51.481783] [WARN ] [MAIN ] ALV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:10:51.482438] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-09-23T17:10:51.482526] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-09-23T17:10:51.495220] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-23T17:10:51.499384] [DEBUG] [LOCAL ] ALV: Deleted primary data file. [2025-09-23T17:10:51.500004] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-09-23T17:10:51.853724] [INFO ] [REMOTE ] ALV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:10:52.202195] [INFO ] [REMOTE ] ALV: Fetching primary data for 2024-12. [2025-09-23T17:10:52.399454] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-23T17:10:53.002245] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-07. [2025-09-23T17:10:53.502925] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-23T17:10:53.802215] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-03. [2025-09-23T17:10:54.227631] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-23T17:10:54.602252] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-08. [2025-09-23T17:10:54.683060] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-23T17:10:55.402200] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-04. [2025-09-23T17:10:55.944243] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-23T17:10:56.202221] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-01. [2025-09-23T17:10:56.227634] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-23T17:10:57.002233] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-03. [2025-09-23T17:10:57.360548] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-23T17:10:57.802199] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-05. [2025-09-23T17:10:58.164983] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-23T17:10:58.602218] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-09-23T17:10:59.046020] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-23T17:10:59.402210] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-06. [2025-09-23T17:10:59.797475] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-23T17:10:59.805365] [INFO ] [REMOTE ] ALSN: Full fetch complete (62018 records). [2025-09-23T17:10:59.805538] [DEBUG] [VALIDATOR ] ALSN: Validating primary data. [2025-09-23T17:11:00.173233] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-23T17:11:00.203840] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-09-23T17:11:00.227111] [DEBUG] [VALIDATOR ] ALSN: All expected trading days are present. [2025-09-23T17:11:00.227203] [DEBUG] [VALIDATOR ] ALSN: Primary data validation passed. [2025-09-23T17:11:00.227916] [INFO ] [MAIN ] ALSN: Fetched primary data is valid. [2025-09-23T17:11:00.228075] [DEBUG] [LOCAL ] ALSN: Saving primary data. [2025-09-23T17:11:00.229442] [DEBUG] [LOCAL ] ALSN: Trimmed 62018 records to 43307 (keeping 200 days of data) [2025-09-23T17:11:00.508596] [DEBUG] [LOCAL ] ALSN: Primary data saved (43307 records). [2025-09-23T17:11:00.508794] [INFO ] [MAIN ] ALSN: Full history saved. [2025-09-23T17:11:00.512397] [INFO ] [MAIN ] Update Progress: 88/2372 symbols completed. ALSN took 33.1s. Estimated remaining: 4h 44m 20s. Rate: 8.0 symbols/min [2025-09-23T17:11:00.684277] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:11:00.693701] [DEBUG] [LOCAL ] ALX: Loaded 5896 existing records from primary storage. [2025-09-23T17:11:00.693840] [INFO ] [MAIN ] ALX: Loaded 5896 existing records. [2025-09-23T17:11:00.870512] [WARN ] [MAIN ] ALX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:11:00.870868] [INFO ] [MAIN ] ALX: Wiping existing primary data before full refresh. [2025-09-23T17:11:00.870927] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-09-23T17:11:00.871352] [DEBUG] [LOCAL ] ALX: Deleted primary data file. [2025-09-23T17:11:00.871413] [INFO ] [MAIN ] ALX: Starting full primary refresh. [2025-09-23T17:11:01.011695] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-07. [2025-09-23T17:11:01.268155] [INFO ] [REMOTE ] ALX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:11:01.393406] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-23T17:11:01.802215] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-09-23T17:11:01.930016] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-23T17:11:02.602214] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-04. [2025-09-23T17:11:03.173199] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-23T17:11:03.402189] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-08. [2025-09-23T17:11:03.455954] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-23T17:11:03.887616] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-23T17:11:04.202252] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-05. [2025-09-23T17:11:04.842206] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-23T17:11:05.002201] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-06. [2025-09-23T17:11:05.802170] [INFO ] [REMOTE ] ALX: Fetching primary data for 2024-12. [2025-09-23T17:11:05.919031] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-23T17:11:06.275809] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-23T17:11:06.602225] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-09-23T17:11:07.390590] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-23T17:11:07.392133] [INFO ] [REMOTE ] ALUR: Full fetch complete (21065 records). [2025-09-23T17:11:07.392229] [DEBUG] [VALIDATOR ] ALUR: Validating primary data. [2025-09-23T17:11:07.407348] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-01. [2025-09-23T17:11:07.803279] [DEBUG] [VALIDATOR ] ALUR: All expected trading days are present. [2025-09-23T17:11:07.803381] [DEBUG] [VALIDATOR ] ALUR: Primary data validation passed. [2025-09-23T17:11:07.803744] [INFO ] [MAIN ] ALUR: Fetched primary data is valid. [2025-09-23T17:11:07.803807] [DEBUG] [LOCAL ] ALUR: Saving primary data. [2025-09-23T17:11:07.804886] [DEBUG] [LOCAL ] ALUR: Trimmed 21065 records to 10889 (keeping 200 days of data) [2025-09-23T17:11:07.871444] [DEBUG] [LOCAL ] ALUR: Primary data saved (10889 records). [2025-09-23T17:11:07.871592] [INFO ] [MAIN ] ALUR: Full history saved. [2025-09-23T17:11:07.871742] [INFO ] [MAIN ] Update Progress: 89/2372 symbols completed. ALUR took 21.6s. Estimated remaining: 4h 44m 9s. Rate: 8.0 symbols/min [2025-09-23T17:11:07.992686] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-23T17:11:08.054204] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:11:08.113360] [DEBUG] [LOCAL ] AM: Loaded 52159 existing records from primary storage. [2025-09-23T17:11:08.113526] [INFO ] [MAIN ] AM: Loaded 52159 existing records. [2025-09-23T17:11:08.207365] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-02. [2025-09-23T17:11:08.295410] [WARN ] [MAIN ] AM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:11:08.295698] [INFO ] [MAIN ] AM: Wiping existing primary data before full refresh. [2025-09-23T17:11:08.295754] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-09-23T17:11:08.297314] [DEBUG] [LOCAL ] AM: Deleted primary data file. [2025-09-23T17:11:08.297376] [INFO ] [MAIN ] AM: Starting full primary refresh. [2025-09-23T17:11:08.675873] [INFO ] [REMOTE ] AM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:11:08.680609] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-23T17:11:09.002197] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-07. [2025-09-23T17:11:09.802229] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-03. [2025-09-23T17:11:09.946165] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-23T17:11:10.183511] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-23T17:11:10.602246] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-08. [2025-09-23T17:11:11.402208] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-09-23T17:11:12.129743] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-23T17:11:12.202156] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-09-23T17:11:13.002166] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-04. [2025-09-23T17:11:13.362996] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-23T17:11:13.368373] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-23T17:11:13.433563] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-23T17:11:13.437976] [INFO ] [REMOTE ] ALTG: Full fetch complete (33623 records). [2025-09-23T17:11:13.438060] [DEBUG] [VALIDATOR ] ALTG: Validating primary data. [2025-09-23T17:11:13.805031] [INFO ] [REMOTE ] AM: Fetching primary data for 2024-12. [2025-09-23T17:11:13.830508] [DEBUG] [VALIDATOR ] ALTG: All expected trading days are present. [2025-09-23T17:11:13.830607] [DEBUG] [VALIDATOR ] ALTG: Primary data validation passed. [2025-09-23T17:11:13.831300] [INFO ] [MAIN ] ALTG: Fetched primary data is valid. [2025-09-23T17:11:13.831398] [DEBUG] [LOCAL ] ALTG: Saving primary data. [2025-09-23T17:11:13.832277] [DEBUG] [LOCAL ] ALTG: Trimmed 33623 records to 23978 (keeping 200 days of data) [2025-09-23T17:11:13.972983] [DEBUG] [LOCAL ] ALTG: Primary data saved (23978 records). [2025-09-23T17:11:13.973120] [INFO ] [MAIN ] ALTG: Full history saved. [2025-09-23T17:11:13.973246] [INFO ] [MAIN ] Update Progress: 90/2372 symbols completed. ALTG took 33.9s. Estimated remaining: 4h 43m 27s. Rate: 8.1 symbols/min [2025-09-23T17:11:14.144844] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:11:14.188201] [DEBUG] [LOCAL ] AMBC: Loaded 37269 existing records from primary storage. [2025-09-23T17:11:14.188339] [INFO ] [MAIN ] AMBC: Loaded 37269 existing records. [2025-09-23T17:11:14.367170] [WARN ] [MAIN ] AMBC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:11:14.367483] [INFO ] [MAIN ] AMBC: Wiping existing primary data before full refresh. [2025-09-23T17:11:14.367543] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-09-23T17:11:14.368591] [DEBUG] [LOCAL ] AMBC: Deleted primary data file. [2025-09-23T17:11:14.368686] [INFO ] [MAIN ] AMBC: Starting full primary refresh. [2025-09-23T17:11:14.611098] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-09-23T17:11:14.803740] [INFO ] [REMOTE ] AMBC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:11:15.402194] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2024-12. [2025-09-23T17:11:15.462807] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-23T17:11:15.803582] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-23T17:11:16.202206] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-05. [2025-09-23T17:11:16.642886] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-23T17:11:16.897551] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-23T17:11:17.002206] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-06. [2025-09-23T17:11:17.627580] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-23T17:11:17.802253] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-01. [2025-09-23T17:11:18.581391] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-23T17:11:18.602146] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-02. [2025-09-23T17:11:19.402239] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-09-23T17:11:19.552357] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-23T17:11:20.202258] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-03. [2025-09-23T17:11:20.656796] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-23T17:11:21.002209] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-09-23T17:11:21.708760] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-23T17:11:21.802191] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-04. [2025-09-23T17:11:22.281954] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-23T17:11:22.602216] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-01. [2025-09-23T17:11:23.045636] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-23T17:11:23.402223] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-05. [2025-09-23T17:11:23.937818] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-23T17:11:24.202200] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-02. [2025-09-23T17:11:24.462894] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-23T17:11:25.002214] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-06. [2025-09-23T17:11:25.802219] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-09-23T17:11:25.892954] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-23T17:11:26.043025] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-23T17:11:26.602266] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-03. [2025-09-23T17:11:27.312142] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-23T17:11:27.402280] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-07. [2025-09-23T17:11:27.970547] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-23T17:11:28.008822] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-23T17:11:28.202206] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-08. [2025-09-23T17:11:28.734972] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-23T17:11:29.002195] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-09-23T17:11:29.574412] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-23T17:11:29.576611] [INFO ] [REMOTE ] ALX: Full fetch complete (6824 records). [2025-09-23T17:11:29.576790] [DEBUG] [VALIDATOR ] ALX: Validating primary data. [2025-09-23T17:11:29.807775] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-04. [2025-09-23T17:11:30.035209] [DEBUG] [VALIDATOR ] ALX: All expected trading days are present. [2025-09-23T17:11:30.035290] [DEBUG] [VALIDATOR ] ALX: Primary data validation passed. [2025-09-23T17:11:30.035549] [INFO ] [MAIN ] ALX: Fetched primary data is valid. [2025-09-23T17:11:30.035611] [DEBUG] [LOCAL ] ALX: Saving primary data. [2025-09-23T17:11:30.036895] [DEBUG] [LOCAL ] ALX: Trimmed 6824 records to 5959 (keeping 200 days of data) [2025-09-23T17:11:30.078780] [DEBUG] [LOCAL ] ALX: Primary data saved (5959 records). [2025-09-23T17:11:30.078883] [INFO ] [MAIN ] ALX: Full history saved. [2025-09-23T17:11:30.078996] [INFO ] [MAIN ] Update Progress: 91/2372 symbols completed. ALX took 29.6s. Estimated remaining: 4h 46m 57s. Rate: 7.9 symbols/min [2025-09-23T17:11:30.251704] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:11:30.317337] [DEBUG] [LOCAL ] AMBP: Loaded 45371 existing records from primary storage. [2025-09-23T17:11:30.317481] [INFO ] [MAIN ] AMBP: Loaded 45371 existing records. [2025-09-23T17:11:30.505508] [WARN ] [MAIN ] AMBP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:11:30.505850] [INFO ] [MAIN ] AMBP: Wiping existing primary data before full refresh. [2025-09-23T17:11:30.505916] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-09-23T17:11:30.507146] [DEBUG] [LOCAL ] AMBP: Deleted primary data file. [2025-09-23T17:11:30.507220] [INFO ] [MAIN ] AMBP: Starting full primary refresh. [2025-09-23T17:11:30.607284] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-09-23T17:11:30.891866] [INFO ] [REMOTE ] AMBP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:11:31.402178] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-07. [2025-09-23T17:11:31.759686] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-23T17:11:31.868303] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-23T17:11:31.876809] [INFO ] [REMOTE ] ALV: Full fetch complete (61871 records). [2025-09-23T17:11:31.876942] [DEBUG] [VALIDATOR ] ALV: Validating primary data. [2025-09-23T17:11:32.207303] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2024-12. [2025-09-23T17:11:32.283056] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present. [2025-09-23T17:11:32.283146] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed. [2025-09-23T17:11:32.283793] [INFO ] [MAIN ] ALV: Fetched primary data is valid. [2025-09-23T17:11:32.283858] [DEBUG] [LOCAL ] ALV: Saving primary data. [2025-09-23T17:11:32.287581] [DEBUG] [LOCAL ] ALV: Trimmed 61871 records to 42654 (keeping 200 days of data) [2025-09-23T17:11:32.571248] [DEBUG] [LOCAL ] ALV: Primary data saved (42654 records). [2025-09-23T17:11:32.571388] [INFO ] [MAIN ] ALV: Full history saved. [2025-09-23T17:11:32.571492] [INFO ] [MAIN ] Update Progress: 92/2372 symbols completed. ALV took 41.5s. Estimated remaining: 4h 44m 44s. Rate: 8.0 symbols/min [2025-09-23T17:11:32.758279] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-23T17:11:32.790164] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:11:32.791096] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-09-23T17:11:32.791348] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-09-23T17:11:32.791698] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-09-23T17:11:32.791765] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-09-23T17:11:32.791821] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-09-23T17:11:32.791857] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-09-23T17:11:33.007353] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-05. [2025-09-23T17:11:33.162558] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:11:33.679393] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-23T17:11:33.802191] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-08. [2025-09-23T17:11:34.467472] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-23T17:11:34.602251] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2024-12. [2025-09-23T17:11:34.803588] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:11:34.803994] [WARN ] [REMOTE ] AMBQ: No data returned for month 2024-12 [2025-09-23T17:11:35.096445] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-23T17:11:35.402232] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-01. [2025-09-23T17:11:36.202187] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-06. [2025-09-23T17:11:36.612124] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-23T17:11:37.002201] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-02. [2025-09-23T17:11:37.704997] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-23T17:11:37.802201] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-07. [2025-09-23T17:11:38.114005] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-23T17:11:38.602218] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-01. [2025-09-23T17:11:38.799073] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:11:38.799408] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-01 [2025-09-23T17:11:39.127937] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-23T17:11:39.402225] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-08. [2025-09-23T17:11:40.202236] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-03. [2025-09-23T17:11:41.002181] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-09. [2025-09-23T17:11:41.042333] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-23T17:11:41.365766] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-23T17:11:41.802224] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-04. [2025-09-23T17:11:41.949858] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-23T17:11:41.956370] [INFO ] [REMOTE ] AMBC: Full fetch complete (51037 records). [2025-09-23T17:11:41.956483] [DEBUG] [VALIDATOR ] AMBC: Validating primary data. [2025-09-23T17:11:42.361492] [DEBUG] [VALIDATOR ] AMBC: All expected trading days are present. [2025-09-23T17:11:42.361672] [DEBUG] [VALIDATOR ] AMBC: Primary data validation passed. [2025-09-23T17:11:42.362276] [INFO ] [MAIN ] AMBC: Fetched primary data is valid. [2025-09-23T17:11:42.362321] [DEBUG] [LOCAL ] AMBC: Saving primary data. [2025-09-23T17:11:42.363505] [DEBUG] [LOCAL ] AMBC: Trimmed 51037 records to 37181 (keeping 200 days of data) [2025-09-23T17:11:42.575060] [DEBUG] [LOCAL ] AMBC: Primary data saved (37181 records). [2025-09-23T17:11:42.575217] [INFO ] [MAIN ] AMBC: Full history saved. [2025-09-23T17:11:42.575341] [INFO ] [MAIN ] Update Progress: 93/2372 symbols completed. AMBC took 28.6s. Estimated remaining: 4h 45m 38s. Rate: 8.0 symbols/min [2025-09-23T17:11:42.607435] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-09-23T17:11:42.757007] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:11:42.814365] [DEBUG] [LOCAL ] AMC: Loaded 53758 existing records from primary storage. [2025-09-23T17:11:42.814514] [INFO ] [MAIN ] AMC: Loaded 53758 existing records. [2025-09-23T17:11:43.011545] [WARN ] [MAIN ] AMC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:11:43.012199] [INFO ] [MAIN ] AMC: Wiping existing primary data before full refresh. [2025-09-23T17:11:43.012344] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-09-23T17:11:43.014082] [DEBUG] [LOCAL ] AMC: Deleted primary data file. [2025-09-23T17:11:43.014149] [INFO ] [MAIN ] AMC: Starting full primary refresh. [2025-09-23T17:11:43.416191] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-23T17:11:43.414637] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-02. [2025-09-23T17:11:43.422162] [INFO ] [REMOTE ] AMC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:11:43.634188] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:11:43.634501] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-02 [2025-09-23T17:11:44.052111] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-23T17:11:44.060900] [INFO ] [REMOTE ] AM: Full fetch complete (75613 records). [2025-09-23T17:11:44.061068] [DEBUG] [VALIDATOR ] AM: Validating primary data. [2025-09-23T17:11:44.207343] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-03. [2025-09-23T17:11:44.478337] [DEBUG] [VALIDATOR ] AM: All expected trading days are present. [2025-09-23T17:11:44.478434] [DEBUG] [VALIDATOR ] AM: Primary data validation passed. [2025-09-23T17:11:44.479176] [INFO ] [MAIN ] AM: Fetched primary data is valid. [2025-09-23T17:11:44.479244] [DEBUG] [LOCAL ] AM: Saving primary data. [2025-09-23T17:11:44.480863] [DEBUG] [LOCAL ] AM: Trimmed 75613 records to 52154 (keeping 200 days of data) [2025-09-23T17:11:44.546739] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:11:44.581523] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-03 [2025-09-23T17:11:44.812263] [DEBUG] [LOCAL ] AM: Primary data saved (52154 records). [2025-09-23T17:11:44.812417] [INFO ] [MAIN ] AM: Full history saved. [2025-09-23T17:11:44.812508] [INFO ] [MAIN ] Update Progress: 94/2372 symbols completed. AM took 36.9s. Estimated remaining: 4h 43m 22s. Rate: 8.0 symbols/min [2025-09-23T17:11:45.015347] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:11:45.011293] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-05. [2025-09-23T17:11:45.077788] [DEBUG] [LOCAL ] AMCR: Loaded 53668 existing records from primary storage. [2025-09-23T17:11:45.077955] [INFO ] [MAIN ] AMCR: Loaded 53668 existing records. [2025-09-23T17:11:45.261849] [WARN ] [MAIN ] AMCR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:11:45.262128] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-09-23T17:11:45.262178] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-09-23T17:11:45.263705] [DEBUG] [LOCAL ] AMCR: Deleted primary data file. [2025-09-23T17:11:45.263768] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-09-23T17:11:45.632217] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:11:45.802200] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-04. [2025-09-23T17:11:46.004506] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:11:46.004835] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-04 [2025-09-23T17:11:46.602219] [INFO ] [REMOTE ] AMC: Fetching primary data for 2024-12. [2025-09-23T17:11:46.707420] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-23T17:11:47.402213] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-06. [2025-09-23T17:11:48.202244] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-05. [2025-09-23T17:11:48.414894] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:11:48.415246] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-05 [2025-09-23T17:11:48.957347] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-23T17:11:49.002166] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-07. [2025-09-23T17:11:49.471682] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2024-12 (2.87 seconds). [2025-09-23T17:11:49.802200] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-06. [2025-09-23T17:11:49.992109] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:11:49.992432] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-06 [2025-09-23T17:11:50.357722] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-23T17:11:50.602197] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2024-12. [2025-09-23T17:11:51.402253] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-01. [2025-09-23T17:11:52.202222] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-07. [2025-09-23T17:11:52.410007] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-23T17:11:52.788929] [INFO ] [REMOTE ] AMBQ: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-23T17:11:53.002205] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-08. [2025-09-23T17:11:53.336757] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-23T17:11:53.802202] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-01. [2025-09-23T17:11:54.203311] [INFO ] [REMOTE ] AMBQ: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-23T17:11:54.602208] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-08. [2025-09-23T17:11:55.121198] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-23T17:11:55.402187] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-09. [2025-09-23T17:11:55.807137] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-23T17:11:56.202249] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-09-23T17:11:56.369840] [INFO ] [REMOTE ] AMBQ: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-23T17:11:56.374205] [INFO ] [REMOTE ] AMBQ: Full fetch complete (7753 records). [2025-09-23T17:11:56.374293] [DEBUG] [VALIDATOR ] AMBQ: Validating primary data. [2025-09-23T17:11:56.558200] [WARN ] [VALIDATOR ] AMBQ: Validation failed - insufficient historical data. Have 39 unique days, need 200 days [2025-09-23T17:11:56.558459] [FATAL] [MAIN ] AMBQ: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:11:56.558531] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:11:56.558605] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-09-23T17:11:56.558707] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-09-23T17:11:56.558761] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-09-23T17:11:56.558805] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-09-23T17:11:56.558865] [INFO ] [MAIN ] Update Progress: 95/2372 symbols completed. AMBQ took 24.0s. Estimated remaining: 4h 44m 58s. Rate: 8.0 symbols/min [2025-09-23T17:11:56.730788] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:11:56.783770] [DEBUG] [LOCAL ] AME: Loaded 48548 existing records from primary storage. [2025-09-23T17:11:56.783956] [INFO ] [MAIN ] AME: Loaded 48548 existing records. [2025-09-23T17:11:56.964784] [WARN ] [MAIN ] AME: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:11:56.965083] [INFO ] [MAIN ] AME: Wiping existing primary data before full refresh. [2025-09-23T17:11:56.965137] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-09-23T17:11:56.966877] [DEBUG] [LOCAL ] AME: Deleted primary data file. [2025-09-23T17:11:56.966940] [INFO ] [MAIN ] AME: Starting full primary refresh. [2025-09-23T17:11:57.008826] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-09. [2025-09-23T17:11:57.334985] [INFO ] [REMOTE ] AME: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:11:57.807296] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-02. [2025-09-23T17:11:57.828088] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-23T17:11:58.270684] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-23T17:11:58.281559] [INFO ] [REMOTE ] AMBP: Full fetch complete (66042 records). [2025-09-23T17:11:58.281768] [DEBUG] [VALIDATOR ] AMBP: Validating primary data. [2025-09-23T17:11:58.607311] [INFO ] [REMOTE ] AME: Fetching primary data for 2024-12. [2025-09-23T17:11:58.690228] [DEBUG] [VALIDATOR ] AMBP: All expected trading days are present. [2025-09-23T17:11:58.690324] [DEBUG] [VALIDATOR ] AMBP: Primary data validation passed. [2025-09-23T17:11:58.691041] [INFO ] [MAIN ] AMBP: Fetched primary data is valid. [2025-09-23T17:11:58.691107] [DEBUG] [LOCAL ] AMBP: Saving primary data. [2025-09-23T17:11:58.692676] [DEBUG] [LOCAL ] AMBP: Trimmed 66042 records to 45331 (keeping 200 days of data) [2025-09-23T17:11:58.957985] [DEBUG] [LOCAL ] AMBP: Primary data saved (45331 records). [2025-09-23T17:11:58.958124] [INFO ] [MAIN ] AMBP: Full history saved. [2025-09-23T17:11:58.959260] [INFO ] [MAIN ] Update Progress: 96/2372 symbols completed. AMBP took 28.9s. Estimated remaining: 4h 42m 49s. Rate: 8.0 symbols/min [2025-09-23T17:11:59.177354] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:11:59.202878] [DEBUG] [LOCAL ] AMG: Loaded 20789 existing records from primary storage. [2025-09-23T17:11:59.203061] [INFO ] [MAIN ] AMG: Loaded 20789 existing records. [2025-09-23T17:11:59.395119] [WARN ] [MAIN ] AMG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:11:59.395390] [INFO ] [MAIN ] AMG: Wiping existing primary data before full refresh. [2025-09-23T17:11:59.395439] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-09-23T17:11:59.396300] [DEBUG] [LOCAL ] AMG: Deleted primary data file. [2025-09-23T17:11:59.396362] [INFO ] [MAIN ] AMG: Starting full primary refresh. [2025-09-23T17:11:59.428379] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-09-23T17:11:59.758916] [INFO ] [REMOTE ] AMG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:12:00.041829] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-09-23T17:12:00.202209] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-03. [2025-09-23T17:12:00.614800] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-23T17:12:01.002184] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-01. [2025-09-23T17:12:01.081473] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-23T17:12:01.802213] [INFO ] [REMOTE ] AMG: Fetching primary data for 2024-12. [2025-09-23T17:12:02.602174] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-09-23T17:12:02.828841] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-03 (2.63 seconds). [2025-09-23T17:12:02.897683] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-23T17:12:03.402237] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-04. [2025-09-23T17:12:04.202237] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-02. [2025-09-23T17:12:04.556393] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2024-12 (2.75 seconds). [2025-09-23T17:12:05.002200] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-01. [2025-09-23T17:12:05.450293] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (2.85 seconds). [2025-09-23T17:12:05.545568] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-23T17:12:05.802165] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-03. [2025-09-23T17:12:05.906252] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-09-23T17:12:06.031808] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-23T17:12:06.602229] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-02. [2025-09-23T17:12:07.263912] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-23T17:12:07.402200] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-04. [2025-09-23T17:12:07.841093] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-23T17:12:08.202145] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-03. [2025-09-23T17:12:08.820457] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-23T17:12:09.002183] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-05. [2025-09-23T17:12:09.063816] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-23T17:12:09.802194] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-09-23T17:12:10.432661] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-23T17:12:10.602227] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-04. [2025-09-23T17:12:11.332690] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-23T17:12:11.402168] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-09-23T17:12:11.455383] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-23T17:12:12.202251] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-05. [2025-09-23T17:12:13.002168] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-05. [2025-09-23T17:12:13.171722] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-23T17:12:13.239999] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-23T17:12:13.802249] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-06. [2025-09-23T17:12:14.602244] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-06. [2025-09-23T17:12:15.402305] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-09-23T17:12:15.573342] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-05 (2.57 seconds). [2025-09-23T17:12:16.181300] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-23T17:12:16.202149] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-07. [2025-09-23T17:12:16.402580] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-09-23T17:12:17.002282] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-06. [2025-09-23T17:12:17.344406] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-23T17:12:17.674621] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-09-23T17:12:17.802240] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-08. [2025-09-23T17:12:18.501148] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-23T17:12:18.602190] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-09-23T17:12:19.031916] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-23T17:12:19.406045] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-09-23T17:12:19.411232] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-23T17:12:19.419438] [INFO ] [REMOTE ] AMG: Full fetch complete (29795 records). [2025-09-23T17:12:19.419581] [DEBUG] [VALIDATOR ] AMG: Validating primary data. [2025-09-23T17:12:19.970089] [DEBUG] [VALIDATOR ] AMG: All expected trading days are present. [2025-09-23T17:12:19.970206] [DEBUG] [VALIDATOR ] AMG: Primary data validation passed. [2025-09-23T17:12:19.970802] [INFO ] [MAIN ] AMG: Fetched primary data is valid. [2025-09-23T17:12:19.970931] [DEBUG] [LOCAL ] AMG: Saving primary data. [2025-09-23T17:12:19.972254] [DEBUG] [LOCAL ] AMG: Trimmed 29795 records to 20774 (keeping 200 days of data) [2025-09-23T17:12:20.152754] [DEBUG] [LOCAL ] AMG: Primary data saved (20774 records). [2025-09-23T17:12:20.152947] [INFO ] [MAIN ] AMG: Full history saved. [2025-09-23T17:12:20.153081] [INFO ] [MAIN ] Update Progress: 97/2372 symbols completed. AMG took 21.2s. Estimated remaining: 4h 48m 4s. Rate: 7.9 symbols/min [2025-09-23T17:12:20.209599] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-07. [2025-09-23T17:12:20.426452] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:12:20.500757] [DEBUG] [LOCAL ] AMH: Loaded 51691 existing records from primary storage. [2025-09-23T17:12:20.500970] [INFO ] [MAIN ] AMH: Loaded 51691 existing records. [2025-09-23T17:12:20.712127] [WARN ] [MAIN ] AMH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:12:20.712435] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-09-23T17:12:20.712485] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-09-23T17:12:20.714434] [DEBUG] [LOCAL ] AMH: Deleted primary data file. [2025-09-23T17:12:20.714500] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-09-23T17:12:21.006793] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-07. [2025-09-23T17:12:21.154796] [INFO ] [REMOTE ] AMH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:12:21.184974] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-23T17:12:21.802201] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-09-23T17:12:22.323938] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-23T17:12:22.602199] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-08. [2025-09-23T17:12:22.677692] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-23T17:12:23.402214] [INFO ] [REMOTE ] AMH: Fetching primary data for 2024-12. [2025-09-23T17:12:23.599689] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-23T17:12:23.608398] [INFO ] [REMOTE ] AMCR: Full fetch complete (77677 records). [2025-09-23T17:12:23.608524] [DEBUG] [VALIDATOR ] AMCR: Validating primary data. [2025-09-23T17:12:24.002669] [DEBUG] [VALIDATOR ] AMCR: All expected trading days are present. [2025-09-23T17:12:24.002759] [DEBUG] [VALIDATOR ] AMCR: Primary data validation passed. [2025-09-23T17:12:24.003549] [INFO ] [MAIN ] AMCR: Fetched primary data is valid. [2025-09-23T17:12:24.003614] [DEBUG] [LOCAL ] AMCR: Saving primary data. [2025-09-23T17:12:24.005112] [DEBUG] [LOCAL ] AMCR: Trimmed 77677 records to 53668 (keeping 200 days of data) [2025-09-23T17:12:24.210316] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-08. [2025-09-23T17:12:24.335517] [DEBUG] [LOCAL ] AMCR: Primary data saved (53668 records). [2025-09-23T17:12:24.335705] [INFO ] [MAIN ] AMCR: Full history saved. [2025-09-23T17:12:24.335809] [INFO ] [MAIN ] Update Progress: 98/2372 symbols completed. AMCR took 39.5s. Estimated remaining: 4h 46m 37s. Rate: 7.9 symbols/min [2025-09-23T17:12:24.514240] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:12:24.557099] [DEBUG] [LOCAL ] AMN: Loaded 42032 existing records from primary storage. [2025-09-23T17:12:24.557394] [INFO ] [MAIN ] AMN: Loaded 42032 existing records. [2025-09-23T17:12:24.777955] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-23T17:12:24.784391] [WARN ] [MAIN ] AMN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:12:24.795620] [INFO ] [MAIN ] AMN: Wiping existing primary data before full refresh. [2025-09-23T17:12:24.795902] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-09-23T17:12:24.798042] [DEBUG] [LOCAL ] AMN: Deleted primary data file. [2025-09-23T17:12:24.798112] [INFO ] [MAIN ] AMN: Starting full primary refresh. [2025-09-23T17:12:25.007790] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-09-23T17:12:25.188861] [INFO ] [REMOTE ] AMN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:12:25.217680] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-23T17:12:25.561411] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-23T17:12:25.802203] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-09-23T17:12:26.602252] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-01. [2025-09-23T17:12:27.123322] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-23T17:12:27.133312] [INFO ] [REMOTE ] AMC: Full fetch complete (77923 records). [2025-09-23T17:12:27.133517] [DEBUG] [VALIDATOR ] AMC: Validating primary data. [2025-09-23T17:12:27.407326] [INFO ] [REMOTE ] AMN: Fetching primary data for 2024-12. [2025-09-23T17:12:27.555146] [DEBUG] [VALIDATOR ] AMC: All expected trading days are present. [2025-09-23T17:12:27.555279] [DEBUG] [VALIDATOR ] AMC: Primary data validation passed. [2025-09-23T17:12:27.556275] [INFO ] [MAIN ] AMC: Fetched primary data is valid. [2025-09-23T17:12:27.556367] [DEBUG] [LOCAL ] AMC: Saving primary data. [2025-09-23T17:12:27.558333] [DEBUG] [LOCAL ] AMC: Trimmed 77923 records to 53758 (keeping 200 days of data) [2025-09-23T17:12:27.670060] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-23T17:12:27.693701] [INFO ] [REMOTE ] AME: Full fetch complete (69704 records). [2025-09-23T17:12:27.697162] [DEBUG] [VALIDATOR ] AME: Validating primary data. [2025-09-23T17:12:28.234380] [DEBUG] [VALIDATOR ] AME: All expected trading days are present. [2025-09-23T17:12:28.235236] [DEBUG] [VALIDATOR ] AME: Primary data validation passed. [2025-09-23T17:12:28.236172] [INFO ] [MAIN ] AME: Fetched primary data is valid. [2025-09-23T17:12:28.237406] [DEBUG] [LOCAL ] AME: Saving primary data. [2025-09-23T17:12:28.246288] [DEBUG] [LOCAL ] AME: Trimmed 69704 records to 48543 (keeping 200 days of data) [2025-09-23T17:12:28.391790] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-23T17:12:28.408574] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-09-23T17:12:28.534775] [DEBUG] [LOCAL ] AMC: Primary data saved (53758 records). [2025-09-23T17:12:28.536471] [INFO ] [MAIN ] AMC: Full history saved. [2025-09-23T17:12:28.536851] [INFO ] [MAIN ] Update Progress: 99/2372 symbols completed. AMC took 46.0s. Estimated remaining: 4h 45m 12s. Rate: 8.0 symbols/min [2025-09-23T17:12:28.727354] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:12:28.922924] [DEBUG] [LOCAL ] AMP: Loaded 32634 existing records from primary storage. [2025-09-23T17:12:28.923747] [INFO ] [MAIN ] AMP: Loaded 32634 existing records. [2025-09-23T17:12:29.113596] [WARN ] [MAIN ] AMP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:12:29.128887] [INFO ] [MAIN ] AMP: Wiping existing primary data before full refresh. [2025-09-23T17:12:29.137802] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-09-23T17:12:29.141559] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-23T17:12:29.141970] [DEBUG] [LOCAL ] AMP: Deleted primary data file. [2025-09-23T17:12:29.151406] [INFO ] [MAIN ] AMP: Starting full primary refresh. [2025-09-23T17:12:29.152195] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-01. [2025-09-23T17:12:29.187868] [DEBUG] [LOCAL ] AME: Primary data saved (48543 records). [2025-09-23T17:12:29.204985] [INFO ] [MAIN ] AME: Full history saved. [2025-09-23T17:12:29.222730] [INFO ] [MAIN ] Update Progress: 100/2372 symbols completed. AME took 32.7s. Estimated remaining: 4h 42m 29s. Rate: 8.0 symbols/min [2025-09-23T17:12:29.609663] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:12:29.750978] [INFO ] [REMOTE ] AMP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:12:29.790314] [DEBUG] [LOCAL ] AMPX: Loaded 52158 existing records from primary storage. [2025-09-23T17:12:29.790553] [INFO ] [MAIN ] AMPX: Loaded 52158 existing records. [2025-09-23T17:12:29.811203] [INFO ] [REMOTE ] AMP: Fetching primary data for 2024-12. [2025-09-23T17:12:29.978699] [WARN ] [MAIN ] AMPX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:12:29.978940] [INFO ] [MAIN ] AMPX: Wiping existing primary data before full refresh. [2025-09-23T17:12:29.978988] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-09-23T17:12:29.980731] [DEBUG] [LOCAL ] AMPX: Deleted primary data file. [2025-09-23T17:12:29.980794] [INFO ] [MAIN ] AMPX: Starting full primary refresh. [2025-09-23T17:12:30.354689] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-23T17:12:30.397951] [INFO ] [REMOTE ] AMPX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:12:30.426162] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-23T17:12:30.602216] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2024-12. [2025-09-23T17:12:31.171185] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-23T17:12:31.402221] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-09-23T17:12:32.202221] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-02. [2025-09-23T17:12:32.279699] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-23T17:12:32.743095] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-23T17:12:33.002222] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-09-23T17:12:33.300220] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-23T17:12:33.802219] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-03. [2025-09-23T17:12:34.302083] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-23T17:12:34.602243] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-09-23T17:12:35.018251] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-23T17:12:35.402256] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-01. [2025-09-23T17:12:36.002396] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-23T17:12:36.202271] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-01. [2025-09-23T17:12:37.002233] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-09-23T17:12:37.142277] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-23T17:12:37.338119] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-23T17:12:37.802244] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-02. [2025-09-23T17:12:38.339735] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-23T17:12:38.602195] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-09-23T17:12:39.402202] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-04. [2025-09-23T17:12:39.532508] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-23T17:12:39.888594] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-23T17:12:40.202221] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-09-23T17:12:40.872396] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-23T17:12:41.002229] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-03. [2025-09-23T17:12:41.802160] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-05. [2025-09-23T17:12:41.919437] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-23T17:12:42.602201] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-09-23T17:12:43.060840] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-23T17:12:43.168072] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-23T17:12:43.402183] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-06. [2025-09-23T17:12:44.202199] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-02. [2025-09-23T17:12:44.329693] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-23T17:12:44.338400] [INFO ] [REMOTE ] AMH: Full fetch complete (74698 records). [2025-09-23T17:12:44.338529] [DEBUG] [VALIDATOR ] AMH: Validating primary data. [2025-09-23T17:12:44.758553] [DEBUG] [VALIDATOR ] AMH: All expected trading days are present. [2025-09-23T17:12:44.762138] [DEBUG] [VALIDATOR ] AMH: Primary data validation passed. [2025-09-23T17:12:44.762960] [INFO ] [MAIN ] AMH: Fetched primary data is valid. [2025-09-23T17:12:44.763093] [DEBUG] [LOCAL ] AMH: Saving primary data. [2025-09-23T17:12:44.765317] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-23T17:12:44.774116] [DEBUG] [LOCAL ] AMH: Trimmed 74698 records to 51695 (keeping 200 days of data) [2025-09-23T17:12:45.002858] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-04. [2025-09-23T17:12:45.094415] [DEBUG] [LOCAL ] AMH: Primary data saved (51695 records). [2025-09-23T17:12:45.094627] [INFO ] [MAIN ] AMH: Full history saved. [2025-09-23T17:12:45.094750] [INFO ] [MAIN ] Update Progress: 101/2372 symbols completed. AMH took 24.9s. Estimated remaining: 4h 45m 31s. Rate: 8.0 symbols/min [2025-09-23T17:12:45.267051] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:12:45.303083] [DEBUG] [LOCAL ] AMPY: Loaded 37411 existing records from primary storage. [2025-09-23T17:12:45.303389] [INFO ] [MAIN ] AMPY: Loaded 37411 existing records. [2025-09-23T17:12:45.420310] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-23T17:12:45.505375] [WARN ] [MAIN ] AMPY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:12:45.505628] [INFO ] [MAIN ] AMPY: Wiping existing primary data before full refresh. [2025-09-23T17:12:45.505708] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-09-23T17:12:45.506757] [DEBUG] [LOCAL ] AMPY: Deleted primary data file. [2025-09-23T17:12:45.506818] [INFO ] [MAIN ] AMPY: Starting full primary refresh. [2025-09-23T17:12:45.807374] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-07. [2025-09-23T17:12:45.863549] [INFO ] [REMOTE ] AMPY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:12:46.407978] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-23T17:12:46.602215] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2024-12. [2025-09-23T17:12:47.052033] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-23T17:12:47.402221] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-03. [2025-09-23T17:12:47.466717] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-23T17:12:48.202231] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-01. [2025-09-23T17:12:49.002221] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-08. [2025-09-23T17:12:49.239017] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-23T17:12:49.469560] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-23T17:12:49.802187] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-02. [2025-09-23T17:12:50.227218] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-23T17:12:50.602213] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-05. [2025-09-23T17:12:50.981812] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-23T17:12:51.402231] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-03. [2025-09-23T17:12:52.202219] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-04. [2025-09-23T17:12:52.293833] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-23T17:12:52.517189] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-23T17:12:53.002228] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-06. [2025-09-23T17:12:53.547497] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-23T17:12:53.802249] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-04. [2025-09-23T17:12:54.510088] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-23T17:12:54.602177] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-07. [2025-09-23T17:12:54.942225] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-23T17:12:55.402196] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-05. [2025-09-23T17:12:56.202206] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-09-23T17:12:56.526329] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-23T17:12:56.620490] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-23T17:12:57.002196] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-06. [2025-09-23T17:12:57.703154] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-23T17:12:57.712086] [INFO ] [REMOTE ] AMN: Full fetch complete (60531 records). [2025-09-23T17:12:57.712268] [DEBUG] [VALIDATOR ] AMN: Validating primary data. [2025-09-23T17:12:57.809020] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-05. [2025-09-23T17:12:58.144908] [DEBUG] [VALIDATOR ] AMN: All expected trading days are present. [2025-09-23T17:12:58.145175] [DEBUG] [VALIDATOR ] AMN: Primary data validation passed. [2025-09-23T17:12:58.145923] [INFO ] [MAIN ] AMN: Fetched primary data is valid. [2025-09-23T17:12:58.145992] [DEBUG] [LOCAL ] AMN: Saving primary data. [2025-09-23T17:12:58.154106] [DEBUG] [LOCAL ] AMN: Trimmed 60531 records to 42049 (keeping 200 days of data) [2025-09-23T17:12:58.166320] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-23T17:12:58.429131] [DEBUG] [LOCAL ] AMN: Primary data saved (42049 records). [2025-09-23T17:12:58.429290] [INFO ] [MAIN ] AMN: Full history saved. [2025-09-23T17:12:58.429389] [INFO ] [MAIN ] Update Progress: 102/2372 symbols completed. AMN took 34.1s. Estimated remaining: 4h 47m 32s. Rate: 7.9 symbols/min [2025-09-23T17:12:58.614220] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-07. [2025-09-23T17:12:58.619188] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:12:58.653893] [DEBUG] [LOCAL ] AMR: Loaded 29089 existing records from primary storage. [2025-09-23T17:12:58.654091] [INFO ] [MAIN ] AMR: Loaded 29089 existing records. [2025-09-23T17:12:58.833812] [WARN ] [MAIN ] AMR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:12:58.834058] [INFO ] [MAIN ] AMR: Wiping existing primary data before full refresh. [2025-09-23T17:12:58.834107] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-09-23T17:12:58.835244] [DEBUG] [LOCAL ] AMR: Deleted primary data file. [2025-09-23T17:12:58.835310] [INFO ] [MAIN ] AMR: Starting full primary refresh. [2025-09-23T17:12:59.194239] [INFO ] [REMOTE ] AMR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:12:59.242875] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-23T17:12:59.402172] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-06. [2025-09-23T17:12:59.689530] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-23T17:13:00.202208] [INFO ] [REMOTE ] AMR: Fetching primary data for 2024-12. [2025-09-23T17:13:00.812585] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-23T17:13:01.002238] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-08. [2025-09-23T17:13:01.066490] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-23T17:13:01.802225] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-01. [2025-09-23T17:13:01.921740] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-23T17:13:02.443855] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-23T17:13:02.602212] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-02. [2025-09-23T17:13:03.402179] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-07. [2025-09-23T17:13:03.798127] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-23T17:13:04.202251] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-09-23T17:13:04.475775] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-23T17:13:05.002207] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-03. [2025-09-23T17:13:05.661139] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-23T17:13:05.666575] [INFO ] [REMOTE ] AMP: Full fetch complete (47589 records). [2025-09-23T17:13:05.666690] [DEBUG] [VALIDATOR ] AMP: Validating primary data. [2025-09-23T17:13:05.807357] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-08. [2025-09-23T17:13:06.053520] [DEBUG] [VALIDATOR ] AMP: All expected trading days are present. [2025-09-23T17:13:06.053669] [DEBUG] [VALIDATOR ] AMP: Primary data validation passed. [2025-09-23T17:13:06.054677] [INFO ] [MAIN ] AMP: Fetched primary data is valid. [2025-09-23T17:13:06.054763] [DEBUG] [LOCAL ] AMP: Saving primary data. [2025-09-23T17:13:06.056126] [DEBUG] [LOCAL ] AMP: Trimmed 47589 records to 32522 (keeping 200 days of data) [2025-09-23T17:13:06.168013] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-23T17:13:06.282588] [DEBUG] [LOCAL ] AMP: Primary data saved (32522 records). [2025-09-23T17:13:06.282743] [INFO ] [MAIN ] AMP: Full history saved. [2025-09-23T17:13:06.282830] [INFO ] [MAIN ] Update Progress: 103/2372 symbols completed. AMP took 37.7s. Estimated remaining: 4h 47m 30s. Rate: 7.9 symbols/min [2025-09-23T17:13:06.451479] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:13:06.488400] [DEBUG] [LOCAL ] AMRC: Loaded 38463 existing records from primary storage. [2025-09-23T17:13:06.488537] [INFO ] [MAIN ] AMRC: Loaded 38463 existing records. [2025-09-23T17:13:06.607325] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-08. [2025-09-23T17:13:06.670229] [WARN ] [MAIN ] AMRC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:13:06.670480] [INFO ] [MAIN ] AMRC: Wiping existing primary data before full refresh. [2025-09-23T17:13:06.670529] [INFO ] [LOCAL ] AMRC: Starting deletion of primary data. [2025-09-23T17:13:06.671822] [DEBUG] [LOCAL ] AMRC: Deleted primary data file. [2025-09-23T17:13:06.671885] [INFO ] [MAIN ] AMRC: Starting full primary refresh. [2025-09-23T17:13:07.037164] [INFO ] [REMOTE ] AMRC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:13:07.402200] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2024-12. [2025-09-23T17:13:07.939381] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-23T17:13:08.202265] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-04. [2025-09-23T17:13:08.267462] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-09-23T17:13:08.456683] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-23T17:13:09.002254] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-09-23T17:13:09.347633] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-23T17:13:09.802204] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-09-23T17:13:10.602189] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-01. [2025-09-23T17:13:10.799061] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-23T17:13:10.804732] [INFO ] [REMOTE ] AMPY: Full fetch complete (50241 records). [2025-09-23T17:13:10.804884] [DEBUG] [VALIDATOR ] AMPY: Validating primary data. [2025-09-23T17:13:11.220702] [DEBUG] [VALIDATOR ] AMPY: All expected trading days are present. [2025-09-23T17:13:11.220945] [DEBUG] [VALIDATOR ] AMPY: Primary data validation passed. [2025-09-23T17:13:11.221567] [INFO ] [MAIN ] AMPY: Fetched primary data is valid. [2025-09-23T17:13:11.221677] [DEBUG] [LOCAL ] AMPY: Saving primary data. [2025-09-23T17:13:11.249620] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-23T17:13:11.249834] [DEBUG] [LOCAL ] AMPY: Trimmed 50241 records to 37407 (keeping 200 days of data) [2025-09-23T17:13:11.260763] [INFO ] [REMOTE ] AMPX: Full fetch complete (74524 records). [2025-09-23T17:13:11.260962] [DEBUG] [VALIDATOR ] AMPX: Validating primary data. [2025-09-23T17:13:11.427590] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-05. [2025-09-23T17:13:11.906293] [DEBUG] [VALIDATOR ] AMPX: All expected trading days are present. [2025-09-23T17:13:11.906589] [DEBUG] [VALIDATOR ] AMPX: Primary data validation passed. [2025-09-23T17:13:11.887906] [DEBUG] [LOCAL ] AMPY: Primary data saved (37407 records). [2025-09-23T17:13:11.907798] [INFO ] [MAIN ] AMPX: Fetched primary data is valid. [2025-09-23T17:13:11.907928] [DEBUG] [LOCAL ] AMPX: Saving primary data. [2025-09-23T17:13:11.906930] [INFO ] [MAIN ] AMPY: Full history saved. [2025-09-23T17:13:11.908951] [INFO ] [MAIN ] Update Progress: 104/2372 symbols completed. AMPY took 26.8s. Estimated remaining: 4h 46m 39s. Rate: 7.9 symbols/min [2025-09-23T17:13:11.956529] [DEBUG] [LOCAL ] AMPX: Trimmed 74524 records to 52164 (keeping 200 days of data) [2025-09-23T17:13:12.120399] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-23T17:13:12.238124] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-02. [2025-09-23T17:13:12.303254] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:13:12.309787] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-09-23T17:13:12.310578] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-09-23T17:13:12.321996] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-09-23T17:13:12.326317] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-09-23T17:13:12.328288] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-09-23T17:13:12.330525] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-09-23T17:13:12.778510] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-23T17:13:13.007687] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-06. [2025-09-23T17:13:13.235794] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:13:13.242419] [DEBUG] [LOCAL ] AMPX: Primary data saved (52164 records). [2025-09-23T17:13:13.242919] [INFO ] [MAIN ] AMPX: Full history saved. [2025-09-23T17:13:13.243138] [INFO ] [MAIN ] Update Progress: 105/2372 symbols completed. AMPX took 44.0s. Estimated remaining: 4h 44m 17s. Rate: 8.0 symbols/min [2025-09-23T17:13:13.465974] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:13:13.486494] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-23T17:13:13.547807] [DEBUG] [LOCAL ] AMT: Loaded 52455 existing records from primary storage. [2025-09-23T17:13:13.547971] [INFO ] [MAIN ] AMT: Loaded 52455 existing records. [2025-09-23T17:13:13.727752] [WARN ] [MAIN ] AMT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:13:13.728037] [INFO ] [MAIN ] AMT: Wiping existing primary data before full refresh. [2025-09-23T17:13:13.728088] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-09-23T17:13:13.729485] [DEBUG] [LOCAL ] AMT: Deleted primary data file. [2025-09-23T17:13:13.729546] [INFO ] [MAIN ] AMT: Starting full primary refresh. [2025-09-23T17:13:13.807342] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-03. [2025-09-23T17:13:14.091382] [INFO ] [REMOTE ] AMT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:13:14.243845] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-23T17:13:14.602222] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-07. [2025-09-23T17:13:15.130606] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-23T17:13:15.402248] [INFO ] [REMOTE ] AMT: Fetching primary data for 2024-12. [2025-09-23T17:13:15.721878] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-23T17:13:16.202217] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2024-12. [2025-09-23T17:13:16.431310] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:13:16.431675] [WARN ] [REMOTE ] AMRZ: No data returned for month 2024-12 [2025-09-23T17:13:16.832810] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-23T17:13:17.002214] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-01. [2025-09-23T17:13:17.802198] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-04. [2025-09-23T17:13:18.607371] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-08. [2025-09-23T17:13:18.624752] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-23T17:13:19.006546] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-23T17:13:19.402289] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-05. [2025-09-23T17:13:19.614799] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-23T17:13:20.202201] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-09-23T17:13:20.409543] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-23T17:13:21.002212] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-01. [2025-09-23T17:13:21.204232] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:13:21.204545] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-01 [2025-09-23T17:13:21.557085] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-23T17:13:21.564748] [INFO ] [REMOTE ] AMR: Full fetch complete (39605 records). [2025-09-23T17:13:21.564913] [DEBUG] [VALIDATOR ] AMR: Validating primary data. [2025-09-23T17:13:21.807445] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-06. [2025-09-23T17:13:21.993562] [DEBUG] [VALIDATOR ] AMR: All expected trading days are present. [2025-09-23T17:13:21.993755] [DEBUG] [VALIDATOR ] AMR: Primary data validation passed. [2025-09-23T17:13:21.994532] [INFO ] [MAIN ] AMR: Fetched primary data is valid. [2025-09-23T17:13:21.994630] [DEBUG] [LOCAL ] AMR: Saving primary data. [2025-09-23T17:13:21.996448] [DEBUG] [LOCAL ] AMR: Trimmed 39605 records to 29107 (keeping 200 days of data) [2025-09-23T17:13:22.202958] [DEBUG] [LOCAL ] AMR: Primary data saved (29107 records). [2025-09-23T17:13:22.203181] [INFO ] [MAIN ] AMR: Full history saved. [2025-09-23T17:13:22.203321] [INFO ] [MAIN ] Update Progress: 106/2372 symbols completed. AMR took 23.8s. Estimated remaining: 4h 44m 40s. Rate: 8.0 symbols/min [2025-09-23T17:13:22.414753] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:13:22.439807] [DEBUG] [LOCAL ] AMTB: Loaded 20461 existing records from primary storage. [2025-09-23T17:13:22.439981] [INFO ] [MAIN ] AMTB: Loaded 20461 existing records. [2025-09-23T17:13:22.618024] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-02. [2025-09-23T17:13:22.624418] [WARN ] [MAIN ] AMTB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:13:22.626455] [INFO ] [MAIN ] AMTB: Wiping existing primary data before full refresh. [2025-09-23T17:13:22.626549] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-09-23T17:13:22.627491] [DEBUG] [LOCAL ] AMTB: Deleted primary data file. [2025-09-23T17:13:22.627588] [INFO ] [MAIN ] AMTB: Starting full primary refresh. [2025-09-23T17:13:22.880472] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:13:22.906666] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-02 [2025-09-23T17:13:22.962352] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-23T17:13:23.057932] [INFO ] [REMOTE ] AMTB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:13:23.402255] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-07. [2025-09-23T17:13:24.202214] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-03. [2025-09-23T17:13:24.433021] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:13:24.433306] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-03 [2025-09-23T17:13:24.692916] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-23T17:13:25.002223] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-04. [2025-09-23T17:13:25.218124] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:13:25.218516] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-04 [2025-09-23T17:13:25.802211] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-08. [2025-09-23T17:13:26.602199] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-05. [2025-09-23T17:13:26.832439] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:13:26.832779] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-05 [2025-09-23T17:13:26.931043] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-23T17:13:27.402236] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2024-12. [2025-09-23T17:13:28.202195] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-02. [2025-09-23T17:13:28.562376] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-23T17:13:29.002205] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-01. [2025-09-23T17:13:29.577574] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-23T17:13:29.660525] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-23T17:13:29.802260] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-02. [2025-09-23T17:13:30.602254] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-09-23T17:13:31.071170] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-23T17:13:31.402199] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-06. [2025-09-23T17:13:32.029251] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-23T17:13:32.164154] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-23T17:13:32.172449] [INFO ] [REMOTE ] AMRC: Full fetch complete (52378 records). [2025-09-23T17:13:32.172727] [DEBUG] [VALIDATOR ] AMRC: Validating primary data. [2025-09-23T17:13:32.207337] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-07. [2025-09-23T17:13:32.582758] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present. [2025-09-23T17:13:32.582864] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed. [2025-09-23T17:13:32.583535] [INFO ] [MAIN ] AMRC: Fetched primary data is valid. [2025-09-23T17:13:32.583600] [DEBUG] [LOCAL ] AMRC: Saving primary data. [2025-09-23T17:13:32.585185] [DEBUG] [LOCAL ] AMRC: Trimmed 52378 records to 38438 (keeping 200 days of data) [2025-09-23T17:13:32.834241] [DEBUG] [LOCAL ] AMRC: Primary data saved (38438 records). [2025-09-23T17:13:32.834637] [INFO ] [MAIN ] AMRC: Full history saved. [2025-09-23T17:13:32.834848] [INFO ] [MAIN ] Update Progress: 107/2372 symbols completed. AMRC took 26.6s. Estimated remaining: 4h 45m 38s. Rate: 7.9 symbols/min [2025-09-23T17:13:33.018319] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-03. [2025-09-23T17:13:33.022019] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:13:33.030422] [DEBUG] [LOCAL ] AMTD: Loaded 3554 existing records from primary storage. [2025-09-23T17:13:33.030528] [INFO ] [MAIN ] AMTD: Loaded 3554 existing records. [2025-09-23T17:13:33.212036] [WARN ] [MAIN ] AMTD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:13:33.212356] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-09-23T17:13:33.212419] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-09-23T17:13:33.212914] [DEBUG] [LOCAL ] AMTD: Deleted primary data file. [2025-09-23T17:13:33.212975] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-09-23T17:13:33.584197] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:13:33.735164] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-23T17:13:33.802215] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-03. [2025-09-23T17:13:34.067251] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-23T17:13:34.602212] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-04. [2025-09-23T17:13:35.402216] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2024-12. [2025-09-23T17:13:35.474789] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-23T17:13:35.926619] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-23T17:13:36.202200] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-05. [2025-09-23T17:13:36.332972] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-23T17:13:36.964492] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-23T17:13:37.002201] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-04. [2025-09-23T17:13:37.802200] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-08. [2025-09-23T17:13:38.585324] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-23T17:13:38.602169] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-05. [2025-09-23T17:13:39.095867] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-23T17:13:39.402198] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-09. [2025-09-23T17:13:40.202217] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-06. [2025-09-23T17:13:40.299944] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-23T17:13:40.630936] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-23T17:13:40.639514] [INFO ] [REMOTE ] AMRZ: Full fetch complete (24577 records). [2025-09-23T17:13:40.639604] [DEBUG] [VALIDATOR ] AMRZ: Validating primary data. [2025-09-23T17:13:40.835513] [WARN ] [VALIDATOR ] AMRZ: Validation failed - insufficient historical data. Have 65 unique days, need 200 days [2025-09-23T17:13:40.835984] [FATAL] [MAIN ] AMRZ: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:13:40.836090] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:13:40.836186] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-09-23T17:13:40.836276] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-09-23T17:13:40.836325] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-09-23T17:13:40.836405] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-09-23T17:13:40.836489] [INFO ] [MAIN ] Update Progress: 108/2372 symbols completed. AMRZ took 28.9s. Estimated remaining: 4h 45m 40s. Rate: 7.9 symbols/min [2025-09-23T17:13:41.006220] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:13:41.006307] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-01. [2025-09-23T17:13:41.079451] [DEBUG] [LOCAL ] AMTM: Loaded 50777 existing records from primary storage. [2025-09-23T17:13:41.079686] [INFO ] [MAIN ] AMTM: Loaded 50777 existing records. [2025-09-23T17:13:41.283104] [WARN ] [MAIN ] AMTM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:13:41.284262] [INFO ] [MAIN ] AMTM: Wiping existing primary data before full refresh. [2025-09-23T17:13:41.284321] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-09-23T17:13:41.286192] [DEBUG] [LOCAL ] AMTM: Deleted primary data file. [2025-09-23T17:13:41.286371] [INFO ] [MAIN ] AMTM: Starting full primary refresh. [2025-09-23T17:13:41.428625] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-23T17:13:41.598072] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-23T17:13:41.678539] [INFO ] [REMOTE ] AMTM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:13:41.802203] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2024-12. [2025-09-23T17:13:42.602198] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-09-23T17:13:42.978204] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-23T17:13:43.301698] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-23T17:13:43.402153] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-01. [2025-09-23T17:13:44.202218] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-09-23T17:13:44.722422] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-23T17:13:45.002184] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-09-23T17:13:45.129526] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-23T17:13:45.338797] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-23T17:13:45.802255] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-09-23T17:13:46.216848] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-23T17:13:46.602196] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-09-23T17:13:47.163722] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-23T17:13:47.402193] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-09-23T17:13:47.900850] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-23T17:13:48.202279] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-09-23T17:13:48.693485] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-23T17:13:49.002275] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-02. [2025-09-23T17:13:49.802251] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-09-23T17:13:50.366803] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-23T17:13:50.368398] [INFO ] [REMOTE ] AMTD: Full fetch complete (5616 records). [2025-09-23T17:13:50.368469] [DEBUG] [VALIDATOR ] AMTD: Validating primary data. [2025-09-23T17:13:50.609014] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-06. [2025-09-23T17:13:50.740437] [DEBUG] [VALIDATOR ] AMTD: All expected trading days are present. [2025-09-23T17:13:50.740637] [DEBUG] [VALIDATOR ] AMTD: Primary data validation passed. [2025-09-23T17:13:50.740876] [INFO ] [MAIN ] AMTD: Fetched primary data is valid. [2025-09-23T17:13:50.741014] [DEBUG] [LOCAL ] AMTD: Saving primary data. [2025-09-23T17:13:50.741579] [DEBUG] [LOCAL ] AMTD: Trimmed 5616 records to 3564 (keeping 200 days of data) [2025-09-23T17:13:50.787948] [DEBUG] [LOCAL ] AMTD: Primary data saved (3564 records). [2025-09-23T17:13:50.789433] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-23T17:13:50.788431] [INFO ] [MAIN ] AMTD: Full history saved. [2025-09-23T17:13:50.798737] [INFO ] [MAIN ] Update Progress: 109/2372 symbols completed. AMTD took 18.0s. Estimated remaining: 4h 46m 22s. Rate: 7.9 symbols/min [2025-09-23T17:13:50.970855] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:13:50.983263] [DEBUG] [LOCAL ] AMWL: Loaded 8612 existing records from primary storage. [2025-09-23T17:13:50.983367] [INFO ] [MAIN ] AMWL: Loaded 8612 existing records. [2025-09-23T17:13:51.158487] [WARN ] [MAIN ] AMWL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:13:51.158797] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-09-23T17:13:51.158850] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-09-23T17:13:51.159241] [DEBUG] [LOCAL ] AMWL: Deleted primary data file. [2025-09-23T17:13:51.159302] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-09-23T17:13:51.407363] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-03. [2025-09-23T17:13:51.526285] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:13:52.202229] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-07. [2025-09-23T17:13:52.232318] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-23T17:13:52.874869] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-23T17:13:53.002196] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-07. [2025-09-23T17:13:53.186384] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-23T17:13:53.802193] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-08. [2025-09-23T17:13:54.454872] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-23T17:13:54.515986] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-23T17:13:54.602204] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2024-12. [2025-09-23T17:13:55.241435] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-23T17:13:55.402193] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-09. [2025-09-23T17:13:56.098038] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-23T17:13:56.101378] [INFO ] [REMOTE ] AMTB: Full fetch complete (30307 records). [2025-09-23T17:13:56.101473] [DEBUG] [VALIDATOR ] AMTB: Validating primary data. [2025-09-23T17:13:56.208478] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-01. [2025-09-23T17:13:56.493732] [DEBUG] [VALIDATOR ] AMTB: All expected trading days are present. [2025-09-23T17:13:56.493827] [DEBUG] [VALIDATOR ] AMTB: Primary data validation passed. [2025-09-23T17:13:56.494233] [INFO ] [MAIN ] AMTB: Fetched primary data is valid. [2025-09-23T17:13:56.494297] [DEBUG] [LOCAL ] AMTB: Saving primary data. [2025-09-23T17:13:56.495241] [DEBUG] [LOCAL ] AMTB: Trimmed 30307 records to 20436 (keeping 200 days of data) [2025-09-23T17:13:56.618308] [DEBUG] [LOCAL ] AMTB: Primary data saved (20436 records). [2025-09-23T17:13:56.618444] [INFO ] [MAIN ] AMTB: Full history saved. [2025-09-23T17:13:56.618528] [INFO ] [MAIN ] Update Progress: 110/2372 symbols completed. AMTB took 34.4s. Estimated remaining: 4h 45m 38s. Rate: 7.9 symbols/min [2025-09-23T17:13:56.796151] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:13:56.806022] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-23T17:13:56.858220] [DEBUG] [LOCAL ] AMX: Loaded 49133 existing records from primary storage. [2025-09-23T17:13:56.858362] [INFO ] [MAIN ] AMX: Loaded 49133 existing records. [2025-09-23T17:13:57.004901] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-08. [2025-09-23T17:13:57.042369] [WARN ] [MAIN ] AMX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:13:57.042627] [INFO ] [MAIN ] AMX: Wiping existing primary data before full refresh. [2025-09-23T17:13:57.042712] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-09-23T17:13:57.043838] [DEBUG] [LOCAL ] AMX: Deleted primary data file. [2025-09-23T17:13:57.043900] [INFO ] [MAIN ] AMX: Starting full primary refresh. [2025-09-23T17:13:57.401760] [INFO ] [REMOTE ] AMX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:13:57.802219] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-09-23T17:13:58.348771] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-23T17:13:58.381744] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-23T17:13:58.602235] [INFO ] [REMOTE ] AMX: Fetching primary data for 2024-12. [2025-09-23T17:13:59.402193] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-09-23T17:14:00.056635] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-23T17:14:00.202204] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-09-23T17:14:00.665849] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-23T17:14:00.853890] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-23T17:14:00.863261] [INFO ] [REMOTE ] AMT: Full fetch complete (76004 records). [2025-09-23T17:14:00.863394] [DEBUG] [VALIDATOR ] AMT: Validating primary data. [2025-09-23T17:14:01.016485] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-01. [2025-09-23T17:14:01.298351] [DEBUG] [VALIDATOR ] AMT: All expected trading days are present. [2025-09-23T17:14:01.298445] [DEBUG] [VALIDATOR ] AMT: Primary data validation passed. [2025-09-23T17:14:01.299314] [INFO ] [MAIN ] AMT: Fetched primary data is valid. [2025-09-23T17:14:01.299384] [DEBUG] [LOCAL ] AMT: Saving primary data. [2025-09-23T17:14:01.301413] [DEBUG] [LOCAL ] AMT: Trimmed 76004 records to 52450 (keeping 200 days of data) [2025-09-23T17:14:01.661769] [DEBUG] [LOCAL ] AMT: Primary data saved (52450 records). [2025-09-23T17:14:01.661928] [INFO ] [MAIN ] AMT: Full history saved. [2025-09-23T17:14:01.662041] [INFO ] [MAIN ] Update Progress: 111/2372 symbols completed. AMT took 48.4s. Estimated remaining: 4h 44m 38s. Rate: 7.9 symbols/min [2025-09-23T17:14:01.807428] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-04. [2025-09-23T17:14:01.857934] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:14:01.896156] [DEBUG] [LOCAL ] AN: Loaded 32596 existing records from primary storage. [2025-09-23T17:14:01.896322] [INFO ] [MAIN ] AN: Loaded 32596 existing records. [2025-09-23T17:14:02.075172] [WARN ] [MAIN ] AN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:14:02.075412] [INFO ] [MAIN ] AN: Wiping existing primary data before full refresh. [2025-09-23T17:14:02.075460] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-09-23T17:14:02.076156] [DEBUG] [LOCAL ] AN: Deleted primary data file. [2025-09-23T17:14:02.076217] [INFO ] [MAIN ] AN: Starting full primary refresh. [2025-09-23T17:14:02.433542] [INFO ] [REMOTE ] AN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:14:02.471982] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-23T17:14:02.602182] [INFO ] [REMOTE ] AN: Fetching primary data for 2024-12. [2025-09-23T17:14:03.217749] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-23T17:14:03.402216] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-09-23T17:14:04.077037] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-23T17:14:04.090858] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-23T17:14:04.202225] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-09-23T17:14:05.001689] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-23T17:14:05.005182] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-02. [2025-09-23T17:14:05.802217] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-05. [2025-09-23T17:14:06.541792] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-23T17:14:06.602204] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-03. [2025-09-23T17:14:07.154861] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-23T17:14:07.402258] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-06. [2025-09-23T17:14:07.920162] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-23T17:14:08.202238] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-04. [2025-09-23T17:14:09.002270] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-01. [2025-09-23T17:14:09.230907] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-23T17:14:09.520950] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-23T17:14:09.802229] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-05. [2025-09-23T17:14:09.986506] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-23T17:14:10.602201] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-07. [2025-09-23T17:14:11.402208] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-02. [2025-09-23T17:14:11.621583] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-23T17:14:11.939235] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-23T17:14:12.202220] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-09-23T17:14:12.390826] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-23T17:14:12.743299] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-23T17:14:13.002214] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-08. [2025-09-23T17:14:13.802263] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-06. [2025-09-23T17:14:14.445263] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-23T17:14:14.602225] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-09-23T17:14:14.894982] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-23T17:14:15.164127] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-23T17:14:15.402254] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-09-23T17:14:16.202212] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-07. [2025-09-23T17:14:16.754175] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-23T17:14:16.762383] [INFO ] [REMOTE ] AMTM: Full fetch complete (73596 records). [2025-09-23T17:14:16.762513] [DEBUG] [VALIDATOR ] AMTM: Validating primary data. [2025-09-23T17:14:16.763299] [FATAL] [VALIDATOR ] AMTM: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:14:16.763391] [FATAL] [MAIN ] AMTM: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:14:16.763434] [WARN ] [MAIN ] AMTM: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:14:16.763473] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-09-23T17:14:16.763534] [DEBUG] [LOCAL ] AMTM: No primary data file found to delete. [2025-09-23T17:14:16.763569] [INFO ] [LOCAL ] AMTM: Starting deletion of derivative data. [2025-09-23T17:14:16.764045] [DEBUG] [LOCAL ] AMTM: Deleted derivative data file. [2025-09-23T17:14:16.764141] [INFO ] [MAIN ] Update Progress: 112/2372 symbols completed. AMTM took 35.9s. Estimated remaining: 4h 47m 3s. Rate: 7.9 symbols/min [2025-09-23T17:14:16.941198] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:14:16.998538] [DEBUG] [LOCAL ] ANET: Loaded 53766 existing records from primary storage. [2025-09-23T17:14:16.998804] [INFO ] [MAIN ] ANET: Loaded 53766 existing records. [2025-09-23T17:14:17.010631] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-09-23T17:14:17.192380] [WARN ] [MAIN ] ANET: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:14:17.192628] [INFO ] [MAIN ] ANET: Wiping existing primary data before full refresh. [2025-09-23T17:14:17.192713] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-09-23T17:14:17.193968] [DEBUG] [LOCAL ] ANET: Deleted primary data file. [2025-09-23T17:14:17.194031] [INFO ] [MAIN ] ANET: Starting full primary refresh. [2025-09-23T17:14:17.625204] [INFO ] [REMOTE ] ANET: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:14:17.633094] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-23T17:14:17.688911] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-23T17:14:17.802214] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-08. [2025-09-23T17:14:18.602243] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-09-23T17:14:19.019860] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-23T17:14:19.258280] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-23T17:14:19.260879] [INFO ] [REMOTE ] AMWL: Full fetch complete (13976 records). [2025-09-23T17:14:19.260982] [DEBUG] [VALIDATOR ] AMWL: Validating primary data. [2025-09-23T17:14:19.410945] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-09-23T17:14:19.642904] [DEBUG] [VALIDATOR ] AMWL: All expected trading days are present. [2025-09-23T17:14:19.643012] [DEBUG] [VALIDATOR ] AMWL: Primary data validation passed. [2025-09-23T17:14:19.643286] [INFO ] [MAIN ] AMWL: Fetched primary data is valid. [2025-09-23T17:14:19.643329] [DEBUG] [LOCAL ] AMWL: Saving primary data. [2025-09-23T17:14:19.644135] [DEBUG] [LOCAL ] AMWL: Trimmed 13976 records to 8642 (keeping 200 days of data) [2025-09-23T17:14:19.698074] [DEBUG] [LOCAL ] AMWL: Primary data saved (8642 records). [2025-09-23T17:14:19.698247] [INFO ] [MAIN ] AMWL: Full history saved. [2025-09-23T17:14:19.698354] [INFO ] [MAIN ] Update Progress: 113/2372 symbols completed. AMWL took 28.9s. Estimated remaining: 4h 45m 22s. Rate: 7.9 symbols/min [2025-09-23T17:14:19.871518] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:14:19.931109] [DEBUG] [LOCAL ] ANF: Loaded 52264 existing records from primary storage. [2025-09-23T17:14:19.931262] [INFO ] [MAIN ] ANF: Loaded 52264 existing records. [2025-09-23T17:14:20.112112] [WARN ] [MAIN ] ANF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:14:20.112409] [INFO ] [MAIN ] ANF: Wiping existing primary data before full refresh. [2025-09-23T17:14:20.112463] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-09-23T17:14:20.114744] [DEBUG] [LOCAL ] ANF: Deleted primary data file. [2025-09-23T17:14:20.114806] [INFO ] [MAIN ] ANF: Starting full primary refresh. [2025-09-23T17:14:20.211152] [INFO ] [REMOTE ] ANET: Fetching primary data for 2024-12. [2025-09-23T17:14:20.478707] [INFO ] [REMOTE ] ANF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:14:20.786271] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-23T17:14:20.794525] [INFO ] [REMOTE ] AMX: Full fetch complete (70783 records). [2025-09-23T17:14:20.794727] [DEBUG] [VALIDATOR ] AMX: Validating primary data. [2025-09-23T17:14:21.007462] [INFO ] [REMOTE ] ANF: Fetching primary data for 2024-12. [2025-09-23T17:14:21.196324] [DEBUG] [VALIDATOR ] AMX: All expected trading days are present. [2025-09-23T17:14:21.196402] [DEBUG] [VALIDATOR ] AMX: Primary data validation passed. [2025-09-23T17:14:21.197126] [INFO ] [MAIN ] AMX: Fetched primary data is valid. [2025-09-23T17:14:21.197189] [DEBUG] [LOCAL ] AMX: Saving primary data. [2025-09-23T17:14:21.198678] [DEBUG] [LOCAL ] AMX: Trimmed 70783 records to 49162 (keeping 200 days of data) [2025-09-23T17:14:21.497252] [DEBUG] [LOCAL ] AMX: Primary data saved (49162 records). [2025-09-23T17:14:21.497384] [INFO ] [MAIN ] AMX: Full history saved. [2025-09-23T17:14:21.497469] [INFO ] [MAIN ] Update Progress: 114/2372 symbols completed. AMX took 24.9s. Estimated remaining: 4h 43m 20s. Rate: 8.0 symbols/min [2025-09-23T17:14:21.663513] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:14:21.663716] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-09-23T17:14:21.663772] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-09-23T17:14:21.663923] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-09-23T17:14:21.663965] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-09-23T17:14:21.664010] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-09-23T17:14:21.664042] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-09-23T17:14:21.813156] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-03. [2025-09-23T17:14:22.042762] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:14:22.450825] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-09-23T17:14:22.602247] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2024-12. [2025-09-23T17:14:22.804503] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-23T17:14:22.817338] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:14:22.818835] [WARN ] [REMOTE ] ANGX: No data returned for month 2024-12 [2025-09-23T17:14:23.201306] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-23T17:14:23.402225] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-01. [2025-09-23T17:14:23.651271] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:14:23.651840] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-01 [2025-09-23T17:14:24.202200] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-02. [2025-09-23T17:14:24.393896] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:14:24.394173] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-02 [2025-09-23T17:14:25.002225] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-04. [2025-09-23T17:14:25.802194] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-01. [2025-09-23T17:14:26.290774] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-23T17:14:26.602190] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-01. [2025-09-23T17:14:27.402210] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-03. [2025-09-23T17:14:27.592324] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:14:27.592719] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-03 [2025-09-23T17:14:27.813041] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-23T17:14:28.054509] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-23T17:14:28.202189] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-02. [2025-09-23T17:14:29.002279] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-04. [2025-09-23T17:14:29.207154] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:14:29.207449] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-04 [2025-09-23T17:14:29.802201] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-05. [2025-09-23T17:14:30.011433] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:14:30.011770] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-05 [2025-09-23T17:14:30.607668] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-05. [2025-09-23T17:14:30.610750] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-02 (2.41 seconds). [2025-09-23T17:14:31.402217] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-06. [2025-09-23T17:14:31.575954] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-23T17:14:31.635740] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:14:31.636094] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-06 [2025-09-23T17:14:32.202206] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-03. [2025-09-23T17:14:33.002268] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-02. [2025-09-23T17:14:33.802197] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-06. [2025-09-23T17:14:34.233094] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-23T17:14:34.602229] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-07. [2025-09-23T17:14:34.746976] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-23T17:14:34.798298] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:14:34.798608] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-07 [2025-09-23T17:14:34.974523] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-23T17:14:35.402213] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-08. [2025-09-23T17:14:35.758770] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:14:35.759128] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-08 [2025-09-23T17:14:36.202191] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-09. [2025-09-23T17:14:37.002217] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-04. [2025-09-23T17:14:37.570520] [INFO ] [REMOTE ] ANGX: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-23T17:14:37.575173] [INFO ] [REMOTE ] ANGX: Full fetch complete (3160 records). [2025-09-23T17:14:37.575245] [DEBUG] [VALIDATOR ] ANGX: Validating primary data. [2025-09-23T17:14:37.762721] [WARN ] [VALIDATOR ] ANGX: Validation failed - insufficient historical data. Have 9 unique days, need 200 days [2025-09-23T17:14:37.762953] [FATAL] [MAIN ] ANGX: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:14:37.763024] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:14:37.763134] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-09-23T17:14:37.763213] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-09-23T17:14:37.763252] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-09-23T17:14:37.763310] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-09-23T17:14:37.763393] [INFO ] [MAIN ] Update Progress: 115/2372 symbols completed. ANGX took 16.3s. Estimated remaining: 4h 46m 4s. Rate: 7.9 symbols/min [2025-09-23T17:14:37.808966] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-03. [2025-09-23T17:14:37.950683] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:14:37.972374] [DEBUG] [LOCAL ] ANRO: Loaded 19673 existing records from primary storage. [2025-09-23T17:14:37.972535] [INFO ] [MAIN ] ANRO: Loaded 19673 existing records. [2025-09-23T17:14:38.172586] [WARN ] [MAIN ] ANRO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:14:38.172870] [INFO ] [MAIN ] ANRO: Wiping existing primary data before full refresh. [2025-09-23T17:14:38.172932] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-09-23T17:14:38.173527] [DEBUG] [LOCAL ] ANRO: Deleted primary data file. [2025-09-23T17:14:38.173590] [INFO ] [MAIN ] ANRO: Starting full primary refresh. [2025-09-23T17:14:38.592092] [INFO ] [REMOTE ] ANRO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:14:38.602165] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2024-12. [2025-09-23T17:14:38.977577] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-23T17:14:39.402159] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-05. [2025-09-23T17:14:39.470962] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-23T17:14:39.544140] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-23T17:14:40.202201] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-04. [2025-09-23T17:14:41.002195] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-01. [2025-09-23T17:14:41.529311] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-23T17:14:41.765394] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-23T17:14:41.802152] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-07. [2025-09-23T17:14:42.156867] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-23T17:14:42.602218] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-05. [2025-09-23T17:14:42.844768] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-23T17:14:43.402194] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-08. [2025-09-23T17:14:43.968792] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-23T17:14:44.202167] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-06. [2025-09-23T17:14:44.449678] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-23T17:14:45.002198] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-02. [2025-09-23T17:14:45.688321] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-23T17:14:45.802199] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-07. [2025-09-23T17:14:45.985020] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-23T17:14:46.602206] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-06. [2025-09-23T17:14:47.409597] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-03. [2025-09-23T17:14:47.415691] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-23T17:14:48.202215] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-09-23T17:14:48.532238] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-23T17:14:48.637994] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-23T17:14:49.002251] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-07. [2025-09-23T17:14:49.182926] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-23T17:14:49.191332] [INFO ] [REMOTE ] AN: Full fetch complete (47692 records). [2025-09-23T17:14:49.191512] [DEBUG] [VALIDATOR ] AN: Validating primary data. [2025-09-23T17:14:49.582253] [DEBUG] [VALIDATOR ] AN: All expected trading days are present. [2025-09-23T17:14:49.582352] [DEBUG] [VALIDATOR ] AN: Primary data validation passed. [2025-09-23T17:14:49.582884] [INFO ] [MAIN ] AN: Fetched primary data is valid. [2025-09-23T17:14:49.582948] [DEBUG] [LOCAL ] AN: Saving primary data. [2025-09-23T17:14:49.584507] [DEBUG] [LOCAL ] AN: Trimmed 47692 records to 32517 (keeping 200 days of data) [2025-09-23T17:14:49.779528] [DEBUG] [LOCAL ] AN: Primary data saved (32517 records). [2025-09-23T17:14:49.779704] [INFO ] [MAIN ] AN: Full history saved. [2025-09-23T17:14:49.779804] [INFO ] [MAIN ] Update Progress: 116/2372 symbols completed. AN took 48.1s. Estimated remaining: 4h 47m 22s. Rate: 7.9 symbols/min [2025-09-23T17:14:49.810889] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-08. [2025-09-23T17:14:49.953026] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:14:49.978225] [DEBUG] [LOCAL ] ANVS: Loaded 23209 existing records from primary storage. [2025-09-23T17:14:49.978384] [INFO ] [MAIN ] ANVS: Loaded 23209 existing records. [2025-09-23T17:14:50.160018] [WARN ] [MAIN ] ANVS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:14:50.160320] [INFO ] [MAIN ] ANVS: Wiping existing primary data before full refresh. [2025-09-23T17:14:50.160369] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-09-23T17:14:50.160998] [DEBUG] [LOCAL ] ANVS: Deleted primary data file. [2025-09-23T17:14:50.161058] [INFO ] [MAIN ] ANVS: Starting full primary refresh. [2025-09-23T17:14:50.516579] [INFO ] [REMOTE ] ANVS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:14:50.602158] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2024-12. [2025-09-23T17:14:50.876985] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-23T17:14:51.402258] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-04. [2025-09-23T17:14:51.767089] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-23T17:14:51.833019] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-23T17:14:52.202206] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-09-23T17:14:52.288208] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-23T17:14:53.002257] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-08. [2025-09-23T17:14:53.505870] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-23T17:14:53.515789] [INFO ] [REMOTE ] ANF: Full fetch complete (75631 records). [2025-09-23T17:14:53.515934] [DEBUG] [VALIDATOR ] ANF: Validating primary data. [2025-09-23T17:14:53.809398] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-01. [2025-09-23T17:14:53.908927] [DEBUG] [VALIDATOR ] ANF: All expected trading days are present. [2025-09-23T17:14:53.909017] [DEBUG] [VALIDATOR ] ANF: Primary data validation passed. [2025-09-23T17:14:53.909755] [INFO ] [MAIN ] ANF: Fetched primary data is valid. [2025-09-23T17:14:53.909857] [DEBUG] [LOCAL ] ANF: Saving primary data. [2025-09-23T17:14:53.911422] [DEBUG] [LOCAL ] ANF: Trimmed 75631 records to 52244 (keeping 200 days of data) [2025-09-23T17:14:54.224434] [DEBUG] [LOCAL ] ANF: Primary data saved (52244 records). [2025-09-23T17:14:54.224567] [INFO ] [MAIN ] ANF: Full history saved. [2025-09-23T17:14:54.224671] [INFO ] [MAIN ] Update Progress: 117/2372 symbols completed. ANF took 34.5s. Estimated remaining: 4h 46m 13s. Rate: 7.9 symbols/min [2025-09-23T17:14:54.602219] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-05. [2025-09-23T17:14:54.787853] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-23T17:14:54.887406] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-23T17:14:55.182478] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-23T17:14:55.402251] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-06. [2025-09-23T17:14:56.202214] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-02. [2025-09-23T17:14:56.225315] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-23T17:14:57.002220] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-07. [2025-09-23T17:14:57.421744] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-23T17:14:57.802168] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-09-23T17:14:58.123068] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-23T17:14:58.602241] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-08. [2025-09-23T17:14:59.198537] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-23T17:14:59.402184] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-09-23T17:14:59.997608] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-23T17:15:00.006802] [INFO ] [REMOTE ] ANET: Full fetch complete (77859 records). [2025-09-23T17:15:00.006986] [DEBUG] [VALIDATOR ] ANET: Validating primary data. [2025-09-23T17:15:00.160921] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-23T17:15:00.199080] [INFO ] [REMOTE ] ANRO: Full fetch complete (30667 records). [2025-09-23T17:15:00.205960] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-03. [2025-09-23T17:15:00.219893] [DEBUG] [VALIDATOR ] ANRO: Validating primary data. [2025-09-23T17:15:00.712969] [DEBUG] [VALIDATOR ] ANET: All expected trading days are present. [2025-09-23T17:15:00.718570] [DEBUG] [VALIDATOR ] ANET: Primary data validation passed. [2025-09-23T17:15:00.725214] [INFO ] [MAIN ] ANET: Fetched primary data is valid. [2025-09-23T17:15:00.725303] [DEBUG] [LOCAL ] ANET: Saving primary data. [2025-09-23T17:15:00.768619] [DEBUG] [LOCAL ] ANET: Trimmed 77859 records to 53766 (keeping 200 days of data) [2025-09-23T17:15:00.896822] [DEBUG] [VALIDATOR ] ANRO: All expected trading days are present. [2025-09-23T17:15:00.923553] [DEBUG] [VALIDATOR ] ANRO: Primary data validation passed. [2025-09-23T17:15:00.924280] [INFO ] [MAIN ] ANRO: Fetched primary data is valid. [2025-09-23T17:15:00.924929] [DEBUG] [LOCAL ] ANRO: Saving primary data. [2025-09-23T17:15:00.927384] [DEBUG] [LOCAL ] ANRO: Trimmed 30667 records to 19470 (keeping 200 days of data) [2025-09-23T17:15:01.181321] [DEBUG] [LOCAL ] ANRO: Primary data saved (19470 records). [2025-09-23T17:15:01.182117] [INFO ] [MAIN ] ANRO: Full history saved. [2025-09-23T17:15:01.183039] [INFO ] [MAIN ] Update Progress: 118/2372 symbols completed. ANRO took 23.4s. Estimated remaining: 4h 45m 53s. Rate: 7.9 symbols/min [2025-09-23T17:15:01.203283] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-23T17:15:01.210025] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-04. [2025-09-23T17:15:01.297572] [DEBUG] [LOCAL ] ANET: Primary data saved (53766 records). [2025-09-23T17:15:01.297796] [INFO ] [MAIN ] ANET: Full history saved. [2025-09-23T17:15:01.297909] [INFO ] [MAIN ] Update Progress: 119/2372 symbols completed. ANET took 44.5s. Estimated remaining: 4h 43m 23s. Rate: 8.0 symbols/min [2025-09-23T17:15:02.565140] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-23T17:15:02.570670] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-05. [2025-09-23T17:15:05.945566] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-05 (3.37 seconds). [2025-09-23T17:15:05.951752] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-06. [2025-09-23T17:15:07.314178] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-23T17:15:07.321166] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-07. [2025-09-23T17:15:08.207737] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-23T17:15:08.213930] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-08. [2025-09-23T17:15:08.884618] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-23T17:15:08.889509] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-09. [2025-09-23T17:15:09.913517] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-23T17:15:09.916886] [INFO ] [REMOTE ] ANVS: Full fetch complete (36800 records). [2025-09-23T17:15:09.917073] [DEBUG] [VALIDATOR ] ANVS: Validating primary data. [2025-09-23T17:15:10.295017] [DEBUG] [VALIDATOR ] ANVS: All expected trading days are present. [2025-09-23T17:15:10.295120] [DEBUG] [VALIDATOR ] ANVS: Primary data validation passed. [2025-09-23T17:15:10.295597] [INFO ] [MAIN ] ANVS: Fetched primary data is valid. [2025-09-23T17:15:10.295684] [DEBUG] [LOCAL ] ANVS: Saving primary data. [2025-09-23T17:15:10.298279] [DEBUG] [LOCAL ] ANVS: Trimmed 36800 records to 23212 (keeping 200 days of data) [2025-09-23T17:15:10.426762] [DEBUG] [LOCAL ] ANVS: Primary data saved (23212 records). [2025-09-23T17:15:10.426891] [INFO ] [MAIN ] ANVS: Full history saved. [2025-09-23T17:15:10.426997] [INFO ] [MAIN ] Update Progress: 120/2372 symbols completed. ANVS took 20.6s. Estimated remaining: 4h 43m 45s. Rate: 7.9 symbols/min [2025-09-23T17:15:11.161918] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:15:11.170509] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:15:11.218240] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:15:11.214709] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:15:11.219292] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-09-23T17:15:11.219603] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-09-23T17:15:11.220062] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-09-23T17:15:11.220155] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-09-23T17:15:11.220262] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-09-23T17:15:11.220349] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-09-23T17:15:11.368948] [DEBUG] [LOCAL ] AOMR: Loaded 16786 existing records from primary storage. [2025-09-23T17:15:11.399933] [INFO ] [MAIN ] AOMR: Loaded 16786 existing records. [2025-09-23T17:15:11.599012] [DEBUG] [LOCAL ] AOD: Loaded 30300 existing records from primary storage. [2025-09-23T17:15:11.659429] [INFO ] [MAIN ] AOD: Loaded 30300 existing records. [2025-09-23T17:15:11.699769] [DEBUG] [LOCAL ] AON: Loaded 45635 existing records from primary storage. [2025-09-23T17:15:11.748501] [INFO ] [MAIN ] AON: Loaded 45635 existing records. [2025-09-23T17:15:11.973777] [WARN ] [MAIN ] AOMR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:15:12.032477] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-09-23T17:15:12.032340] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:15:12.043420] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-09-23T17:15:12.056398] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2024-12. [2025-09-23T17:15:12.072726] [DEBUG] [LOCAL ] AOMR: Deleted primary data file. [2025-09-23T17:15:12.090020] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-09-23T17:15:12.252790] [WARN ] [MAIN ] AOD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:15:12.332747] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:15:12.333189] [INFO ] [MAIN ] AOD: Wiping existing primary data before full refresh. [2025-09-23T17:15:12.339079] [WARN ] [REMOTE ] AOMD: No data returned for month 2024-12 [2025-09-23T17:15:12.345114] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-01. [2025-09-23T17:15:12.339462] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-09-23T17:15:12.453304] [DEBUG] [LOCAL ] AOD: Deleted primary data file. [2025-09-23T17:15:12.431842] [WARN ] [MAIN ] AON: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:15:12.489908] [INFO ] [MAIN ] AOD: Starting full primary refresh. [2025-09-23T17:15:12.535625] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-09-23T17:15:12.571479] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-09-23T17:15:12.653680] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:15:12.653444] [DEBUG] [LOCAL ] AON: Deleted primary data file. [2025-09-23T17:15:12.676187] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-01 [2025-09-23T17:15:12.700570] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-09-23T17:15:12.722525] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-02. [2025-09-23T17:15:12.990719] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:15:13.032069] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2024-12. [2025-09-23T17:15:13.075547] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:15:13.096406] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-02 [2025-09-23T17:15:13.143338] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-03. [2025-09-23T17:15:13.358254] [INFO ] [REMOTE ] AOD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:15:13.358561] [INFO ] [REMOTE ] AOD: Fetching primary data for 2024-12. [2025-09-23T17:15:13.441260] [INFO ] [REMOTE ] AON: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:15:13.434842] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:15:13.441576] [INFO ] [REMOTE ] AON: Fetching primary data for 2024-12. [2025-09-23T17:15:13.442443] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-03 [2025-09-23T17:15:13.443047] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-04. [2025-09-23T17:15:13.915884] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:15:13.916187] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-04 [2025-09-23T17:15:13.916625] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-05. [2025-09-23T17:15:13.994772] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-23T17:15:13.997673] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-01. [2025-09-23T17:15:15.521326] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-23T17:15:15.526217] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-09-23T17:15:15.625530] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-23T17:15:15.627497] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-06. [2025-09-23T17:15:15.641982] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-09-23T17:15:15.652110] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-01. [2025-09-23T17:15:15.748920] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-09-23T17:15:16.030095] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-23T17:15:16.202458] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-23T17:15:16.202582] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-07. [2025-09-23T17:15:16.523888] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-23T17:15:16.774483] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-23T17:15:17.002207] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-02. [2025-09-23T17:15:17.782388] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-23T17:15:17.802176] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-03. [2025-09-23T17:15:18.558763] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-23T17:15:18.602182] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-04. [2025-09-23T17:15:19.402239] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-09-23T17:15:19.960050] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-23T17:15:19.987947] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-23T17:15:20.202201] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-08. [2025-09-23T17:15:20.486246] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-09-23T17:15:21.002205] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-09. [2025-09-23T17:15:21.441314] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-23T17:15:21.442487] [INFO ] [REMOTE ] AOMD: Full fetch complete (1777 records). [2025-09-23T17:15:21.442561] [DEBUG] [VALIDATOR ] AOMD: Validating primary data. [2025-09-23T17:15:21.650355] [WARN ] [VALIDATOR ] AOMD: Validation failed - insufficient historical data. Have 83 unique days, need 200 days [2025-09-23T17:15:21.650568] [FATAL] [MAIN ] AOMD: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:15:21.650615] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:15:21.650683] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-09-23T17:15:21.650757] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-09-23T17:15:21.650793] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-09-23T17:15:21.650859] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-09-23T17:15:21.650957] [INFO ] [MAIN ] Update Progress: 121/2372 symbols completed. AOMD took 11.2s. Estimated remaining: 4h 44m 46s. Rate: 7.9 symbols/min [2025-09-23T17:15:21.802291] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-09-23T17:15:21.823616] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:15:21.823816] [DEBUG] [LOCAL ] AORT: No existing data file found in primary storage. [2025-09-23T17:15:21.823857] [WARN ] [MAIN ] AORT: No existing data found, performing full refresh instead. [2025-09-23T17:15:21.823999] [INFO ] [MAIN ] AORT: Wiping existing primary data before full refresh. [2025-09-23T17:15:21.824041] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-09-23T17:15:21.824081] [DEBUG] [LOCAL ] AORT: No primary data file found to delete. [2025-09-23T17:15:21.824113] [INFO ] [MAIN ] AORT: Starting full primary refresh. [2025-09-23T17:15:22.196228] [INFO ] [REMOTE ] AORT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:15:22.484667] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-23T17:15:22.602225] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-01. [2025-09-23T17:15:23.402265] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-05. [2025-09-23T17:15:23.888229] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-23T17:15:24.202216] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-09-23T17:15:24.299112] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-23T17:15:25.002247] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-06. [2025-09-23T17:15:25.802185] [INFO ] [REMOTE ] AORT: Fetching primary data for 2024-12. [2025-09-23T17:15:26.104321] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-23T17:15:26.399544] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-23T17:15:26.602190] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-09-23T17:15:26.698151] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-23T17:15:27.402208] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-09-23T17:15:27.497178] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-23T17:15:28.202256] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-09-23T17:15:28.745859] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-23T17:15:28.907011] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-23T17:15:29.002209] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-09-23T17:15:29.802252] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-07. [2025-09-23T17:15:30.433379] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-23T17:15:30.602199] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-09-23T17:15:30.632996] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-23T17:15:31.402304] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-01. [2025-09-23T17:15:31.893453] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-23T17:15:32.189912] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-23T17:15:32.202151] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-02. [2025-09-23T17:15:33.002258] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-08. [2025-09-23T17:15:33.050943] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-23T17:15:33.802170] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-07. [2025-09-23T17:15:33.838499] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-23T17:15:34.602225] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-09-23T17:15:35.047068] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-23T17:15:35.402219] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-08. [2025-09-23T17:15:36.140234] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-23T17:15:36.202158] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-09-23T17:15:36.555668] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-23T17:15:37.002249] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-03. [2025-09-23T17:15:37.546018] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-23T17:15:37.802235] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-09-23T17:15:38.339691] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-23T17:15:38.602155] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-09-23T17:15:38.614585] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-23T17:15:38.617978] [INFO ] [REMOTE ] AOMR: Full fetch complete (23129 records). [2025-09-23T17:15:38.618065] [DEBUG] [VALIDATOR ] AOMR: Validating primary data. [2025-09-23T17:15:39.000373] [DEBUG] [VALIDATOR ] AOMR: All expected trading days are present. [2025-09-23T17:15:39.000509] [DEBUG] [VALIDATOR ] AOMR: Primary data validation passed. [2025-09-23T17:15:39.000864] [INFO ] [MAIN ] AOMR: Fetched primary data is valid. [2025-09-23T17:15:39.000945] [DEBUG] [LOCAL ] AOMR: Saving primary data. [2025-09-23T17:15:39.001587] [DEBUG] [LOCAL ] AOMR: Trimmed 23129 records to 16714 (keeping 200 days of data) [2025-09-23T17:15:39.101984] [DEBUG] [LOCAL ] AOMR: Primary data saved (16714 records). [2025-09-23T17:15:39.102125] [INFO ] [MAIN ] AOMR: Full history saved. [2025-09-23T17:15:39.102258] [INFO ] [MAIN ] Update Progress: 122/2372 symbols completed. AOMR took 28.7s. Estimated remaining: 4h 47m 40s. Rate: 7.8 symbols/min [2025-09-23T17:15:39.272904] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:15:39.322561] [DEBUG] [LOCAL ] AOS: Loaded 49320 existing records from primary storage. [2025-09-23T17:15:39.322752] [INFO ] [MAIN ] AOS: Loaded 49320 existing records. [2025-09-23T17:15:39.411771] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-09-23T17:15:39.513391] [WARN ] [MAIN ] AOS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:15:39.514008] [INFO ] [MAIN ] AOS: Wiping existing primary data before full refresh. [2025-09-23T17:15:39.514094] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-09-23T17:15:39.516534] [DEBUG] [LOCAL ] AOS: Deleted primary data file. [2025-09-23T17:15:39.516595] [INFO ] [MAIN ] AOS: Starting full primary refresh. [2025-09-23T17:15:39.874952] [INFO ] [REMOTE ] AOS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:15:39.891365] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-23T17:15:39.898583] [INFO ] [REMOTE ] AOD: Full fetch complete (44059 records). [2025-09-23T17:15:39.898703] [DEBUG] [VALIDATOR ] AOD: Validating primary data. [2025-09-23T17:15:40.207367] [INFO ] [REMOTE ] AOS: Fetching primary data for 2024-12. [2025-09-23T17:15:40.286254] [DEBUG] [VALIDATOR ] AOD: All expected trading days are present. [2025-09-23T17:15:40.286394] [DEBUG] [VALIDATOR ] AOD: Primary data validation passed. [2025-09-23T17:15:40.287392] [INFO ] [MAIN ] AOD: Fetched primary data is valid. [2025-09-23T17:15:40.287509] [DEBUG] [LOCAL ] AOD: Saving primary data. [2025-09-23T17:15:40.293172] [DEBUG] [LOCAL ] AOD: Trimmed 44059 records to 30169 (keeping 200 days of data) [2025-09-23T17:15:40.491885] [DEBUG] [LOCAL ] AOD: Primary data saved (30169 records). [2025-09-23T17:15:40.492034] [INFO ] [MAIN ] AOD: Full history saved. [2025-09-23T17:15:40.492235] [INFO ] [MAIN ] Update Progress: 123/2372 symbols completed. AOD took 30.1s. Estimated remaining: 4h 45m 38s. Rate: 7.9 symbols/min [2025-09-23T17:15:40.674875] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:15:40.687587] [DEBUG] [LOCAL ] AP: Loaded 6931 existing records from primary storage. [2025-09-23T17:15:40.687743] [INFO ] [MAIN ] AP: Loaded 6931 existing records. [2025-09-23T17:15:40.904018] [WARN ] [MAIN ] AP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:15:40.904606] [INFO ] [MAIN ] AP: Wiping existing primary data before full refresh. [2025-09-23T17:15:40.904723] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-09-23T17:15:40.906766] [DEBUG] [LOCAL ] AP: Deleted primary data file. [2025-09-23T17:15:40.906716] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-23T17:15:40.906926] [INFO ] [MAIN ] AP: Starting full primary refresh. [2025-09-23T17:15:41.007540] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-04. [2025-09-23T17:15:41.288857] [INFO ] [REMOTE ] AP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:15:41.634267] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-23T17:15:41.802191] [INFO ] [REMOTE ] AP: Fetching primary data for 2024-12. [2025-09-23T17:15:42.058215] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-23T17:15:42.479132] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-23T17:15:42.602215] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-05. [2025-09-23T17:15:43.402183] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-09-23T17:15:43.511730] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-23T17:15:44.202222] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-01. [2025-09-23T17:15:44.551964] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-23T17:15:44.878446] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-23T17:15:44.887039] [INFO ] [REMOTE ] AON: Full fetch complete (64934 records). [2025-09-23T17:15:44.887215] [DEBUG] [VALIDATOR ] AON: Validating primary data. [2025-09-23T17:15:45.007402] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-02. [2025-09-23T17:15:45.316811] [DEBUG] [VALIDATOR ] AON: All expected trading days are present. [2025-09-23T17:15:45.316931] [DEBUG] [VALIDATOR ] AON: Primary data validation passed. [2025-09-23T17:15:45.317590] [INFO ] [MAIN ] AON: Fetched primary data is valid. [2025-09-23T17:15:45.317637] [DEBUG] [LOCAL ] AON: Saving primary data. [2025-09-23T17:15:45.321677] [DEBUG] [LOCAL ] AON: Trimmed 64934 records to 45655 (keeping 200 days of data) [2025-09-23T17:15:45.585691] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-23T17:15:45.639368] [DEBUG] [LOCAL ] AON: Primary data saved (45655 records). [2025-09-23T17:15:45.639533] [INFO ] [MAIN ] AON: Full history saved. [2025-09-23T17:15:45.639675] [INFO ] [MAIN ] Update Progress: 124/2372 symbols completed. AON took 35.2s. Estimated remaining: 4h 44m 45s. Rate: 7.9 symbols/min [2025-09-23T17:15:45.812174] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-06. [2025-09-23T17:15:45.841100] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:15:45.884710] [DEBUG] [LOCAL ] APAM: Loaded 36619 existing records from primary storage. [2025-09-23T17:15:45.884875] [INFO ] [MAIN ] APAM: Loaded 36619 existing records. [2025-09-23T17:15:46.068291] [WARN ] [MAIN ] APAM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:15:46.068613] [INFO ] [MAIN ] APAM: Wiping existing primary data before full refresh. [2025-09-23T17:15:46.068704] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-09-23T17:15:46.071158] [DEBUG] [LOCAL ] APAM: Deleted primary data file. [2025-09-23T17:15:46.071266] [INFO ] [MAIN ] APAM: Starting full primary refresh. [2025-09-23T17:15:46.449237] [INFO ] [REMOTE ] APAM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:15:46.602162] [INFO ] [REMOTE ] APAM: Fetching primary data for 2024-12. [2025-09-23T17:15:46.704459] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-23T17:15:47.402259] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-03. [2025-09-23T17:15:48.056782] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-23T17:15:48.057374] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-23T17:15:48.202193] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-01. [2025-09-23T17:15:49.002187] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-07. [2025-09-23T17:15:49.162892] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-23T17:15:49.802193] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-02. [2025-09-23T17:15:50.400887] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-23T17:15:50.602168] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-04. [2025-09-23T17:15:50.786000] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-23T17:15:50.995979] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-23T17:15:51.402186] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-05. [2025-09-23T17:15:51.962997] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-23T17:15:52.202302] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-08. [2025-09-23T17:15:53.002253] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-03. [2025-09-23T17:15:53.329780] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-23T17:15:53.802231] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-01. [2025-09-23T17:15:54.061255] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-23T17:15:54.602185] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-09-23T17:15:55.386123] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-23T17:15:55.402138] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-02. [2025-09-23T17:15:55.942029] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-23T17:15:55.947272] [INFO ] [REMOTE ] AORT: Full fetch complete (41646 records). [2025-09-23T17:15:55.947367] [DEBUG] [VALIDATOR ] AORT: Validating primary data. [2025-09-23T17:15:56.207470] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-04. [2025-09-23T17:15:56.322863] [DEBUG] [VALIDATOR ] AORT: All expected trading days are present. [2025-09-23T17:15:56.322953] [DEBUG] [VALIDATOR ] AORT: Primary data validation passed. [2025-09-23T17:15:56.323414] [INFO ] [MAIN ] AORT: Fetched primary data is valid. [2025-09-23T17:15:56.323457] [DEBUG] [LOCAL ] AORT: Saving primary data. [2025-09-23T17:15:56.326206] [DEBUG] [LOCAL ] AORT: Trimmed 41646 records to 29726 (keeping 200 days of data) [2025-09-23T17:15:56.502490] [DEBUG] [LOCAL ] AORT: Primary data saved (29726 records). [2025-09-23T17:15:56.502669] [INFO ] [MAIN ] AORT: Full history saved. [2025-09-23T17:15:56.502764] [INFO ] [MAIN ] Update Progress: 125/2372 symbols completed. AORT took 34.9s. Estimated remaining: 4h 45m 36s. Rate: 7.9 symbols/min [2025-09-23T17:15:56.684841] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:15:56.739527] [DEBUG] [LOCAL ] APD: Loaded 45375 existing records from primary storage. [2025-09-23T17:15:56.739693] [INFO ] [MAIN ] APD: Loaded 45375 existing records. [2025-09-23T17:15:56.881467] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-23T17:15:56.958976] [WARN ] [MAIN ] APD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:15:56.959222] [INFO ] [MAIN ] APD: Wiping existing primary data before full refresh. [2025-09-23T17:15:56.959269] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-09-23T17:15:56.961635] [DEBUG] [LOCAL ] APD: Deleted primary data file. [2025-09-23T17:15:56.961722] [INFO ] [MAIN ] APD: Starting full primary refresh. [2025-09-23T17:15:57.007274] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-03. [2025-09-23T17:15:57.320675] [INFO ] [REMOTE ] APD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:15:57.523303] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-23T17:15:57.802282] [INFO ] [REMOTE ] APD: Fetching primary data for 2024-12. [2025-09-23T17:15:58.596578] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-23T17:15:58.606397] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-05. [2025-09-23T17:15:59.402170] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-06. [2025-09-23T17:15:59.495600] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-23T17:15:59.708154] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-23T17:16:00.003588] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-23T17:16:00.202195] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-01. [2025-09-23T17:16:01.002227] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-06. [2025-09-23T17:16:01.729474] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-23T17:16:01.802214] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-04. [2025-09-23T17:16:01.938314] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-23T17:16:02.602247] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-02. [2025-09-23T17:16:03.146329] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-23T17:16:03.402225] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-07. [2025-09-23T17:16:03.750615] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-23T17:16:04.122258] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-23T17:16:04.202201] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-08. [2025-09-23T17:16:04.630414] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-23T17:16:05.002241] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-03. [2025-09-23T17:16:05.802236] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-05. [2025-09-23T17:16:06.371671] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-23T17:16:06.602173] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-04. [2025-09-23T17:16:07.402179] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-09. [2025-09-23T17:16:07.689831] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-23T17:16:07.971166] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-23T17:16:07.974212] [INFO ] [REMOTE ] AP: Full fetch complete (8733 records). [2025-09-23T17:16:07.978003] [DEBUG] [VALIDATOR ] AP: Validating primary data. [2025-09-23T17:16:08.116146] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-23T17:16:08.208798] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-07. [2025-09-23T17:16:08.692260] [DEBUG] [VALIDATOR ] AP: All expected trading days are present. [2025-09-23T17:16:08.692350] [DEBUG] [VALIDATOR ] AP: Primary data validation passed. [2025-09-23T17:16:08.692574] [INFO ] [MAIN ] AP: Fetched primary data is valid. [2025-09-23T17:16:08.692617] [DEBUG] [LOCAL ] AP: Saving primary data. [2025-09-23T17:16:08.693219] [DEBUG] [LOCAL ] AP: Trimmed 8733 records to 6975 (keeping 200 days of data) [2025-09-23T17:16:08.762528] [DEBUG] [LOCAL ] AP: Primary data saved (6975 records). [2025-09-23T17:16:08.762740] [INFO ] [MAIN ] AP: Full history saved. [2025-09-23T17:16:08.762859] [INFO ] [MAIN ] Update Progress: 126/2372 symbols completed. AP took 28.3s. Estimated remaining: 4h 46m 51s. Rate: 7.8 symbols/min [2025-09-23T17:16:08.947838] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:16:09.008462] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-06. [2025-09-23T17:16:09.012029] [DEBUG] [LOCAL ] APG: Loaded 50234 existing records from primary storage. [2025-09-23T17:16:09.012276] [INFO ] [MAIN ] APG: Loaded 50234 existing records. [2025-09-23T17:16:09.205851] [WARN ] [MAIN ] APG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:16:09.206289] [INFO ] [MAIN ] APG: Wiping existing primary data before full refresh. [2025-09-23T17:16:09.206382] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-09-23T17:16:09.209789] [DEBUG] [LOCAL ] APG: Deleted primary data file. [2025-09-23T17:16:09.209859] [INFO ] [MAIN ] APG: Starting full primary refresh. [2025-09-23T17:16:09.406107] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-23T17:16:09.616030] [INFO ] [REMOTE ] APG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:16:09.802190] [INFO ] [REMOTE ] APG: Fetching primary data for 2024-12. [2025-09-23T17:16:10.350527] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-23T17:16:10.602246] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-05. [2025-09-23T17:16:11.193892] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-23T17:16:11.402183] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-01. [2025-09-23T17:16:12.095497] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-23T17:16:12.202228] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-06. [2025-09-23T17:16:12.581180] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-23T17:16:13.002202] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-07. [2025-09-23T17:16:13.607248] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-23T17:16:13.802211] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-07. [2025-09-23T17:16:14.602198] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-02. [2025-09-23T17:16:14.780170] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-23T17:16:15.190374] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-23T17:16:15.402233] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-08. [2025-09-23T17:16:15.864177] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-23T17:16:16.202244] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-08. [2025-09-23T17:16:16.584373] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-23T17:16:17.002222] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-08. [2025-09-23T17:16:17.726094] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-23T17:16:17.802202] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-09-23T17:16:18.442017] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-23T17:16:18.602238] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-09-23T17:16:19.077578] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-23T17:16:19.084772] [INFO ] [REMOTE ] APD: Full fetch complete (66571 records). [2025-09-23T17:16:19.084946] [DEBUG] [VALIDATOR ] APD: Validating primary data. [2025-09-23T17:16:19.407283] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-09-23T17:16:19.487774] [DEBUG] [VALIDATOR ] APD: All expected trading days are present. [2025-09-23T17:16:19.487865] [DEBUG] [VALIDATOR ] APD: Primary data validation passed. [2025-09-23T17:16:19.488511] [INFO ] [MAIN ] APD: Fetched primary data is valid. [2025-09-23T17:16:19.488554] [DEBUG] [LOCAL ] APD: Saving primary data. [2025-09-23T17:16:19.490009] [DEBUG] [LOCAL ] APD: Trimmed 66571 records to 45379 (keeping 200 days of data) [2025-09-23T17:16:19.791975] [DEBUG] [LOCAL ] APD: Primary data saved (45379 records). [2025-09-23T17:16:19.792134] [INFO ] [MAIN ] APD: Full history saved. [2025-09-23T17:16:19.794082] [INFO ] [MAIN ] Update Progress: 127/2372 symbols completed. APD took 23.3s. Estimated remaining: 4h 47m 43s. Rate: 7.8 symbols/min [2025-09-23T17:16:19.990939] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:16:20.018420] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-23T17:16:20.028183] [INFO ] [REMOTE ] AOS: Full fetch complete (70678 records). [2025-09-23T17:16:20.028364] [DEBUG] [VALIDATOR ] AOS: Validating primary data. [2025-09-23T17:16:20.226530] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-03. [2025-09-23T17:16:20.374692] [DEBUG] [LOCAL ] APH: Loaded 53691 existing records from primary storage. [2025-09-23T17:16:20.374914] [INFO ] [MAIN ] APH: Loaded 53691 existing records. [2025-09-23T17:16:20.591360] [DEBUG] [VALIDATOR ] AOS: All expected trading days are present. [2025-09-23T17:16:20.602134] [DEBUG] [VALIDATOR ] AOS: Primary data validation passed. [2025-09-23T17:16:20.603005] [INFO ] [MAIN ] AOS: Fetched primary data is valid. [2025-09-23T17:16:20.608578] [DEBUG] [LOCAL ] AOS: Saving primary data. [2025-09-23T17:16:20.745536] [WARN ] [MAIN ] APH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:16:20.745304] [DEBUG] [LOCAL ] AOS: Trimmed 70678 records to 49194 (keeping 200 days of data) [2025-09-23T17:16:20.760854] [INFO ] [MAIN ] APH: Wiping existing primary data before full refresh. [2025-09-23T17:16:20.762967] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-23T17:16:20.762397] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-09-23T17:16:20.769614] [DEBUG] [LOCAL ] APH: Deleted primary data file. [2025-09-23T17:16:20.769780] [INFO ] [MAIN ] APH: Starting full primary refresh. [2025-09-23T17:16:20.802737] [INFO ] [REMOTE ] APAM: Full fetch complete (51247 records). [2025-09-23T17:16:20.907763] [DEBUG] [VALIDATOR ] APAM: Validating primary data. [2025-09-23T17:16:20.963563] [FATAL] [VALIDATOR ] APAM: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:16:20.965922] [FATAL] [MAIN ] APAM: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:16:21.008225] [WARN ] [MAIN ] APAM: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:16:21.058727] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-09-23T17:16:21.088439] [DEBUG] [LOCAL ] APAM: No primary data file found to delete. [2025-09-23T17:16:21.089716] [INFO ] [LOCAL ] APAM: Starting deletion of derivative data. [2025-09-23T17:16:21.133785] [DEBUG] [LOCAL ] APAM: Deleted derivative data file. [2025-09-23T17:16:21.145790] [INFO ] [MAIN ] Update Progress: 128/2372 symbols completed. APAM took 35.5s. Estimated remaining: 4h 45m 44s. Rate: 7.9 symbols/min [2025-09-23T17:16:21.343298] [INFO ] [REMOTE ] APH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:16:21.359083] [INFO ] [REMOTE ] APH: Fetching primary data for 2024-12. [2025-09-23T17:16:21.442782] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:16:21.602436] [DEBUG] [LOCAL ] APLE: Loaded 52036 existing records from primary storage. [2025-09-23T17:16:21.605688] [INFO ] [MAIN ] APLE: Loaded 52036 existing records. [2025-09-23T17:16:21.858394] [WARN ] [MAIN ] APLE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:16:21.859512] [INFO ] [MAIN ] APLE: Wiping existing primary data before full refresh. [2025-09-23T17:16:21.860956] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-09-23T17:16:21.864466] [DEBUG] [LOCAL ] APLE: Deleted primary data file. [2025-09-23T17:16:21.865176] [INFO ] [MAIN ] APLE: Starting full primary refresh. [2025-09-23T17:16:22.048703] [DEBUG] [LOCAL ] AOS: Primary data saved (49194 records). [2025-09-23T17:16:22.094197] [INFO ] [MAIN ] AOS: Full history saved. [2025-09-23T17:16:22.128213] [INFO ] [MAIN ] Update Progress: 129/2372 symbols completed. AOS took 43.0s. Estimated remaining: 4h 43m 41s. Rate: 7.9 symbols/min [2025-09-23T17:16:22.388494] [INFO ] [REMOTE ] APLE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:16:22.394546] [INFO ] [REMOTE ] APLE: Fetching primary data for 2024-12. [2025-09-23T17:16:22.466204] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:16:22.498276] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-09-23T17:16:22.566523] [DEBUG] [LOCAL ] APO: Loaded 53386 existing records from primary storage. [2025-09-23T17:16:22.566747] [INFO ] [MAIN ] APO: Loaded 53386 existing records. [2025-09-23T17:16:22.612475] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-04. [2025-09-23T17:16:22.757677] [WARN ] [MAIN ] APO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:16:22.757930] [INFO ] [MAIN ] APO: Wiping existing primary data before full refresh. [2025-09-23T17:16:22.757981] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-09-23T17:16:22.760751] [DEBUG] [LOCAL ] APO: Deleted primary data file. [2025-09-23T17:16:22.760816] [INFO ] [MAIN ] APO: Starting full primary refresh. [2025-09-23T17:16:23.139396] [INFO ] [REMOTE ] APO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:16:23.173793] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-23T17:16:23.402202] [INFO ] [REMOTE ] APO: Fetching primary data for 2024-12. [2025-09-23T17:16:23.897711] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-23T17:16:23.937037] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-23T17:16:24.202279] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-05. [2025-09-23T17:16:25.003332] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-23T17:16:25.003426] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-01. [2025-09-23T17:16:25.768687] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-23T17:16:25.802204] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-01. [2025-09-23T17:16:26.379563] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-23T17:16:26.602206] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-06. [2025-09-23T17:16:27.402189] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-02. [2025-09-23T17:16:27.699490] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-23T17:16:28.047936] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-09-23T17:16:28.202199] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-02. [2025-09-23T17:16:28.720408] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-23T17:16:29.002230] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-03. [2025-09-23T17:16:29.620876] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-23T17:16:29.802208] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-03. [2025-09-23T17:16:30.487503] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-23T17:16:30.602231] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-04. [2025-09-23T17:16:31.193547] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-23T17:16:31.402217] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-01. [2025-09-23T17:16:32.202204] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-07. [2025-09-23T17:16:32.514751] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-23T17:16:32.804495] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-23T17:16:33.002200] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-02. [2025-09-23T17:16:33.668069] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-23T17:16:33.802217] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-05. [2025-09-23T17:16:34.602255] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-04. [2025-09-23T17:16:34.641541] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-23T17:16:35.407932] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-03. [2025-09-23T17:16:35.429497] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-23T17:16:36.202266] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-08. [2025-09-23T17:16:36.754427] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-23T17:16:36.971040] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-23T17:16:37.002160] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-04. [2025-09-23T17:16:37.298381] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-23T17:16:37.802226] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-06. [2025-09-23T17:16:38.602209] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-05. [2025-09-23T17:16:38.687088] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-23T17:16:39.135232] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-23T17:16:39.402187] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-05. [2025-09-23T17:16:40.159372] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-23T17:16:40.202161] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-06. [2025-09-23T17:16:41.002199] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-09-23T17:16:41.300523] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-23T17:16:41.691300] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-23T17:16:41.802306] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-07. [2025-09-23T17:16:42.399727] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-23T17:16:42.408399] [INFO ] [REMOTE ] APG: Full fetch complete (71634 records). [2025-09-23T17:16:42.408552] [DEBUG] [VALIDATOR ] APG: Validating primary data. [2025-09-23T17:16:42.613601] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-06. [2025-09-23T17:16:42.820401] [DEBUG] [VALIDATOR ] APG: All expected trading days are present. [2025-09-23T17:16:42.820481] [DEBUG] [VALIDATOR ] APG: Primary data validation passed. [2025-09-23T17:16:42.821176] [INFO ] [MAIN ] APG: Fetched primary data is valid. [2025-09-23T17:16:42.821239] [DEBUG] [LOCAL ] APG: Saving primary data. [2025-09-23T17:16:42.822633] [DEBUG] [LOCAL ] APG: Trimmed 71634 records to 50228 (keeping 200 days of data) [2025-09-23T17:16:43.137365] [DEBUG] [LOCAL ] APG: Primary data saved (50228 records). [2025-09-23T17:16:43.137500] [INFO ] [MAIN ] APG: Full history saved. [2025-09-23T17:16:43.137587] [INFO ] [MAIN ] Update Progress: 130/2372 symbols completed. APG took 34.4s. Estimated remaining: 4h 47m 25s. Rate: 7.8 symbols/min [2025-09-23T17:16:43.306125] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:16:43.315480] [DEBUG] [LOCAL ] APOS: Loaded 7486 existing records from primary storage. [2025-09-23T17:16:43.315620] [INFO ] [MAIN ] APOS: Loaded 7486 existing records. [2025-09-23T17:16:43.406684] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-07. [2025-09-23T17:16:43.500279] [WARN ] [MAIN ] APOS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:16:43.500908] [INFO ] [MAIN ] APOS: Wiping existing primary data before full refresh. [2025-09-23T17:16:43.500989] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-09-23T17:16:43.501697] [DEBUG] [LOCAL ] APOS: Deleted primary data file. [2025-09-23T17:16:43.501837] [INFO ] [MAIN ] APOS: Starting full primary refresh. [2025-09-23T17:16:43.783861] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-23T17:16:43.910343] [INFO ] [REMOTE ] APOS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:16:44.158838] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-23T17:16:44.202200] [INFO ] [REMOTE ] APOS: Fetching primary data for 2024-12. [2025-09-23T17:16:44.791552] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-23T17:16:45.002212] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-01. [2025-09-23T17:16:45.312807] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-23T17:16:45.403888] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-23T17:16:45.802195] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-08. [2025-09-23T17:16:46.602188] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-08. [2025-09-23T17:16:47.402228] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-02. [2025-09-23T17:16:47.513693] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-23T17:16:47.817533] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-23T17:16:48.202174] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-09-23T17:16:48.250580] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-23T17:16:49.002238] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-07. [2025-09-23T17:16:49.802159] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-09. [2025-09-23T17:16:49.876476] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-23T17:16:49.884887] [INFO ] [REMOTE ] APH: Full fetch complete (77293 records). [2025-09-23T17:16:49.885170] [DEBUG] [VALIDATOR ] APH: Validating primary data. [2025-09-23T17:16:49.886318] [FATAL] [VALIDATOR ] APH: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:16:49.886427] [FATAL] [MAIN ] APH: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:16:49.886490] [WARN ] [MAIN ] APH: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:16:49.886565] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-09-23T17:16:49.886630] [DEBUG] [LOCAL ] APH: No primary data file found to delete. [2025-09-23T17:16:49.886712] [INFO ] [LOCAL ] APH: Starting deletion of derivative data. [2025-09-23T17:16:49.887117] [DEBUG] [LOCAL ] APH: Deleted derivative data file. [2025-09-23T17:16:49.887224] [INFO ] [MAIN ] Update Progress: 131/2372 symbols completed. APH took 30.1s. Estimated remaining: 4h 47m 1s. Rate: 7.8 symbols/min [2025-09-23T17:16:50.055568] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:16:50.107163] [DEBUG] [LOCAL ] APTV: Loaded 52232 existing records from primary storage. [2025-09-23T17:16:50.107309] [INFO ] [MAIN ] APTV: Loaded 52232 existing records. [2025-09-23T17:16:50.283367] [WARN ] [MAIN ] APTV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:16:50.283664] [INFO ] [MAIN ] APTV: Wiping existing primary data before full refresh. [2025-09-23T17:16:50.283740] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-09-23T17:16:50.286170] [DEBUG] [LOCAL ] APTV: Deleted primary data file. [2025-09-23T17:16:50.286234] [INFO ] [MAIN ] APTV: Starting full primary refresh. [2025-09-23T17:16:50.606097] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-03. [2025-09-23T17:16:50.654626] [INFO ] [REMOTE ] APTV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:16:50.729632] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-23T17:16:51.164285] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-23T17:16:51.190035] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-23T17:16:51.199006] [INFO ] [REMOTE ] APLE: Full fetch complete (74254 records). [2025-09-23T17:16:51.199162] [DEBUG] [VALIDATOR ] APLE: Validating primary data. [2025-09-23T17:16:51.410098] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-08. [2025-09-23T17:16:51.601540] [DEBUG] [VALIDATOR ] APLE: All expected trading days are present. [2025-09-23T17:16:51.601628] [DEBUG] [VALIDATOR ] APLE: Primary data validation passed. [2025-09-23T17:16:51.602409] [INFO ] [MAIN ] APLE: Fetched primary data is valid. [2025-09-23T17:16:51.602462] [DEBUG] [LOCAL ] APLE: Saving primary data. [2025-09-23T17:16:51.604026] [DEBUG] [LOCAL ] APLE: Trimmed 74254 records to 52034 (keeping 200 days of data) [2025-09-23T17:16:51.923234] [DEBUG] [LOCAL ] APLE: Primary data saved (52034 records). [2025-09-23T17:16:51.923381] [INFO ] [MAIN ] APLE: Full history saved. [2025-09-23T17:16:51.923479] [INFO ] [MAIN ] Update Progress: 132/2372 symbols completed. APLE took 30.8s. Estimated remaining: 4h 45m 17s. Rate: 7.9 symbols/min [2025-09-23T17:16:52.094411] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:16:52.144917] [DEBUG] [LOCAL ] AQN: Loaded 51958 existing records from primary storage. [2025-09-23T17:16:52.145136] [INFO ] [MAIN ] AQN: Loaded 51958 existing records. [2025-09-23T17:16:52.208118] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-04. [2025-09-23T17:16:52.344610] [WARN ] [MAIN ] AQN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:16:52.345117] [INFO ] [MAIN ] AQN: Wiping existing primary data before full refresh. [2025-09-23T17:16:52.345197] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-09-23T17:16:52.347312] [DEBUG] [LOCAL ] AQN: Deleted primary data file. [2025-09-23T17:16:52.347376] [INFO ] [MAIN ] AQN: Starting full primary refresh. [2025-09-23T17:16:52.699460] [INFO ] [REMOTE ] AQN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:16:52.742838] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-23T17:16:53.002220] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-05. [2025-09-23T17:16:53.108722] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-23T17:16:53.432807] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-23T17:16:53.802211] [INFO ] [REMOTE ] AQN: Fetching primary data for 2024-12. [2025-09-23T17:16:54.602237] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-09-23T17:16:55.402198] [INFO ] [REMOTE ] APTV: Fetching primary data for 2024-12. [2025-09-23T17:16:55.534489] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-23T17:16:55.968560] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-23T17:16:55.977470] [INFO ] [REMOTE ] APO: Full fetch complete (77292 records). [2025-09-23T17:16:55.977614] [DEBUG] [VALIDATOR ] APO: Validating primary data. [2025-09-23T17:16:56.209800] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-01. [2025-09-23T17:16:56.382494] [DEBUG] [VALIDATOR ] APO: All expected trading days are present. [2025-09-23T17:16:56.382573] [DEBUG] [VALIDATOR ] APO: Primary data validation passed. [2025-09-23T17:16:56.383313] [INFO ] [MAIN ] APO: Fetched primary data is valid. [2025-09-23T17:16:56.383377] [DEBUG] [LOCAL ] APO: Saving primary data. [2025-09-23T17:16:56.384892] [DEBUG] [LOCAL ] APO: Trimmed 77292 records to 53386 (keeping 200 days of data) [2025-09-23T17:16:56.729067] [DEBUG] [LOCAL ] APO: Primary data saved (53386 records). [2025-09-23T17:16:56.729199] [INFO ] [MAIN ] APO: Full history saved. [2025-09-23T17:16:56.729281] [INFO ] [MAIN ] Update Progress: 133/2372 symbols completed. APO took 34.6s. Estimated remaining: 4h 44m 22s. Rate: 7.9 symbols/min [2025-09-23T17:16:56.916814] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:16:56.917120] [DEBUG] [LOCAL ] AQNB: No existing data file found in primary storage. [2025-09-23T17:16:56.917282] [WARN ] [MAIN ] AQNB: No existing data found, performing full refresh instead. [2025-09-23T17:16:56.917632] [INFO ] [MAIN ] AQNB: Wiping existing primary data before full refresh. [2025-09-23T17:16:56.917803] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-09-23T17:16:56.918098] [DEBUG] [LOCAL ] AQNB: No primary data file found to delete. [2025-09-23T17:16:56.918162] [INFO ] [MAIN ] AQNB: Starting full primary refresh. [2025-09-23T17:16:57.004402] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-06. [2025-09-23T17:16:57.242820] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-23T17:16:57.355621] [INFO ] [REMOTE ] AQNB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:16:57.424035] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-23T17:16:57.714406] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-23T17:16:57.802158] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-02. [2025-09-23T17:16:58.602201] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-01. [2025-09-23T17:16:59.070994] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-23T17:16:59.402188] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-03. [2025-09-23T17:17:00.036551] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-23T17:17:00.202203] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-07. [2025-09-23T17:17:00.757031] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-23T17:17:01.002227] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2024-12. [2025-09-23T17:17:01.067913] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-23T17:17:01.537331] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-23T17:17:01.802216] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-08. [2025-09-23T17:17:02.203813] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-23T17:17:02.602207] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-04. [2025-09-23T17:17:03.402225] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-02. [2025-09-23T17:17:03.758992] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-23T17:17:04.202214] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-05. [2025-09-23T17:17:05.002173] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-01. [2025-09-23T17:17:05.049387] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-23T17:17:05.319712] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-09-23T17:17:05.685733] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-23T17:17:05.802197] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-06. [2025-09-23T17:17:06.602204] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-02. [2025-09-23T17:17:06.965393] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-23T17:17:07.281726] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-23T17:17:07.402193] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-07. [2025-09-23T17:17:08.202210] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-09-23T17:17:08.669422] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-23T17:17:08.848799] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-23T17:17:08.850597] [INFO ] [REMOTE ] APOS: Full fetch complete (10450 records). [2025-09-23T17:17:08.850700] [DEBUG] [VALIDATOR ] APOS: Validating primary data. [2025-09-23T17:17:09.005425] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-03. [2025-09-23T17:17:09.225718] [DEBUG] [VALIDATOR ] APOS: All expected trading days are present. [2025-09-23T17:17:09.225812] [DEBUG] [VALIDATOR ] APOS: Primary data validation passed. [2025-09-23T17:17:09.226074] [INFO ] [MAIN ] APOS: Fetched primary data is valid. [2025-09-23T17:17:09.226114] [DEBUG] [LOCAL ] APOS: Saving primary data. [2025-09-23T17:17:09.226594] [DEBUG] [LOCAL ] APOS: Trimmed 10450 records to 7493 (keeping 200 days of data) [2025-09-23T17:17:09.273016] [DEBUG] [LOCAL ] APOS: Primary data saved (7493 records). [2025-09-23T17:17:09.273162] [INFO ] [MAIN ] APOS: Full history saved. [2025-09-23T17:17:09.273253] [INFO ] [MAIN ] Update Progress: 134/2372 symbols completed. APOS took 26.1s. Estimated remaining: 4h 45m 37s. Rate: 7.8 symbols/min [2025-09-23T17:17:09.451290] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:17:09.504804] [DEBUG] [LOCAL ] AR: Loaded 53585 existing records from primary storage. [2025-09-23T17:17:09.504977] [INFO ] [MAIN ] AR: Loaded 53585 existing records. [2025-09-23T17:17:09.714326] [WARN ] [MAIN ] AR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:17:09.714699] [INFO ] [MAIN ] AR: Wiping existing primary data before full refresh. [2025-09-23T17:17:09.714778] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-09-23T17:17:09.717683] [DEBUG] [LOCAL ] AR: Deleted primary data file. [2025-09-23T17:17:09.717802] [INFO ] [MAIN ] AR: Starting full primary refresh. [2025-09-23T17:17:09.807321] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-08. [2025-09-23T17:17:10.090495] [INFO ] [REMOTE ] AR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:17:10.602246] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-03. [2025-09-23T17:17:10.762398] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-23T17:17:10.987406] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-23T17:17:11.402166] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-04. [2025-09-23T17:17:11.558455] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-23T17:17:11.877145] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-23T17:17:12.202192] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-05. [2025-09-23T17:17:12.564016] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-23T17:17:13.002203] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-06. [2025-09-23T17:17:13.442696] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-23T17:17:13.802206] [INFO ] [REMOTE ] AR: Fetching primary data for 2024-12. [2025-09-23T17:17:14.602199] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-04. [2025-09-23T17:17:15.402262] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-07. [2025-09-23T17:17:15.696704] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-23T17:17:15.730237] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-23T17:17:15.942591] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-23T17:17:16.202224] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-01. [2025-09-23T17:17:17.002215] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-09-23T17:17:17.598422] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-23T17:17:17.802240] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-02. [2025-09-23T17:17:18.602168] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-05. [2025-09-23T17:17:18.888633] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-23T17:17:18.897931] [INFO ] [REMOTE ] AQN: Full fetch complete (75267 records). [2025-09-23T17:17:18.898089] [DEBUG] [VALIDATOR ] AQN: Validating primary data. [2025-09-23T17:17:19.182803] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-23T17:17:19.351130] [DEBUG] [VALIDATOR ] AQN: All expected trading days are present. [2025-09-23T17:17:19.351239] [DEBUG] [VALIDATOR ] AQN: Primary data validation passed. [2025-09-23T17:17:19.352043] [INFO ] [MAIN ] AQN: Fetched primary data is valid. [2025-09-23T17:17:19.352107] [DEBUG] [LOCAL ] AQN: Saving primary data. [2025-09-23T17:17:19.353688] [DEBUG] [LOCAL ] AQN: Trimmed 75267 records to 51946 (keeping 200 days of data) [2025-09-23T17:17:19.403566] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-08. [2025-09-23T17:17:19.657196] [DEBUG] [LOCAL ] AQN: Primary data saved (51946 records). [2025-09-23T17:17:19.657369] [INFO ] [MAIN ] AQN: Full history saved. [2025-09-23T17:17:19.657470] [INFO ] [MAIN ] Update Progress: 135/2372 symbols completed. AQN took 27.7s. Estimated remaining: 4h 46m 14s. Rate: 7.8 symbols/min [2025-09-23T17:17:19.820872] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-23T17:17:19.844004] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:17:19.894381] [DEBUG] [LOCAL ] ARCO: Loaded 44673 existing records from primary storage. [2025-09-23T17:17:19.894534] [INFO ] [MAIN ] ARCO: Loaded 44673 existing records. [2025-09-23T17:17:20.105474] [WARN ] [MAIN ] ARCO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:17:20.106061] [INFO ] [MAIN ] ARCO: Wiping existing primary data before full refresh. [2025-09-23T17:17:20.106142] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-09-23T17:17:20.108406] [DEBUG] [LOCAL ] ARCO: Deleted primary data file. [2025-09-23T17:17:20.108487] [INFO ] [MAIN ] ARCO: Starting full primary refresh. [2025-09-23T17:17:20.207943] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-09. [2025-09-23T17:17:20.252777] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-23T17:17:20.524944] [INFO ] [REMOTE ] ARCO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:17:20.725966] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-23T17:17:20.727233] [INFO ] [REMOTE ] AQNB: Full fetch complete (5947 records). [2025-09-23T17:17:20.727311] [DEBUG] [VALIDATOR ] AQNB: Validating primary data. [2025-09-23T17:17:21.007328] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2024-12. [2025-09-23T17:17:21.124330] [DEBUG] [VALIDATOR ] AQNB: All expected trading days are present. [2025-09-23T17:17:21.124406] [DEBUG] [VALIDATOR ] AQNB: Primary data validation passed. [2025-09-23T17:17:21.124564] [INFO ] [MAIN ] AQNB: Fetched primary data is valid. [2025-09-23T17:17:21.124601] [DEBUG] [LOCAL ] AQNB: Saving primary data. [2025-09-23T17:17:21.125050] [DEBUG] [LOCAL ] AQNB: Trimmed 5947 records to 4213 (keeping 200 days of data) [2025-09-23T17:17:21.153425] [DEBUG] [LOCAL ] AQNB: Primary data saved (4213 records). [2025-09-23T17:17:21.153544] [INFO ] [MAIN ] AQNB: Full history saved. [2025-09-23T17:17:21.153617] [INFO ] [MAIN ] Update Progress: 136/2372 symbols completed. AQNB took 24.4s. Estimated remaining: 4h 44m 25s. Rate: 7.9 symbols/min [2025-09-23T17:17:21.323512] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:17:21.340254] [DEBUG] [LOCAL ] ARDC: Loaded 14387 existing records from primary storage. [2025-09-23T17:17:21.340373] [INFO ] [MAIN ] ARDC: Loaded 14387 existing records. [2025-09-23T17:17:21.515790] [WARN ] [MAIN ] ARDC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:17:21.516076] [INFO ] [MAIN ] ARDC: Wiping existing primary data before full refresh. [2025-09-23T17:17:21.516133] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-09-23T17:17:21.517018] [DEBUG] [LOCAL ] ARDC: Deleted primary data file. [2025-09-23T17:17:21.517080] [INFO ] [MAIN ] ARDC: Starting full primary refresh. [2025-09-23T17:17:21.807334] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-03. [2025-09-23T17:17:21.877762] [INFO ] [REMOTE ] ARDC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:17:22.348307] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-23T17:17:22.602213] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-06. [2025-09-23T17:17:23.233010] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-23T17:17:23.402187] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-04. [2025-09-23T17:17:24.036423] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-23T17:17:24.202260] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-01. [2025-09-23T17:17:24.877307] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-23T17:17:25.002228] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-05. [2025-09-23T17:17:25.483152] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-23T17:17:25.802227] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-02. [2025-09-23T17:17:26.487226] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-23T17:17:26.602211] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-07. [2025-09-23T17:17:27.039893] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-23T17:17:27.402205] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-06. [2025-09-23T17:17:28.043623] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-23T17:17:28.202204] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2024-12. [2025-09-23T17:17:28.833125] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-23T17:17:28.931206] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-23T17:17:29.002176] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-07. [2025-09-23T17:17:29.802219] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-03. [2025-09-23T17:17:30.602185] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-01. [2025-09-23T17:17:30.862820] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-23T17:17:30.910342] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-23T17:17:31.185024] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-23T17:17:31.402202] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-04. [2025-09-23T17:17:32.202191] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-08. [2025-09-23T17:17:33.002174] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-08. [2025-09-23T17:17:33.046077] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-23T17:17:33.769719] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-23T17:17:33.802168] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-09-23T17:17:34.588812] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-23T17:17:34.602159] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-09-23T17:17:35.402197] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-02. [2025-09-23T17:17:35.759524] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-23T17:17:35.770224] [INFO ] [REMOTE ] AR: Full fetch complete (77526 records). [2025-09-23T17:17:35.770377] [DEBUG] [VALIDATOR ] AR: Validating primary data. [2025-09-23T17:17:36.107013] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-23T17:17:36.190332] [DEBUG] [VALIDATOR ] AR: All expected trading days are present. [2025-09-23T17:17:36.190417] [DEBUG] [VALIDATOR ] AR: Primary data validation passed. [2025-09-23T17:17:36.191148] [INFO ] [MAIN ] AR: Fetched primary data is valid. [2025-09-23T17:17:36.191213] [DEBUG] [LOCAL ] AR: Saving primary data. [2025-09-23T17:17:36.192638] [DEBUG] [LOCAL ] AR: Trimmed 77526 records to 53585 (keeping 200 days of data) [2025-09-23T17:17:36.240374] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-05. [2025-09-23T17:17:36.506945] [DEBUG] [LOCAL ] AR: Primary data saved (53585 records). [2025-09-23T17:17:36.507073] [INFO ] [MAIN ] AR: Full history saved. [2025-09-23T17:17:36.507154] [INFO ] [MAIN ] Update Progress: 137/2372 symbols completed. AR took 27.2s. Estimated remaining: 4h 46m 23s. Rate: 7.8 symbols/min [2025-09-23T17:17:36.720132] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:17:36.716408] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-23T17:17:36.730944] [INFO ] [REMOTE ] APTV: Full fetch complete (76059 records). [2025-09-23T17:17:36.731048] [DEBUG] [VALIDATOR ] APTV: Validating primary data. [2025-09-23T17:17:36.993840] [DEBUG] [LOCAL ] ARDT: Loaded 28318 existing records from primary storage. [2025-09-23T17:17:37.014236] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-03. [2025-09-23T17:17:37.031133] [INFO ] [MAIN ] ARDT: Loaded 28318 existing records. [2025-09-23T17:17:37.313001] [DEBUG] [VALIDATOR ] APTV: All expected trading days are present. [2025-09-23T17:17:37.313737] [DEBUG] [VALIDATOR ] APTV: Primary data validation passed. [2025-09-23T17:17:37.314836] [INFO ] [MAIN ] APTV: Fetched primary data is valid. [2025-09-23T17:17:37.315278] [DEBUG] [LOCAL ] APTV: Saving primary data. [2025-09-23T17:17:37.336782] [WARN ] [MAIN ] ARDT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:17:37.337960] [INFO ] [MAIN ] ARDT: Wiping existing primary data before full refresh. [2025-09-23T17:17:37.338029] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-09-23T17:17:37.338250] [DEBUG] [LOCAL ] APTV: Trimmed 76059 records to 52221 (keeping 200 days of data) [2025-09-23T17:17:37.339356] [DEBUG] [LOCAL ] ARDT: Deleted primary data file. [2025-09-23T17:17:37.339420] [INFO ] [MAIN ] ARDT: Starting full primary refresh. [2025-09-23T17:17:37.776189] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-23T17:17:37.848841] [INFO ] [REMOTE ] ARDT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:17:37.850220] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2024-12. [2025-09-23T17:17:37.871132] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-23T17:17:38.090044] [DEBUG] [LOCAL ] APTV: Primary data saved (52221 records). [2025-09-23T17:17:38.090260] [INFO ] [MAIN ] APTV: Full history saved. [2025-09-23T17:17:38.090499] [INFO ] [MAIN ] Update Progress: 138/2372 symbols completed. APTV took 48.2s. Estimated remaining: 4h 44m 37s. Rate: 7.8 symbols/min [2025-09-23T17:17:38.263946] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:17:38.264146] [DEBUG] [LOCAL ] ARE: No existing data file found in primary storage. [2025-09-23T17:17:38.264202] [WARN ] [MAIN ] ARE: No existing data found, performing full refresh instead. [2025-09-23T17:17:38.264362] [INFO ] [MAIN ] ARE: Wiping existing primary data before full refresh. [2025-09-23T17:17:38.264405] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-09-23T17:17:38.264449] [DEBUG] [LOCAL ] ARE: No primary data file found to delete. [2025-09-23T17:17:38.264493] [INFO ] [MAIN ] ARE: Starting full primary refresh. [2025-09-23T17:17:38.608880] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-06. [2025-09-23T17:17:38.629577] [INFO ] [REMOTE ] ARE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:17:39.164404] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-23T17:17:39.402178] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-04. [2025-09-23T17:17:39.782042] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-23T17:17:40.202737] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-01. [2025-09-23T17:17:40.203897] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-23T17:17:41.002262] [INFO ] [REMOTE ] ARE: Fetching primary data for 2024-12. [2025-09-23T17:17:41.203176] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-23T17:17:41.802223] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-02. [2025-09-23T17:17:42.602213] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-05. [2025-09-23T17:17:42.691537] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-23T17:17:42.990370] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-23T17:17:43.132115] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-23T17:17:43.402205] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-07. [2025-09-23T17:17:44.202201] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-01. [2025-09-23T17:17:44.987986] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-23T17:17:45.002143] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-08. [2025-09-23T17:17:45.526482] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-23T17:17:45.802212] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-06. [2025-09-23T17:17:46.266102] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-23T17:17:46.391360] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-23T17:17:46.602234] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-07. [2025-09-23T17:17:47.402229] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-02. [2025-09-23T17:17:47.667062] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-23T17:17:48.202204] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-08. [2025-09-23T17:17:48.848120] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-23T17:17:48.957071] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-23T17:17:49.002170] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-03. [2025-09-23T17:17:49.802239] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-09. [2025-09-23T17:17:50.321537] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-23T17:17:50.602201] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-04. [2025-09-23T17:17:50.873574] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-23T17:17:50.880878] [INFO ] [REMOTE ] ARCO: Full fetch complete (65641 records). [2025-09-23T17:17:50.881032] [DEBUG] [VALIDATOR ] ARCO: Validating primary data. [2025-09-23T17:17:51.320016] [DEBUG] [VALIDATOR ] ARCO: All expected trading days are present. [2025-09-23T17:17:51.320133] [DEBUG] [VALIDATOR ] ARCO: Primary data validation passed. [2025-09-23T17:17:51.320949] [INFO ] [MAIN ] ARCO: Fetched primary data is valid. [2025-09-23T17:17:51.321062] [DEBUG] [LOCAL ] ARCO: Saving primary data. [2025-09-23T17:17:51.327932] [DEBUG] [LOCAL ] ARCO: Trimmed 65641 records to 44633 (keeping 200 days of data) [2025-09-23T17:17:51.427084] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-09-23T17:17:51.608822] [DEBUG] [LOCAL ] ARCO: Primary data saved (44633 records). [2025-09-23T17:17:51.608962] [INFO ] [MAIN ] ARCO: Full history saved. [2025-09-23T17:17:51.609092] [INFO ] [MAIN ] Update Progress: 139/2372 symbols completed. ARCO took 32.0s. Estimated remaining: 4h 46m 3s. Rate: 7.8 symbols/min [2025-09-23T17:17:51.811790] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:17:51.868796] [DEBUG] [LOCAL ] ARES: Loaded 49656 existing records from primary storage. [2025-09-23T17:17:51.868989] [INFO ] [MAIN ] ARES: Loaded 49656 existing records. [2025-09-23T17:17:52.054361] [WARN ] [MAIN ] ARES: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:17:52.054658] [INFO ] [MAIN ] ARES: Wiping existing primary data before full refresh. [2025-09-23T17:17:52.054732] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-09-23T17:17:52.057320] [DEBUG] [LOCAL ] ARES: Deleted primary data file. [2025-09-23T17:17:52.057398] [INFO ] [MAIN ] ARES: Starting full primary refresh. [2025-09-23T17:17:52.206169] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-03. [2025-09-23T17:17:52.419979] [INFO ] [REMOTE ] ARES: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:17:52.556690] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-23T17:17:52.577602] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-23T17:17:52.581107] [INFO ] [REMOTE ] ARDC: Full fetch complete (20225 records). [2025-09-23T17:17:52.581182] [DEBUG] [VALIDATOR ] ARDC: Validating primary data. [2025-09-23T17:17:52.947459] [DEBUG] [VALIDATOR ] ARDC: All expected trading days are present. [2025-09-23T17:17:52.947536] [DEBUG] [VALIDATOR ] ARDC: Primary data validation passed. [2025-09-23T17:17:52.947859] [INFO ] [MAIN ] ARDC: Fetched primary data is valid. [2025-09-23T17:17:52.947919] [DEBUG] [LOCAL ] ARDC: Saving primary data. [2025-09-23T17:17:52.948478] [DEBUG] [LOCAL ] ARDC: Trimmed 20225 records to 14405 (keeping 200 days of data) [2025-09-23T17:17:53.002971] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-05. [2025-09-23T17:17:53.049043] [DEBUG] [LOCAL ] ARDC: Primary data saved (14405 records). [2025-09-23T17:17:53.049172] [INFO ] [MAIN ] ARDC: Full history saved. [2025-09-23T17:17:53.049297] [INFO ] [MAIN ] Update Progress: 140/2372 symbols completed. ARDC took 31.9s. Estimated remaining: 4h 44m 16s. Rate: 7.9 symbols/min [2025-09-23T17:17:53.227976] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:17:53.252982] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-23T17:17:53.306463] [DEBUG] [LOCAL ] ARI: Loaded 43335 existing records from primary storage. [2025-09-23T17:17:53.306607] [INFO ] [MAIN ] ARI: Loaded 43335 existing records. [2025-09-23T17:17:53.480491] [WARN ] [MAIN ] ARI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:17:53.480867] [INFO ] [MAIN ] ARI: Wiping existing primary data before full refresh. [2025-09-23T17:17:53.480923] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-09-23T17:17:53.483555] [DEBUG] [LOCAL ] ARI: Deleted primary data file. [2025-09-23T17:17:53.483618] [INFO ] [MAIN ] ARI: Starting full primary refresh. [2025-09-23T17:17:53.807312] [INFO ] [REMOTE ] ARES: Fetching primary data for 2024-12. [2025-09-23T17:17:53.837202] [INFO ] [REMOTE ] ARI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:17:54.602203] [INFO ] [REMOTE ] ARI: Fetching primary data for 2024-12. [2025-09-23T17:17:54.643609] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-23T17:17:55.351333] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-23T17:17:55.402159] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-01. [2025-09-23T17:17:55.942169] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-23T17:17:56.202198] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-04. [2025-09-23T17:17:56.787391] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-23T17:17:57.002167] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-02. [2025-09-23T17:17:57.041252] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-23T17:17:57.802233] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-05. [2025-09-23T17:17:58.416446] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-23T17:17:58.565150] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-23T17:17:58.602149] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-06. [2025-09-23T17:17:59.402224] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-06. [2025-09-23T17:17:59.751927] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-23T17:18:00.202228] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-03. [2025-09-23T17:18:00.980515] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-23T17:18:01.002158] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-07. [2025-09-23T17:18:01.802228] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-07. [2025-09-23T17:18:02.555708] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-23T17:18:02.602180] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-08. [2025-09-23T17:18:02.657736] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-09-23T17:18:03.402262] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-01. [2025-09-23T17:18:04.202195] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-04. [2025-09-23T17:18:05.020425] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-23T17:18:05.029069] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-02. [2025-09-23T17:18:05.423372] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-07 (3.62 seconds). [2025-09-23T17:18:05.457967] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-08 (2.86 seconds). [2025-09-23T17:18:05.802220] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-08. [2025-09-23T17:18:06.249055] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-23T17:18:06.424560] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-23T17:18:06.602210] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-03. [2025-09-23T17:18:07.402184] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-05. [2025-09-23T17:18:07.617274] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-23T17:18:07.689416] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-23T17:18:08.202246] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-09. [2025-09-23T17:18:08.941216] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-23T17:18:09.003740] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-09-23T17:18:09.005871] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-23T17:18:09.011586] [INFO ] [REMOTE ] ARDT: Full fetch complete (41173 records). [2025-09-23T17:18:09.011737] [DEBUG] [VALIDATOR ] ARDT: Validating primary data. [2025-09-23T17:18:09.418686] [DEBUG] [VALIDATOR ] ARDT: All expected trading days are present. [2025-09-23T17:18:09.419011] [DEBUG] [VALIDATOR ] ARDT: Primary data validation passed. [2025-09-23T17:18:09.419511] [INFO ] [MAIN ] ARDT: Fetched primary data is valid. [2025-09-23T17:18:09.419556] [DEBUG] [LOCAL ] ARDT: Saving primary data. [2025-09-23T17:18:09.421377] [DEBUG] [LOCAL ] ARDT: Trimmed 41173 records to 28224 (keeping 200 days of data) [2025-09-23T17:18:09.599629] [DEBUG] [LOCAL ] ARDT: Primary data saved (28224 records). [2025-09-23T17:18:09.599792] [INFO ] [MAIN ] ARDT: Full history saved. [2025-09-23T17:18:09.599903] [INFO ] [MAIN ] Update Progress: 141/2372 symbols completed. ARDT took 33.1s. Estimated remaining: 4h 46m 29s. Rate: 7.8 symbols/min [2025-09-23T17:18:09.767546] [INFO ] [MAIN ] ARIS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:18:09.802231] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-06. [2025-09-23T17:18:09.817624] [DEBUG] [LOCAL ] ARIS: Loaded 41970 existing records from primary storage. [2025-09-23T17:18:09.817805] [INFO ] [MAIN ] ARIS: Loaded 41970 existing records. [2025-09-23T17:18:10.018013] [WARN ] [MAIN ] ARIS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:18:10.018339] [INFO ] [MAIN ] ARIS: Wiping existing primary data before full refresh. [2025-09-23T17:18:10.018396] [INFO ] [LOCAL ] ARIS: Starting deletion of primary data. [2025-09-23T17:18:10.020561] [DEBUG] [LOCAL ] ARIS: Deleted primary data file. [2025-09-23T17:18:10.020630] [INFO ] [MAIN ] ARIS: Starting full primary refresh. [2025-09-23T17:18:10.377912] [INFO ] [REMOTE ] ARIS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:18:10.602200] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2024-12. [2025-09-23T17:18:10.846318] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-23T17:18:10.854736] [INFO ] [REMOTE ] ARE: Full fetch complete (72662 records). [2025-09-23T17:18:10.854899] [DEBUG] [VALIDATOR ] ARE: Validating primary data. [2025-09-23T17:18:11.247591] [DEBUG] [VALIDATOR ] ARE: All expected trading days are present. [2025-09-23T17:18:11.247809] [DEBUG] [VALIDATOR ] ARE: Primary data validation passed. [2025-09-23T17:18:11.248575] [INFO ] [MAIN ] ARE: Fetched primary data is valid. [2025-09-23T17:18:11.248720] [DEBUG] [LOCAL ] ARE: Saving primary data. [2025-09-23T17:18:11.250353] [DEBUG] [LOCAL ] ARE: Trimmed 72662 records to 50634 (keeping 200 days of data) [2025-09-23T17:18:11.376707] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-23T17:18:11.402338] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-04. [2025-09-23T17:18:11.728188] [DEBUG] [LOCAL ] ARE: Primary data saved (50634 records). [2025-09-23T17:18:11.728457] [INFO ] [MAIN ] ARE: Full history saved. [2025-09-23T17:18:11.728619] [INFO ] [MAIN ] Update Progress: 142/2372 symbols completed. ARE took 33.6s. Estimated remaining: 4h 44m 54s. Rate: 7.8 symbols/min [2025-09-23T17:18:11.887852] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-23T17:18:12.045163] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:18:12.109528] [DEBUG] [LOCAL ] ARLO: Loaded 43987 existing records from primary storage. [2025-09-23T17:18:12.109840] [INFO ] [MAIN ] ARLO: Loaded 43987 existing records. [2025-09-23T17:18:12.207634] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-01. [2025-09-23T17:18:12.412538] [WARN ] [MAIN ] ARLO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:18:12.412843] [INFO ] [MAIN ] ARLO: Wiping existing primary data before full refresh. [2025-09-23T17:18:12.412895] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-09-23T17:18:12.414847] [DEBUG] [LOCAL ] ARLO: Deleted primary data file. [2025-09-23T17:18:12.414923] [INFO ] [MAIN ] ARLO: Starting full primary refresh. [2025-09-23T17:18:12.879866] [INFO ] [REMOTE ] ARLO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:18:12.968732] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-23T17:18:13.002158] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-05. [2025-09-23T17:18:13.575586] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-23T17:18:13.802238] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2024-12. [2025-09-23T17:18:14.602198] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-02. [2025-09-23T17:18:15.216622] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-23T17:18:15.402212] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-06. [2025-09-23T17:18:16.202177] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-07. [2025-09-23T17:18:16.327090] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-23T17:18:16.392209] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2024-12 (2.59 seconds). [2025-09-23T17:18:17.002204] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-03. [2025-09-23T17:18:17.192070] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-23T17:18:17.491113] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-23T17:18:17.802251] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-01. [2025-09-23T17:18:18.028031] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-23T17:18:18.602198] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-04. [2025-09-23T17:18:18.773804] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-23T17:18:19.402205] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-02. [2025-09-23T17:18:19.793464] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-23T17:18:20.202216] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-08. [2025-09-23T17:18:20.520234] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-23T17:18:21.002285] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-07. [2025-09-23T17:18:21.646243] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-23T17:18:21.802253] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-09-23T17:18:22.157199] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-23T17:18:22.602205] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-05. [2025-09-23T17:18:23.402295] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-03. [2025-09-23T17:18:23.738073] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-23T17:18:23.746597] [INFO ] [REMOTE ] ARES: Full fetch complete (70585 records). [2025-09-23T17:18:23.746788] [DEBUG] [VALIDATOR ] ARES: Validating primary data. [2025-09-23T17:18:24.161099] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-23T17:18:24.212707] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-08. [2025-09-23T17:18:24.216744] [DEBUG] [VALIDATOR ] ARES: All expected trading days are present. [2025-09-23T17:18:24.218263] [DEBUG] [VALIDATOR ] ARES: Primary data validation passed. [2025-09-23T17:18:24.219276] [INFO ] [MAIN ] ARES: Fetched primary data is valid. [2025-09-23T17:18:24.219485] [DEBUG] [LOCAL ] ARES: Saving primary data. [2025-09-23T17:18:24.222022] [DEBUG] [LOCAL ] ARES: Trimmed 70585 records to 49614 (keeping 200 days of data) [2025-09-23T17:18:24.576363] [DEBUG] [LOCAL ] ARES: Primary data saved (49614 records). [2025-09-23T17:18:24.576594] [INFO ] [MAIN ] ARES: Full history saved. [2025-09-23T17:18:24.576736] [INFO ] [MAIN ] Update Progress: 143/2372 symbols completed. ARES took 33.0s. Estimated remaining: 4h 46m 7s. Rate: 7.8 symbols/min [2025-09-23T17:18:24.765875] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:18:24.766161] [DEBUG] [LOCAL ] ARMK: No existing data file found in primary storage. [2025-09-23T17:18:24.766236] [WARN ] [MAIN ] ARMK: No existing data found, performing full refresh instead. [2025-09-23T17:18:24.766534] [INFO ] [MAIN ] ARMK: Wiping existing primary data before full refresh. [2025-09-23T17:18:24.766615] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-09-23T17:18:24.766734] [DEBUG] [LOCAL ] ARMK: No primary data file found to delete. [2025-09-23T17:18:24.766815] [INFO ] [MAIN ] ARMK: Starting full primary refresh. [2025-09-23T17:18:25.026490] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-06. [2025-09-23T17:18:25.153417] [INFO ] [REMOTE ] ARMK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:18:25.308476] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-23T17:18:25.502017] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-23T17:18:25.802218] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-04. [2025-09-23T17:18:26.229527] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-23T17:18:26.602204] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2024-12. [2025-09-23T17:18:27.113982] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-23T17:18:27.402191] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-07. [2025-09-23T17:18:28.010872] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-23T17:18:28.202215] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-05. [2025-09-23T17:18:28.559797] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-23T17:18:29.002229] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-01. [2025-09-23T17:18:29.340516] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-23T17:18:29.802212] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-06. [2025-09-23T17:18:30.602238] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-09-23T17:18:30.798437] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-23T17:18:30.901584] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-23T17:18:31.402199] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-07. [2025-09-23T17:18:31.942131] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-23T17:18:31.949613] [INFO ] [REMOTE ] ARI: Full fetch complete (62724 records). [2025-09-23T17:18:31.949818] [DEBUG] [VALIDATOR ] ARI: Validating primary data. [2025-09-23T17:18:32.208029] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-02. [2025-09-23T17:18:32.405577] [DEBUG] [VALIDATOR ] ARI: All expected trading days are present. [2025-09-23T17:18:32.405696] [DEBUG] [VALIDATOR ] ARI: Primary data validation passed. [2025-09-23T17:18:32.406378] [INFO ] [MAIN ] ARI: Fetched primary data is valid. [2025-09-23T17:18:32.406427] [DEBUG] [LOCAL ] ARI: Saving primary data. [2025-09-23T17:18:32.407830] [DEBUG] [LOCAL ] ARI: Trimmed 62724 records to 43411 (keeping 200 days of data) [2025-09-23T17:18:32.670131] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-23T17:18:32.723375] [DEBUG] [LOCAL ] ARI: Primary data saved (43411 records). [2025-09-23T17:18:32.723521] [INFO ] [MAIN ] ARI: Full history saved. [2025-09-23T17:18:32.723608] [INFO ] [MAIN ] Update Progress: 144/2372 symbols completed. ARI took 39.7s. Estimated remaining: 4h 46m 6s. Rate: 7.8 symbols/min [2025-09-23T17:18:32.892562] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:18:32.938922] [DEBUG] [LOCAL ] AROC: Loaded 48989 existing records from primary storage. [2025-09-23T17:18:32.939103] [INFO ] [MAIN ] AROC: Loaded 48989 existing records. [2025-09-23T17:18:33.007286] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-08. [2025-09-23T17:18:33.116562] [WARN ] [MAIN ] AROC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:18:33.116817] [INFO ] [MAIN ] AROC: Wiping existing primary data before full refresh. [2025-09-23T17:18:33.116867] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-09-23T17:18:33.118932] [DEBUG] [LOCAL ] AROC: Deleted primary data file. [2025-09-23T17:18:33.118995] [INFO ] [MAIN ] AROC: Starting full primary refresh. [2025-09-23T17:18:33.491910] [INFO ] [REMOTE ] AROC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:18:33.549041] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-23T17:18:33.802225] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-03. [2025-09-23T17:18:34.221724] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-23T17:18:34.602200] [INFO ] [REMOTE ] AROC: Fetching primary data for 2024-12. [2025-09-23T17:18:35.402170] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-09-23T17:18:35.467368] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-23T17:18:35.998109] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-23T17:18:36.202200] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-01. [2025-09-23T17:18:37.002213] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-08. [2025-09-23T17:18:37.050359] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-23T17:18:37.058679] [INFO ] [REMOTE ] ARLO: Full fetch complete (62446 records). [2025-09-23T17:18:37.058851] [DEBUG] [VALIDATOR ] ARLO: Validating primary data. [2025-09-23T17:18:37.459178] [DEBUG] [VALIDATOR ] ARLO: All expected trading days are present. [2025-09-23T17:18:37.459373] [DEBUG] [VALIDATOR ] ARLO: Primary data validation passed. [2025-09-23T17:18:37.460088] [INFO ] [MAIN ] ARLO: Fetched primary data is valid. [2025-09-23T17:18:37.460229] [DEBUG] [LOCAL ] ARLO: Saving primary data. [2025-09-23T17:18:37.461616] [DEBUG] [LOCAL ] ARLO: Trimmed 62446 records to 43939 (keeping 200 days of data) [2025-09-23T17:18:37.573972] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-23T17:18:37.750899] [DEBUG] [LOCAL ] ARLO: Primary data saved (43939 records). [2025-09-23T17:18:37.751037] [INFO ] [MAIN ] ARLO: Full history saved. [2025-09-23T17:18:37.751120] [INFO ] [MAIN ] Update Progress: 145/2372 symbols completed. ARLO took 26.0s. Estimated remaining: 4h 45m 18s. Rate: 7.8 symbols/min [2025-09-23T17:18:37.813407] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-04. [2025-09-23T17:18:37.919994] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:18:37.972257] [DEBUG] [LOCAL ] ARR: Loaded 52064 existing records from primary storage. [2025-09-23T17:18:37.972399] [INFO ] [MAIN ] ARR: Loaded 52064 existing records. [2025-09-23T17:18:38.150019] [WARN ] [MAIN ] ARR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:18:38.150268] [INFO ] [MAIN ] ARR: Wiping existing primary data before full refresh. [2025-09-23T17:18:38.150329] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-09-23T17:18:38.152418] [DEBUG] [LOCAL ] ARR: Deleted primary data file. [2025-09-23T17:18:38.152478] [INFO ] [MAIN ] ARR: Starting full primary refresh. [2025-09-23T17:18:38.510516] [INFO ] [REMOTE ] ARR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:18:38.568073] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-23T17:18:38.602143] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-09. [2025-09-23T17:18:39.379371] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-23T17:18:39.402143] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-05. [2025-09-23T17:18:39.829949] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-23T17:18:39.837222] [INFO ] [REMOTE ] ARIS: Full fetch complete (59853 records). [2025-09-23T17:18:39.837337] [DEBUG] [VALIDATOR ] ARIS: Validating primary data. [2025-09-23T17:18:40.204890] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-02. [2025-09-23T17:18:40.241986] [DEBUG] [VALIDATOR ] ARIS: All expected trading days are present. [2025-09-23T17:18:40.242070] [DEBUG] [VALIDATOR ] ARIS: Primary data validation passed. [2025-09-23T17:18:40.242733] [INFO ] [MAIN ] ARIS: Fetched primary data is valid. [2025-09-23T17:18:40.242800] [DEBUG] [LOCAL ] ARIS: Saving primary data. [2025-09-23T17:18:40.244163] [DEBUG] [LOCAL ] ARIS: Trimmed 59853 records to 41981 (keeping 200 days of data) [2025-09-23T17:18:40.509611] [DEBUG] [LOCAL ] ARIS: Primary data saved (41981 records). [2025-09-23T17:18:40.509767] [INFO ] [MAIN ] ARIS: Full history saved. [2025-09-23T17:18:40.509855] [INFO ] [MAIN ] Update Progress: 146/2372 symbols completed. ARIS took 30.9s. Estimated remaining: 4h 43m 55s. Rate: 7.8 symbols/min [2025-09-23T17:18:40.678448] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:18:40.713575] [DEBUG] [LOCAL ] ARW: Loaded 33224 existing records from primary storage. [2025-09-23T17:18:40.713761] [INFO ] [MAIN ] ARW: Loaded 33224 existing records. [2025-09-23T17:18:40.894733] [WARN ] [MAIN ] ARW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:18:40.895129] [INFO ] [MAIN ] ARW: Wiping existing primary data before full refresh. [2025-09-23T17:18:40.895238] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-09-23T17:18:40.896208] [DEBUG] [LOCAL ] ARW: Deleted primary data file. [2025-09-23T17:18:40.896269] [INFO ] [MAIN ] ARW: Starting full primary refresh. [2025-09-23T17:18:41.005671] [INFO ] [REMOTE ] ARR: Fetching primary data for 2024-12. [2025-09-23T17:18:41.107609] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-23T17:18:41.300630] [INFO ] [REMOTE ] ARW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:18:41.517230] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-23T17:18:41.802201] [INFO ] [REMOTE ] ARW: Fetching primary data for 2024-12. [2025-09-23T17:18:42.602222] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-03. [2025-09-23T17:18:42.913828] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-23T17:18:43.133229] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-23T17:18:43.402222] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-01. [2025-09-23T17:18:43.939393] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-23T17:18:44.202223] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-04. [2025-09-23T17:18:44.713494] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-23T17:18:45.002199] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-06. [2025-09-23T17:18:45.802222] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-01. [2025-09-23T17:18:45.983488] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-23T17:18:46.304306] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-23T17:18:46.602225] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-02. [2025-09-23T17:18:46.706137] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-23T17:18:47.402188] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-02. [2025-09-23T17:18:48.035623] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-23T17:18:48.202163] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-05. [2025-09-23T17:18:48.680864] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-23T17:18:49.002208] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-03. [2025-09-23T17:18:49.801552] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-23T17:18:49.810742] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-07. [2025-09-23T17:18:50.602159] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-06. [2025-09-23T17:18:50.779590] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-23T17:18:51.402174] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-03. [2025-09-23T17:18:51.518781] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-23T17:18:51.978752] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-23T17:18:52.202290] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-04. [2025-09-23T17:18:52.516872] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-23T17:18:53.002197] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-04. [2025-09-23T17:18:53.802170] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-08. [2025-09-23T17:18:54.075995] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-23T17:18:54.187828] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-23T17:18:54.602249] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-05. [2025-09-23T17:18:54.973067] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-23T17:18:55.402200] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-05. [2025-09-23T17:18:55.517385] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-23T17:18:56.202249] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-06. [2025-09-23T17:18:57.002216] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-09-23T17:18:57.109813] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-23T17:18:57.203080] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-23T17:18:57.802275] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-06. [2025-09-23T17:18:58.602168] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-07. [2025-09-23T17:18:58.984957] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-23T17:18:58.993708] [INFO ] [REMOTE ] ARMK: Full fetch complete (72511 records). [2025-09-23T17:18:58.993861] [DEBUG] [VALIDATOR ] ARMK: Validating primary data. [2025-09-23T17:18:59.406035] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-07. [2025-09-23T17:18:59.407229] [DEBUG] [VALIDATOR ] ARMK: All expected trading days are present. [2025-09-23T17:18:59.407412] [DEBUG] [VALIDATOR ] ARMK: Primary data validation passed. [2025-09-23T17:18:59.408232] [INFO ] [MAIN ] ARMK: Fetched primary data is valid. [2025-09-23T17:18:59.408463] [DEBUG] [LOCAL ] ARMK: Saving primary data. [2025-09-23T17:18:59.438795] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-23T17:18:59.438931] [DEBUG] [LOCAL ] ARMK: Trimmed 72511 records to 50336 (keeping 200 days of data) [2025-09-23T17:18:59.707637] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-23T17:18:59.785364] [DEBUG] [LOCAL ] ARMK: Primary data saved (50336 records). [2025-09-23T17:18:59.785501] [INFO ] [MAIN ] ARMK: Full history saved. [2025-09-23T17:18:59.785598] [INFO ] [MAIN ] Update Progress: 147/2372 symbols completed. ARMK took 35.2s. Estimated remaining: 4h 46m 43s. Rate: 7.8 symbols/min [2025-09-23T17:18:59.972262] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:18:59.972495] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-09-23T17:18:59.972551] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-09-23T17:18:59.972734] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-09-23T17:18:59.972785] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-09-23T17:18:59.972835] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-09-23T17:18:59.972869] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-09-23T17:19:00.209797] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-07. [2025-09-23T17:19:00.344458] [INFO ] [REMOTE ] ARX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:19:00.750249] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-23T17:19:01.002217] [INFO ] [REMOTE ] ARX: Fetching primary data for 2024-12. [2025-09-23T17:19:01.219518] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:19:01.219900] [WARN ] [REMOTE ] ARX: No data returned for month 2024-12 [2025-09-23T17:19:01.802202] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-08. [2025-09-23T17:19:02.013396] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-23T17:19:02.602276] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-08. [2025-09-23T17:19:02.811677] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-23T17:19:03.402198] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-08. [2025-09-23T17:19:04.202330] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-09-23T17:19:04.822013] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-23T17:19:05.002246] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-01. [2025-09-23T17:19:05.203431] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-23T17:19:05.251329] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:19:05.251837] [WARN ] [REMOTE ] ARX: No data returned for month 2025-01 [2025-09-23T17:19:05.356974] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-23T17:19:05.364552] [INFO ] [REMOTE ] ARW: Full fetch complete (47894 records). [2025-09-23T17:19:05.364832] [DEBUG] [VALIDATOR ] ARW: Validating primary data. [2025-09-23T17:19:05.788964] [DEBUG] [VALIDATOR ] ARW: All expected trading days are present. [2025-09-23T17:19:05.789052] [DEBUG] [VALIDATOR ] ARW: Primary data validation passed. [2025-09-23T17:19:05.789670] [INFO ] [MAIN ] ARW: Fetched primary data is valid. [2025-09-23T17:19:05.789735] [DEBUG] [LOCAL ] ARW: Saving primary data. [2025-09-23T17:19:05.791995] [DEBUG] [LOCAL ] ARW: Trimmed 47894 records to 33212 (keeping 200 days of data) [2025-09-23T17:19:05.850570] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-02. [2025-09-23T17:19:06.024708] [DEBUG] [LOCAL ] ARW: Primary data saved (33212 records). [2025-09-23T17:19:06.024951] [INFO ] [MAIN ] ARW: Full history saved. [2025-09-23T17:19:06.025102] [INFO ] [MAIN ] Update Progress: 148/2372 symbols completed. ARW took 25.5s. Estimated remaining: 4h 46m 13s. Rate: 7.8 symbols/min [2025-09-23T17:19:06.106851] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:19:06.146701] [WARN ] [REMOTE ] ARX: No data returned for month 2025-02 [2025-09-23T17:19:06.228216] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:19:06.228529] [DEBUG] [LOCAL ] AS: No existing data file found in primary storage. [2025-09-23T17:19:06.228574] [WARN ] [MAIN ] AS: No existing data found, performing full refresh instead. [2025-09-23T17:19:06.228769] [INFO ] [MAIN ] AS: Wiping existing primary data before full refresh. [2025-09-23T17:19:06.228820] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-09-23T17:19:06.228863] [DEBUG] [LOCAL ] AS: No primary data file found to delete. [2025-09-23T17:19:06.228896] [INFO ] [MAIN ] AS: Starting full primary refresh. [2025-09-23T17:19:06.607554] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-03. [2025-09-23T17:19:06.613271] [INFO ] [REMOTE ] AS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:19:06.821358] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:19:06.821821] [WARN ] [REMOTE ] ARX: No data returned for month 2025-03 [2025-09-23T17:19:07.402197] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-04. [2025-09-23T17:19:07.632386] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:19:07.632754] [WARN ] [REMOTE ] ARX: No data returned for month 2025-04 [2025-09-23T17:19:08.202244] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-09. [2025-09-23T17:19:09.002227] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-05. [2025-09-23T17:19:09.207520] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:19:09.207892] [WARN ] [REMOTE ] ARX: No data returned for month 2025-05 [2025-09-23T17:19:09.802238] [INFO ] [REMOTE ] AS: Fetching primary data for 2024-12. [2025-09-23T17:19:09.834578] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-23T17:19:09.844202] [INFO ] [REMOTE ] ARR: Full fetch complete (75073 records). [2025-09-23T17:19:09.844390] [DEBUG] [VALIDATOR ] ARR: Validating primary data. [2025-09-23T17:19:10.242149] [DEBUG] [VALIDATOR ] ARR: All expected trading days are present. [2025-09-23T17:19:10.242253] [DEBUG] [VALIDATOR ] ARR: Primary data validation passed. [2025-09-23T17:19:10.243092] [INFO ] [MAIN ] ARR: Fetched primary data is valid. [2025-09-23T17:19:10.243162] [DEBUG] [LOCAL ] ARR: Saving primary data. [2025-09-23T17:19:10.244783] [DEBUG] [LOCAL ] ARR: Trimmed 75073 records to 52069 (keeping 200 days of data) [2025-09-23T17:19:10.575477] [DEBUG] [LOCAL ] ARR: Primary data saved (52069 records). [2025-09-23T17:19:10.575703] [INFO ] [MAIN ] ARR: Full history saved. [2025-09-23T17:19:10.575803] [INFO ] [MAIN ] Update Progress: 149/2372 symbols completed. ARR took 32.8s. Estimated remaining: 4h 45m 18s. Rate: 7.8 symbols/min [2025-09-23T17:19:10.607881] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-09-23T17:19:10.754961] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:19:10.773336] [DEBUG] [LOCAL ] ASA: Loaded 13639 existing records from primary storage. [2025-09-23T17:19:10.773529] [INFO ] [MAIN ] ASA: Loaded 13639 existing records. [2025-09-23T17:19:10.957398] [WARN ] [MAIN ] ASA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:19:10.957804] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-09-23T17:19:10.957881] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-09-23T17:19:10.958454] [DEBUG] [LOCAL ] ASA: Deleted primary data file. [2025-09-23T17:19:10.958533] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-09-23T17:19:11.332533] [INFO ] [REMOTE ] ASA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:19:11.407347] [INFO ] [REMOTE ] ASA: Fetching primary data for 2024-12. [2025-09-23T17:19:11.427722] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-23T17:19:11.954828] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-23T17:19:11.963775] [INFO ] [REMOTE ] AROC: Full fetch complete (70536 records). [2025-09-23T17:19:11.963924] [DEBUG] [VALIDATOR ] AROC: Validating primary data. [2025-09-23T17:19:12.208960] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-06. [2025-09-23T17:19:12.360908] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-23T17:19:12.403089] [DEBUG] [VALIDATOR ] AROC: All expected trading days are present. [2025-09-23T17:19:12.403203] [DEBUG] [VALIDATOR ] AROC: Primary data validation passed. [2025-09-23T17:19:12.404046] [INFO ] [MAIN ] AROC: Fetched primary data is valid. [2025-09-23T17:19:12.404115] [DEBUG] [LOCAL ] AROC: Saving primary data. [2025-09-23T17:19:12.405880] [DEBUG] [LOCAL ] AROC: Trimmed 70536 records to 48987 (keeping 200 days of data) [2025-09-23T17:19:12.652463] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:19:12.653554] [WARN ] [REMOTE ] ARX: No data returned for month 2025-06 [2025-09-23T17:19:12.711591] [DEBUG] [LOCAL ] AROC: Primary data saved (48987 records). [2025-09-23T17:19:12.711755] [INFO ] [MAIN ] AROC: Full history saved. [2025-09-23T17:19:12.711843] [INFO ] [MAIN ] Update Progress: 150/2372 symbols completed. AROC took 40.0s. Estimated remaining: 4h 43m 48s. Rate: 7.8 symbols/min [2025-09-23T17:19:12.879337] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:19:12.933359] [DEBUG] [LOCAL ] ASAN: Loaded 52755 existing records from primary storage. [2025-09-23T17:19:12.933502] [INFO ] [MAIN ] ASAN: Loaded 52755 existing records. [2025-09-23T17:19:13.007333] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-07. [2025-09-23T17:19:13.122577] [WARN ] [MAIN ] ASAN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:19:13.122852] [INFO ] [MAIN ] ASAN: Wiping existing primary data before full refresh. [2025-09-23T17:19:13.122906] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-09-23T17:19:13.125334] [DEBUG] [LOCAL ] ASAN: Deleted primary data file. [2025-09-23T17:19:13.125398] [INFO ] [MAIN ] ASAN: Starting full primary refresh. [2025-09-23T17:19:13.483054] [INFO ] [REMOTE ] ASAN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:19:13.802505] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-01. [2025-09-23T17:19:13.821545] [INFO ] [REMOTE ] ARX: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-23T17:19:14.333767] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-23T17:19:14.602214] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2024-12. [2025-09-23T17:19:15.402200] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-01. [2025-09-23T17:19:16.202235] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-08. [2025-09-23T17:19:16.323445] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-23T17:19:17.002216] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-09-23T17:19:17.164955] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-23T17:19:17.428696] [INFO ] [REMOTE ] ARX: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-23T17:19:17.526518] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-23T17:19:17.802206] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-09-23T17:19:18.317228] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-23T17:19:18.602242] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-09. [2025-09-23T17:19:19.402193] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-09-23T17:19:20.119613] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-23T17:19:20.202228] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-09-23T17:19:20.416093] [INFO ] [REMOTE ] ARX: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-23T17:19:20.423094] [INFO ] [REMOTE ] ARX: Full fetch complete (13435 records). [2025-09-23T17:19:20.423176] [DEBUG] [VALIDATOR ] ARX: Validating primary data. [2025-09-23T17:19:20.605147] [WARN ] [VALIDATOR ] ARX: Validation failed - insufficient historical data. Have 43 unique days, need 200 days [2025-09-23T17:19:20.605475] [FATAL] [MAIN ] ARX: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:19:20.605549] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:19:20.605622] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-09-23T17:19:20.605722] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-09-23T17:19:20.605769] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-09-23T17:19:20.605829] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-09-23T17:19:20.605910] [INFO ] [MAIN ] Update Progress: 151/2372 symbols completed. ARX took 20.8s. Estimated remaining: 4h 43m 44s. Rate: 7.8 symbols/min [2025-09-23T17:19:20.788439] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:19:20.839877] [DEBUG] [LOCAL ] ASB: Loaded 49584 existing records from primary storage. [2025-09-23T17:19:20.840018] [INFO ] [MAIN ] ASB: Loaded 49584 existing records. [2025-09-23T17:19:21.002987] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-01. [2025-09-23T17:19:21.025471] [WARN ] [MAIN ] ASB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:19:21.025777] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-09-23T17:19:21.025859] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-09-23T17:19:21.029130] [DEBUG] [LOCAL ] ASB: Deleted primary data file. [2025-09-23T17:19:21.029209] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-09-23T17:19:21.159831] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-23T17:19:21.418634] [INFO ] [REMOTE ] ASB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:19:21.802192] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-09-23T17:19:22.435837] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-23T17:19:22.602176] [INFO ] [REMOTE ] ASB: Fetching primary data for 2024-12. [2025-09-23T17:19:22.672395] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-23T17:19:23.402219] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-09-23T17:19:23.932817] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-23T17:19:23.954732] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-23T17:19:24.202219] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-02. [2025-09-23T17:19:25.002234] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-09-23T17:19:25.802182] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-02. [2025-09-23T17:19:25.887766] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-23T17:19:26.072494] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-23T17:19:26.602239] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-01. [2025-09-23T17:19:27.242452] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-23T17:19:27.402190] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-03. [2025-09-23T17:19:27.690460] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-23T17:19:28.202192] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-09-23T17:19:29.002265] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-09-23T17:19:29.070883] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-23T17:19:29.628488] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-23T17:19:29.808095] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-09-23T17:19:29.811631] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-23T17:19:29.816107] [INFO ] [REMOTE ] ASA: Full fetch complete (18479 records). [2025-09-23T17:19:29.816203] [DEBUG] [VALIDATOR ] ASA: Validating primary data. [2025-09-23T17:19:30.187625] [DEBUG] [VALIDATOR ] ASA: All expected trading days are present. [2025-09-23T17:19:30.187735] [DEBUG] [VALIDATOR ] ASA: Primary data validation passed. [2025-09-23T17:19:30.188024] [INFO ] [MAIN ] ASA: Fetched primary data is valid. [2025-09-23T17:19:30.188062] [DEBUG] [LOCAL ] ASA: Saving primary data. [2025-09-23T17:19:30.188632] [DEBUG] [LOCAL ] ASA: Trimmed 18479 records to 13773 (keeping 200 days of data) [2025-09-23T17:19:30.272028] [DEBUG] [LOCAL ] ASA: Primary data saved (13773 records). [2025-09-23T17:19:30.272170] [INFO ] [MAIN ] ASA: Full history saved. [2025-09-23T17:19:30.272264] [INFO ] [MAIN ] Update Progress: 152/2372 symbols completed. ASA took 19.7s. Estimated remaining: 4h 44m 5s. Rate: 7.8 symbols/min [2025-09-23T17:19:30.452595] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:19:30.459699] [DEBUG] [LOCAL ] ASBA: Loaded 3446 existing records from primary storage. [2025-09-23T17:19:30.459790] [INFO ] [MAIN ] ASBA: Loaded 3446 existing records. [2025-09-23T17:19:30.611407] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-03. [2025-09-23T17:19:30.643604] [WARN ] [MAIN ] ASBA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:19:30.643920] [INFO ] [MAIN ] ASBA: Wiping existing primary data before full refresh. [2025-09-23T17:19:30.643975] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-09-23T17:19:30.644268] [DEBUG] [LOCAL ] ASBA: Deleted primary data file. [2025-09-23T17:19:30.644327] [INFO ] [MAIN ] ASBA: Starting full primary refresh. [2025-09-23T17:19:31.010011] [INFO ] [REMOTE ] ASBA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:19:31.248144] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-23T17:19:31.402165] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2024-12. [2025-09-23T17:19:32.047437] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-23T17:19:32.098220] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-23T17:19:32.202144] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-04. [2025-09-23T17:19:33.002186] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-01. [2025-09-23T17:19:33.611852] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-23T17:19:33.612502] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-23T17:19:33.802209] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-02. [2025-09-23T17:19:34.604984] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-04. [2025-09-23T17:19:34.605311] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-23T17:19:35.402199] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-03. [2025-09-23T17:19:35.763190] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-23T17:19:36.202179] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-05. [2025-09-23T17:19:36.442084] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-23T17:19:37.002217] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-04. [2025-09-23T17:19:37.559315] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-23T17:19:37.802163] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-09-23T17:19:37.894427] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-23T17:19:38.602215] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-05. [2025-09-23T17:19:39.276026] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-23T17:19:39.402193] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-05. [2025-09-23T17:19:39.724668] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-23T17:19:40.202165] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-06. [2025-09-23T17:19:40.521975] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-23T17:19:40.538333] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-23T17:19:41.002202] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-06. [2025-09-23T17:19:41.802256] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-07. [2025-09-23T17:19:42.303523] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-23T17:19:42.455601] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-23T17:19:42.602219] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-06. [2025-09-23T17:19:43.402235] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-07. [2025-09-23T17:19:44.202200] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-08. [2025-09-23T17:19:44.702235] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-23T17:19:44.807847] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-23T17:19:44.836451] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-23T17:19:45.002202] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-09-23T17:19:45.518149] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-23T17:19:45.519299] [INFO ] [REMOTE ] ASBA: Full fetch complete (5290 records). [2025-09-23T17:19:45.519374] [DEBUG] [VALIDATOR ] ASBA: Validating primary data. [2025-09-23T17:19:45.807458] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-05. [2025-09-23T17:19:45.909030] [DEBUG] [VALIDATOR ] ASBA: All expected trading days are present. [2025-09-23T17:19:45.909133] [DEBUG] [VALIDATOR ] ASBA: Primary data validation passed. [2025-09-23T17:19:45.909325] [INFO ] [MAIN ] ASBA: Fetched primary data is valid. [2025-09-23T17:19:45.909441] [DEBUG] [LOCAL ] ASBA: Saving primary data. [2025-09-23T17:19:45.909960] [DEBUG] [LOCAL ] ASBA: Trimmed 5290 records to 3438 (keeping 200 days of data) [2025-09-23T17:19:45.933808] [DEBUG] [LOCAL ] ASBA: Primary data saved (3438 records). [2025-09-23T17:19:45.933887] [INFO ] [MAIN ] ASBA: Full history saved. [2025-09-23T17:19:45.934001] [INFO ] [MAIN ] Update Progress: 153/2372 symbols completed. ASBA took 15.7s. Estimated remaining: 4h 45m 53s. Rate: 7.8 symbols/min [2025-09-23T17:19:46.102494] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:19:46.151994] [DEBUG] [LOCAL ] ASC: Loaded 37878 existing records from primary storage. [2025-09-23T17:19:46.152167] [INFO ] [MAIN ] ASC: Loaded 37878 existing records. [2025-09-23T17:19:46.347875] [WARN ] [MAIN ] ASC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:19:46.348313] [INFO ] [MAIN ] ASC: Wiping existing primary data before full refresh. [2025-09-23T17:19:46.348408] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-09-23T17:19:46.349503] [DEBUG] [LOCAL ] ASC: Deleted primary data file. [2025-09-23T17:19:46.349595] [INFO ] [MAIN ] ASC: Starting full primary refresh. [2025-09-23T17:19:46.607432] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-08. [2025-09-23T17:19:46.717698] [INFO ] [REMOTE ] ASC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:19:47.092415] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-23T17:19:47.402199] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-06. [2025-09-23T17:19:48.202181] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-07. [2025-09-23T17:19:48.462449] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-23T17:19:48.633337] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-23T17:19:49.002187] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-07. [2025-09-23T17:19:49.768274] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-23T17:19:49.802151] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-08. [2025-09-23T17:19:50.226754] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-23T17:19:50.602230] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-08. [2025-09-23T17:19:51.387894] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-23T17:19:51.402156] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-09-23T17:19:52.202218] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-09-23T17:19:52.305587] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-23T17:19:52.983025] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-23T17:19:52.991789] [INFO ] [REMOTE ] ASAN: Full fetch complete (76560 records). [2025-09-23T17:19:52.991963] [DEBUG] [VALIDATOR ] ASAN: Validating primary data. [2025-09-23T17:19:53.007443] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-09-23T17:19:53.402804] [DEBUG] [VALIDATOR ] ASAN: All expected trading days are present. [2025-09-23T17:19:53.402894] [DEBUG] [VALIDATOR ] ASAN: Primary data validation passed. [2025-09-23T17:19:53.403890] [INFO ] [MAIN ] ASAN: Fetched primary data is valid. [2025-09-23T17:19:53.403957] [DEBUG] [LOCAL ] ASAN: Saving primary data. [2025-09-23T17:19:53.408617] [DEBUG] [LOCAL ] ASAN: Trimmed 76560 records to 52755 (keeping 200 days of data) [2025-09-23T17:19:53.732006] [DEBUG] [LOCAL ] ASAN: Primary data saved (52755 records). [2025-09-23T17:19:53.732235] [INFO ] [MAIN ] ASAN: Full history saved. [2025-09-23T17:19:53.732391] [INFO ] [MAIN ] Update Progress: 154/2372 symbols completed. ASAN took 41.0s. Estimated remaining: 4h 45m 46s. Rate: 7.8 symbols/min [2025-09-23T17:19:53.802963] [INFO ] [REMOTE ] ASC: Fetching primary data for 2024-12. [2025-09-23T17:19:53.908466] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:19:53.940010] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-23T17:19:53.950589] [INFO ] [REMOTE ] AS: Full fetch complete (76523 records). [2025-09-23T17:19:53.950797] [DEBUG] [VALIDATOR ] AS: Validating primary data. [2025-09-23T17:19:54.083969] [DEBUG] [LOCAL ] ASG: Loaded 20751 existing records from primary storage. [2025-09-23T17:19:54.094431] [INFO ] [MAIN ] ASG: Loaded 20751 existing records. [2025-09-23T17:19:54.472389] [WARN ] [MAIN ] ASG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:19:54.518009] [INFO ] [MAIN ] ASG: Wiping existing primary data before full refresh. [2025-09-23T17:19:54.518119] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-09-23T17:19:54.543549] [DEBUG] [LOCAL ] ASG: Deleted primary data file. [2025-09-23T17:19:54.549338] [INFO ] [MAIN ] ASG: Starting full primary refresh. [2025-09-23T17:19:54.587969] [DEBUG] [VALIDATOR ] AS: All expected trading days are present. [2025-09-23T17:19:54.610765] [DEBUG] [VALIDATOR ] AS: Primary data validation passed. [2025-09-23T17:19:54.628524] [INFO ] [MAIN ] AS: Fetched primary data is valid. [2025-09-23T17:19:54.672771] [DEBUG] [LOCAL ] AS: Saving primary data. [2025-09-23T17:19:54.728329] [DEBUG] [LOCAL ] AS: Trimmed 76523 records to 53077 (keeping 200 days of data) [2025-09-23T17:19:55.126046] [INFO ] [REMOTE ] ASG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:19:55.127580] [INFO ] [REMOTE ] ASG: Fetching primary data for 2024-12. [2025-09-23T17:19:55.158259] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-23T17:19:55.273434] [INFO ] [REMOTE ] ASB: Full fetch complete (71577 records). [2025-09-23T17:19:55.303628] [DEBUG] [VALIDATOR ] ASB: Validating primary data. [2025-09-23T17:19:55.463811] [DEBUG] [LOCAL ] AS: Primary data saved (53077 records). [2025-09-23T17:19:55.477154] [INFO ] [MAIN ] AS: Full history saved. [2025-09-23T17:19:55.477545] [INFO ] [MAIN ] Update Progress: 155/2372 symbols completed. AS took 49.5s. Estimated remaining: 4h 44m 13s. Rate: 7.8 symbols/min [2025-09-23T17:19:55.802952] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-23T17:19:55.885438] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-01. [2025-09-23T17:19:55.902253] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:19:56.050123] [DEBUG] [VALIDATOR ] ASB: All expected trading days are present. [2025-09-23T17:19:56.050229] [DEBUG] [VALIDATOR ] ASB: Primary data validation passed. [2025-09-23T17:19:56.050986] [INFO ] [MAIN ] ASB: Fetched primary data is valid. [2025-09-23T17:19:56.051112] [DEBUG] [LOCAL ] ASB: Saving primary data. [2025-09-23T17:19:56.052884] [DEBUG] [LOCAL ] ASB: Trimmed 71577 records to 49587 (keeping 200 days of data) [2025-09-23T17:19:56.060991] [DEBUG] [LOCAL ] ASGI: Loaded 22400 existing records from primary storage. [2025-09-23T17:19:56.061288] [INFO ] [MAIN ] ASGI: Loaded 22400 existing records. [2025-09-23T17:19:56.387336] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-23T17:19:56.412868] [WARN ] [MAIN ] ASGI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:19:56.478595] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-01. [2025-09-23T17:19:56.516441] [INFO ] [MAIN ] ASGI: Wiping existing primary data before full refresh. [2025-09-23T17:19:56.518008] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-09-23T17:19:56.520757] [DEBUG] [LOCAL ] ASGI: Deleted primary data file. [2025-09-23T17:19:56.521844] [INFO ] [MAIN ] ASGI: Starting full primary refresh. [2025-09-23T17:19:57.025484] [INFO ] [REMOTE ] ASGI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:19:57.028132] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2024-12. [2025-09-23T17:19:57.041047] [DEBUG] [LOCAL ] ASB: Primary data saved (49587 records). [2025-09-23T17:19:57.041316] [INFO ] [MAIN ] ASB: Full history saved. [2025-09-23T17:19:57.041457] [INFO ] [MAIN ] Update Progress: 156/2372 symbols completed. ASB took 36.4s. Estimated remaining: 4h 42m 38s. Rate: 7.8 symbols/min [2025-09-23T17:19:57.299478] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:19:57.325620] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-23T17:19:57.402539] [DEBUG] [LOCAL ] ASGN: Loaded 35998 existing records from primary storage. [2025-09-23T17:19:57.403216] [INFO ] [MAIN ] ASGN: Loaded 35998 existing records. [2025-09-23T17:19:57.537723] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-23T17:19:57.887937] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-02. [2025-09-23T17:19:57.900350] [WARN ] [MAIN ] ASGN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:19:57.902881] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-09-23T17:19:57.903061] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-09-23T17:19:57.904986] [DEBUG] [LOCAL ] ASGN: Deleted primary data file. [2025-09-23T17:19:57.905116] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-09-23T17:19:58.347237] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:19:58.366727] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-23T17:19:58.602260] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2024-12. [2025-09-23T17:19:58.952203] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-23T17:19:59.402253] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-03. [2025-09-23T17:19:59.799081] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-23T17:20:00.207290] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-02. [2025-09-23T17:20:00.221562] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-23T17:20:01.002275] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-04. [2025-09-23T17:20:01.516425] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-23T17:20:01.794169] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-23T17:20:01.802148] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-05. [2025-09-23T17:20:02.611002] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-01. [2025-09-23T17:20:02.618274] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-23T17:20:03.402201] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-01. [2025-09-23T17:20:03.852390] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-23T17:20:04.202228] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-06. [2025-09-23T17:20:04.520011] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-23T17:20:04.885253] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-23T17:20:05.002221] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-09-23T17:20:05.802209] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-03. [2025-09-23T17:20:06.095256] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-23T17:20:06.602276] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-07. [2025-09-23T17:20:06.979520] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-23T17:20:07.402244] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-02. [2025-09-23T17:20:07.979457] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-23T17:20:08.202219] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-09-23T17:20:08.573638] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-23T17:20:09.002189] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-08. [2025-09-23T17:20:09.754844] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-23T17:20:09.802153] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-09-23T17:20:10.014811] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-23T17:20:10.602242] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-04. [2025-09-23T17:20:11.032389] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-23T17:20:11.402213] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-09-23T17:20:11.723993] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-23T17:20:12.202196] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-03. [2025-09-23T17:20:12.560035] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-23T17:20:12.854737] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-23T17:20:13.002194] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-05. [2025-09-23T17:20:13.802227] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-09-23T17:20:14.211130] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-23T17:20:14.602224] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-04. [2025-09-23T17:20:15.345739] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-23T17:20:15.402155] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-05. [2025-09-23T17:20:15.412524] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-23T17:20:15.416300] [INFO ] [REMOTE ] ASG: Full fetch complete (31458 records). [2025-09-23T17:20:15.416381] [DEBUG] [VALIDATOR ] ASG: Validating primary data. [2025-09-23T17:20:15.801272] [DEBUG] [VALIDATOR ] ASG: All expected trading days are present. [2025-09-23T17:20:15.801369] [DEBUG] [VALIDATOR ] ASG: Primary data validation passed. [2025-09-23T17:20:15.801824] [INFO ] [MAIN ] ASG: Fetched primary data is valid. [2025-09-23T17:20:15.801889] [DEBUG] [LOCAL ] ASG: Saving primary data. [2025-09-23T17:20:15.803002] [DEBUG] [LOCAL ] ASG: Trimmed 31458 records to 20570 (keeping 200 days of data) [2025-09-23T17:20:15.922485] [DEBUG] [LOCAL ] ASG: Primary data saved (20570 records). [2025-09-23T17:20:15.922612] [INFO ] [MAIN ] ASG: Full history saved. [2025-09-23T17:20:15.922720] [INFO ] [MAIN ] Update Progress: 157/2372 symbols completed. ASG took 22.2s. Estimated remaining: 4h 45m 9s. Rate: 7.8 symbols/min [2025-09-23T17:20:16.202283] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-06. [2025-09-23T17:20:16.424051] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-23T17:20:17.002272] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-09-23T17:20:17.710008] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-23T17:20:17.802153] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-07. [2025-09-23T17:20:17.900298] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-23T17:20:18.602249] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-09-23T17:20:18.895410] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-23T17:20:19.402199] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-08. [2025-09-23T17:20:19.712743] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-23T17:20:20.202193] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-06. [2025-09-23T17:20:20.415194] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-23T17:20:21.002236] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-09-23T17:20:21.346586] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-23T17:20:21.802231] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-07. [2025-09-23T17:20:22.080859] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-23T17:20:22.087038] [INFO ] [REMOTE ] ASC: Full fetch complete (57214 records). [2025-09-23T17:20:22.087152] [DEBUG] [VALIDATOR ] ASC: Validating primary data. [2025-09-23T17:20:22.511204] [DEBUG] [VALIDATOR ] ASC: All expected trading days are present. [2025-09-23T17:20:22.511293] [DEBUG] [VALIDATOR ] ASC: Primary data validation passed. [2025-09-23T17:20:22.511903] [INFO ] [MAIN ] ASC: Fetched primary data is valid. [2025-09-23T17:20:22.511967] [DEBUG] [LOCAL ] ASC: Saving primary data. [2025-09-23T17:20:22.513199] [DEBUG] [LOCAL ] ASC: Trimmed 57214 records to 37756 (keeping 200 days of data) [2025-09-23T17:20:22.614197] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-09-23T17:20:22.639841] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-23T17:20:22.780597] [DEBUG] [LOCAL ] ASC: Primary data saved (37756 records). [2025-09-23T17:20:22.780776] [INFO ] [MAIN ] ASC: Full history saved. [2025-09-23T17:20:22.780871] [INFO ] [MAIN ] Update Progress: 158/2372 symbols completed. ASC took 36.8s. Estimated remaining: 4h 44m 49s. Rate: 7.8 symbols/min [2025-09-23T17:20:23.402206] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-08. [2025-09-23T17:20:24.133344] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-23T17:20:24.202178] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-09-23T17:20:24.354025] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-23T17:20:25.002266] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-09-23T17:20:25.268810] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-23T17:20:25.274752] [INFO ] [REMOTE ] ASGN: Full fetch complete (51316 records). [2025-09-23T17:20:25.274860] [DEBUG] [VALIDATOR ] ASGN: Validating primary data. [2025-09-23T17:20:25.276494] [FATAL] [VALIDATOR ] ASGN: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:20:25.276725] [FATAL] [MAIN ] ASGN: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:20:25.276798] [WARN ] [MAIN ] ASGN: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:20:25.276872] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-09-23T17:20:25.276945] [DEBUG] [LOCAL ] ASGN: No primary data file found to delete. [2025-09-23T17:20:25.276986] [INFO ] [LOCAL ] ASGN: Starting deletion of derivative data. [2025-09-23T17:20:25.277582] [DEBUG] [LOCAL ] ASGN: Deleted derivative data file. [2025-09-23T17:20:25.277736] [INFO ] [MAIN ] Update Progress: 159/2372 symbols completed. ASGN took 28.2s. Estimated remaining: 4h 43m 29s. Rate: 7.8 symbols/min [2025-09-23T17:20:25.774261] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-23T17:20:25.778761] [INFO ] [REMOTE ] ASGI: Full fetch complete (33412 records). [2025-09-23T17:20:25.778890] [DEBUG] [VALIDATOR ] ASGI: Validating primary data. [2025-09-23T17:20:26.164677] [DEBUG] [VALIDATOR ] ASGI: All expected trading days are present. [2025-09-23T17:20:26.164772] [DEBUG] [VALIDATOR ] ASGI: Primary data validation passed. [2025-09-23T17:20:26.165210] [INFO ] [MAIN ] ASGI: Fetched primary data is valid. [2025-09-23T17:20:26.165272] [DEBUG] [LOCAL ] ASGI: Saving primary data. [2025-09-23T17:20:26.166094] [DEBUG] [LOCAL ] ASGI: Trimmed 33412 records to 22412 (keeping 200 days of data) [2025-09-23T17:20:26.298404] [DEBUG] [LOCAL ] ASGI: Primary data saved (22412 records). [2025-09-23T17:20:26.298535] [INFO ] [MAIN ] ASGI: Full history saved. [2025-09-23T17:20:26.298620] [INFO ] [MAIN ] Update Progress: 160/2372 symbols completed. ASGI took 30.8s. Estimated remaining: 4h 41m 49s. Rate: 7.8 symbols/min [2025-09-23T17:20:26.989989] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:20:27.045451] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:20:27.045624] [DEBUG] [LOCAL ] ASR: No existing data file found in primary storage. [2025-09-23T17:20:26.990919] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:20:27.048609] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:20:27.049441] [WARN ] [MAIN ] ASR: No existing data found, performing full refresh instead. [2025-09-23T17:20:27.049584] [INFO ] [MAIN ] ASR: Wiping existing primary data before full refresh. [2025-09-23T17:20:27.049625] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-09-23T17:20:27.049704] [DEBUG] [LOCAL ] ASR: No primary data file found to delete. [2025-09-23T17:20:27.049747] [INFO ] [MAIN ] ASR: Starting full primary refresh. [2025-09-23T17:20:27.260528] [DEBUG] [LOCAL ] ASIX: Loaded 22422 existing records from primary storage. [2025-09-23T17:20:27.317695] [INFO ] [MAIN ] ASIX: Loaded 22422 existing records. [2025-09-23T17:20:27.432333] [DEBUG] [LOCAL ] ASH: Loaded 37815 existing records from primary storage. [2025-09-23T17:20:27.498999] [INFO ] [MAIN ] ASH: Loaded 37815 existing records. [2025-09-23T17:20:27.629119] [DEBUG] [LOCAL ] ASPN: Loaded 49599 existing records from primary storage. [2025-09-23T17:20:27.726401] [INFO ] [REMOTE ] ASR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:20:27.729902] [INFO ] [MAIN ] ASPN: Loaded 49599 existing records. [2025-09-23T17:20:27.756668] [INFO ] [REMOTE ] ASR: Fetching primary data for 2024-12. [2025-09-23T17:20:27.832241] [WARN ] [MAIN ] ASIX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:20:27.933866] [INFO ] [MAIN ] ASIX: Wiping existing primary data before full refresh. [2025-09-23T17:20:27.957223] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-09-23T17:20:27.982107] [WARN ] [MAIN ] ASH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:20:28.008591] [DEBUG] [LOCAL ] ASIX: Deleted primary data file. [2025-09-23T17:20:28.008736] [INFO ] [MAIN ] ASIX: Starting full primary refresh. [2025-09-23T17:20:28.053065] [INFO ] [MAIN ] ASH: Wiping existing primary data before full refresh. [2025-09-23T17:20:28.053218] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-09-23T17:20:28.119495] [DEBUG] [LOCAL ] ASH: Deleted primary data file. [2025-09-23T17:20:28.105516] [WARN ] [MAIN ] ASPN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:20:28.119775] [INFO ] [MAIN ] ASH: Starting full primary refresh. [2025-09-23T17:20:28.166323] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-09-23T17:20:28.187438] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-09-23T17:20:28.247760] [DEBUG] [LOCAL ] ASPN: Deleted primary data file. [2025-09-23T17:20:28.275521] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-09-23T17:20:28.718505] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-23T17:20:28.802452] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-01. [2025-09-23T17:20:29.049097] [INFO ] [REMOTE ] ASH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:20:29.084401] [INFO ] [REMOTE ] ASH: Fetching primary data for 2024-12. [2025-09-23T17:20:29.113535] [INFO ] [REMOTE ] ASIX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:20:29.117431] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2024-12. [2025-09-23T17:20:29.201959] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:20:29.202291] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2024-12. [2025-09-23T17:20:29.520246] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-23T17:20:29.802196] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-02. [2025-09-23T17:20:29.844582] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-23T17:20:30.364635] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-23T17:20:30.406448] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-23T17:20:30.602203] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-03. [2025-09-23T17:20:30.863789] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-23T17:20:31.070064] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-23T17:20:31.402217] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-01. [2025-09-23T17:20:32.202204] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-01. [2025-09-23T17:20:32.478731] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-23T17:20:32.885393] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-23T17:20:33.002182] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-02. [2025-09-23T17:20:33.802199] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-04. [2025-09-23T17:20:33.923108] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-23T17:20:34.373428] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-23T17:20:34.602255] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-05. [2025-09-23T17:20:35.212486] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-23T17:20:35.402210] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-06. [2025-09-23T17:20:36.192166] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-23T17:20:36.202136] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-07. [2025-09-23T17:20:36.830564] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-23T17:20:37.002197] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-01. [2025-09-23T17:20:37.802189] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-02. [2025-09-23T17:20:38.261528] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-23T17:20:38.602214] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-03. [2025-09-23T17:20:38.758032] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-23T17:20:39.402255] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-09-23T17:20:39.841599] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-23T17:20:40.202224] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-08. [2025-09-23T17:20:40.902664] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-23T17:20:41.002165] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-04. [2025-09-23T17:20:41.048369] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-23T17:20:41.802216] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-09-23T17:20:42.392507] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-23T17:20:42.395213] [INFO ] [REMOTE ] ASR: Full fetch complete (12307 records). [2025-09-23T17:20:42.395293] [DEBUG] [VALIDATOR ] ASR: Validating primary data. [2025-09-23T17:20:42.602446] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-03. [2025-09-23T17:20:42.644572] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-23T17:20:42.832131] [DEBUG] [VALIDATOR ] ASR: All expected trading days are present. [2025-09-23T17:20:42.832212] [DEBUG] [VALIDATOR ] ASR: Primary data validation passed. [2025-09-23T17:20:42.832485] [INFO ] [MAIN ] ASR: Fetched primary data is valid. [2025-09-23T17:20:42.832524] [DEBUG] [LOCAL ] ASR: Saving primary data. [2025-09-23T17:20:42.833239] [DEBUG] [LOCAL ] ASR: Trimmed 12307 records to 9238 (keeping 200 days of data) [2025-09-23T17:20:42.892026] [DEBUG] [LOCAL ] ASR: Primary data saved (9238 records). [2025-09-23T17:20:42.892202] [INFO ] [MAIN ] ASR: Full history saved. [2025-09-23T17:20:42.892284] [INFO ] [MAIN ] Update Progress: 161/2372 symbols completed. ASR took 16.6s. Estimated remaining: 4h 43m 44s. Rate: 7.8 symbols/min [2025-09-23T17:20:43.058852] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:20:43.114873] [DEBUG] [LOCAL ] ASX: Loaded 52907 existing records from primary storage. [2025-09-23T17:20:43.115048] [INFO ] [MAIN ] ASX: Loaded 52907 existing records. [2025-09-23T17:20:43.291227] [WARN ] [MAIN ] ASX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:20:43.291472] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-09-23T17:20:43.291520] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-09-23T17:20:43.294068] [DEBUG] [LOCAL ] ASX: Deleted primary data file. [2025-09-23T17:20:43.294133] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-09-23T17:20:43.407294] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-09-23T17:20:43.695093] [INFO ] [REMOTE ] ASX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:20:43.697269] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-23T17:20:44.202249] [INFO ] [REMOTE ] ASX: Fetching primary data for 2024-12. [2025-09-23T17:20:44.870956] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-23T17:20:45.002253] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-09-23T17:20:45.802208] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-04. [2025-09-23T17:20:46.069080] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-23T17:20:46.373561] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-23T17:20:46.602159] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-09-23T17:20:46.773208] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-23T17:20:47.402208] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-05. [2025-09-23T17:20:48.078014] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-23T17:20:48.202178] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-09-23T17:20:49.002166] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-01. [2025-09-23T17:20:49.028966] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-23T17:20:49.568179] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-23T17:20:49.802187] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-05. [2025-09-23T17:20:50.567290] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-23T17:20:50.604163] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-06. [2025-09-23T17:20:50.607366] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-23T17:20:51.402181] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-09-23T17:20:51.557899] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-23T17:20:52.202196] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-07. [2025-09-23T17:20:52.923975] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-23T17:20:53.002277] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-09-23T17:20:53.390613] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-23T17:20:53.802193] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-08. [2025-09-23T17:20:54.602272] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-09-23T17:20:54.892272] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-23T17:20:54.992235] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-23T17:20:55.402218] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-09. [2025-09-23T17:20:56.148092] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-23T17:20:56.202159] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-09-23T17:20:56.453815] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-23T17:20:56.457897] [INFO ] [REMOTE ] ASIX: Full fetch complete (29711 records). [2025-09-23T17:20:56.458011] [DEBUG] [VALIDATOR ] ASIX: Validating primary data. [2025-09-23T17:20:56.852574] [DEBUG] [VALIDATOR ] ASIX: All expected trading days are present. [2025-09-23T17:20:56.852679] [DEBUG] [VALIDATOR ] ASIX: Primary data validation passed. [2025-09-23T17:20:56.853102] [INFO ] [MAIN ] ASIX: Fetched primary data is valid. [2025-09-23T17:20:56.853145] [DEBUG] [LOCAL ] ASIX: Saving primary data. [2025-09-23T17:20:56.853972] [DEBUG] [LOCAL ] ASIX: Trimmed 29711 records to 22480 (keeping 200 days of data) [2025-09-23T17:20:57.001385] [DEBUG] [LOCAL ] ASIX: Primary data saved (22480 records). [2025-09-23T17:20:57.001555] [INFO ] [MAIN ] ASIX: Full history saved. [2025-09-23T17:20:57.001697] [INFO ] [MAIN ] Update Progress: 162/2372 symbols completed. ASIX took 30.7s. Estimated remaining: 4h 45m 4s. Rate: 7.8 symbols/min [2025-09-23T17:20:57.007260] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-09-23T17:20:57.197010] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:20:57.242495] [DEBUG] [LOCAL ] ATEN: Loaded 39993 existing records from primary storage. [2025-09-23T17:20:57.242689] [INFO ] [MAIN ] ATEN: Loaded 39993 existing records. [2025-09-23T17:20:57.453599] [WARN ] [MAIN ] ATEN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:20:57.453896] [INFO ] [MAIN ] ATEN: Wiping existing primary data before full refresh. [2025-09-23T17:20:57.453945] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-09-23T17:20:57.455846] [DEBUG] [LOCAL ] ATEN: Deleted primary data file. [2025-09-23T17:20:57.455912] [INFO ] [MAIN ] ATEN: Starting full primary refresh. [2025-09-23T17:20:57.810174] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-06. [2025-09-23T17:20:57.842838] [INFO ] [REMOTE ] ATEN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:20:57.878143] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-23T17:20:58.602223] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2024-12. [2025-09-23T17:20:58.690146] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-23T17:20:59.064144] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-23T17:20:59.402215] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-09-23T17:20:59.788978] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-23T17:21:00.202225] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-01. [2025-09-23T17:21:01.002192] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-07. [2025-09-23T17:21:01.100323] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-23T17:21:01.108274] [INFO ] [REMOTE ] ASPN: Full fetch complete (72353 records). [2025-09-23T17:21:01.108410] [DEBUG] [VALIDATOR ] ASPN: Validating primary data. [2025-09-23T17:21:01.549969] [DEBUG] [VALIDATOR ] ASPN: All expected trading days are present. [2025-09-23T17:21:01.550600] [DEBUG] [VALIDATOR ] ASPN: Primary data validation passed. [2025-09-23T17:21:01.551612] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-23T17:21:01.552477] [INFO ] [MAIN ] ASPN: Fetched primary data is valid. [2025-09-23T17:21:01.560346] [DEBUG] [LOCAL ] ASPN: Saving primary data. [2025-09-23T17:21:01.562550] [DEBUG] [LOCAL ] ASPN: Trimmed 72353 records to 49610 (keeping 200 days of data) [2025-09-23T17:21:01.817848] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-02. [2025-09-23T17:21:01.852457] [DEBUG] [LOCAL ] ASPN: Primary data saved (49610 records). [2025-09-23T17:21:01.852585] [INFO ] [MAIN ] ASPN: Full history saved. [2025-09-23T17:21:01.852690] [INFO ] [MAIN ] Update Progress: 163/2372 symbols completed. ASPN took 35.6s. Estimated remaining: 4h 44m 17s. Rate: 7.8 symbols/min [2025-09-23T17:21:02.031138] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:21:02.065468] [DEBUG] [LOCAL ] ATGE: Loaded 32042 existing records from primary storage. [2025-09-23T17:21:02.065632] [INFO ] [MAIN ] ATGE: Loaded 32042 existing records. [2025-09-23T17:21:02.266575] [WARN ] [MAIN ] ATGE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:21:02.266957] [INFO ] [MAIN ] ATGE: Wiping existing primary data before full refresh. [2025-09-23T17:21:02.267028] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-09-23T17:21:02.268977] [DEBUG] [LOCAL ] ATGE: Deleted primary data file. [2025-09-23T17:21:02.269065] [INFO ] [MAIN ] ATGE: Starting full primary refresh. [2025-09-23T17:21:02.607323] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-09-23T17:21:02.660407] [INFO ] [REMOTE ] ATGE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:21:03.167138] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-23T17:21:03.402220] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2024-12. [2025-09-23T17:21:04.202273] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-08. [2025-09-23T17:21:05.326769] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-02 (3.51 seconds). [2025-09-23T17:21:05.335578] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-03. [2025-09-23T17:21:05.600242] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-09-23T17:21:05.678374] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-23T17:21:05.802247] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-01. [2025-09-23T17:21:06.211223] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (3.60 seconds). [2025-09-23T17:21:06.526749] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-23T17:21:06.602200] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-09-23T17:21:06.708995] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-23T17:21:07.402252] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-09. [2025-09-23T17:21:07.740886] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-23T17:21:08.202195] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-02. [2025-09-23T17:21:08.563444] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-23T17:21:08.571418] [INFO ] [REMOTE ] ASH: Full fetch complete (54475 records). [2025-09-23T17:21:08.571580] [DEBUG] [VALIDATOR ] ASH: Validating primary data. [2025-09-23T17:21:09.014329] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-04. [2025-09-23T17:21:09.038584] [DEBUG] [VALIDATOR ] ASH: All expected trading days are present. [2025-09-23T17:21:09.038719] [DEBUG] [VALIDATOR ] ASH: Primary data validation passed. [2025-09-23T17:21:09.039359] [INFO ] [MAIN ] ASH: Fetched primary data is valid. [2025-09-23T17:21:09.039405] [DEBUG] [LOCAL ] ASH: Saving primary data. [2025-09-23T17:21:09.040980] [DEBUG] [LOCAL ] ASH: Trimmed 54475 records to 37789 (keeping 200 days of data) [2025-09-23T17:21:09.291666] [DEBUG] [LOCAL ] ASH: Primary data saved (37789 records). [2025-09-23T17:21:09.292019] [INFO ] [MAIN ] ASH: Full history saved. [2025-09-23T17:21:09.292134] [INFO ] [MAIN ] Update Progress: 164/2372 symbols completed. ASH took 43.0s. Estimated remaining: 4h 44m 6s. Rate: 7.8 symbols/min [2025-09-23T17:21:09.481463] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:21:09.515788] [DEBUG] [LOCAL ] ATHM: Loaded 32743 existing records from primary storage. [2025-09-23T17:21:09.524042] [INFO ] [MAIN ] ATHM: Loaded 32743 existing records. [2025-09-23T17:21:09.588591] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-23T17:21:09.757352] [WARN ] [MAIN ] ATHM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:21:09.757684] [INFO ] [MAIN ] ATHM: Wiping existing primary data before full refresh. [2025-09-23T17:21:09.757744] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-09-23T17:21:09.759279] [DEBUG] [LOCAL ] ATHM: Deleted primary data file. [2025-09-23T17:21:09.759344] [INFO ] [MAIN ] ATHM: Starting full primary refresh. [2025-09-23T17:21:09.807316] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-03. [2025-09-23T17:21:10.158276] [INFO ] [REMOTE ] ATHM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:21:10.303829] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-23T17:21:10.602214] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-05. [2025-09-23T17:21:10.808901] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-23T17:21:11.402205] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-04. [2025-09-23T17:21:12.078320] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-23T17:21:12.202211] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-09-23T17:21:13.002215] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-06. [2025-09-23T17:21:13.421614] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-23T17:21:13.802195] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-05. [2025-09-23T17:21:14.433024] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-23T17:21:14.602239] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2024-12. [2025-09-23T17:21:14.766626] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-23T17:21:14.969709] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-23T17:21:15.402196] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-06. [2025-09-23T17:21:15.926428] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-23T17:21:16.202353] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-01. [2025-09-23T17:21:16.612976] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-23T17:21:17.002204] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-09-23T17:21:17.309199] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-23T17:21:17.802233] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-07. [2025-09-23T17:21:18.489321] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-23T17:21:18.602169] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-07. [2025-09-23T17:21:18.642861] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-23T17:21:19.402219] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-02. [2025-09-23T17:21:20.075963] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-23T17:21:20.202258] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-08. [2025-09-23T17:21:20.610770] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-23T17:21:21.002269] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-08. [2025-09-23T17:21:21.426841] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-23T17:21:21.802451] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-09-23T17:21:22.308226] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-23T17:21:22.602174] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-09-23T17:21:22.909943] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-23T17:21:22.917168] [INFO ] [REMOTE ] ATEN: Full fetch complete (57524 records). [2025-09-23T17:21:22.917279] [DEBUG] [VALIDATOR ] ATEN: Validating primary data. [2025-09-23T17:21:23.297501] [DEBUG] [VALIDATOR ] ATEN: All expected trading days are present. [2025-09-23T17:21:23.297615] [DEBUG] [VALIDATOR ] ATEN: Primary data validation passed. [2025-09-23T17:21:23.298255] [INFO ] [MAIN ] ATEN: Fetched primary data is valid. [2025-09-23T17:21:23.298307] [DEBUG] [LOCAL ] ATEN: Saving primary data. [2025-09-23T17:21:23.301147] [DEBUG] [LOCAL ] ATEN: Trimmed 57524 records to 39963 (keeping 200 days of data) [2025-09-23T17:21:23.404812] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-03. [2025-09-23T17:21:23.543142] [DEBUG] [LOCAL ] ATEN: Primary data saved (39963 records). [2025-09-23T17:21:23.543268] [INFO ] [MAIN ] ATEN: Full history saved. [2025-09-23T17:21:23.543345] [INFO ] [MAIN ] Update Progress: 165/2372 symbols completed. ATEN took 26.5s. Estimated remaining: 4h 45m 25s. Rate: 7.7 symbols/min [2025-09-23T17:21:23.714511] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:21:23.727886] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-23T17:21:23.734211] [INFO ] [REMOTE ] ATGE: Full fetch complete (46217 records). [2025-09-23T17:21:23.734358] [DEBUG] [VALIDATOR ] ATGE: Validating primary data. [2025-09-23T17:21:23.835308] [DEBUG] [LOCAL ] ATHS: Loaded 7074 existing records from primary storage. [2025-09-23T17:21:23.846635] [INFO ] [MAIN ] ATHS: Loaded 7074 existing records. [2025-09-23T17:21:24.207113] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-09-23T17:21:24.206972] [WARN ] [MAIN ] ATHS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:21:24.219196] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-09-23T17:21:24.219314] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-09-23T17:21:24.225329] [DEBUG] [LOCAL ] ATHS: Deleted primary data file. [2025-09-23T17:21:24.225512] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-09-23T17:21:24.403120] [DEBUG] [VALIDATOR ] ATGE: All expected trading days are present. [2025-09-23T17:21:24.413633] [DEBUG] [VALIDATOR ] ATGE: Primary data validation passed. [2025-09-23T17:21:24.414191] [INFO ] [MAIN ] ATGE: Fetched primary data is valid. [2025-09-23T17:21:24.414266] [DEBUG] [LOCAL ] ATGE: Saving primary data. [2025-09-23T17:21:24.476480] [DEBUG] [LOCAL ] ATGE: Trimmed 46217 records to 32031 (keeping 200 days of data) [2025-09-23T17:21:24.772168] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:21:24.877126] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-23T17:21:24.903659] [DEBUG] [LOCAL ] ATGE: Primary data saved (32031 records). [2025-09-23T17:21:24.903771] [INFO ] [MAIN ] ATGE: Full history saved. [2025-09-23T17:21:24.903847] [INFO ] [MAIN ] Update Progress: 166/2372 symbols completed. ATGE took 23.1s. Estimated remaining: 4h 43m 52s. Rate: 7.8 symbols/min [2025-09-23T17:21:25.003529] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2024-12. [2025-09-23T17:21:25.074127] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:21:25.125468] [DEBUG] [LOCAL ] ATI: Loaded 51595 existing records from primary storage. [2025-09-23T17:21:25.125602] [INFO ] [MAIN ] ATI: Loaded 51595 existing records. [2025-09-23T17:21:25.301192] [WARN ] [MAIN ] ATI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:21:25.301436] [INFO ] [MAIN ] ATI: Wiping existing primary data before full refresh. [2025-09-23T17:21:25.301482] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-09-23T17:21:25.304093] [DEBUG] [LOCAL ] ATI: Deleted primary data file. [2025-09-23T17:21:25.304155] [INFO ] [MAIN ] ATI: Starting full primary refresh. [2025-09-23T17:21:25.691798] [INFO ] [REMOTE ] ATI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:21:25.697778] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-23T17:21:25.800009] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-23T17:21:25.808144] [INFO ] [REMOTE ] ATI: Fetching primary data for 2024-12. [2025-09-23T17:21:25.810167] [INFO ] [REMOTE ] ASX: Full fetch complete (76623 records). [2025-09-23T17:21:25.810257] [DEBUG] [VALIDATOR ] ASX: Validating primary data. [2025-09-23T17:21:26.208369] [DEBUG] [VALIDATOR ] ASX: All expected trading days are present. [2025-09-23T17:21:26.208449] [DEBUG] [VALIDATOR ] ASX: Primary data validation passed. [2025-09-23T17:21:26.209216] [INFO ] [MAIN ] ASX: Fetched primary data is valid. [2025-09-23T17:21:26.209280] [DEBUG] [LOCAL ] ASX: Saving primary data. [2025-09-23T17:21:26.210721] [DEBUG] [LOCAL ] ASX: Trimmed 76623 records to 52890 (keeping 200 days of data) [2025-09-23T17:21:26.536277] [DEBUG] [LOCAL ] ASX: Primary data saved (52890 records). [2025-09-23T17:21:26.536433] [INFO ] [MAIN ] ASX: Full history saved. [2025-09-23T17:21:26.536524] [INFO ] [MAIN ] Update Progress: 167/2372 symbols completed. ASX took 43.6s. Estimated remaining: 4h 42m 24s. Rate: 7.8 symbols/min [2025-09-23T17:21:26.608731] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-04. [2025-09-23T17:21:26.744744] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:21:26.784298] [DEBUG] [LOCAL ] ATKR: Loaded 35746 existing records from primary storage. [2025-09-23T17:21:26.784454] [INFO ] [MAIN ] ATKR: Loaded 35746 existing records. [2025-09-23T17:21:26.970823] [WARN ] [MAIN ] ATKR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:21:26.971060] [INFO ] [MAIN ] ATKR: Wiping existing primary data before full refresh. [2025-09-23T17:21:26.971109] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-09-23T17:21:26.972584] [DEBUG] [LOCAL ] ATKR: Deleted primary data file. [2025-09-23T17:21:26.972671] [INFO ] [MAIN ] ATKR: Starting full primary refresh. [2025-09-23T17:21:27.359809] [INFO ] [REMOTE ] ATKR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:21:27.407315] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-01. [2025-09-23T17:21:27.420720] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-23T17:21:27.952413] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-23T17:21:28.123980] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-23T17:21:28.202193] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-01. [2025-09-23T17:21:29.002195] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2024-12. [2025-09-23T17:21:29.315495] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-23T17:21:29.802405] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-02. [2025-09-23T17:21:30.315325] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-23T17:21:30.602198] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-09-23T17:21:31.087152] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-23T17:21:31.119940] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-23T17:21:31.402207] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-05. [2025-09-23T17:21:32.202211] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-01. [2025-09-23T17:21:32.781342] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-23T17:21:33.002200] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-06. [2025-09-23T17:21:33.406632] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-23T17:21:33.802189] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-02. [2025-09-23T17:21:34.017260] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-23T17:21:34.602217] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-07. [2025-09-23T17:21:35.024701] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-23T17:21:35.402175] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-03. [2025-09-23T17:21:35.437292] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-23T17:21:36.202192] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-09-23T17:21:36.688716] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-23T17:21:36.817700] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-23T17:21:37.002188] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-03. [2025-09-23T17:21:37.802293] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-09-23T17:21:38.544200] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-23T17:21:38.602175] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-09-23T17:21:38.807794] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-23T17:21:38.982934] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-23T17:21:39.402202] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-04. [2025-09-23T17:21:40.202265] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-09-23T17:21:40.772523] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-23T17:21:41.002172] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-08. [2025-09-23T17:21:41.270867] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-23T17:21:41.802279] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-05. [2025-09-23T17:21:42.375632] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-23T17:21:42.602222] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-09-23T17:21:43.239391] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-23T17:21:43.334837] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-23T17:21:43.402193] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-04. [2025-09-23T17:21:44.202207] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-06. [2025-09-23T17:21:44.870987] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-23T17:21:45.002227] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-05. [2025-09-23T17:21:45.626720] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-23T17:21:45.802211] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-07. [2025-09-23T17:21:45.934967] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-23T17:21:46.602254] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-09-23T17:21:47.134377] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-23T17:21:47.151269] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-23T17:21:47.402196] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-06. [2025-09-23T17:21:48.202206] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-09-23T17:21:48.245906] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-23T17:21:49.002255] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-09-23T17:21:49.359458] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-23T17:21:49.366143] [INFO ] [REMOTE ] ATHM: Full fetch complete (51972 records). [2025-09-23T17:21:49.366328] [DEBUG] [VALIDATOR ] ATHM: Validating primary data. [2025-09-23T17:21:49.805043] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-07. [2025-09-23T17:21:49.807712] [DEBUG] [VALIDATOR ] ATHM: All expected trading days are present. [2025-09-23T17:21:49.808078] [DEBUG] [VALIDATOR ] ATHM: Primary data validation passed. [2025-09-23T17:21:49.813477] [INFO ] [MAIN ] ATHM: Fetched primary data is valid. [2025-09-23T17:21:49.813714] [DEBUG] [LOCAL ] ATHM: Saving primary data. [2025-09-23T17:21:49.814811] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-23T17:21:49.817071] [INFO ] [REMOTE ] ATHS: Full fetch complete (10062 records). [2025-09-23T17:21:49.817237] [DEBUG] [VALIDATOR ] ATHS: Validating primary data. [2025-09-23T17:21:49.884373] [DEBUG] [LOCAL ] ATHM: Trimmed 51972 records to 32638 (keeping 200 days of data) [2025-09-23T17:21:50.381441] [DEBUG] [VALIDATOR ] ATHS: All expected trading days are present. [2025-09-23T17:21:50.398461] [DEBUG] [VALIDATOR ] ATHS: Primary data validation passed. [2025-09-23T17:21:50.399000] [INFO ] [MAIN ] ATHS: Fetched primary data is valid. [2025-09-23T17:21:50.399336] [DEBUG] [LOCAL ] ATHS: Saving primary data. [2025-09-23T17:21:50.407207] [DEBUG] [LOCAL ] ATHS: Trimmed 10062 records to 7107 (keeping 200 days of data) [2025-09-23T17:21:50.421575] [DEBUG] [LOCAL ] ATHM: Primary data saved (32638 records). [2025-09-23T17:21:50.421750] [INFO ] [MAIN ] ATHM: Full history saved. [2025-09-23T17:21:50.421907] [INFO ] [MAIN ] Update Progress: 168/2372 symbols completed. ATHM took 41.1s. Estimated remaining: 4h 45m 49s. Rate: 7.7 symbols/min [2025-09-23T17:21:50.577035] [DEBUG] [LOCAL ] ATHS: Primary data saved (7107 records). [2025-09-23T17:21:50.587912] [INFO ] [MAIN ] ATHS: Full history saved. [2025-09-23T17:21:50.603440] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-08. [2025-09-23T17:21:50.616729] [INFO ] [MAIN ] Update Progress: 169/2372 symbols completed. ATHS took 27.1s. Estimated remaining: 4h 44m 3s. Rate: 7.8 symbols/min [2025-09-23T17:21:50.693583] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:21:50.841192] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:21:50.872880] [DEBUG] [LOCAL ] ATMU: Loaded 39666 existing records from primary storage. [2025-09-23T17:21:50.873126] [INFO ] [MAIN ] ATMU: Loaded 39666 existing records. [2025-09-23T17:21:51.093153] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-23T17:21:51.098958] [WARN ] [MAIN ] ATMU: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:21:51.108291] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-09-23T17:21:51.121207] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-09-23T17:21:51.121957] [DEBUG] [LOCAL ] ATO: Loaded 42015 existing records from primary storage. [2025-09-23T17:21:51.122128] [INFO ] [MAIN ] ATO: Loaded 42015 existing records. [2025-09-23T17:21:51.134016] [DEBUG] [LOCAL ] ATMU: Deleted primary data file. [2025-09-23T17:21:51.157509] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-09-23T17:21:51.409940] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-08. [2025-09-23T17:21:51.511277] [WARN ] [MAIN ] ATO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:21:51.586964] [INFO ] [MAIN ] ATO: Wiping existing primary data before full refresh. [2025-09-23T17:21:51.605931] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-09-23T17:21:51.627588] [DEBUG] [LOCAL ] ATO: Deleted primary data file. [2025-09-23T17:21:51.630634] [INFO ] [MAIN ] ATO: Starting full primary refresh. [2025-09-23T17:21:51.829634] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:21:52.089349] [INFO ] [REMOTE ] ATO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:21:52.200878] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-23T17:21:52.214107] [INFO ] [REMOTE ] ATO: Fetching primary data for 2024-12. [2025-09-23T17:21:52.578794] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-23T17:21:53.002222] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-09. [2025-09-23T17:21:53.802157] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-09-23T17:21:53.967011] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-23T17:21:54.278291] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-23T17:21:54.289190] [INFO ] [REMOTE ] ATI: Full fetch complete (73809 records). [2025-09-23T17:21:54.289389] [DEBUG] [VALIDATOR ] ATI: Validating primary data. [2025-09-23T17:21:54.607368] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2024-12. [2025-09-23T17:21:54.717685] [DEBUG] [VALIDATOR ] ATI: All expected trading days are present. [2025-09-23T17:21:54.717804] [DEBUG] [VALIDATOR ] ATI: Primary data validation passed. [2025-09-23T17:21:54.718762] [INFO ] [MAIN ] ATI: Fetched primary data is valid. [2025-09-23T17:21:54.718882] [DEBUG] [LOCAL ] ATI: Saving primary data. [2025-09-23T17:21:54.720572] [DEBUG] [LOCAL ] ATI: Trimmed 73809 records to 51578 (keeping 200 days of data) [2025-09-23T17:21:54.983608] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-23T17:21:54.992833] [INFO ] [REMOTE ] ATKR: Full fetch complete (53617 records). [2025-09-23T17:21:54.994604] [DEBUG] [VALIDATOR ] ATKR: Validating primary data. [2025-09-23T17:21:55.402978] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-01. [2025-09-23T17:21:55.426103] [DEBUG] [VALIDATOR ] ATKR: All expected trading days are present. [2025-09-23T17:21:55.426683] [DEBUG] [VALIDATOR ] ATKR: Primary data validation passed. [2025-09-23T17:21:55.428078] [INFO ] [MAIN ] ATKR: Fetched primary data is valid. [2025-09-23T17:21:55.428611] [DEBUG] [LOCAL ] ATKR: Saving primary data. [2025-09-23T17:21:55.434446] [DEBUG] [LOCAL ] ATKR: Trimmed 53617 records to 35702 (keeping 200 days of data) [2025-09-23T17:21:55.734225] [DEBUG] [LOCAL ] ATKR: Primary data saved (35702 records). [2025-09-23T17:21:55.735466] [INFO ] [MAIN ] ATKR: Full history saved. [2025-09-23T17:21:55.735693] [INFO ] [MAIN ] Update Progress: 170/2372 symbols completed. ATKR took 29.2s. Estimated remaining: 4h 43m 21s. Rate: 7.8 symbols/min [2025-09-23T17:21:55.911542] [DEBUG] [LOCAL ] ATI: Primary data saved (51578 records). [2025-09-23T17:21:55.928811] [INFO ] [MAIN ] ATI: Full history saved. [2025-09-23T17:21:55.933592] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:21:55.934289] [INFO ] [MAIN ] Update Progress: 171/2372 symbols completed. ATI took 31.0s. Estimated remaining: 4h 41m 36s. Rate: 7.8 symbols/min [2025-09-23T17:21:56.158951] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:21:56.171028] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-23T17:21:56.181202] [DEBUG] [LOCAL ] ATR: Loaded 30532 existing records from primary storage. [2025-09-23T17:21:56.181394] [INFO ] [MAIN ] ATR: Loaded 30532 existing records. [2025-09-23T17:21:56.206179] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-01. [2025-09-23T17:21:56.325317] [DEBUG] [LOCAL ] ATS: Loaded 18112 existing records from primary storage. [2025-09-23T17:21:56.336216] [INFO ] [MAIN ] ATS: Loaded 18112 existing records. [2025-09-23T17:21:56.640035] [WARN ] [MAIN ] ATS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:21:56.646433] [INFO ] [MAIN ] ATS: Wiping existing primary data before full refresh. [2025-09-23T17:21:56.646554] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-09-23T17:21:56.646093] [WARN ] [MAIN ] ATR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:21:56.646897] [INFO ] [MAIN ] ATR: Wiping existing primary data before full refresh. [2025-09-23T17:21:56.646955] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-09-23T17:21:56.647926] [DEBUG] [LOCAL ] ATS: Deleted primary data file. [2025-09-23T17:21:56.648012] [INFO ] [MAIN ] ATS: Starting full primary refresh. [2025-09-23T17:21:56.653619] [DEBUG] [LOCAL ] ATR: Deleted primary data file. [2025-09-23T17:21:56.671947] [INFO ] [MAIN ] ATR: Starting full primary refresh. [2025-09-23T17:21:57.409451] [INFO ] [REMOTE ] ATS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:21:57.475761] [INFO ] [REMOTE ] ATS: Fetching primary data for 2024-12. [2025-09-23T17:21:57.484912] [INFO ] [REMOTE ] ATR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:21:57.481467] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-23T17:21:57.551806] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-23T17:21:57.802227] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-09-23T17:21:58.497957] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-23T17:21:58.602255] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-02. [2025-09-23T17:21:58.777036] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-23T17:21:59.402231] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-09-23T17:21:59.615192] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-23T17:22:00.202242] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-01. [2025-09-23T17:22:00.827442] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-23T17:22:00.851407] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-23T17:22:01.002258] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-02. [2025-09-23T17:22:01.707193] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-23T17:22:01.802267] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-09-23T17:22:02.602236] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-03. [2025-09-23T17:22:03.342895] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-23T17:22:03.402155] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-09-23T17:22:04.202235] [INFO ] [REMOTE ] ATR: Fetching primary data for 2024-12. [2025-09-23T17:22:04.310492] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-23T17:22:04.536404] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-23T17:22:05.002221] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-04. [2025-09-23T17:22:05.160810] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-23T17:22:05.802266] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-01. [2025-09-23T17:22:06.607541] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-03. [2025-09-23T17:22:06.630125] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-23T17:22:06.746731] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-23T17:22:07.196887] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-23T17:22:07.402195] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-04. [2025-09-23T17:22:08.132781] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-23T17:22:08.202170] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-05. [2025-09-23T17:22:09.002238] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-02. [2025-09-23T17:22:09.298003] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-23T17:22:09.802211] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-09-23T17:22:10.017688] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-23T17:22:10.602287] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-03. [2025-09-23T17:22:10.950056] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-23T17:22:11.402225] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-09-23T17:22:11.992546] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-23T17:22:12.202267] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-05. [2025-09-23T17:22:12.678528] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-23T17:22:13.002225] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-04. [2025-09-23T17:22:13.573675] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-23T17:22:13.802195] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-06. [2025-09-23T17:22:13.940139] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-23T17:22:14.460353] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-23T17:22:14.602214] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-05. [2025-09-23T17:22:15.402227] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-09-23T17:22:15.836379] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-23T17:22:16.202217] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-06. [2025-09-23T17:22:17.002216] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-06. [2025-09-23T17:22:17.103666] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-23T17:22:17.175512] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-23T17:22:17.802199] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-09-23T17:22:18.107477] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-23T17:22:18.602229] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-07. [2025-09-23T17:22:18.930225] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-23T17:22:18.937615] [INFO ] [REMOTE ] ATMU: Full fetch complete (56814 records). [2025-09-23T17:22:18.937775] [DEBUG] [VALIDATOR ] ATMU: Validating primary data. [2025-09-23T17:22:19.338832] [DEBUG] [VALIDATOR ] ATMU: All expected trading days are present. [2025-09-23T17:22:19.338933] [DEBUG] [VALIDATOR ] ATMU: Primary data validation passed. [2025-09-23T17:22:19.339771] [INFO ] [MAIN ] ATMU: Fetched primary data is valid. [2025-09-23T17:22:19.339834] [DEBUG] [LOCAL ] ATMU: Saving primary data. [2025-09-23T17:22:19.341630] [DEBUG] [LOCAL ] ATMU: Trimmed 56814 records to 39751 (keeping 200 days of data) [2025-09-23T17:22:19.409542] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-07. [2025-09-23T17:22:19.600512] [DEBUG] [LOCAL ] ATMU: Primary data saved (39751 records). [2025-09-23T17:22:19.600705] [INFO ] [MAIN ] ATMU: Full history saved. [2025-09-23T17:22:19.600810] [INFO ] [MAIN ] Update Progress: 172/2372 symbols completed. ATMU took 29.2s. Estimated remaining: 4h 44m 53s. Rate: 7.7 symbols/min [2025-09-23T17:22:19.809734] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:22:19.824608] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-23T17:22:19.878443] [DEBUG] [LOCAL ] ATUS: Loaded 49259 existing records from primary storage. [2025-09-23T17:22:19.878621] [INFO ] [MAIN ] ATUS: Loaded 49259 existing records. [2025-09-23T17:22:20.074380] [WARN ] [MAIN ] ATUS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:22:20.074738] [INFO ] [MAIN ] ATUS: Wiping existing primary data before full refresh. [2025-09-23T17:22:20.074795] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-09-23T17:22:20.076915] [DEBUG] [LOCAL ] ATUS: Deleted primary data file. [2025-09-23T17:22:20.076988] [INFO ] [MAIN ] ATUS: Starting full primary refresh. [2025-09-23T17:22:20.207358] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-07. [2025-09-23T17:22:20.480145] [INFO ] [REMOTE ] ATUS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:22:20.853690] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-23T17:22:21.002233] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2024-12. [2025-09-23T17:22:21.245857] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-23T17:22:21.802232] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-08. [2025-09-23T17:22:22.134155] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-23T17:22:22.424022] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-23T17:22:22.602191] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-08. [2025-09-23T17:22:23.402197] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-09-23T17:22:24.042872] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-23T17:22:24.046225] [INFO ] [REMOTE ] ATS: Full fetch complete (25779 records). [2025-09-23T17:22:24.046329] [DEBUG] [VALIDATOR ] ATS: Validating primary data. [2025-09-23T17:22:24.207063] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-01. [2025-09-23T17:22:24.451408] [DEBUG] [VALIDATOR ] ATS: All expected trading days are present. [2025-09-23T17:22:24.451507] [DEBUG] [VALIDATOR ] ATS: Primary data validation passed. [2025-09-23T17:22:24.460456] [INFO ] [MAIN ] ATS: Fetched primary data is valid. [2025-09-23T17:22:24.476690] [DEBUG] [LOCAL ] ATS: Saving primary data. [2025-09-23T17:22:24.479039] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-23T17:22:24.490901] [DEBUG] [LOCAL ] ATS: Trimmed 25779 records to 18001 (keeping 200 days of data) [2025-09-23T17:22:24.601052] [DEBUG] [LOCAL ] ATS: Primary data saved (18001 records). [2025-09-23T17:22:24.601217] [INFO ] [MAIN ] ATS: Full history saved. [2025-09-23T17:22:24.601307] [INFO ] [MAIN ] Update Progress: 173/2372 symbols completed. ATS took 28.7s. Estimated remaining: 4h 44m 10s. Rate: 7.7 symbols/min [2025-09-23T17:22:24.809298] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:22:24.871216] [DEBUG] [LOCAL ] AU: Loaded 52931 existing records from primary storage. [2025-09-23T17:22:24.871401] [INFO ] [MAIN ] AU: Loaded 52931 existing records. [2025-09-23T17:22:25.007357] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-08. [2025-09-23T17:22:25.071420] [WARN ] [MAIN ] AU: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:22:25.071721] [INFO ] [MAIN ] AU: Wiping existing primary data before full refresh. [2025-09-23T17:22:25.071779] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-09-23T17:22:25.074422] [DEBUG] [LOCAL ] AU: Deleted primary data file. [2025-09-23T17:22:25.074488] [INFO ] [MAIN ] AU: Starting full primary refresh. [2025-09-23T17:22:25.553012] [INFO ] [REMOTE ] AU: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:22:25.585123] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-23T17:22:25.802194] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-02. [2025-09-23T17:22:26.203223] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-23T17:22:26.602206] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-09-23T17:22:27.402252] [INFO ] [REMOTE ] AU: Fetching primary data for 2024-12. [2025-09-23T17:22:27.466318] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-23T17:22:27.831705] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-23T17:22:27.841565] [INFO ] [REMOTE ] ATO: Full fetch complete (60423 records). [2025-09-23T17:22:27.841736] [DEBUG] [VALIDATOR ] ATO: Validating primary data. [2025-09-23T17:22:28.208975] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-03. [2025-09-23T17:22:28.232639] [DEBUG] [VALIDATOR ] ATO: All expected trading days are present. [2025-09-23T17:22:28.232757] [DEBUG] [VALIDATOR ] ATO: Primary data validation passed. [2025-09-23T17:22:28.233395] [INFO ] [MAIN ] ATO: Fetched primary data is valid. [2025-09-23T17:22:28.233436] [DEBUG] [LOCAL ] ATO: Saving primary data. [2025-09-23T17:22:28.234746] [DEBUG] [LOCAL ] ATO: Trimmed 60423 records to 41969 (keeping 200 days of data) [2025-09-23T17:22:28.522704] [DEBUG] [LOCAL ] ATO: Primary data saved (41969 records). [2025-09-23T17:22:28.522856] [INFO ] [MAIN ] ATO: Full history saved. [2025-09-23T17:22:28.523974] [INFO ] [MAIN ] Update Progress: 174/2372 symbols completed. ATO took 37.9s. Estimated remaining: 4h 43m 14s. Rate: 7.8 symbols/min [2025-09-23T17:22:28.702059] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:22:28.764956] [DEBUG] [LOCAL ] AUB: Loaded 46477 existing records from primary storage. [2025-09-23T17:22:28.765195] [INFO ] [MAIN ] AUB: Loaded 46477 existing records. [2025-09-23T17:22:28.977822] [WARN ] [MAIN ] AUB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:22:28.978257] [INFO ] [MAIN ] AUB: Wiping existing primary data before full refresh. [2025-09-23T17:22:28.978334] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-09-23T17:22:28.980953] [DEBUG] [LOCAL ] AUB: Deleted primary data file. [2025-09-23T17:22:28.981054] [INFO ] [MAIN ] AUB: Starting full primary refresh. [2025-09-23T17:22:29.013212] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-09-23T17:22:29.322026] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-23T17:22:29.418458] [INFO ] [REMOTE ] AUB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:22:29.492073] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-23T17:22:29.802204] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-01. [2025-09-23T17:22:30.100945] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-23T17:22:30.107273] [INFO ] [REMOTE ] ATR: Full fetch complete (43364 records). [2025-09-23T17:22:30.107454] [DEBUG] [VALIDATOR ] ATR: Validating primary data. [2025-09-23T17:22:30.516110] [DEBUG] [VALIDATOR ] ATR: All expected trading days are present. [2025-09-23T17:22:30.516227] [DEBUG] [VALIDATOR ] ATR: Primary data validation passed. [2025-09-23T17:22:30.516777] [INFO ] [MAIN ] ATR: Fetched primary data is valid. [2025-09-23T17:22:30.516841] [DEBUG] [LOCAL ] ATR: Saving primary data. [2025-09-23T17:22:30.518192] [DEBUG] [LOCAL ] ATR: Trimmed 43364 records to 30488 (keeping 200 days of data) [2025-09-23T17:22:30.613343] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-04. [2025-09-23T17:22:30.722174] [DEBUG] [LOCAL ] ATR: Primary data saved (30488 records). [2025-09-23T17:22:30.722320] [INFO ] [MAIN ] ATR: Full history saved. [2025-09-23T17:22:30.722411] [INFO ] [MAIN ] Update Progress: 175/2372 symbols completed. ATR took 35.0s. Estimated remaining: 4h 41m 57s. Rate: 7.8 symbols/min [2025-09-23T17:22:30.895942] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:22:30.903015] [DEBUG] [LOCAL ] AUNA: Loaded 4683 existing records from primary storage. [2025-09-23T17:22:30.903132] [INFO ] [MAIN ] AUNA: Loaded 4683 existing records. [2025-09-23T17:22:31.084147] [WARN ] [MAIN ] AUNA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:22:31.084432] [INFO ] [MAIN ] AUNA: Wiping existing primary data before full refresh. [2025-09-23T17:22:31.084481] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-09-23T17:22:31.084816] [DEBUG] [LOCAL ] AUNA: Deleted primary data file. [2025-09-23T17:22:31.084876] [INFO ] [MAIN ] AUNA: Starting full primary refresh. [2025-09-23T17:22:31.416223] [INFO ] [REMOTE ] AUB: Fetching primary data for 2024-12. [2025-09-23T17:22:31.462870] [INFO ] [REMOTE ] AUNA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:22:31.994370] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-09-23T17:22:32.136708] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-23T17:22:32.202208] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-02. [2025-09-23T17:22:32.836036] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-23T17:22:33.002233] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-01. [2025-09-23T17:22:33.802192] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-05. [2025-09-23T17:22:33.836371] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-23T17:22:34.110227] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-23T17:22:34.602243] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-03. [2025-09-23T17:22:35.062540] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-23T17:22:35.402210] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2024-12. [2025-09-23T17:22:35.859416] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-23T17:22:36.177758] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-23T17:22:36.202151] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-04. [2025-09-23T17:22:37.002251] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-06. [2025-09-23T17:22:37.802153] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-02. [2025-09-23T17:22:37.860958] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-23T17:22:38.186702] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-23T17:22:38.602246] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-07. [2025-09-23T17:22:38.978776] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-23T17:22:39.402213] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-03. [2025-09-23T17:22:40.011144] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-23T17:22:40.202236] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-01. [2025-09-23T17:22:40.993259] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-23T17:22:41.003540] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-23T17:22:41.003354] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-05. [2025-09-23T17:22:41.802212] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-04. [2025-09-23T17:22:42.602310] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-02. [2025-09-23T17:22:42.844674] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-23T17:22:43.038708] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-23T17:22:43.327368] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-23T17:22:43.402154] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-06. [2025-09-23T17:22:44.202233] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-03. [2025-09-23T17:22:44.590023] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-23T17:22:45.002154] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-05. [2025-09-23T17:22:45.042795] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-23T17:22:45.802215] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-04. [2025-09-23T17:22:46.171829] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-23T17:22:46.330409] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-23T17:22:46.602204] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-06. [2025-09-23T17:22:47.402200] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-07. [2025-09-23T17:22:47.865958] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-23T17:22:48.202214] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-07. [2025-09-23T17:22:49.002212] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-05. [2025-09-23T17:22:49.294926] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-23T17:22:49.459382] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-23T17:22:49.458257] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-23T17:22:49.802215] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-08. [2025-09-23T17:22:50.602209] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-08. [2025-09-23T17:22:51.140177] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-23T17:22:51.402220] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-06. [2025-09-23T17:22:52.202184] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-08. [2025-09-23T17:22:52.372218] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-23T17:22:53.002202] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-09. [2025-09-23T17:22:53.802268] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-09. [2025-09-23T17:23:05.161097] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-06 (13.76 seconds). [2025-09-23T17:23:05.163588] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-07. [2025-09-23T17:23:05.367405] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-09 (11.57 seconds). [2025-09-23T17:23:05.375235] [INFO ] [REMOTE ] AUB: Full fetch complete (65381 records). [2025-09-23T17:23:05.375400] [DEBUG] [VALIDATOR ] AUB: Validating primary data. [2025-09-23T17:23:05.802056] [DEBUG] [VALIDATOR ] AUB: All expected trading days are present. [2025-09-23T17:23:05.802492] [DEBUG] [VALIDATOR ] AUB: Primary data validation passed. [2025-09-23T17:23:05.807826] [INFO ] [MAIN ] AUB: Fetched primary data is valid. [2025-09-23T17:23:05.808938] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-23T17:23:05.809230] [DEBUG] [LOCAL ] AUB: Saving primary data. [2025-09-23T17:23:05.819729] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-08. [2025-09-23T17:23:05.837160] [DEBUG] [LOCAL ] AUB: Trimmed 65381 records to 46455 (keeping 200 days of data) [2025-09-23T17:23:05.836924] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-09 (12.83 seconds). [2025-09-23T17:23:05.847484] [INFO ] [REMOTE ] ATUS: Full fetch complete (70607 records). [2025-09-23T17:23:05.934417] [DEBUG] [VALIDATOR ] ATUS: Validating primary data. [2025-09-23T17:23:05.982107] [FATAL] [VALIDATOR ] ATUS: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:23:05.986378] [FATAL] [MAIN ] ATUS: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:23:05.986546] [WARN ] [MAIN ] ATUS: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:23:05.985224] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-08 (13.78 seconds). [2025-09-23T17:23:05.987590] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-09-23T17:23:06.001020] [DEBUG] [LOCAL ] ATUS: No primary data file found to delete. [2025-09-23T17:23:06.003806] [INFO ] [LOCAL ] ATUS: Starting deletion of derivative data. [2025-09-23T17:23:06.006537] [DEBUG] [LOCAL ] ATUS: Deleted derivative data file. [2025-09-23T17:23:06.006474] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-09-23T17:23:06.007127] [INFO ] [MAIN ] Update Progress: 176/2372 symbols completed. ATUS took 46.4s. Estimated remaining: 4h 47m 33s. Rate: 7.6 symbols/min [2025-09-23T17:23:06.222017] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:23:06.275202] [DEBUG] [LOCAL ] AVA: Loaded 39610 existing records from primary storage. [2025-09-23T17:23:06.278054] [INFO ] [MAIN ] AVA: Loaded 39610 existing records. [2025-09-23T17:23:06.612219] [WARN ] [MAIN ] AVA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:23:06.613716] [INFO ] [MAIN ] AVA: Wiping existing primary data before full refresh. [2025-09-23T17:23:06.614067] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-09-23T17:23:06.616009] [DEBUG] [LOCAL ] AVA: Deleted primary data file. [2025-09-23T17:23:06.616341] [INFO ] [MAIN ] AVA: Starting full primary refresh. [2025-09-23T17:23:07.039059] [INFO ] [REMOTE ] AVA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:23:07.040446] [INFO ] [REMOTE ] AVA: Fetching primary data for 2024-12. [2025-09-23T17:23:07.048082] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-23T17:23:07.051694] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-09-23T17:23:07.118352] [DEBUG] [LOCAL ] AUB: Primary data saved (46455 records). [2025-09-23T17:23:07.118525] [INFO ] [MAIN ] AUB: Full history saved. [2025-09-23T17:23:07.118623] [INFO ] [MAIN ] Update Progress: 177/2372 symbols completed. AUB took 38.6s. Estimated remaining: 4h 46m 2s. Rate: 7.7 symbols/min [2025-09-23T17:23:07.301478] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:23:07.313310] [DEBUG] [LOCAL ] AVAL: Loaded 9095 existing records from primary storage. [2025-09-23T17:23:07.313448] [INFO ] [MAIN ] AVAL: Loaded 9095 existing records. [2025-09-23T17:23:07.502349] [WARN ] [MAIN ] AVAL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:23:07.502611] [INFO ] [MAIN ] AVAL: Wiping existing primary data before full refresh. [2025-09-23T17:23:07.502692] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-09-23T17:23:07.503240] [DEBUG] [LOCAL ] AVAL: Deleted primary data file. [2025-09-23T17:23:07.503302] [INFO ] [MAIN ] AVAL: Starting full primary refresh. [2025-09-23T17:23:07.619082] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-23T17:23:07.641494] [INFO ] [REMOTE ] AUNA: Full fetch complete (7462 records). [2025-09-23T17:23:07.646733] [DEBUG] [VALIDATOR ] AUNA: Validating primary data. [2025-09-23T17:23:08.208780] [INFO ] [REMOTE ] AVAL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:23:08.242570] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2024-12. [2025-09-23T17:23:08.337241] [DEBUG] [VALIDATOR ] AUNA: All expected trading days are present. [2025-09-23T17:23:08.337553] [DEBUG] [VALIDATOR ] AUNA: Primary data validation passed. [2025-09-23T17:23:08.338089] [INFO ] [MAIN ] AUNA: Fetched primary data is valid. [2025-09-23T17:23:08.338309] [DEBUG] [LOCAL ] AUNA: Saving primary data. [2025-09-23T17:23:08.389979] [DEBUG] [LOCAL ] AUNA: Trimmed 7462 records to 4746 (keeping 200 days of data) [2025-09-23T17:23:08.394466] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-09-23T17:23:08.407184] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-23T17:23:08.441716] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-01. [2025-09-23T17:23:08.443406] [DEBUG] [LOCAL ] AUNA: Primary data saved (4746 records). [2025-09-23T17:23:08.445049] [INFO ] [MAIN ] AUNA: Full history saved. [2025-09-23T17:23:08.445394] [INFO ] [MAIN ] Update Progress: 178/2372 symbols completed. AUNA took 37.7s. Estimated remaining: 4h 44m 34s. Rate: 7.7 symbols/min [2025-09-23T17:23:08.445811] [INFO ] [REMOTE ] AU: Full fetch complete (76262 records). [2025-09-23T17:23:08.458748] [DEBUG] [VALIDATOR ] AU: Validating primary data. [2025-09-23T17:23:08.811280] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:23:09.000579] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-23T17:23:09.020785] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-01. [2025-09-23T17:23:09.093556] [DEBUG] [VALIDATOR ] AU: All expected trading days are present. [2025-09-23T17:23:09.104588] [DEBUG] [VALIDATOR ] AU: Primary data validation passed. [2025-09-23T17:23:09.106836] [INFO ] [MAIN ] AU: Fetched primary data is valid. [2025-09-23T17:23:09.106962] [DEBUG] [LOCAL ] AU: Saving primary data. [2025-09-23T17:23:09.107950] [DEBUG] [LOCAL ] AVB: Loaded 41705 existing records from primary storage. [2025-09-23T17:23:09.108441] [INFO ] [MAIN ] AVB: Loaded 41705 existing records. [2025-09-23T17:23:09.203700] [DEBUG] [LOCAL ] AU: Trimmed 76262 records to 52932 (keeping 200 days of data) [2025-09-23T17:23:09.390613] [WARN ] [MAIN ] AVB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:23:09.393010] [INFO ] [MAIN ] AVB: Wiping existing primary data before full refresh. [2025-09-23T17:23:09.393386] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-09-23T17:23:09.396889] [DEBUG] [LOCAL ] AVB: Deleted primary data file. [2025-09-23T17:23:09.397577] [INFO ] [MAIN ] AVB: Starting full primary refresh. [2025-09-23T17:23:09.735347] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-23T17:23:09.794515] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-02. [2025-09-23T17:23:09.815536] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-23T17:23:09.847484] [INFO ] [REMOTE ] AVB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:23:09.848632] [INFO ] [REMOTE ] AVB: Fetching primary data for 2024-12. [2025-09-23T17:23:09.848311] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-02. [2025-09-23T17:23:10.088395] [DEBUG] [LOCAL ] AU: Primary data saved (52932 records). [2025-09-23T17:23:10.088572] [INFO ] [MAIN ] AU: Full history saved. [2025-09-23T17:23:10.088723] [INFO ] [MAIN ] Update Progress: 179/2372 symbols completed. AU took 45.5s. Estimated remaining: 4h 43m 11s. Rate: 7.7 symbols/min [2025-09-23T17:23:10.281686] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:23:10.281931] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-09-23T17:23:10.281987] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-09-23T17:23:10.282142] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-09-23T17:23:10.282185] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-09-23T17:23:10.282230] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-09-23T17:23:10.282301] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-09-23T17:23:10.490405] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-23T17:23:10.533153] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-03. [2025-09-23T17:23:10.688521] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:23:10.688909] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2024-12. [2025-09-23T17:23:10.896489] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:23:10.897435] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-23T17:23:10.898087] [WARN ] [REMOTE ] AVBC: No data returned for month 2024-12 [2025-09-23T17:23:10.906525] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-01. [2025-09-23T17:23:10.907030] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-03. [2025-09-23T17:23:11.152697] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:23:11.153226] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-01 [2025-09-23T17:23:11.153721] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-02. [2025-09-23T17:23:11.167304] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-23T17:23:11.171341] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-04. [2025-09-23T17:23:11.226722] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-23T17:23:11.235024] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-01. [2025-09-23T17:23:11.363352] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:23:11.363706] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-02 [2025-09-23T17:23:11.364157] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-03. [2025-09-23T17:23:11.751120] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:23:11.751470] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-03 [2025-09-23T17:23:11.751966] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-04. [2025-09-23T17:23:11.979912] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:23:11.980220] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-04 [2025-09-23T17:23:11.980696] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-05. [2025-09-23T17:23:12.014797] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-23T17:23:12.019702] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-05. [2025-09-23T17:23:12.211484] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:23:12.212383] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-05 [2025-09-23T17:23:12.213260] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-06. [2025-09-23T17:23:12.241803] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-23T17:23:12.484727] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:23:12.484212] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-23T17:23:12.492449] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-06 [2025-09-23T17:23:12.794455] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-23T17:23:13.002279] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-02. [2025-09-23T17:23:13.802347] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-07. [2025-09-23T17:23:14.008141] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:23:14.008455] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-07 [2025-09-23T17:23:14.163252] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-23T17:23:14.602202] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-08. [2025-09-23T17:23:15.402189] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-03. [2025-09-23T17:23:15.813182] [INFO ] [REMOTE ] AVBC: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-23T17:23:16.202191] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-09. [2025-09-23T17:23:16.686054] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-23T17:23:17.002212] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-06. [2025-09-23T17:23:17.097407] [INFO ] [REMOTE ] AVBC: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-23T17:23:17.099987] [INFO ] [REMOTE ] AVBC: Full fetch complete (4498 records). [2025-09-23T17:23:17.100058] [DEBUG] [VALIDATOR ] AVBC: Validating primary data. [2025-09-23T17:23:17.281765] [WARN ] [VALIDATOR ] AVBC: Validation failed - insufficient historical data. Have 37 unique days, need 200 days [2025-09-23T17:23:17.281987] [FATAL] [MAIN ] AVBC: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:23:17.282056] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:23:17.282106] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-09-23T17:23:17.282163] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-09-23T17:23:17.282197] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-09-23T17:23:17.282264] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-09-23T17:23:17.282343] [INFO ] [MAIN ] Update Progress: 180/2372 symbols completed. AVBC took 7.2s. Estimated remaining: 4h 42m 57s. Rate: 7.7 symbols/min [2025-09-23T17:23:17.458798] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:23:17.466780] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-23T17:23:17.489304] [DEBUG] [LOCAL ] AVD: Loaded 23038 existing records from primary storage. [2025-09-23T17:23:17.489446] [INFO ] [MAIN ] AVD: Loaded 23038 existing records. [2025-09-23T17:23:17.666513] [WARN ] [MAIN ] AVD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:23:17.666802] [INFO ] [MAIN ] AVD: Wiping existing primary data before full refresh. [2025-09-23T17:23:17.666852] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-09-23T17:23:17.668194] [DEBUG] [LOCAL ] AVD: Deleted primary data file. [2025-09-23T17:23:17.668256] [INFO ] [MAIN ] AVD: Starting full primary refresh. [2025-09-23T17:23:17.811605] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-07. [2025-09-23T17:23:18.032378] [INFO ] [REMOTE ] AVD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:23:18.417441] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-23T17:23:18.602199] [INFO ] [REMOTE ] AVD: Fetching primary data for 2024-12. [2025-09-23T17:23:19.402207] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-04. [2025-09-23T17:23:19.546958] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-23T17:23:20.202196] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-01. [2025-09-23T17:23:20.612766] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-23T17:23:21.002196] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-05. [2025-09-23T17:23:21.182153] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-23T17:23:21.802222] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-04. [2025-09-23T17:23:22.190254] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-23T17:23:22.602220] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-02. [2025-09-23T17:23:23.218613] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-23T17:23:23.317555] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-23T17:23:23.402226] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-05. [2025-09-23T17:23:24.202227] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-03. [2025-09-23T17:23:24.979888] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-23T17:23:25.002189] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-06. [2025-09-23T17:23:25.078569] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-23T17:23:25.802205] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-04. [2025-09-23T17:23:26.169410] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-23T17:23:26.602181] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-08. [2025-09-23T17:23:26.619365] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-23T17:23:27.108443] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-23T17:23:27.402195] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-09-23T17:23:27.929902] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-23T17:23:27.931551] [INFO ] [REMOTE ] AVAL: Full fetch complete (14613 records). [2025-09-23T17:23:27.931628] [DEBUG] [VALIDATOR ] AVAL: Validating primary data. [2025-09-23T17:23:28.207276] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-06. [2025-09-23T17:23:28.313616] [DEBUG] [VALIDATOR ] AVAL: All expected trading days are present. [2025-09-23T17:23:28.313841] [DEBUG] [VALIDATOR ] AVAL: Primary data validation passed. [2025-09-23T17:23:28.314166] [INFO ] [MAIN ] AVAL: Fetched primary data is valid. [2025-09-23T17:23:28.314210] [DEBUG] [LOCAL ] AVAL: Saving primary data. [2025-09-23T17:23:28.314971] [DEBUG] [LOCAL ] AVAL: Trimmed 14613 records to 8950 (keeping 200 days of data) [2025-09-23T17:23:28.371331] [DEBUG] [LOCAL ] AVAL: Primary data saved (8950 records). [2025-09-23T17:23:28.371484] [INFO ] [MAIN ] AVAL: Full history saved. [2025-09-23T17:23:28.371571] [INFO ] [MAIN ] Update Progress: 181/2372 symbols completed. AVAL took 21.3s. Estimated remaining: 4h 43m 29s. Rate: 7.7 symbols/min [2025-09-23T17:23:28.557796] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:23:28.577883] [DEBUG] [LOCAL ] AVK: Loaded 18073 existing records from primary storage. [2025-09-23T17:23:28.578043] [INFO ] [MAIN ] AVK: Loaded 18073 existing records. [2025-09-23T17:23:28.771279] [WARN ] [MAIN ] AVK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:23:28.771606] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-09-23T17:23:28.771714] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-09-23T17:23:28.772817] [DEBUG] [LOCAL ] AVK: Deleted primary data file. [2025-09-23T17:23:28.772880] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-09-23T17:23:29.007457] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-07. [2025-09-23T17:23:29.135905] [INFO ] [REMOTE ] AVK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:23:29.226606] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-23T17:23:29.802231] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-07. [2025-09-23T17:23:30.337106] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-23T17:23:30.602205] [INFO ] [REMOTE ] AVK: Fetching primary data for 2024-12. [2025-09-23T17:23:31.192745] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-23T17:23:31.342000] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-23T17:23:31.402177] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-05. [2025-09-23T17:23:32.189447] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-23T17:23:32.202143] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-06. [2025-09-23T17:23:32.985330] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-23T17:23:33.002227] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-08. [2025-09-23T17:23:33.802253] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-07. [2025-09-23T17:23:34.399010] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-23T17:23:34.602250] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-01. [2025-09-23T17:23:34.902860] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-23T17:23:35.410775] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-08. [2025-09-23T17:23:35.413192] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-23T17:23:36.202190] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-08. [2025-09-23T17:23:36.224902] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-23T17:23:37.002204] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-09-23T17:23:37.639829] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-23T17:23:37.737614] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-23T17:23:37.741299] [INFO ] [REMOTE ] AVD: Full fetch complete (33899 records). [2025-09-23T17:23:37.741381] [DEBUG] [VALIDATOR ] AVD: Validating primary data. [2025-09-23T17:23:37.807316] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-09-23T17:23:38.127956] [DEBUG] [VALIDATOR ] AVD: All expected trading days are present. [2025-09-23T17:23:38.128048] [DEBUG] [VALIDATOR ] AVD: Primary data validation passed. [2025-09-23T17:23:38.128485] [INFO ] [MAIN ] AVD: Fetched primary data is valid. [2025-09-23T17:23:38.128526] [DEBUG] [LOCAL ] AVD: Saving primary data. [2025-09-23T17:23:38.129349] [DEBUG] [LOCAL ] AVD: Trimmed 33899 records to 22934 (keeping 200 days of data) [2025-09-23T17:23:38.258510] [DEBUG] [LOCAL ] AVD: Primary data saved (22934 records). [2025-09-23T17:23:38.258673] [INFO ] [MAIN ] AVD: Full history saved. [2025-09-23T17:23:38.258782] [INFO ] [MAIN ] Update Progress: 182/2372 symbols completed. AVD took 21.0s. Estimated remaining: 4h 43m 47s. Rate: 7.7 symbols/min [2025-09-23T17:23:38.433996] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:23:38.469155] [DEBUG] [LOCAL ] AVNS: Loaded 33592 existing records from primary storage. [2025-09-23T17:23:38.469462] [INFO ] [MAIN ] AVNS: Loaded 33592 existing records. [2025-09-23T17:23:38.535812] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-23T17:23:38.607270] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-09-23T17:23:38.671903] [WARN ] [MAIN ] AVNS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:23:38.672161] [INFO ] [MAIN ] AVNS: Wiping existing primary data before full refresh. [2025-09-23T17:23:38.672213] [INFO ] [LOCAL ] AVNS: Starting deletion of primary data. [2025-09-23T17:23:38.674403] [DEBUG] [LOCAL ] AVNS: Deleted primary data file. [2025-09-23T17:23:38.674491] [INFO ] [MAIN ] AVNS: Starting full primary refresh. [2025-09-23T17:23:39.056722] [INFO ] [REMOTE ] AVNS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:23:39.402180] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2024-12. [2025-09-23T17:23:39.622294] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-23T17:23:40.202274] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-09-23T17:23:40.446269] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-23T17:23:41.002229] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-01. [2025-09-23T17:23:41.648470] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-23T17:23:41.655785] [INFO ] [REMOTE ] AVB: Full fetch complete (58043 records). [2025-09-23T17:23:41.655890] [DEBUG] [VALIDATOR ] AVB: Validating primary data. [2025-09-23T17:23:41.807415] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-09-23T17:23:42.054711] [DEBUG] [VALIDATOR ] AVB: All expected trading days are present. [2025-09-23T17:23:42.055016] [DEBUG] [VALIDATOR ] AVB: Primary data validation passed. [2025-09-23T17:23:42.055937] [INFO ] [MAIN ] AVB: Fetched primary data is valid. [2025-09-23T17:23:42.056175] [DEBUG] [LOCAL ] AVB: Saving primary data. [2025-09-23T17:23:42.077245] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-23T17:23:42.084391] [DEBUG] [LOCAL ] AVB: Trimmed 58043 records to 41728 (keeping 200 days of data) [2025-09-23T17:23:42.345627] [DEBUG] [LOCAL ] AVB: Primary data saved (41728 records). [2025-09-23T17:23:42.345784] [INFO ] [MAIN ] AVB: Full history saved. [2025-09-23T17:23:42.345869] [INFO ] [MAIN ] Update Progress: 183/2372 symbols completed. AVB took 33.9s. Estimated remaining: 4h 42m 55s. Rate: 7.7 symbols/min [2025-09-23T17:23:42.515524] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:23:42.554301] [DEBUG] [LOCAL ] AVNT: Loaded 39407 existing records from primary storage. [2025-09-23T17:23:42.554450] [INFO ] [MAIN ] AVNT: Loaded 39407 existing records. [2025-09-23T17:23:42.609098] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-02. [2025-09-23T17:23:42.737208] [WARN ] [MAIN ] AVNT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:23:42.737475] [INFO ] [MAIN ] AVNT: Wiping existing primary data before full refresh. [2025-09-23T17:23:42.737530] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-09-23T17:23:42.739424] [DEBUG] [LOCAL ] AVNT: Deleted primary data file. [2025-09-23T17:23:42.739491] [INFO ] [MAIN ] AVNT: Starting full primary refresh. [2025-09-23T17:23:43.106312] [INFO ] [REMOTE ] AVNT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:23:43.118421] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-23T17:23:43.402235] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2024-12. [2025-09-23T17:23:43.507076] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-23T17:23:44.202239] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-09-23T17:23:44.754195] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-23T17:23:44.977271] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-23T17:23:45.002154] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-09-23T17:23:45.588944] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-23T17:23:45.802233] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-09-23T17:23:46.582844] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-23T17:23:46.602145] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-09-23T17:23:47.238929] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-23T17:23:47.402182] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-09-23T17:23:48.202210] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-01. [2025-09-23T17:23:48.625674] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-23T17:23:48.632208] [INFO ] [REMOTE ] AVA: Full fetch complete (55535 records). [2025-09-23T17:23:48.632313] [DEBUG] [VALIDATOR ] AVA: Validating primary data. [2025-09-23T17:23:49.004965] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-03. [2025-09-23T17:23:49.018808] [DEBUG] [VALIDATOR ] AVA: All expected trading days are present. [2025-09-23T17:23:49.019983] [DEBUG] [VALIDATOR ] AVA: Primary data validation passed. [2025-09-23T17:23:49.020591] [INFO ] [MAIN ] AVA: Fetched primary data is valid. [2025-09-23T17:23:49.020667] [DEBUG] [LOCAL ] AVA: Saving primary data. [2025-09-23T17:23:49.021975] [DEBUG] [LOCAL ] AVA: Trimmed 55535 records to 39654 (keeping 200 days of data) [2025-09-23T17:23:49.288755] [DEBUG] [LOCAL ] AVA: Primary data saved (39654 records). [2025-09-23T17:23:49.289468] [INFO ] [MAIN ] AVA: Full history saved. [2025-09-23T17:23:49.291545] [INFO ] [MAIN ] Update Progress: 184/2372 symbols completed. AVA took 43.3s. Estimated remaining: 4h 42m 38s. Rate: 7.7 symbols/min [2025-09-23T17:23:49.290804] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-23T17:23:49.471681] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:23:49.532092] [DEBUG] [LOCAL ] AVTR: Loaded 53567 existing records from primary storage. [2025-09-23T17:23:49.532267] [INFO ] [MAIN ] AVTR: Loaded 53567 existing records. [2025-09-23T17:23:49.706923] [WARN ] [MAIN ] AVTR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:23:49.707186] [INFO ] [MAIN ] AVTR: Wiping existing primary data before full refresh. [2025-09-23T17:23:49.707232] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-09-23T17:23:49.709837] [DEBUG] [LOCAL ] AVTR: Deleted primary data file. [2025-09-23T17:23:49.709901] [INFO ] [MAIN ] AVTR: Starting full primary refresh. [2025-09-23T17:23:49.807498] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-02. [2025-09-23T17:23:50.065195] [INFO ] [REMOTE ] AVTR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:23:50.087280] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-23T17:23:50.602239] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-04. [2025-09-23T17:23:51.252464] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-23T17:23:51.402276] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2024-12. [2025-09-23T17:23:51.751991] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-23T17:23:52.202203] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-09-23T17:23:52.919217] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-23T17:23:53.002155] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-01. [2025-09-23T17:23:53.037342] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-23T17:23:53.041281] [INFO ] [REMOTE ] AVK: Full fetch complete (26639 records). [2025-09-23T17:23:53.041387] [DEBUG] [VALIDATOR ] AVK: Validating primary data. [2025-09-23T17:23:53.440372] [DEBUG] [VALIDATOR ] AVK: All expected trading days are present. [2025-09-23T17:23:53.440456] [DEBUG] [VALIDATOR ] AVK: Primary data validation passed. [2025-09-23T17:23:53.440831] [INFO ] [MAIN ] AVK: Fetched primary data is valid. [2025-09-23T17:23:53.440894] [DEBUG] [LOCAL ] AVK: Saving primary data. [2025-09-23T17:23:53.441587] [DEBUG] [LOCAL ] AVK: Trimmed 26639 records to 17983 (keeping 200 days of data) [2025-09-23T17:23:53.558295] [DEBUG] [LOCAL ] AVK: Primary data saved (17983 records). [2025-09-23T17:23:53.558445] [INFO ] [MAIN ] AVK: Full history saved. [2025-09-23T17:23:53.558534] [INFO ] [MAIN ] Update Progress: 185/2372 symbols completed. AVK took 25.2s. Estimated remaining: 4h 41m 49s. Rate: 7.8 symbols/min [2025-09-23T17:23:53.742527] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:23:53.786492] [DEBUG] [LOCAL ] AVY: Loaded 37716 existing records from primary storage. [2025-09-23T17:23:53.786691] [INFO ] [MAIN ] AVY: Loaded 37716 existing records. [2025-09-23T17:23:53.809176] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-05. [2025-09-23T17:23:53.997761] [WARN ] [MAIN ] AVY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:23:53.998174] [INFO ] [MAIN ] AVY: Wiping existing primary data before full refresh. [2025-09-23T17:23:53.998285] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-09-23T17:23:54.001059] [DEBUG] [LOCAL ] AVY: Deleted primary data file. [2025-09-23T17:23:54.001127] [INFO ] [MAIN ] AVY: Starting full primary refresh. [2025-09-23T17:23:54.399325] [INFO ] [REMOTE ] AVY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:23:54.533711] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-23T17:23:54.602219] [INFO ] [REMOTE ] AVY: Fetching primary data for 2024-12. [2025-09-23T17:23:54.772180] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-23T17:23:55.402195] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-06. [2025-09-23T17:23:56.100025] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-23T17:23:56.127730] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-23T17:23:56.202195] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-02. [2025-09-23T17:23:57.002206] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-01. [2025-09-23T17:23:57.344323] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-23T17:23:57.802216] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-03. [2025-09-23T17:23:58.504590] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-23T17:23:58.602211] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-07. [2025-09-23T17:23:59.195561] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-23T17:23:59.402195] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-04. [2025-09-23T17:24:00.097822] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-23T17:24:00.202212] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-08. [2025-09-23T17:24:00.987739] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-23T17:24:01.002170] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-03. [2025-09-23T17:24:01.170210] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-23T17:24:01.802238] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-05. [2025-09-23T17:24:02.602230] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-02. [2025-09-23T17:24:03.280935] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-09-23T17:24:03.402194] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-04. [2025-09-23T17:24:04.202210] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-09-23T17:24:04.622839] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-23T17:24:04.664950] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-05 (2.86 seconds). [2025-09-23T17:24:04.720631] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-23T17:24:05.002202] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-03. [2025-09-23T17:24:05.354180] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-23T17:24:05.360047] [INFO ] [REMOTE ] AVNS: Full fetch complete (47792 records). [2025-09-23T17:24:05.360160] [DEBUG] [VALIDATOR ] AVNS: Validating primary data. [2025-09-23T17:24:05.745890] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present. [2025-09-23T17:24:05.746018] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed. [2025-09-23T17:24:05.746565] [INFO ] [MAIN ] AVNS: Fetched primary data is valid. [2025-09-23T17:24:05.746636] [DEBUG] [LOCAL ] AVNS: Saving primary data. [2025-09-23T17:24:05.747812] [DEBUG] [LOCAL ] AVNS: Trimmed 47792 records to 33579 (keeping 200 days of data) [2025-09-23T17:24:05.810338] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-06. [2025-09-23T17:24:05.952469] [DEBUG] [LOCAL ] AVNS: Primary data saved (33579 records). [2025-09-23T17:24:05.952615] [INFO ] [MAIN ] AVNS: Full history saved. [2025-09-23T17:24:05.952763] [INFO ] [MAIN ] Update Progress: 186/2372 symbols completed. AVNS took 27.7s. Estimated remaining: 4h 42m 36s. Rate: 7.7 symbols/min [2025-09-23T17:24:06.125269] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:24:06.150475] [DEBUG] [LOCAL ] AWF: Loaded 24294 existing records from primary storage. [2025-09-23T17:24:06.150606] [INFO ] [MAIN ] AWF: Loaded 24294 existing records. [2025-09-23T17:24:06.347989] [WARN ] [MAIN ] AWF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:24:06.348608] [INFO ] [MAIN ] AWF: Wiping existing primary data before full refresh. [2025-09-23T17:24:06.348709] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-09-23T17:24:06.350007] [DEBUG] [LOCAL ] AWF: Deleted primary data file. [2025-09-23T17:24:06.350071] [INFO ] [MAIN ] AWF: Starting full primary refresh. [2025-09-23T17:24:06.607414] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-05. [2025-09-23T17:24:06.739096] [INFO ] [REMOTE ] AWF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:24:06.765634] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-23T17:24:07.225780] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-23T17:24:07.402239] [INFO ] [REMOTE ] AWF: Fetching primary data for 2024-12. [2025-09-23T17:24:07.708470] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-23T17:24:08.202193] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-07. [2025-09-23T17:24:08.384739] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-23T17:24:09.002202] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-01. [2025-09-23T17:24:09.720708] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-23T17:24:09.802163] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-06. [2025-09-23T17:24:09.962173] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-23T17:24:10.602230] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-02. [2025-09-23T17:24:10.849431] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-23T17:24:11.297593] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-23T17:24:11.402188] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-03. [2025-09-23T17:24:12.202261] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-04. [2025-09-23T17:24:12.587875] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-23T17:24:13.002231] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-08. [2025-09-23T17:24:13.626182] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-23T17:24:13.802155] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-05. [2025-09-23T17:24:14.602189] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-04. [2025-09-23T17:24:15.402201] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-07. [2025-09-23T17:24:15.614582] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-08 (2.61 seconds). [2025-09-23T17:24:15.780196] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-23T17:24:16.202194] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-09-23T17:24:16.765916] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-23T17:24:17.002220] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-05. [2025-09-23T17:24:17.638257] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-23T17:24:17.647742] [INFO ] [REMOTE ] AVTR: Full fetch complete (77440 records). [2025-09-23T17:24:17.647938] [DEBUG] [VALIDATOR ] AVTR: Validating primary data. [2025-09-23T17:24:17.802703] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-06. [2025-09-23T17:24:17.818568] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-09-23T17:24:18.096724] [DEBUG] [VALIDATOR ] AVTR: All expected trading days are present. [2025-09-23T17:24:18.096824] [DEBUG] [VALIDATOR ] AVTR: Primary data validation passed. [2025-09-23T17:24:18.097590] [INFO ] [MAIN ] AVTR: Fetched primary data is valid. [2025-09-23T17:24:18.097709] [DEBUG] [LOCAL ] AVTR: Saving primary data. [2025-09-23T17:24:18.099226] [DEBUG] [LOCAL ] AVTR: Trimmed 77440 records to 53567 (keeping 200 days of data) [2025-09-23T17:24:18.224571] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-23T17:24:18.456290] [DEBUG] [LOCAL ] AVTR: Primary data saved (53567 records). [2025-09-23T17:24:18.456463] [INFO ] [MAIN ] AVTR: Full history saved. [2025-09-23T17:24:18.456625] [INFO ] [MAIN ] Update Progress: 187/2372 symbols completed. AVTR took 29.2s. Estimated remaining: 4h 43m 24s. Rate: 7.7 symbols/min [2025-09-23T17:24:18.626213] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:24:18.609186] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-08. [2025-09-23T17:24:18.659244] [DEBUG] [LOCAL ] AWI: Loaded 26066 existing records from primary storage. [2025-09-23T17:24:18.659386] [INFO ] [MAIN ] AWI: Loaded 26066 existing records. [2025-09-23T17:24:18.837893] [WARN ] [MAIN ] AWI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:24:18.838289] [INFO ] [MAIN ] AWI: Wiping existing primary data before full refresh. [2025-09-23T17:24:18.838357] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-09-23T17:24:18.839256] [DEBUG] [LOCAL ] AWI: Deleted primary data file. [2025-09-23T17:24:18.839338] [INFO ] [MAIN ] AWI: Starting full primary refresh. [2025-09-23T17:24:19.217219] [INFO ] [REMOTE ] AWI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:24:19.237052] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-23T17:24:19.402176] [INFO ] [REMOTE ] AWI: Fetching primary data for 2024-12. [2025-09-23T17:24:19.757238] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-23T17:24:20.202250] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-09. [2025-09-23T17:24:20.884563] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-23T17:24:21.002204] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-06. [2025-09-23T17:24:21.387134] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-23T17:24:21.393555] [INFO ] [REMOTE ] AVNT: Full fetch complete (55808 records). [2025-09-23T17:24:21.393716] [DEBUG] [VALIDATOR ] AVNT: Validating primary data. [2025-09-23T17:24:21.394806] [FATAL] [VALIDATOR ] AVNT: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:24:21.394942] [FATAL] [MAIN ] AVNT: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:24:21.394997] [WARN ] [MAIN ] AVNT: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:24:21.395062] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-09-23T17:24:21.395169] [DEBUG] [LOCAL ] AVNT: No primary data file found to delete. [2025-09-23T17:24:21.395241] [INFO ] [LOCAL ] AVNT: Starting deletion of derivative data. [2025-09-23T17:24:21.395941] [DEBUG] [LOCAL ] AVNT: Deleted derivative data file. [2025-09-23T17:24:21.396072] [INFO ] [MAIN ] Update Progress: 188/2372 symbols completed. AVNT took 39.1s. Estimated remaining: 4h 42m 20s. Rate: 7.7 symbols/min [2025-09-23T17:24:21.564015] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:24:21.633078] [DEBUG] [LOCAL ] AWK: Loaded 48853 existing records from primary storage. [2025-09-23T17:24:21.633249] [INFO ] [MAIN ] AWK: Loaded 48853 existing records. [2025-09-23T17:24:21.810741] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-01. [2025-09-23T17:24:21.811104] [WARN ] [MAIN ] AWK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:24:21.812532] [INFO ] [MAIN ] AWK: Wiping existing primary data before full refresh. [2025-09-23T17:24:21.812723] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-09-23T17:24:21.819082] [DEBUG] [LOCAL ] AWK: Deleted primary data file. [2025-09-23T17:24:21.819303] [INFO ] [MAIN ] AWK: Starting full primary refresh. [2025-09-23T17:24:21.873487] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-23T17:24:22.200594] [INFO ] [REMOTE ] AWK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:24:22.602178] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-07. [2025-09-23T17:24:22.902916] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-23T17:24:23.388713] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-23T17:24:23.402143] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-08. [2025-09-23T17:24:24.200476] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-23T17:24:24.202237] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-02. [2025-09-23T17:24:25.002231] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-09-23T17:24:25.263633] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-23T17:24:25.773146] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-23T17:24:25.778068] [INFO ] [REMOTE ] AWF: Full fetch complete (35992 records). [2025-09-23T17:24:25.778220] [DEBUG] [VALIDATOR ] AWF: Validating primary data. [2025-09-23T17:24:25.809481] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-03. [2025-09-23T17:24:26.180318] [DEBUG] [VALIDATOR ] AWF: All expected trading days are present. [2025-09-23T17:24:26.180417] [DEBUG] [VALIDATOR ] AWF: Primary data validation passed. [2025-09-23T17:24:26.180951] [INFO ] [MAIN ] AWF: Fetched primary data is valid. [2025-09-23T17:24:26.181014] [DEBUG] [LOCAL ] AWF: Saving primary data. [2025-09-23T17:24:26.181907] [DEBUG] [LOCAL ] AWF: Trimmed 35992 records to 24324 (keeping 200 days of data) [2025-09-23T17:24:26.348092] [DEBUG] [LOCAL ] AWF: Primary data saved (24324 records). [2025-09-23T17:24:26.348231] [INFO ] [MAIN ] AWF: Full history saved. [2025-09-23T17:24:26.348332] [INFO ] [MAIN ] Update Progress: 189/2372 symbols completed. AWF took 20.4s. Estimated remaining: 4h 41m 39s. Rate: 7.8 symbols/min [2025-09-23T17:24:26.598996] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:24:26.602169] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-07. [2025-09-23T17:24:26.624112] [DEBUG] [LOCAL ] AWP: Loaded 21999 existing records from primary storage. [2025-09-23T17:24:26.624267] [INFO ] [MAIN ] AWP: Loaded 21999 existing records. [2025-09-23T17:24:26.811052] [WARN ] [MAIN ] AWP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:24:26.811572] [INFO ] [MAIN ] AWP: Wiping existing primary data before full refresh. [2025-09-23T17:24:26.811670] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-09-23T17:24:26.818658] [DEBUG] [LOCAL ] AWP: Deleted primary data file. [2025-09-23T17:24:26.829445] [INFO ] [MAIN ] AWP: Starting full primary refresh. [2025-09-23T17:24:26.830129] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-23T17:24:27.200535] [INFO ] [REMOTE ] AWP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:24:27.402193] [INFO ] [REMOTE ] AWP: Fetching primary data for 2024-12. [2025-09-23T17:24:27.999254] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-23T17:24:28.202209] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-04. [2025-09-23T17:24:28.261984] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-23T17:24:29.002201] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-01. [2025-09-23T17:24:29.155914] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-23T17:24:29.802216] [INFO ] [REMOTE ] AWK: Fetching primary data for 2024-12. [2025-09-23T17:24:29.844055] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-23T17:24:30.602236] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-05. [2025-09-23T17:24:31.080495] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-23T17:24:31.402200] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-01. [2025-09-23T17:24:31.552170] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-23T17:24:32.202206] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-08. [2025-09-23T17:24:33.002198] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-06. [2025-09-23T17:24:33.228801] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-23T17:24:33.387846] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-23T17:24:33.802231] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-02. [2025-09-23T17:24:34.088475] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-23T17:24:34.602231] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-09-23T17:24:35.353313] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-23T17:24:35.402142] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-03. [2025-09-23T17:24:35.764448] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-23T17:24:35.770936] [INFO ] [REMOTE ] AVY: Full fetch complete (56074 records). [2025-09-23T17:24:35.771086] [DEBUG] [VALIDATOR ] AVY: Validating primary data. [2025-09-23T17:24:36.148852] [DEBUG] [VALIDATOR ] AVY: All expected trading days are present. [2025-09-23T17:24:36.148932] [DEBUG] [VALIDATOR ] AVY: Primary data validation passed. [2025-09-23T17:24:36.149507] [INFO ] [MAIN ] AVY: Fetched primary data is valid. [2025-09-23T17:24:36.149547] [DEBUG] [LOCAL ] AVY: Saving primary data. [2025-09-23T17:24:36.150630] [DEBUG] [LOCAL ] AVY: Trimmed 56074 records to 37657 (keeping 200 days of data) [2025-09-23T17:24:36.224477] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-02. [2025-09-23T17:24:36.404294] [DEBUG] [LOCAL ] AVY: Primary data saved (37657 records). [2025-09-23T17:24:36.404433] [INFO ] [MAIN ] AVY: Full history saved. [2025-09-23T17:24:36.405568] [INFO ] [MAIN ] Update Progress: 190/2372 symbols completed. AVY took 42.8s. Estimated remaining: 4h 41m 58s. Rate: 7.7 symbols/min [2025-09-23T17:24:36.574907] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:24:36.604176] [DEBUG] [LOCAL ] AWR: Loaded 22541 existing records from primary storage. [2025-09-23T17:24:36.604328] [INFO ] [MAIN ] AWR: Loaded 22541 existing records. [2025-09-23T17:24:36.787071] [WARN ] [MAIN ] AWR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:24:36.787620] [INFO ] [MAIN ] AWR: Wiping existing primary data before full refresh. [2025-09-23T17:24:36.787757] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-09-23T17:24:36.788368] [DEBUG] [LOCAL ] AWR: Deleted primary data file. [2025-09-23T17:24:36.788463] [INFO ] [MAIN ] AWR: Starting full primary refresh. [2025-09-23T17:24:37.006238] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-07. [2025-09-23T17:24:37.091442] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-23T17:24:37.193431] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-23T17:24:37.225038] [INFO ] [REMOTE ] AWR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:24:37.802228] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-03. [2025-09-23T17:24:38.320478] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-23T17:24:38.602204] [INFO ] [REMOTE ] AWR: Fetching primary data for 2024-12. [2025-09-23T17:24:38.976451] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-23T17:24:39.402199] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-08. [2025-09-23T17:24:39.458846] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-23T17:24:40.202186] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-04. [2025-09-23T17:24:40.250964] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-23T17:24:40.945185] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-23T17:24:41.002215] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-01. [2025-09-23T17:24:41.802225] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-05. [2025-09-23T17:24:42.152773] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-23T17:24:42.504618] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-23T17:24:42.602265] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-06. [2025-09-23T17:24:43.302351] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-23T17:24:43.402261] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-09-23T17:24:44.202295] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-02. [2025-09-23T17:24:44.682725] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-23T17:24:44.688084] [INFO ] [REMOTE ] AWI: Full fetch complete (35461 records). [2025-09-23T17:24:44.688292] [DEBUG] [VALIDATOR ] AWI: Validating primary data. [2025-09-23T17:24:45.007951] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-07. [2025-09-23T17:24:45.103967] [DEBUG] [VALIDATOR ] AWI: All expected trading days are present. [2025-09-23T17:24:45.104338] [DEBUG] [VALIDATOR ] AWI: Primary data validation passed. [2025-09-23T17:24:45.105516] [INFO ] [MAIN ] AWI: Fetched primary data is valid. [2025-09-23T17:24:45.107210] [DEBUG] [LOCAL ] AWI: Saving primary data. [2025-09-23T17:24:45.107114] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-23T17:24:45.115613] [DEBUG] [LOCAL ] AWI: Trimmed 35461 records to 26007 (keeping 200 days of data) [2025-09-23T17:24:45.294156] [DEBUG] [LOCAL ] AWI: Primary data saved (26007 records). [2025-09-23T17:24:45.294310] [INFO ] [MAIN ] AWI: Full history saved. [2025-09-23T17:24:45.294401] [INFO ] [MAIN ] Update Progress: 191/2372 symbols completed. AWI took 26.8s. Estimated remaining: 4h 42m 4s. Rate: 7.7 symbols/min [2025-09-23T17:24:45.474690] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:24:45.504349] [DEBUG] [LOCAL ] AX: Loaded 28679 existing records from primary storage. [2025-09-23T17:24:45.504490] [INFO ] [MAIN ] AX: Loaded 28679 existing records. [2025-09-23T17:24:45.698618] [WARN ] [MAIN ] AX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:24:45.698908] [INFO ] [MAIN ] AX: Wiping existing primary data before full refresh. [2025-09-23T17:24:45.698956] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-09-23T17:24:45.699670] [DEBUG] [LOCAL ] AX: Deleted primary data file. [2025-09-23T17:24:45.699735] [INFO ] [MAIN ] AX: Starting full primary refresh. [2025-09-23T17:24:45.807453] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-03. [2025-09-23T17:24:46.112433] [INFO ] [REMOTE ] AX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:24:46.133085] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-23T17:24:46.573997] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-23T17:24:46.602175] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-04. [2025-09-23T17:24:47.402278] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-08. [2025-09-23T17:24:47.671433] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-23T17:24:48.161024] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-23T17:24:48.202152] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-05. [2025-09-23T17:24:48.854668] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-23T17:24:49.002186] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-06. [2025-09-23T17:24:49.802179] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-09-23T17:24:50.165077] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-23T17:24:50.580925] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-23T17:24:50.585285] [INFO ] [REMOTE ] AWP: Full fetch complete (32517 records). [2025-09-23T17:24:50.585462] [DEBUG] [VALIDATOR ] AWP: Validating primary data. [2025-09-23T17:24:50.608503] [INFO ] [REMOTE ] AX: Fetching primary data for 2024-12. [2025-09-23T17:24:50.994156] [DEBUG] [VALIDATOR ] AWP: All expected trading days are present. [2025-09-23T17:24:50.994289] [DEBUG] [VALIDATOR ] AWP: Primary data validation passed. [2025-09-23T17:24:50.994806] [INFO ] [MAIN ] AWP: Fetched primary data is valid. [2025-09-23T17:24:50.994870] [DEBUG] [LOCAL ] AWP: Saving primary data. [2025-09-23T17:24:50.996127] [DEBUG] [LOCAL ] AWP: Trimmed 32517 records to 21785 (keeping 200 days of data) [2025-09-23T17:24:51.121547] [DEBUG] [LOCAL ] AWP: Primary data saved (21785 records). [2025-09-23T17:24:51.121705] [INFO ] [MAIN ] AWP: Full history saved. [2025-09-23T17:24:51.121797] [INFO ] [MAIN ] Update Progress: 192/2372 symbols completed. AWP took 24.8s. Estimated remaining: 4h 41m 34s. Rate: 7.7 symbols/min [2025-09-23T17:24:51.300170] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:24:51.300356] [DEBUG] [LOCAL ] AXL: No existing data file found in primary storage. [2025-09-23T17:24:51.300393] [WARN ] [MAIN ] AXL: No existing data found, performing full refresh instead. [2025-09-23T17:24:51.300535] [INFO ] [MAIN ] AXL: Wiping existing primary data before full refresh. [2025-09-23T17:24:51.300576] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-09-23T17:24:51.300617] [DEBUG] [LOCAL ] AXL: No primary data file found to delete. [2025-09-23T17:24:51.300675] [INFO ] [MAIN ] AXL: Starting full primary refresh. [2025-09-23T17:24:51.407399] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-07. [2025-09-23T17:24:51.676448] [INFO ] [REMOTE ] AXL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:24:51.736914] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-23T17:24:52.202199] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-01. [2025-09-23T17:24:52.670296] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-23T17:24:53.002259] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-04. [2025-09-23T17:24:53.098264] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-23T17:24:53.802239] [INFO ] [REMOTE ] AXL: Fetching primary data for 2024-12. [2025-09-23T17:24:54.353275] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-23T17:24:54.602214] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-02. [2025-09-23T17:24:55.113043] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-23T17:24:55.402187] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-05. [2025-09-23T17:24:55.422614] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-23T17:24:56.202215] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-03. [2025-09-23T17:24:57.002199] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-08. [2025-09-23T17:24:57.153898] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-23T17:24:57.227395] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-23T17:24:57.770884] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-23T17:24:57.802162] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-09. [2025-09-23T17:24:58.602208] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-04. [2025-09-23T17:24:58.701784] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-23T17:24:58.706777] [INFO ] [REMOTE ] AWR: Full fetch complete (31716 records). [2025-09-23T17:24:58.706955] [DEBUG] [VALIDATOR ] AWR: Validating primary data. [2025-09-23T17:24:59.081804] [DEBUG] [VALIDATOR ] AWR: All expected trading days are present. [2025-09-23T17:24:59.081887] [DEBUG] [VALIDATOR ] AWR: Primary data validation passed. [2025-09-23T17:24:59.082303] [INFO ] [MAIN ] AWR: Fetched primary data is valid. [2025-09-23T17:24:59.082380] [DEBUG] [LOCAL ] AWR: Saving primary data. [2025-09-23T17:24:59.083282] [DEBUG] [LOCAL ] AWR: Trimmed 31716 records to 22614 (keeping 200 days of data) [2025-09-23T17:24:59.226048] [DEBUG] [LOCAL ] AWR: Primary data saved (22614 records). [2025-09-23T17:24:59.226217] [INFO ] [MAIN ] AWR: Full history saved. [2025-09-23T17:24:59.226335] [INFO ] [MAIN ] Update Progress: 193/2372 symbols completed. AWR took 22.8s. Estimated remaining: 4h 41m 30s. Rate: 7.7 symbols/min [2025-09-23T17:24:59.393961] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:24:59.402166] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-06. [2025-09-23T17:24:59.450081] [DEBUG] [LOCAL ] AXP: Loaded 53264 existing records from primary storage. [2025-09-23T17:24:59.450229] [INFO ] [MAIN ] AXP: Loaded 53264 existing records. [2025-09-23T17:24:59.618763] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-23T17:24:59.663944] [WARN ] [MAIN ] AXP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:24:59.664333] [INFO ] [MAIN ] AXP: Wiping existing primary data before full refresh. [2025-09-23T17:24:59.665202] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-09-23T17:24:59.666544] [DEBUG] [LOCAL ] AXP: Deleted primary data file. [2025-09-23T17:24:59.666612] [INFO ] [MAIN ] AXP: Starting full primary refresh. [2025-09-23T17:25:00.037876] [INFO ] [REMOTE ] AXP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:25:00.202201] [INFO ] [REMOTE ] AXP: Fetching primary data for 2024-12. [2025-09-23T17:25:00.937796] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-23T17:25:01.002207] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-07. [2025-09-23T17:25:01.802227] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-05. [2025-09-23T17:25:02.185234] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-23T17:25:02.246490] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-23T17:25:02.602205] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-01. [2025-09-23T17:25:02.735230] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-23T17:25:03.402249] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-01. [2025-09-23T17:25:03.831010] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-23T17:25:04.202253] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-08. [2025-09-23T17:25:05.002214] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-02. [2025-09-23T17:25:05.542979] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-09-23T17:25:05.802212] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-02. [2025-09-23T17:25:06.099747] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-23T17:25:06.448377] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-23T17:25:06.602221] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-06. [2025-09-23T17:25:07.402173] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-09-23T17:25:07.434891] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-23T17:25:07.658134] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-23T17:25:08.202192] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-03. [2025-09-23T17:25:08.955598] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-23T17:25:08.967255] [INFO ] [REMOTE ] AWK: Full fetch complete (70524 records). [2025-09-23T17:25:08.967419] [DEBUG] [VALIDATOR ] AWK: Validating primary data. [2025-09-23T17:25:09.007428] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-07. [2025-09-23T17:25:09.393950] [DEBUG] [VALIDATOR ] AWK: All expected trading days are present. [2025-09-23T17:25:09.394050] [DEBUG] [VALIDATOR ] AWK: Primary data validation passed. [2025-09-23T17:25:09.394784] [INFO ] [MAIN ] AWK: Fetched primary data is valid. [2025-09-23T17:25:09.394848] [DEBUG] [LOCAL ] AWK: Saving primary data. [2025-09-23T17:25:09.396276] [DEBUG] [LOCAL ] AWK: Trimmed 70524 records to 48832 (keeping 200 days of data) [2025-09-23T17:25:09.704689] [DEBUG] [LOCAL ] AWK: Primary data saved (48832 records). [2025-09-23T17:25:09.704824] [INFO ] [MAIN ] AWK: Full history saved. [2025-09-23T17:25:09.704908] [INFO ] [MAIN ] Update Progress: 194/2372 symbols completed. AWK took 48.3s. Estimated remaining: 4h 41m 53s. Rate: 7.7 symbols/min [2025-09-23T17:25:09.804529] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-03. [2025-09-23T17:25:09.878841] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:25:09.884401] [DEBUG] [LOCAL ] AXR: Loaded 3148 existing records from primary storage. [2025-09-23T17:25:09.884493] [INFO ] [MAIN ] AXR: Loaded 3148 existing records. [2025-09-23T17:25:10.067225] [WARN ] [MAIN ] AXR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:25:10.067479] [INFO ] [MAIN ] AXR: Wiping existing primary data before full refresh. [2025-09-23T17:25:10.067527] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-09-23T17:25:10.067788] [DEBUG] [LOCAL ] AXR: Deleted primary data file. [2025-09-23T17:25:10.067847] [INFO ] [MAIN ] AXR: Starting full primary refresh. [2025-09-23T17:25:10.382803] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-23T17:25:10.464308] [INFO ] [REMOTE ] AXR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:25:10.500888] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-09-23T17:25:10.602155] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-04. [2025-09-23T17:25:11.313127] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-23T17:25:11.402200] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-04. [2025-09-23T17:25:12.202299] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-08. [2025-09-23T17:25:12.510420] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-23T17:25:13.002225] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-05. [2025-09-23T17:25:13.136465] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-23T17:25:13.374370] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-23T17:25:13.802216] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-05. [2025-09-23T17:25:14.602253] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-09. [2025-09-23T17:25:15.168229] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-23T17:25:15.224349] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-23T17:25:15.402175] [INFO ] [REMOTE ] AXR: Fetching primary data for 2024-12. [2025-09-23T17:25:15.549176] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-23T17:25:15.554468] [INFO ] [REMOTE ] AX: Full fetch complete (42762 records). [2025-09-23T17:25:15.554629] [DEBUG] [VALIDATOR ] AX: Validating primary data. [2025-09-23T17:25:15.933349] [DEBUG] [VALIDATOR ] AX: All expected trading days are present. [2025-09-23T17:25:15.933430] [DEBUG] [VALIDATOR ] AX: Primary data validation passed. [2025-09-23T17:25:15.933937] [INFO ] [MAIN ] AX: Fetched primary data is valid. [2025-09-23T17:25:15.934000] [DEBUG] [LOCAL ] AX: Saving primary data. [2025-09-23T17:25:15.934972] [DEBUG] [LOCAL ] AX: Trimmed 42762 records to 28637 (keeping 200 days of data) [2025-09-23T17:25:16.037362] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-23T17:25:16.120949] [DEBUG] [LOCAL ] AX: Primary data saved (28637 records). [2025-09-23T17:25:16.121083] [INFO ] [MAIN ] AX: Full history saved. [2025-09-23T17:25:16.121165] [INFO ] [MAIN ] Update Progress: 195/2372 symbols completed. AX took 30.8s. Estimated remaining: 4h 41m 30s. Rate: 7.7 symbols/min [2025-09-23T17:25:16.207442] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-06. [2025-09-23T17:25:16.297720] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:25:16.345351] [DEBUG] [LOCAL ] AXS: Loaded 38244 existing records from primary storage. [2025-09-23T17:25:16.345511] [INFO ] [MAIN ] AXS: Loaded 38244 existing records. [2025-09-23T17:25:16.523289] [WARN ] [MAIN ] AXS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:25:16.523549] [INFO ] [MAIN ] AXS: Wiping existing primary data before full refresh. [2025-09-23T17:25:16.523597] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-09-23T17:25:16.524501] [DEBUG] [LOCAL ] AXS: Deleted primary data file. [2025-09-23T17:25:16.524564] [INFO ] [MAIN ] AXS: Starting full primary refresh. [2025-09-23T17:25:16.874553] [INFO ] [REMOTE ] AXS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:25:17.002149] [INFO ] [REMOTE ] AXS: Fetching primary data for 2024-12. [2025-09-23T17:25:17.802208] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-06. [2025-09-23T17:25:18.224937] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-23T17:25:18.305131] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-23T17:25:18.602204] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-01. [2025-09-23T17:25:19.284030] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-23T17:25:19.402192] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-07. [2025-09-23T17:25:19.758308] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-23T17:25:20.202193] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-07. [2025-09-23T17:25:20.650512] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-23T17:25:21.002196] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-02. [2025-09-23T17:25:21.802197] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-08. [2025-09-23T17:25:21.956186] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-23T17:25:22.062802] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-23T17:25:22.602196] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-08. [2025-09-23T17:25:23.402213] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-01. [2025-09-23T17:25:23.492870] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-23T17:25:23.770479] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-09-23T17:25:24.202158] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-03. [2025-09-23T17:25:24.391287] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-23T17:25:25.002188] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-09-23T17:25:25.378232] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-23T17:25:25.802202] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-02. [2025-09-23T17:25:26.264618] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-23T17:25:26.555485] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-23T17:25:26.564144] [INFO ] [REMOTE ] AXL: Full fetch complete (72396 records). [2025-09-23T17:25:26.564288] [DEBUG] [VALIDATOR ] AXL: Validating primary data. [2025-09-23T17:25:26.607258] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-09. [2025-09-23T17:25:26.962834] [DEBUG] [VALIDATOR ] AXL: All expected trading days are present. [2025-09-23T17:25:26.962917] [DEBUG] [VALIDATOR ] AXL: Primary data validation passed. [2025-09-23T17:25:26.963618] [INFO ] [MAIN ] AXL: Fetched primary data is valid. [2025-09-23T17:25:26.963694] [DEBUG] [LOCAL ] AXL: Saving primary data. [2025-09-23T17:25:26.965407] [DEBUG] [LOCAL ] AXL: Trimmed 72396 records to 50505 (keeping 200 days of data) [2025-09-23T17:25:27.248104] [DEBUG] [LOCAL ] AXL: Primary data saved (50505 records). [2025-09-23T17:25:27.248242] [INFO ] [MAIN ] AXL: Full history saved. [2025-09-23T17:25:27.248319] [INFO ] [MAIN ] Update Progress: 196/2372 symbols completed. AXL took 36.1s. Estimated remaining: 4h 41m 60s. Rate: 7.7 symbols/min [2025-09-23T17:25:27.417183] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:25:27.414351] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-04. [2025-09-23T17:25:27.478000] [DEBUG] [LOCAL ] AXTA: Loaded 52052 existing records from primary storage. [2025-09-23T17:25:27.478163] [INFO ] [MAIN ] AXTA: Loaded 52052 existing records. [2025-09-23T17:25:27.655758] [WARN ] [MAIN ] AXTA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:25:27.655991] [INFO ] [MAIN ] AXTA: Wiping existing primary data before full refresh. [2025-09-23T17:25:27.656045] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-09-23T17:25:27.657098] [DEBUG] [LOCAL ] AXTA: Deleted primary data file. [2025-09-23T17:25:27.657161] [INFO ] [MAIN ] AXTA: Starting full primary refresh. [2025-09-23T17:25:28.014165] [INFO ] [REMOTE ] AXTA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:25:28.202165] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-03. [2025-09-23T17:25:28.562512] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-23T17:25:28.571296] [INFO ] [REMOTE ] AXP: Full fetch complete (76541 records). [2025-09-23T17:25:28.571434] [DEBUG] [VALIDATOR ] AXP: Validating primary data. [2025-09-23T17:25:28.572191] [FATAL] [VALIDATOR ] AXP: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:25:28.572282] [FATAL] [MAIN ] AXP: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:25:28.572332] [WARN ] [MAIN ] AXP: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:25:28.572422] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-09-23T17:25:28.572526] [DEBUG] [LOCAL ] AXP: No primary data file found to delete. [2025-09-23T17:25:28.572579] [INFO ] [LOCAL ] AXP: Starting deletion of derivative data. [2025-09-23T17:25:28.573590] [DEBUG] [LOCAL ] AXP: Deleted derivative data file. [2025-09-23T17:25:28.574098] [INFO ] [MAIN ] Update Progress: 197/2372 symbols completed. AXP took 29.3s. Estimated remaining: 4h 40m 41s. Rate: 7.7 symbols/min [2025-09-23T17:25:28.579362] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-23T17:25:29.002164] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-04. [2025-09-23T17:25:29.094775] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-23T17:25:29.376221] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-23T17:25:29.802217] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-05. [2025-09-23T17:25:30.195310] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-23T17:25:30.602231] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-06. [2025-09-23T17:25:31.219579] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-23T17:25:31.402197] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2024-12. [2025-09-23T17:25:32.202198] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-07. [2025-09-23T17:25:32.559316] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-23T17:25:33.007321] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-08. [2025-09-23T17:25:33.026140] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-23T17:25:33.489561] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-23T17:25:33.802214] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-01. [2025-09-23T17:25:34.602213] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-09. [2025-09-23T17:25:34.889559] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-23T17:25:35.047486] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-23T17:25:35.048751] [INFO ] [REMOTE ] AXR: Full fetch complete (4989 records). [2025-09-23T17:25:35.048821] [DEBUG] [VALIDATOR ] AXR: Validating primary data. [2025-09-23T17:25:35.049176] [FATAL] [VALIDATOR ] AXR: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:25:35.049270] [FATAL] [MAIN ] AXR: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:25:35.049347] [WARN ] [MAIN ] AXR: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:25:35.049436] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-09-23T17:25:35.049516] [DEBUG] [LOCAL ] AXR: No primary data file found to delete. [2025-09-23T17:25:35.049553] [INFO ] [LOCAL ] AXR: Starting deletion of derivative data. [2025-09-23T17:25:35.049844] [DEBUG] [LOCAL ] AXR: Deleted derivative data file. [2025-09-23T17:25:35.049934] [INFO ] [MAIN ] Update Progress: 198/2372 symbols completed. AXR took 25.3s. Estimated remaining: 4h 40m 19s. Rate: 7.8 symbols/min [2025-09-23T17:25:35.402234] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-02. [2025-09-23T17:25:36.202210] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-05. [2025-09-23T17:25:36.465638] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-23T17:25:37.002249] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-03. [2025-09-23T17:25:37.575479] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-23T17:25:37.802277] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-06. [2025-09-23T17:25:38.232841] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-23T17:25:38.602220] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-04. [2025-09-23T17:25:39.292303] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-23T17:25:39.402225] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-07. [2025-09-23T17:25:40.327996] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-23T17:25:40.339273] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-05. [2025-09-23T17:25:41.023446] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-23T17:25:41.032559] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-08. [2025-09-23T17:25:41.691499] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-23T17:25:41.802298] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-06. [2025-09-23T17:25:42.085050] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-23T17:25:42.602251] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-09-23T17:25:43.024315] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-23T17:25:43.402210] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-07. [2025-09-23T17:25:44.187183] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-23T17:25:44.194116] [INFO ] [REMOTE ] AXS: Full fetch complete (55334 records). [2025-09-23T17:25:44.194290] [DEBUG] [VALIDATOR ] AXS: Validating primary data. [2025-09-23T17:25:44.594415] [DEBUG] [VALIDATOR ] AXS: All expected trading days are present. [2025-09-23T17:25:44.594548] [DEBUG] [VALIDATOR ] AXS: Primary data validation passed. [2025-09-23T17:25:44.595249] [INFO ] [MAIN ] AXS: Fetched primary data is valid. [2025-09-23T17:25:44.595314] [DEBUG] [LOCAL ] AXS: Saving primary data. [2025-09-23T17:25:44.596595] [DEBUG] [LOCAL ] AXS: Trimmed 55334 records to 38262 (keeping 200 days of data) [2025-09-23T17:25:44.755946] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-23T17:25:44.819581] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-08. [2025-09-23T17:25:44.873938] [DEBUG] [LOCAL ] AXS: Primary data saved (38262 records). [2025-09-23T17:25:44.874099] [INFO ] [MAIN ] AXS: Full history saved. [2025-09-23T17:25:44.874188] [INFO ] [MAIN ] Update Progress: 199/2372 symbols completed. AXS took 28.8s. Estimated remaining: 4h 40m 34s. Rate: 7.7 symbols/min [2025-09-23T17:25:46.162107] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-23T17:25:46.173507] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-09. [2025-09-23T17:25:47.904238] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-23T17:25:47.912910] [INFO ] [REMOTE ] AXTA: Full fetch complete (74746 records). [2025-09-23T17:25:47.913035] [DEBUG] [VALIDATOR ] AXTA: Validating primary data. [2025-09-23T17:25:48.304405] [DEBUG] [VALIDATOR ] AXTA: All expected trading days are present. [2025-09-23T17:25:48.304573] [DEBUG] [VALIDATOR ] AXTA: Primary data validation passed. [2025-09-23T17:25:48.305365] [INFO ] [MAIN ] AXTA: Fetched primary data is valid. [2025-09-23T17:25:48.305433] [DEBUG] [LOCAL ] AXTA: Saving primary data. [2025-09-23T17:25:48.307377] [DEBUG] [LOCAL ] AXTA: Trimmed 74746 records to 52056 (keeping 200 days of data) [2025-09-23T17:25:48.611431] [DEBUG] [LOCAL ] AXTA: Primary data saved (52056 records). [2025-09-23T17:25:48.611587] [INFO ] [MAIN ] AXTA: Full history saved. [2025-09-23T17:25:48.611699] [INFO ] [MAIN ] Update Progress: 200/2372 symbols completed. AXTA took 21.4s. Estimated remaining: 4h 39m 43s. Rate: 7.8 symbols/min [2025-09-23T17:25:49.305372] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:25:49.247582] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:25:49.331278] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:25:49.333731] [DEBUG] [LOCAL ] AYI: No existing data file found in primary storage. [2025-09-23T17:25:49.331501] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-09-23T17:25:49.338112] [WARN ] [MAIN ] AYI: No existing data found, performing full refresh instead. [2025-09-23T17:25:49.338285] [DEBUG] [LOCAL ] AZZ: No existing data file found in primary storage. [2025-09-23T17:25:49.338419] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-09-23T17:25:49.338720] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-09-23T17:25:49.388964] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-09-23T17:25:49.383481] [WARN ] [MAIN ] AZZ: No existing data found, performing full refresh instead. [2025-09-23T17:25:49.393892] [DEBUG] [LOCAL ] AYI: No primary data file found to delete. [2025-09-23T17:25:49.394120] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-09-23T17:25:49.394438] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-09-23T17:25:49.394380] [INFO ] [MAIN ] AZZ: Wiping existing primary data before full refresh. [2025-09-23T17:25:49.393274] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:25:49.394752] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-09-23T17:25:49.400008] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-09-23T17:25:49.426295] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-09-23T17:25:49.426229] [DEBUG] [LOCAL ] AZZ: No primary data file found to delete. [2025-09-23T17:25:49.426400] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-09-23T17:25:49.447946] [INFO ] [MAIN ] AZZ: Starting full primary refresh. [2025-09-23T17:25:49.886938] [DEBUG] [LOCAL ] AZO: Loaded 11466 existing records from primary storage. [2025-09-23T17:25:49.968849] [INFO ] [MAIN ] AZO: Loaded 11466 existing records. [2025-09-23T17:25:50.546505] [INFO ] [REMOTE ] AYI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:25:50.607387] [INFO ] [REMOTE ] AYI: Fetching primary data for 2024-12. [2025-09-23T17:25:50.606976] [WARN ] [MAIN ] AZO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:25:50.668850] [INFO ] [MAIN ] AZO: Wiping existing primary data before full refresh. [2025-09-23T17:25:50.692928] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-09-23T17:25:50.731475] [INFO ] [REMOTE ] B: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:25:50.738758] [DEBUG] [LOCAL ] AZO: Deleted primary data file. [2025-09-23T17:25:50.738606] [INFO ] [REMOTE ] AZZ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:25:50.739181] [INFO ] [REMOTE ] B: Fetching primary data for 2024-12. [2025-09-23T17:25:50.739308] [INFO ] [MAIN ] AZO: Starting full primary refresh. [2025-09-23T17:25:50.751678] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2024-12. [2025-09-23T17:25:51.096329] [INFO ] [REMOTE ] AZO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:25:51.096755] [INFO ] [REMOTE ] AZO: Fetching primary data for 2024-12. [2025-09-23T17:25:51.838507] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-23T17:25:51.842002] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-01. [2025-09-23T17:25:51.899142] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-23T17:25:51.903746] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-01. [2025-09-23T17:25:51.992037] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-23T17:25:51.997609] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-01. [2025-09-23T17:25:52.060228] [INFO ] [REMOTE ] B: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-23T17:25:52.067735] [INFO ] [REMOTE ] B: Fetching primary data for 2025-01. [2025-09-23T17:25:52.646232] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-23T17:25:52.649082] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-02. [2025-09-23T17:25:52.898105] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-23T17:25:52.915621] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-23T17:25:52.969875] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-23T17:25:53.002182] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-09-23T17:25:53.260024] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-23T17:25:53.757120] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-23T17:25:53.802153] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-09-23T17:25:54.602255] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-02. [2025-09-23T17:25:55.219126] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-23T17:25:55.402280] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-09-23T17:25:55.833284] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-23T17:25:56.202237] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-09-23T17:25:56.402697] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:25:56.403016] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-09-23T17:25:56.915680] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-23T17:25:57.002191] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-09-23T17:25:57.761324] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-23T17:25:57.802203] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-09-23T17:25:58.602220] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-03. [2025-09-23T17:25:58.737701] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-23T17:25:59.317892] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-23T17:25:59.402192] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-09-23T17:26:00.202214] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-03. [2025-09-23T17:26:00.262532] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-23T17:26:01.002231] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-04. [2025-09-23T17:26:01.388037] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-23T17:26:01.802309] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-04. [2025-09-23T17:26:02.578064] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-23T17:26:02.602170] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-05. [2025-09-23T17:26:02.869489] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-23T17:26:03.295919] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-23T17:26:03.402195] [INFO ] [REMOTE ] B: Fetching primary data for 2025-03. [2025-09-23T17:26:03.622986] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:26:03.623293] [WARN ] [REMOTE ] B: No data returned for month 2025-03 [2025-09-23T17:26:04.202232] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-06. [2025-09-23T17:26:04.825225] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-23T17:26:05.002235] [INFO ] [REMOTE ] B: Fetching primary data for 2025-04. [2025-09-23T17:26:05.329947] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:26:05.330281] [WARN ] [REMOTE ] B: No data returned for month 2025-04 [2025-09-23T17:26:05.802205] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-09-23T17:26:06.602222] [INFO ] [REMOTE ] B: Fetching primary data for 2025-05. [2025-09-23T17:26:07.062699] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-23T17:26:07.402233] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-09-23T17:26:08.202153] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-07. [2025-09-23T17:26:08.469783] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-23T17:26:08.564957] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-23T17:26:08.568917] [INFO ] [REMOTE ] AYI: Full fetch complete (36772 records). [2025-09-23T17:26:08.569039] [DEBUG] [VALIDATOR ] AYI: Validating primary data. [2025-09-23T17:26:08.994021] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-23T17:26:08.996550] [DEBUG] [VALIDATOR ] AYI: All expected trading days are present. [2025-09-23T17:26:08.996694] [DEBUG] [VALIDATOR ] AYI: Primary data validation passed. [2025-09-23T17:26:09.000568] [INFO ] [MAIN ] AYI: Fetched primary data is valid. [2025-09-23T17:26:09.000857] [DEBUG] [LOCAL ] AYI: Saving primary data. [2025-09-23T17:26:09.002217] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-08. [2025-09-23T17:26:09.004453] [DEBUG] [LOCAL ] AYI: Trimmed 36772 records to 25239 (keeping 200 days of data) [2025-09-23T17:26:09.178924] [DEBUG] [LOCAL ] AYI: Primary data saved (25239 records). [2025-09-23T17:26:09.179072] [INFO ] [MAIN ] AYI: Full history saved. [2025-09-23T17:26:09.179153] [INFO ] [MAIN ] Update Progress: 201/2372 symbols completed. AYI took 20.6s. Estimated remaining: 4h 41m 54s. Rate: 7.7 symbols/min [2025-09-23T17:26:09.389593] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:26:09.457992] [DEBUG] [LOCAL ] BA: Loaded 53791 existing records from primary storage. [2025-09-23T17:26:09.458154] [INFO ] [MAIN ] BA: Loaded 53791 existing records. [2025-09-23T17:26:09.663104] [WARN ] [MAIN ] BA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:26:09.671608] [INFO ] [MAIN ] BA: Wiping existing primary data before full refresh. [2025-09-23T17:26:09.672464] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-23T17:26:09.672586] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-09-23T17:26:09.678393] [DEBUG] [LOCAL ] BA: Deleted primary data file. [2025-09-23T17:26:09.678464] [INFO ] [MAIN ] BA: Starting full primary refresh. [2025-09-23T17:26:09.807338] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-09-23T17:26:10.078284] [INFO ] [REMOTE ] BA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:26:10.602156] [INFO ] [REMOTE ] BA: Fetching primary data for 2024-12. [2025-09-23T17:26:10.616892] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-23T17:26:10.619290] [INFO ] [REMOTE ] AZO: Full fetch complete (16394 records). [2025-09-23T17:26:10.619363] [DEBUG] [VALIDATOR ] AZO: Validating primary data. [2025-09-23T17:26:10.977433] [DEBUG] [VALIDATOR ] AZO: All expected trading days are present. [2025-09-23T17:26:10.977513] [DEBUG] [VALIDATOR ] AZO: Primary data validation passed. [2025-09-23T17:26:10.977812] [INFO ] [MAIN ] AZO: Fetched primary data is valid. [2025-09-23T17:26:10.977886] [DEBUG] [LOCAL ] AZO: Saving primary data. [2025-09-23T17:26:10.978408] [DEBUG] [LOCAL ] AZO: Trimmed 16394 records to 11496 (keeping 200 days of data) [2025-09-23T17:26:11.054726] [DEBUG] [LOCAL ] AZO: Primary data saved (11496 records). [2025-09-23T17:26:11.054860] [INFO ] [MAIN ] AZO: Full history saved. [2025-09-23T17:26:11.054965] [INFO ] [MAIN ] Update Progress: 202/2372 symbols completed. AZO took 22.4s. Estimated remaining: 4h 40m 43s. Rate: 7.7 symbols/min [2025-09-23T17:26:11.224210] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:26:11.289862] [DEBUG] [LOCAL ] BABA: Loaded 53820 existing records from primary storage. [2025-09-23T17:26:11.290031] [INFO ] [MAIN ] BABA: Loaded 53820 existing records. [2025-09-23T17:26:11.407501] [INFO ] [REMOTE ] B: Fetching primary data for 2025-06. [2025-09-23T17:26:11.480409] [WARN ] [MAIN ] BABA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:26:11.480739] [INFO ] [MAIN ] BABA: Wiping existing primary data before full refresh. [2025-09-23T17:26:11.480795] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-09-23T17:26:11.483355] [DEBUG] [LOCAL ] BABA: Deleted primary data file. [2025-09-23T17:26:11.483418] [INFO ] [MAIN ] BABA: Starting full primary refresh. [2025-09-23T17:26:11.835436] [INFO ] [REMOTE ] BABA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:26:12.202227] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-05. [2025-09-23T17:26:12.411680] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-23T17:26:12.997295] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-23T17:26:13.002195] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-01. [2025-09-23T17:26:13.148459] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-23T17:26:13.802196] [INFO ] [REMOTE ] BABA: Fetching primary data for 2024-12. [2025-09-23T17:26:14.602182] [INFO ] [REMOTE ] B: Fetching primary data for 2025-07. [2025-09-23T17:26:15.279032] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-09-23T17:26:15.402207] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-02. [2025-09-23T17:26:16.202163] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-06. [2025-09-23T17:26:16.256171] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-09-23T17:26:16.443726] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-23T17:26:17.002176] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-01. [2025-09-23T17:26:17.130364] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-23T17:26:17.331726] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-23T17:26:17.802204] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-07. [2025-09-23T17:26:18.602283] [INFO ] [REMOTE ] B: Fetching primary data for 2025-08. [2025-09-23T17:26:19.004856] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-23T17:26:19.127042] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-23T17:26:19.402196] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-02. [2025-09-23T17:26:20.202210] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-03. [2025-09-23T17:26:20.381211] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-23T17:26:21.002200] [INFO ] [REMOTE ] B: Fetching primary data for 2025-09. [2025-09-23T17:26:21.535682] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-23T17:26:21.802219] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-08. [2025-09-23T17:26:22.232291] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-23T17:26:22.549207] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-23T17:26:22.602200] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-04. [2025-09-23T17:26:22.899065] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-23T17:26:22.908740] [INFO ] [REMOTE ] B: Full fetch complete (44970 records). [2025-09-23T17:26:22.908972] [DEBUG] [VALIDATOR ] B: Validating primary data. [2025-09-23T17:26:23.125733] [WARN ] [VALIDATOR ] B: Validation failed - insufficient historical data. Have 128 unique days, need 200 days [2025-09-23T17:26:23.126289] [FATAL] [MAIN ] B: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:26:23.126375] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:26:23.126495] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-09-23T17:26:23.126588] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-09-23T17:26:23.126684] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-09-23T17:26:23.126776] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-09-23T17:26:23.126892] [INFO ] [MAIN ] Update Progress: 203/2372 symbols completed. B took 34.5s. Estimated remaining: 4h 41m 21s. Rate: 7.7 symbols/min [2025-09-23T17:26:23.299604] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:26:23.377287] [DEBUG] [LOCAL ] BAC: Loaded 53808 existing records from primary storage. [2025-09-23T17:26:23.377445] [INFO ] [MAIN ] BAC: Loaded 53808 existing records. [2025-09-23T17:26:23.409390] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-03. [2025-09-23T17:26:23.566409] [WARN ] [MAIN ] BAC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:26:23.566672] [INFO ] [MAIN ] BAC: Wiping existing primary data before full refresh. [2025-09-23T17:26:23.566731] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-09-23T17:26:23.569288] [DEBUG] [LOCAL ] BAC: Deleted primary data file. [2025-09-23T17:26:23.569349] [INFO ] [MAIN ] BAC: Starting full primary refresh. [2025-09-23T17:26:23.938876] [INFO ] [REMOTE ] BAC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:26:24.202197] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-09-23T17:26:24.792614] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-23T17:26:25.002327] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-05. [2025-09-23T17:26:25.260000] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-23T17:26:25.263715] [INFO ] [REMOTE ] AZZ: Full fetch complete (30832 records). [2025-09-23T17:26:25.263823] [DEBUG] [VALIDATOR ] AZZ: Validating primary data. [2025-09-23T17:26:25.659620] [DEBUG] [VALIDATOR ] AZZ: All expected trading days are present. [2025-09-23T17:26:25.659739] [DEBUG] [VALIDATOR ] AZZ: Primary data validation passed. [2025-09-23T17:26:25.660146] [INFO ] [MAIN ] AZZ: Fetched primary data is valid. [2025-09-23T17:26:25.660198] [DEBUG] [LOCAL ] AZZ: Saving primary data. [2025-09-23T17:26:25.661363] [DEBUG] [LOCAL ] AZZ: Trimmed 30832 records to 22139 (keeping 200 days of data) [2025-09-23T17:26:25.802626] [INFO ] [REMOTE ] BAC: Fetching primary data for 2024-12. [2025-09-23T17:26:25.830033] [DEBUG] [LOCAL ] AZZ: Primary data saved (22139 records). [2025-09-23T17:26:25.830180] [INFO ] [MAIN ] AZZ: Full history saved. [2025-09-23T17:26:25.830265] [INFO ] [MAIN ] Update Progress: 204/2372 symbols completed. AZZ took 37.2s. Estimated remaining: 4h 40m 19s. Rate: 7.7 symbols/min [2025-09-23T17:26:26.025067] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:26:26.100098] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-03 (2.69 seconds). [2025-09-23T17:26:26.129004] [DEBUG] [LOCAL ] BAH: Loaded 51749 existing records from primary storage. [2025-09-23T17:26:26.129168] [INFO ] [MAIN ] BAH: Loaded 51749 existing records. [2025-09-23T17:26:26.309931] [WARN ] [MAIN ] BAH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:26:26.310241] [INFO ] [MAIN ] BAH: Wiping existing primary data before full refresh. [2025-09-23T17:26:26.310300] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-09-23T17:26:26.312706] [DEBUG] [LOCAL ] BAH: Deleted primary data file. [2025-09-23T17:26:26.312800] [INFO ] [MAIN ] BAH: Starting full primary refresh. [2025-09-23T17:26:26.607445] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-04. [2025-09-23T17:26:26.679065] [INFO ] [REMOTE ] BAH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:26:27.402243] [INFO ] [REMOTE ] BAH: Fetching primary data for 2024-12. [2025-09-23T17:26:27.473880] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-09-23T17:26:27.563507] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-23T17:26:28.202273] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-01. [2025-09-23T17:26:28.786735] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-23T17:26:28.935444] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-23T17:26:29.002155] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-05. [2025-09-23T17:26:29.802244] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-01. [2025-09-23T17:26:30.229872] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-23T17:26:30.602208] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-02. [2025-09-23T17:26:31.063176] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-23T17:26:31.137317] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-23T17:26:31.402198] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-06. [2025-09-23T17:26:32.202235] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-02. [2025-09-23T17:26:32.480863] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-23T17:26:33.002248] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-06. [2025-09-23T17:26:33.509486] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-23T17:26:33.802220] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-03. [2025-09-23T17:26:33.989619] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-06 (2.59 seconds). [2025-09-23T17:26:34.602173] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-07. [2025-09-23T17:26:34.745306] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-23T17:26:35.402231] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-03. [2025-09-23T17:26:36.134474] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-09-23T17:26:36.202160] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-04. [2025-09-23T17:26:36.678957] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-23T17:26:36.913900] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-23T17:26:37.002190] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-04. [2025-09-23T17:26:37.802193] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-07. [2025-09-23T17:26:38.403790] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-23T17:26:38.602189] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-05. [2025-09-23T17:26:38.892391] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-23T17:26:39.402210] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-05. [2025-09-23T17:26:39.885094] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-23T17:26:40.202199] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-08. [2025-09-23T17:26:40.674407] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-23T17:26:40.815262] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-23T17:26:41.002193] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-06. [2025-09-23T17:26:41.802245] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-06. [2025-09-23T17:26:42.172153] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-23T17:26:42.602248] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-09-23T17:26:42.903872] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-23T17:26:43.130867] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-23T17:26:43.402265] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-07. [2025-09-23T17:26:44.202250] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-08. [2025-09-23T17:26:44.821223] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-23T17:26:44.856820] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-23T17:26:44.867736] [INFO ] [REMOTE ] BA: Full fetch complete (77925 records). [2025-09-23T17:26:44.867879] [DEBUG] [VALIDATOR ] BA: Validating primary data. [2025-09-23T17:26:45.007409] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-08. [2025-09-23T17:26:45.269572] [DEBUG] [VALIDATOR ] BA: All expected trading days are present. [2025-09-23T17:26:45.269693] [DEBUG] [VALIDATOR ] BA: Primary data validation passed. [2025-09-23T17:26:45.270546] [INFO ] [MAIN ] BA: Fetched primary data is valid. [2025-09-23T17:26:45.270611] [DEBUG] [LOCAL ] BA: Saving primary data. [2025-09-23T17:26:45.272183] [DEBUG] [LOCAL ] BA: Trimmed 77925 records to 53791 (keeping 200 days of data) [2025-09-23T17:26:45.604234] [DEBUG] [LOCAL ] BA: Primary data saved (53791 records). [2025-09-23T17:26:45.604383] [INFO ] [MAIN ] BA: Full history saved. [2025-09-23T17:26:45.604468] [INFO ] [MAIN ] Update Progress: 205/2372 symbols completed. BA took 36.4s. Estimated remaining: 4h 42m 18s. Rate: 7.7 symbols/min [2025-09-23T17:26:45.827167] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-07. [2025-09-23T17:26:45.829814] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:26:45.872673] [DEBUG] [LOCAL ] BAK: Loaded 38789 existing records from primary storage. [2025-09-23T17:26:45.872845] [INFO ] [MAIN ] BAK: Loaded 38789 existing records. [2025-09-23T17:26:46.053079] [WARN ] [MAIN ] BAK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:26:46.053316] [INFO ] [MAIN ] BAK: Wiping existing primary data before full refresh. [2025-09-23T17:26:46.053378] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-09-23T17:26:46.055039] [DEBUG] [LOCAL ] BAK: Deleted primary data file. [2025-09-23T17:26:46.055113] [INFO ] [MAIN ] BAK: Starting full primary refresh. [2025-09-23T17:26:46.429014] [INFO ] [REMOTE ] BAK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:26:46.499867] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-09-23T17:26:46.540713] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-23T17:26:46.602160] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-09. [2025-09-23T17:26:47.402209] [INFO ] [REMOTE ] BAK: Fetching primary data for 2024-12. [2025-09-23T17:26:47.642086] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-23T17:26:48.025618] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-23T17:26:48.035034] [INFO ] [REMOTE ] BAH: Full fetch complete (74446 records). [2025-09-23T17:26:48.035269] [DEBUG] [VALIDATOR ] BAH: Validating primary data. [2025-09-23T17:26:48.036346] [FATAL] [VALIDATOR ] BAH: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:26:48.036476] [FATAL] [MAIN ] BAH: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:26:48.036553] [WARN ] [MAIN ] BAH: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:26:48.036678] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-09-23T17:26:48.036787] [DEBUG] [LOCAL ] BAH: No primary data file found to delete. [2025-09-23T17:26:48.036860] [INFO ] [LOCAL ] BAH: Starting deletion of derivative data. [2025-09-23T17:26:48.037382] [DEBUG] [LOCAL ] BAH: Deleted derivative data file. [2025-09-23T17:26:48.042449] [INFO ] [MAIN ] Update Progress: 206/2372 symbols completed. BAH took 22.2s. Estimated remaining: 4h 41m 14s. Rate: 7.7 symbols/min [2025-09-23T17:26:48.209507] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-09. [2025-09-23T17:26:48.332845] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:26:48.432012] [DEBUG] [LOCAL ] BALL: Loaded 51825 existing records from primary storage. [2025-09-23T17:26:48.432234] [INFO ] [MAIN ] BALL: Loaded 51825 existing records. [2025-09-23T17:26:48.724841] [WARN ] [MAIN ] BALL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:26:48.751176] [INFO ] [MAIN ] BALL: Wiping existing primary data before full refresh. [2025-09-23T17:26:48.751785] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-09-23T17:26:48.753398] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-23T17:26:48.763209] [DEBUG] [LOCAL ] BALL: Deleted primary data file. [2025-09-23T17:26:48.764338] [INFO ] [MAIN ] BALL: Starting full primary refresh. [2025-09-23T17:26:49.007354] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-08. [2025-09-23T17:26:49.159678] [INFO ] [REMOTE ] BALL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:26:49.802244] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-01. [2025-09-23T17:26:50.602304] [INFO ] [REMOTE ] BALL: Fetching primary data for 2024-12. [2025-09-23T17:26:50.940691] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-09 (2.73 seconds). [2025-09-23T17:26:50.950977] [INFO ] [REMOTE ] BABA: Full fetch complete (77983 records). [2025-09-23T17:26:50.951183] [DEBUG] [VALIDATOR ] BABA: Validating primary data. [2025-09-23T17:26:51.299857] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-23T17:26:51.406128] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-02. [2025-09-23T17:26:51.433451] [DEBUG] [VALIDATOR ] BABA: All expected trading days are present. [2025-09-23T17:26:51.433576] [DEBUG] [VALIDATOR ] BABA: Primary data validation passed. [2025-09-23T17:26:51.434577] [INFO ] [MAIN ] BABA: Fetched primary data is valid. [2025-09-23T17:26:51.434813] [DEBUG] [LOCAL ] BABA: Saving primary data. [2025-09-23T17:26:51.470761] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-09-23T17:26:51.468500] [DEBUG] [LOCAL ] BABA: Trimmed 77983 records to 53820 (keeping 200 days of data) [2025-09-23T17:26:51.866009] [DEBUG] [LOCAL ] BABA: Primary data saved (53820 records). [2025-09-23T17:26:51.866267] [INFO ] [MAIN ] BABA: Full history saved. [2025-09-23T17:26:51.866551] [INFO ] [MAIN ] Update Progress: 207/2372 symbols completed. BABA took 40.8s. Estimated remaining: 4h 40m 25s. Rate: 7.7 symbols/min [2025-09-23T17:26:52.038377] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:26:52.038616] [DEBUG] [LOCAL ] BALY: No existing data file found in primary storage. [2025-09-23T17:26:52.038798] [WARN ] [MAIN ] BALY: No existing data found, performing full refresh instead. [2025-09-23T17:26:52.039025] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-09-23T17:26:52.039095] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-09-23T17:26:52.039156] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-09-23T17:26:52.039193] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-09-23T17:26:52.207328] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-09-23T17:26:52.263325] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-23T17:26:52.444808] [INFO ] [REMOTE ] BALY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:26:52.477074] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-23T17:26:53.002178] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-03. [2025-09-23T17:26:53.802242] [INFO ] [REMOTE ] BALY: Fetching primary data for 2024-12. [2025-09-23T17:26:53.997096] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-23T17:26:54.602180] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-01. [2025-09-23T17:26:54.635977] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-09-23T17:26:54.645373] [INFO ] [REMOTE ] BAC: Full fetch complete (77943 records). [2025-09-23T17:26:54.645517] [DEBUG] [VALIDATOR ] BAC: Validating primary data. [2025-09-23T17:26:54.805677] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-23T17:26:55.068451] [DEBUG] [VALIDATOR ] BAC: All expected trading days are present. [2025-09-23T17:26:55.068559] [DEBUG] [VALIDATOR ] BAC: Primary data validation passed. [2025-09-23T17:26:55.069358] [INFO ] [MAIN ] BAC: Fetched primary data is valid. [2025-09-23T17:26:55.069426] [DEBUG] [LOCAL ] BAC: Saving primary data. [2025-09-23T17:26:55.071082] [DEBUG] [LOCAL ] BAC: Trimmed 77943 records to 53808 (keeping 200 days of data) [2025-09-23T17:26:55.402713] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-01. [2025-09-23T17:26:55.417883] [DEBUG] [LOCAL ] BAC: Primary data saved (53808 records). [2025-09-23T17:26:55.418022] [INFO ] [MAIN ] BAC: Full history saved. [2025-09-23T17:26:55.418106] [INFO ] [MAIN ] Update Progress: 208/2372 symbols completed. BAC took 32.3s. Estimated remaining: 4h 39m 33s. Rate: 7.7 symbols/min [2025-09-23T17:26:55.600339] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:26:55.653201] [DEBUG] [LOCAL ] BAM: Loaded 52009 existing records from primary storage. [2025-09-23T17:26:55.653368] [INFO ] [MAIN ] BAM: Loaded 52009 existing records. [2025-09-23T17:26:55.844384] [WARN ] [MAIN ] BAM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:26:55.845064] [INFO ] [MAIN ] BAM: Wiping existing primary data before full refresh. [2025-09-23T17:26:55.845453] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-09-23T17:26:55.847899] [DEBUG] [LOCAL ] BAM: Deleted primary data file. [2025-09-23T17:26:55.848029] [INFO ] [MAIN ] BAM: Starting full primary refresh. [2025-09-23T17:26:55.991697] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-23T17:26:56.212398] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-04. [2025-09-23T17:26:56.260141] [INFO ] [REMOTE ] BAM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:26:56.276552] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-23T17:26:57.002196] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-09-23T17:26:57.385765] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-23T17:26:57.597504] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-23T17:26:57.802203] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-05. [2025-09-23T17:26:58.602207] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-02. [2025-09-23T17:26:59.192204] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-23T17:26:59.402247] [INFO ] [REMOTE ] BAM: Fetching primary data for 2024-12. [2025-09-23T17:27:00.013070] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-23T17:27:00.202205] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-03. [2025-09-23T17:27:00.864942] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-23T17:27:01.002199] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-01. [2025-09-23T17:27:01.802239] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-09-23T17:27:02.602220] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-06. [2025-09-23T17:27:02.690099] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-03 (2.49 seconds). [2025-09-23T17:27:03.208393] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-09-23T17:27:03.402220] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-02. [2025-09-23T17:27:03.748615] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-23T17:27:04.202200] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-04. [2025-09-23T17:27:04.776534] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-23T17:27:04.884069] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-09-23T17:27:05.002151] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-07. [2025-09-23T17:27:05.709555] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-23T17:27:05.802143] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-05. [2025-09-23T17:27:06.254597] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-23T17:27:06.602182] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-09-23T17:27:07.153263] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-23T17:27:07.305782] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-23T17:27:07.402217] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-06. [2025-09-23T17:27:08.202186] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-08. [2025-09-23T17:27:08.618176] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-23T17:27:09.002194] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-07. [2025-09-23T17:27:09.373946] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-23T17:27:09.802193] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-09-23T17:27:10.447109] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-23T17:27:10.602223] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-03. [2025-09-23T17:27:10.975984] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-23T17:27:10.982551] [INFO ] [REMOTE ] BAK: Full fetch complete (57062 records). [2025-09-23T17:27:10.982751] [DEBUG] [VALIDATOR ] BAK: Validating primary data. [2025-09-23T17:27:11.365544] [DEBUG] [VALIDATOR ] BAK: All expected trading days are present. [2025-09-23T17:27:11.365635] [DEBUG] [VALIDATOR ] BAK: Primary data validation passed. [2025-09-23T17:27:11.366279] [INFO ] [MAIN ] BAK: Fetched primary data is valid. [2025-09-23T17:27:11.366325] [DEBUG] [LOCAL ] BAK: Saving primary data. [2025-09-23T17:27:11.367602] [DEBUG] [LOCAL ] BAK: Trimmed 57062 records to 38785 (keeping 200 days of data) [2025-09-23T17:27:11.411244] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-08. [2025-09-23T17:27:11.588077] [DEBUG] [LOCAL ] BAK: Primary data saved (38785 records). [2025-09-23T17:27:11.588232] [INFO ] [MAIN ] BAK: Full history saved. [2025-09-23T17:27:11.588316] [INFO ] [MAIN ] Update Progress: 209/2372 symbols completed. BAK took 26.0s. Estimated remaining: 4h 40m 52s. Rate: 7.7 symbols/min [2025-09-23T17:27:11.756200] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:27:11.808492] [DEBUG] [LOCAL ] BANC: Loaded 51261 existing records from primary storage. [2025-09-23T17:27:11.808676] [INFO ] [MAIN ] BANC: Loaded 51261 existing records. [2025-09-23T17:27:11.984120] [WARN ] [MAIN ] BANC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:27:11.984376] [INFO ] [MAIN ] BANC: Wiping existing primary data before full refresh. [2025-09-23T17:27:11.984431] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-09-23T17:27:11.986488] [DEBUG] [LOCAL ] BANC: Deleted primary data file. [2025-09-23T17:27:11.986551] [INFO ] [MAIN ] BANC: Starting full primary refresh. [2025-09-23T17:27:12.223467] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-09-23T17:27:12.352433] [INFO ] [REMOTE ] BANC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:27:12.539959] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-23T17:27:12.890706] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-23T17:27:13.002157] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-04. [2025-09-23T17:27:13.146600] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-23T17:27:13.802261] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-09-23T17:27:14.323937] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-23T17:27:14.447463] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-23T17:27:14.602192] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-05. [2025-09-23T17:27:15.402245] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-09-23T17:27:16.202198] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-09-23T17:27:16.849415] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-09-23T17:27:16.905480] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-23T17:27:17.002209] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-09-23T17:27:17.540070] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-23T17:27:17.539766] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-23T17:27:17.552433] [INFO ] [REMOTE ] BALL: Full fetch complete (75356 records). [2025-09-23T17:27:17.552741] [DEBUG] [VALIDATOR ] BALL: Validating primary data. [2025-09-23T17:27:17.808680] [INFO ] [REMOTE ] BANC: Fetching primary data for 2024-12. [2025-09-23T17:27:17.974874] [DEBUG] [VALIDATOR ] BALL: All expected trading days are present. [2025-09-23T17:27:17.975006] [DEBUG] [VALIDATOR ] BALL: Primary data validation passed. [2025-09-23T17:27:17.976087] [INFO ] [MAIN ] BALL: Fetched primary data is valid. [2025-09-23T17:27:17.976211] [DEBUG] [LOCAL ] BALL: Saving primary data. [2025-09-23T17:27:17.979002] [DEBUG] [LOCAL ] BALL: Trimmed 75356 records to 51815 (keeping 200 days of data) [2025-09-23T17:27:18.326679] [DEBUG] [LOCAL ] BALL: Primary data saved (51815 records). [2025-09-23T17:27:18.326929] [INFO ] [MAIN ] BALL: Full history saved. [2025-09-23T17:27:18.327049] [INFO ] [MAIN ] Update Progress: 210/2372 symbols completed. BALL took 30.3s. Estimated remaining: 4h 40m 34s. Rate: 7.7 symbols/min [2025-09-23T17:27:18.515932] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:27:18.547029] [DEBUG] [LOCAL ] BAP: Loaded 26391 existing records from primary storage. [2025-09-23T17:27:18.547251] [INFO ] [MAIN ] BAP: Loaded 26391 existing records. [2025-09-23T17:27:18.608048] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-09-23T17:27:18.746395] [WARN ] [MAIN ] BAP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:27:18.746900] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-09-23T17:27:18.746953] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-09-23T17:27:18.748263] [DEBUG] [LOCAL ] BAP: Deleted primary data file. [2025-09-23T17:27:18.748327] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-09-23T17:27:19.135194] [INFO ] [REMOTE ] BAP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:27:19.229285] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-23T17:27:19.231463] [INFO ] [REMOTE ] BALY: Full fetch complete (17420 records). [2025-09-23T17:27:19.231537] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-09-23T17:27:19.410735] [INFO ] [REMOTE ] BAP: Fetching primary data for 2024-12. [2025-09-23T17:27:19.423936] [WARN ] [VALIDATOR ] BALY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-23T17:27:19.425558] [FATAL] [MAIN ] BALY: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:27:19.425714] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:27:19.425795] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-09-23T17:27:19.425976] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-09-23T17:27:19.426049] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-09-23T17:27:19.426220] [DEBUG] [LOCAL ] BALY: No derivative data file found to delete. [2025-09-23T17:27:19.426464] [INFO ] [MAIN ] Update Progress: 211/2372 symbols completed. BALY took 27.6s. Estimated remaining: 4h 39m 18s. Rate: 7.7 symbols/min [2025-09-23T17:27:19.617384] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-23T17:27:19.646288] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:27:19.689123] [DEBUG] [LOCAL ] BARK: Loaded 38462 existing records from primary storage. [2025-09-23T17:27:19.689310] [INFO ] [MAIN ] BARK: Loaded 38462 existing records. [2025-09-23T17:27:19.870702] [WARN ] [MAIN ] BARK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:27:19.870941] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-09-23T17:27:19.870988] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-09-23T17:27:19.872407] [DEBUG] [LOCAL ] BARK: Deleted primary data file. [2025-09-23T17:27:19.872489] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-09-23T17:27:20.208388] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-06. [2025-09-23T17:27:20.239016] [INFO ] [REMOTE ] BARK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:27:20.408517] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-23T17:27:21.002188] [INFO ] [REMOTE ] BARK: Fetching primary data for 2024-12. [2025-09-23T17:27:21.409462] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-23T17:27:21.802253] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-01. [2025-09-23T17:27:22.270796] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-23T17:27:22.602227] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-01. [2025-09-23T17:27:23.141239] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-23T17:27:23.402244] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-02. [2025-09-23T17:27:23.460286] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-23T17:27:24.202203] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-09-23T17:27:24.779118] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-23T17:27:25.002164] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-03. [2025-09-23T17:27:25.041971] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-23T17:27:25.802210] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-07. [2025-09-23T17:27:26.602172] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-01. [2025-09-23T17:27:26.760685] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-23T17:27:27.295870] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-23T17:27:27.402250] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-04. [2025-09-23T17:27:27.869202] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-23T17:27:28.202258] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-08. [2025-09-23T17:27:28.865278] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-23T17:27:29.002197] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-09-23T17:27:29.802181] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-05. [2025-09-23T17:27:29.854550] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-23T17:27:30.032775] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-23T17:27:30.602230] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-09. [2025-09-23T17:27:31.047555] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-23T17:27:31.402207] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-09-23T17:27:31.922384] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-23T17:27:31.931070] [INFO ] [REMOTE ] BAM: Full fetch complete (74001 records). [2025-09-23T17:27:31.931200] [DEBUG] [VALIDATOR ] BAM: Validating primary data. [2025-09-23T17:27:32.207481] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-06. [2025-09-23T17:27:32.337556] [DEBUG] [VALIDATOR ] BAM: All expected trading days are present. [2025-09-23T17:27:32.338004] [DEBUG] [VALIDATOR ] BAM: Primary data validation passed. [2025-09-23T17:27:32.339188] [INFO ] [MAIN ] BAM: Fetched primary data is valid. [2025-09-23T17:27:32.339264] [DEBUG] [LOCAL ] BAM: Saving primary data. [2025-09-23T17:27:32.341309] [DEBUG] [LOCAL ] BAM: Trimmed 74001 records to 52005 (keeping 200 days of data) [2025-09-23T17:27:32.598587] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-23T17:27:32.702571] [DEBUG] [LOCAL ] BAM: Primary data saved (52005 records). [2025-09-23T17:27:32.702744] [INFO ] [MAIN ] BAM: Full history saved. [2025-09-23T17:27:32.702842] [INFO ] [MAIN ] Update Progress: 212/2372 symbols completed. BAM took 37.3s. Estimated remaining: 4h 40m 6s. Rate: 7.7 symbols/min [2025-09-23T17:27:32.876339] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:27:32.933581] [DEBUG] [LOCAL ] BAX: Loaded 53491 existing records from primary storage. [2025-09-23T17:27:32.933769] [INFO ] [MAIN ] BAX: Loaded 53491 existing records. [2025-09-23T17:27:33.009246] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-09-23T17:27:33.127980] [WARN ] [MAIN ] BAX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:27:33.128233] [INFO ] [MAIN ] BAX: Wiping existing primary data before full refresh. [2025-09-23T17:27:33.128283] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-09-23T17:27:33.130803] [DEBUG] [LOCAL ] BAX: Deleted primary data file. [2025-09-23T17:27:33.130870] [INFO ] [MAIN ] BAX: Starting full primary refresh. [2025-09-23T17:27:33.529784] [INFO ] [REMOTE ] BAX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:27:33.588324] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-23T17:27:33.802209] [INFO ] [REMOTE ] BAX: Fetching primary data for 2024-12. [2025-09-23T17:27:33.989311] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-23T17:27:34.602246] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-07. [2025-09-23T17:27:35.344569] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-23T17:27:35.402161] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-01. [2025-09-23T17:27:35.909323] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-23T17:27:36.202191] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-09-23T17:27:36.723795] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-23T17:27:37.002183] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-02. [2025-09-23T17:27:37.296718] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-23T17:27:37.802271] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-08. [2025-09-23T17:27:38.387605] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-23T17:27:38.602195] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-03. [2025-09-23T17:27:39.092337] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-23T17:27:39.402215] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-09-23T17:27:40.042854] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-23T17:27:40.202235] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-09-23T17:27:40.801165] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-23T17:27:40.813276] [INFO ] [REMOTE ] BANC: Full fetch complete (74061 records). [2025-09-23T17:27:40.813509] [DEBUG] [VALIDATOR ] BANC: Validating primary data. [2025-09-23T17:27:41.007393] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-04. [2025-09-23T17:27:41.410381] [DEBUG] [VALIDATOR ] BANC: All expected trading days are present. [2025-09-23T17:27:41.410498] [DEBUG] [VALIDATOR ] BANC: Primary data validation passed. [2025-09-23T17:27:41.411297] [INFO ] [MAIN ] BANC: Fetched primary data is valid. [2025-09-23T17:27:41.411388] [DEBUG] [LOCAL ] BANC: Saving primary data. [2025-09-23T17:27:41.430562] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-23T17:27:41.436341] [DEBUG] [LOCAL ] BANC: Trimmed 74061 records to 51262 (keeping 200 days of data) [2025-09-23T17:27:41.767120] [DEBUG] [LOCAL ] BANC: Primary data saved (51262 records). [2025-09-23T17:27:41.767314] [INFO ] [MAIN ] BANC: Full history saved. [2025-09-23T17:27:41.767421] [INFO ] [MAIN ] Update Progress: 213/2372 symbols completed. BANC took 30.2s. Estimated remaining: 4h 40m 11s. Rate: 7.7 symbols/min [2025-09-23T17:27:41.807357] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-09-23T17:27:41.950761] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:27:42.002976] [DEBUG] [LOCAL ] BB: Loaded 52923 existing records from primary storage. [2025-09-23T17:27:42.003128] [INFO ] [MAIN ] BB: Loaded 52923 existing records. [2025-09-23T17:27:42.187109] [WARN ] [MAIN ] BB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:27:42.187424] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-09-23T17:27:42.187473] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-09-23T17:27:42.189426] [DEBUG] [LOCAL ] BB: Deleted primary data file. [2025-09-23T17:27:42.189489] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-09-23T17:27:42.544374] [INFO ] [REMOTE ] BB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:27:42.602324] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-09-23T17:27:42.778571] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-23T17:27:42.818088] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-23T17:27:43.402205] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-09-23T17:27:43.652163] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-23T17:27:44.168394] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-23T17:27:44.202162] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-09-23T17:27:45.002254] [INFO ] [REMOTE ] BB: Fetching primary data for 2024-12. [2025-09-23T17:27:45.366244] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-23T17:27:45.802234] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-05. [2025-09-23T17:27:46.602200] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-09-23T17:27:46.747969] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-23T17:27:47.354124] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-23T17:27:47.402182] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-06. [2025-09-23T17:27:47.543527] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-23T17:27:48.202212] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-01. [2025-09-23T17:27:49.002168] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-09-23T17:27:49.047865] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-23T17:27:49.805852] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-07. [2025-09-23T17:27:49.811200] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-23T17:27:49.902797] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-23T17:27:49.908492] [INFO ] [REMOTE ] BAP: Full fetch complete (38056 records). [2025-09-23T17:27:49.908683] [DEBUG] [VALIDATOR ] BAP: Validating primary data. [2025-09-23T17:27:50.292941] [DEBUG] [VALIDATOR ] BAP: All expected trading days are present. [2025-09-23T17:27:50.293036] [DEBUG] [VALIDATOR ] BAP: Primary data validation passed. [2025-09-23T17:27:50.293520] [INFO ] [MAIN ] BAP: Fetched primary data is valid. [2025-09-23T17:27:50.293565] [DEBUG] [LOCAL ] BAP: Saving primary data. [2025-09-23T17:27:50.294539] [DEBUG] [LOCAL ] BAP: Trimmed 38056 records to 26398 (keeping 200 days of data) [2025-09-23T17:27:50.463897] [DEBUG] [LOCAL ] BAP: Primary data saved (26398 records). [2025-09-23T17:27:50.464059] [INFO ] [MAIN ] BAP: Full history saved. [2025-09-23T17:27:50.464158] [INFO ] [MAIN ] Update Progress: 214/2372 symbols completed. BAP took 32.1s. Estimated remaining: 4h 40m 13s. Rate: 7.7 symbols/min [2025-09-23T17:27:50.607858] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-09-23T17:27:50.642695] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:27:50.696443] [DEBUG] [LOCAL ] BBAI: Loaded 53820 existing records from primary storage. [2025-09-23T17:27:50.696631] [INFO ] [MAIN ] BBAI: Loaded 53820 existing records. [2025-09-23T17:27:50.890414] [WARN ] [MAIN ] BBAI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:27:50.890745] [INFO ] [MAIN ] BBAI: Wiping existing primary data before full refresh. [2025-09-23T17:27:50.890803] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-09-23T17:27:50.893774] [DEBUG] [LOCAL ] BBAI: Deleted primary data file. [2025-09-23T17:27:50.893842] [INFO ] [MAIN ] BBAI: Starting full primary refresh. [2025-09-23T17:27:51.265036] [INFO ] [REMOTE ] BBAI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:27:51.335873] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-23T17:27:51.402215] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-08. [2025-09-23T17:27:52.212718] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2024-12. [2025-09-23T17:27:52.218237] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-23T17:27:52.887097] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-23T17:27:53.002219] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-09-23T17:27:53.802298] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-09-23T17:27:54.607741] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-09-23T17:27:54.629104] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2024-12 (2.42 seconds). [2025-09-23T17:27:54.908806] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-23T17:27:54.917787] [INFO ] [REMOTE ] BAX: Full fetch complete (77436 records). [2025-09-23T17:27:54.917910] [DEBUG] [VALIDATOR ] BAX: Validating primary data. [2025-09-23T17:27:55.340570] [DEBUG] [VALIDATOR ] BAX: All expected trading days are present. [2025-09-23T17:27:55.341057] [DEBUG] [VALIDATOR ] BAX: Primary data validation passed. [2025-09-23T17:27:55.342365] [INFO ] [MAIN ] BAX: Fetched primary data is valid. [2025-09-23T17:27:55.352565] [DEBUG] [LOCAL ] BAX: Saving primary data. [2025-09-23T17:27:55.370922] [DEBUG] [LOCAL ] BAX: Trimmed 77436 records to 53493 (keeping 200 days of data) [2025-09-23T17:27:55.371993] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-23T17:27:55.439316] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-09-23T17:27:55.713265] [DEBUG] [LOCAL ] BAX: Primary data saved (53493 records). [2025-09-23T17:27:55.713409] [INFO ] [MAIN ] BAX: Full history saved. [2025-09-23T17:27:55.713511] [INFO ] [MAIN ] Update Progress: 215/2372 symbols completed. BAX took 23.0s. Estimated remaining: 4h 39m 39s. Rate: 7.7 symbols/min [2025-09-23T17:27:55.882557] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:27:55.924328] [DEBUG] [LOCAL ] BBAR: Loaded 41183 existing records from primary storage. [2025-09-23T17:27:55.924481] [INFO ] [MAIN ] BBAR: Loaded 41183 existing records. [2025-09-23T17:27:56.109845] [WARN ] [MAIN ] BBAR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:27:56.110357] [INFO ] [MAIN ] BBAR: Wiping existing primary data before full refresh. [2025-09-23T17:27:56.110464] [INFO ] [LOCAL ] BBAR: Starting deletion of primary data. [2025-09-23T17:27:56.112877] [DEBUG] [LOCAL ] BBAR: Deleted primary data file. [2025-09-23T17:27:56.112949] [INFO ] [MAIN ] BBAR: Starting full primary refresh. [2025-09-23T17:27:56.210121] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-01. [2025-09-23T17:27:56.482943] [INFO ] [REMOTE ] BBAR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:27:56.504051] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-23T17:27:56.612446] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-23T17:27:57.002203] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-09-23T17:27:57.802200] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-09-23T17:27:58.096811] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-23T17:27:58.602148] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-02. [2025-09-23T17:27:59.025083] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-23T17:27:59.052375] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-23T17:27:59.058472] [INFO ] [REMOTE ] BARK: Full fetch complete (57167 records). [2025-09-23T17:27:59.058584] [DEBUG] [VALIDATOR ] BARK: Validating primary data. [2025-09-23T17:27:59.407270] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-09-23T17:27:59.452916] [DEBUG] [VALIDATOR ] BARK: All expected trading days are present. [2025-09-23T17:27:59.452998] [DEBUG] [VALIDATOR ] BARK: Primary data validation passed. [2025-09-23T17:27:59.453633] [INFO ] [MAIN ] BARK: Fetched primary data is valid. [2025-09-23T17:27:59.453732] [DEBUG] [LOCAL ] BARK: Saving primary data. [2025-09-23T17:27:59.454988] [DEBUG] [LOCAL ] BARK: Trimmed 57167 records to 38517 (keeping 200 days of data) [2025-09-23T17:27:59.684835] [DEBUG] [LOCAL ] BARK: Primary data saved (38517 records). [2025-09-23T17:27:59.685209] [INFO ] [MAIN ] BARK: Full history saved. [2025-09-23T17:27:59.685580] [INFO ] [MAIN ] Update Progress: 216/2372 symbols completed. BARK took 40.3s. Estimated remaining: 4h 38m 54s. Rate: 7.7 symbols/min [2025-09-23T17:27:59.858864] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:27:59.914142] [DEBUG] [LOCAL ] BBD: Loaded 53179 existing records from primary storage. [2025-09-23T17:27:59.914353] [INFO ] [MAIN ] BBD: Loaded 53179 existing records. [2025-09-23T17:28:00.104102] [WARN ] [MAIN ] BBD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:28:00.104385] [INFO ] [MAIN ] BBD: Wiping existing primary data before full refresh. [2025-09-23T17:28:00.104460] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-09-23T17:28:00.106820] [DEBUG] [LOCAL ] BBD: Deleted primary data file. [2025-09-23T17:28:00.106884] [INFO ] [MAIN ] BBD: Starting full primary refresh. [2025-09-23T17:28:00.209175] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2024-12. [2025-09-23T17:28:00.505253] [INFO ] [REMOTE ] BBD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:28:00.931453] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-23T17:28:01.002161] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-05. [2025-09-23T17:28:01.199821] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-02 (2.60 seconds). [2025-09-23T17:28:01.344162] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-23T17:28:01.802216] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-01. [2025-09-23T17:28:02.602195] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-03. [2025-09-23T17:28:02.696551] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-23T17:28:02.993218] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-23T17:28:03.402234] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-06. [2025-09-23T17:28:04.202270] [INFO ] [REMOTE ] BBD: Fetching primary data for 2024-12. [2025-09-23T17:28:05.002179] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-02. [2025-09-23T17:28:05.076266] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-09-23T17:28:05.335821] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-23T17:28:05.665560] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-23T17:28:05.802193] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-01. [2025-09-23T17:28:06.146626] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-23T17:28:06.602207] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-03. [2025-09-23T17:28:07.328544] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-23T17:28:07.402159] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-02. [2025-09-23T17:28:07.919512] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-23T17:28:08.202187] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-07. [2025-09-23T17:28:09.002148] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-04. [2025-09-23T17:28:09.059942] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-23T17:28:09.802347] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-03. [2025-09-23T17:28:09.940485] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-23T17:28:10.222623] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-23T17:28:10.602249] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-08. [2025-09-23T17:28:11.411439] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-04. [2025-09-23T17:28:11.418063] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-23T17:28:11.898373] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-23T17:28:12.202198] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-04. [2025-09-23T17:28:13.002247] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-05. [2025-09-23T17:28:13.433892] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-23T17:28:13.667428] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-23T17:28:13.802228] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-05. [2025-09-23T17:28:14.282999] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-23T17:28:14.602191] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-06. [2025-09-23T17:28:15.119150] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-23T17:28:15.402205] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-09-23T17:28:15.776748] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-23T17:28:16.202227] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-07. [2025-09-23T17:28:16.736723] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-23T17:28:16.745342] [INFO ] [REMOTE ] BB: Full fetch complete (76589 records). [2025-09-23T17:28:16.745560] [DEBUG] [VALIDATOR ] BB: Validating primary data. [2025-09-23T17:28:16.747250] [FATAL] [VALIDATOR ] BB: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:28:16.747429] [FATAL] [MAIN ] BB: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:28:16.747509] [WARN ] [MAIN ] BB: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:28:16.747634] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-09-23T17:28:16.747753] [DEBUG] [LOCAL ] BB: No primary data file found to delete. [2025-09-23T17:28:16.747838] [INFO ] [LOCAL ] BB: Starting deletion of derivative data. [2025-09-23T17:28:16.748409] [DEBUG] [LOCAL ] BB: Deleted derivative data file. [2025-09-23T17:28:16.748599] [INFO ] [MAIN ] Update Progress: 217/2372 symbols completed. BB took 35.0s. Estimated remaining: 4h 40m 18s. Rate: 7.7 symbols/min [2025-09-23T17:28:16.936316] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:28:16.982914] [DEBUG] [LOCAL ] BBDC: Loaded 33253 existing records from primary storage. [2025-09-23T17:28:16.983094] [INFO ] [MAIN ] BBDC: Loaded 33253 existing records. [2025-09-23T17:28:17.007349] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-06. [2025-09-23T17:28:17.168200] [WARN ] [MAIN ] BBDC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:28:17.168439] [INFO ] [MAIN ] BBDC: Wiping existing primary data before full refresh. [2025-09-23T17:28:17.168486] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-09-23T17:28:17.170951] [DEBUG] [LOCAL ] BBDC: Deleted primary data file. [2025-09-23T17:28:17.171013] [INFO ] [MAIN ] BBDC: Starting full primary refresh. [2025-09-23T17:28:17.547597] [INFO ] [REMOTE ] BBDC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:28:17.603524] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-23T17:28:17.802180] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-08. [2025-09-23T17:28:18.366465] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-23T17:28:18.602198] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-07. [2025-09-23T17:28:18.914396] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-23T17:28:19.402203] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2024-12. [2025-09-23T17:28:20.041343] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-23T17:28:20.202169] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-08. [2025-09-23T17:28:20.562837] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-23T17:28:21.002258] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-09-23T17:28:21.430353] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-23T17:28:21.802258] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-09-23T17:28:22.209731] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-23T17:28:22.217564] [INFO ] [REMOTE ] BBAR: Full fetch complete (60508 records). [2025-09-23T17:28:22.217730] [DEBUG] [VALIDATOR ] BBAR: Validating primary data. [2025-09-23T17:28:22.622691] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-05. [2025-09-23T17:28:22.645498] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present. [2025-09-23T17:28:22.645594] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed. [2025-09-23T17:28:22.646309] [INFO ] [MAIN ] BBAR: Fetched primary data is valid. [2025-09-23T17:28:22.646377] [DEBUG] [LOCAL ] BBAR: Saving primary data. [2025-09-23T17:28:22.647589] [DEBUG] [LOCAL ] BBAR: Trimmed 60508 records to 41265 (keeping 200 days of data) [2025-09-23T17:28:22.917300] [DEBUG] [LOCAL ] BBAR: Primary data saved (41265 records). [2025-09-23T17:28:22.917438] [INFO ] [MAIN ] BBAR: Full history saved. [2025-09-23T17:28:22.917549] [INFO ] [MAIN ] Update Progress: 218/2372 symbols completed. BBAR took 27.2s. Estimated remaining: 4h 39m 54s. Rate: 7.7 symbols/min [2025-09-23T17:28:23.097664] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:28:23.105469] [DEBUG] [LOCAL ] BBDO: Loaded 5039 existing records from primary storage. [2025-09-23T17:28:23.105620] [INFO ] [MAIN ] BBDO: Loaded 5039 existing records. [2025-09-23T17:28:23.295257] [WARN ] [MAIN ] BBDO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:28:23.295852] [INFO ] [MAIN ] BBDO: Wiping existing primary data before full refresh. [2025-09-23T17:28:23.295944] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-09-23T17:28:23.296699] [DEBUG] [LOCAL ] BBDO: Deleted primary data file. [2025-09-23T17:28:23.296771] [INFO ] [MAIN ] BBDO: Starting full primary refresh. [2025-09-23T17:28:23.408463] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-23T17:28:23.406867] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-01. [2025-09-23T17:28:23.460161] [INFO ] [REMOTE ] BBD: Full fetch complete (77120 records). [2025-09-23T17:28:23.470609] [DEBUG] [VALIDATOR ] BBD: Validating primary data. [2025-09-23T17:28:23.937176] [INFO ] [REMOTE ] BBDO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:28:24.136845] [DEBUG] [VALIDATOR ] BBD: All expected trading days are present. [2025-09-23T17:28:24.136954] [DEBUG] [VALIDATOR ] BBD: Primary data validation passed. [2025-09-23T17:28:24.137797] [INFO ] [MAIN ] BBD: Fetched primary data is valid. [2025-09-23T17:28:24.137868] [DEBUG] [LOCAL ] BBD: Saving primary data. [2025-09-23T17:28:24.139484] [DEBUG] [LOCAL ] BBD: Trimmed 77120 records to 53181 (keeping 200 days of data) [2025-09-23T17:28:24.208060] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2024-12. [2025-09-23T17:28:24.399407] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-23T17:28:24.509828] [DEBUG] [LOCAL ] BBD: Primary data saved (53181 records). [2025-09-23T17:28:24.509978] [INFO ] [MAIN ] BBD: Full history saved. [2025-09-23T17:28:24.510066] [INFO ] [MAIN ] Update Progress: 219/2372 symbols completed. BBD took 24.8s. Estimated remaining: 4h 38m 45s. Rate: 7.7 symbols/min [2025-09-23T17:28:24.682236] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:28:24.704066] [DEBUG] [LOCAL ] BBN: Loaded 18017 existing records from primary storage. [2025-09-23T17:28:24.704207] [INFO ] [MAIN ] BBN: Loaded 18017 existing records. [2025-09-23T17:28:24.890998] [WARN ] [MAIN ] BBN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:28:24.891268] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-09-23T17:28:24.891319] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-09-23T17:28:24.892455] [DEBUG] [LOCAL ] BBN: Deleted primary data file. [2025-09-23T17:28:24.892526] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-09-23T17:28:25.005956] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-02. [2025-09-23T17:28:25.101252] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-23T17:28:25.308593] [INFO ] [REMOTE ] BBN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:28:25.350708] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-05 (2.73 seconds). [2025-09-23T17:28:25.802252] [INFO ] [REMOTE ] BBN: Fetching primary data for 2024-12. [2025-09-23T17:28:25.968187] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-23T17:28:26.602220] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-06. [2025-09-23T17:28:26.740490] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-23T17:28:27.402230] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-01. [2025-09-23T17:28:28.008703] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-23T17:28:28.202212] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-09-23T17:28:28.793762] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-23T17:28:29.002176] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-09-23T17:28:29.197666] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-09-23T17:28:29.627985] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-23T17:28:29.802200] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-03. [2025-09-23T17:28:30.602235] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-01. [2025-09-23T17:28:30.887494] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-23T17:28:31.218196] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-23T17:28:31.402207] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-04. [2025-09-23T17:28:32.202256] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-09-23T17:28:32.387495] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-23T17:28:33.002274] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-02. [2025-09-23T17:28:33.286445] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-23T17:28:33.695710] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-23T17:28:33.802280] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-05. [2025-09-23T17:28:34.602222] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-09-23T17:28:35.102594] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-23T17:28:35.141229] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-23T17:28:35.402219] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-09-23T17:28:36.053547] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-23T17:28:36.202271] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-03. [2025-09-23T17:28:36.670760] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-23T17:28:37.002267] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-06. [2025-09-23T17:28:37.802222] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-09-23T17:28:38.128294] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-23T17:28:38.520402] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-23T17:28:38.602208] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-07. [2025-09-23T17:28:39.403462] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-04. [2025-09-23T17:28:39.405590] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-23T17:28:39.909396] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-23T17:28:40.202198] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-05. [2025-09-23T17:28:40.612319] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-23T17:28:41.002258] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-06. [2025-09-23T17:28:41.407120] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-23T17:28:41.802261] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-07. [2025-09-23T17:28:42.403210] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-23T17:28:42.602263] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-07. [2025-09-23T17:28:43.402212] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-08. [2025-09-23T17:28:43.752259] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-23T17:28:44.202268] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-08. [2025-09-23T17:28:44.672734] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-23T17:28:44.904579] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-23T17:28:45.002214] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-08. [2025-09-23T17:28:45.802237] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-08. [2025-09-23T17:28:46.602276] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-09-23T17:28:47.101267] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-23T17:28:47.272845] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-09-23T17:28:47.344046] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-23T17:28:47.348108] [INFO ] [REMOTE ] BBN: Full fetch complete (26965 records). [2025-09-23T17:28:47.348193] [DEBUG] [VALIDATOR ] BBN: Validating primary data. [2025-09-23T17:28:47.407438] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-09. [2025-09-23T17:28:47.757945] [DEBUG] [VALIDATOR ] BBN: All expected trading days are present. [2025-09-23T17:28:47.758048] [DEBUG] [VALIDATOR ] BBN: Primary data validation passed. [2025-09-23T17:28:47.758468] [INFO ] [MAIN ] BBN: Fetched primary data is valid. [2025-09-23T17:28:47.758529] [DEBUG] [LOCAL ] BBN: Saving primary data. [2025-09-23T17:28:47.759268] [DEBUG] [LOCAL ] BBN: Trimmed 26965 records to 18034 (keeping 200 days of data) [2025-09-23T17:28:47.870813] [DEBUG] [LOCAL ] BBN: Primary data saved (18034 records). [2025-09-23T17:28:47.870974] [INFO ] [MAIN ] BBN: Full history saved. [2025-09-23T17:28:47.871064] [INFO ] [MAIN ] Update Progress: 220/2372 symbols completed. BBN took 23.4s. Estimated remaining: 4h 41m 10s. Rate: 7.7 symbols/min [2025-09-23T17:28:48.041078] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:28:48.041311] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-09-23T17:28:48.041365] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-09-23T17:28:48.041600] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-09-23T17:28:48.041690] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-09-23T17:28:48.041760] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-09-23T17:28:48.041795] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-09-23T17:28:48.215535] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-09. [2025-09-23T17:28:48.406451] [INFO ] [REMOTE ] BBT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:28:49.002192] [INFO ] [REMOTE ] BBT: Fetching primary data for 2024-12. [2025-09-23T17:28:49.211995] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:28:49.212318] [WARN ] [REMOTE ] BBT: No data returned for month 2024-12 [2025-09-23T17:28:49.308799] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-23T17:28:49.314471] [INFO ] [REMOTE ] BBDC: Full fetch complete (48688 records). [2025-09-23T17:28:49.314604] [DEBUG] [VALIDATOR ] BBDC: Validating primary data. [2025-09-23T17:28:49.315306] [FATAL] [VALIDATOR ] BBDC: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:28:49.315437] [FATAL] [MAIN ] BBDC: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:28:49.315509] [WARN ] [MAIN ] BBDC: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:28:49.315580] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-09-23T17:28:49.315666] [DEBUG] [LOCAL ] BBDC: No primary data file found to delete. [2025-09-23T17:28:49.315728] [INFO ] [LOCAL ] BBDC: Starting deletion of derivative data. [2025-09-23T17:28:49.316164] [DEBUG] [LOCAL ] BBDC: Deleted derivative data file. [2025-09-23T17:28:49.316266] [INFO ] [MAIN ] Update Progress: 221/2372 symbols completed. BBDC took 32.6s. Estimated remaining: 4h 40m 0s. Rate: 7.7 symbols/min [2025-09-23T17:28:49.488688] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:28:49.494796] [DEBUG] [LOCAL ] BBU: Loaded 4091 existing records from primary storage. [2025-09-23T17:28:49.494892] [INFO ] [MAIN ] BBU: Loaded 4091 existing records. [2025-09-23T17:28:49.674780] [WARN ] [MAIN ] BBU: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:28:49.675428] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-09-23T17:28:49.675489] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-09-23T17:28:49.676075] [DEBUG] [LOCAL ] BBU: Deleted primary data file. [2025-09-23T17:28:49.676140] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-09-23T17:28:49.804836] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-09. [2025-09-23T17:28:50.121991] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-09 (2.71 seconds). [2025-09-23T17:28:50.143711] [INFO ] [REMOTE ] BBAI: Full fetch complete (77999 records). [2025-09-23T17:28:50.157257] [INFO ] [REMOTE ] BBU: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:28:50.157395] [DEBUG] [VALIDATOR ] BBAI: Validating primary data. [2025-09-23T17:28:50.540095] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-23T17:28:50.561089] [DEBUG] [VALIDATOR ] BBAI: All expected trading days are present. [2025-09-23T17:28:50.560971] [INFO ] [REMOTE ] BBDO: Full fetch complete (7747 records). [2025-09-23T17:28:50.561219] [DEBUG] [VALIDATOR ] BBDO: Validating primary data. [2025-09-23T17:28:50.561435] [DEBUG] [VALIDATOR ] BBAI: Primary data validation passed. [2025-09-23T17:28:50.594487] [INFO ] [MAIN ] BBAI: Fetched primary data is valid. [2025-09-23T17:28:50.594597] [DEBUG] [LOCAL ] BBAI: Saving primary data. [2025-09-23T17:28:50.606757] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-01. [2025-09-23T17:28:50.663562] [DEBUG] [LOCAL ] BBAI: Trimmed 77999 records to 53820 (keeping 200 days of data) [2025-09-23T17:28:50.862674] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:28:50.893098] [WARN ] [REMOTE ] BBT: No data returned for month 2025-01 [2025-09-23T17:28:51.061490] [DEBUG] [VALIDATOR ] BBDO: All expected trading days are present. [2025-09-23T17:28:51.062193] [DEBUG] [VALIDATOR ] BBDO: Primary data validation passed. [2025-09-23T17:28:51.062825] [INFO ] [MAIN ] BBDO: Fetched primary data is valid. [2025-09-23T17:28:51.062903] [DEBUG] [LOCAL ] BBDO: Saving primary data. [2025-09-23T17:28:51.064634] [DEBUG] [LOCAL ] BBDO: Trimmed 7747 records to 5032 (keeping 200 days of data) [2025-09-23T17:28:51.102828] [DEBUG] [LOCAL ] BBDO: Primary data saved (5032 records). [2025-09-23T17:28:51.103823] [INFO ] [MAIN ] BBDO: Full history saved. [2025-09-23T17:28:51.104479] [INFO ] [MAIN ] Update Progress: 222/2372 symbols completed. BBDO took 28.2s. Estimated remaining: 4h 38m 54s. Rate: 7.7 symbols/min [2025-09-23T17:28:51.368266] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:28:51.394562] [DEBUG] [LOCAL ] BBUC: Loaded 13152 existing records from primary storage. [2025-09-23T17:28:51.402361] [INFO ] [MAIN ] BBUC: Loaded 13152 existing records. [2025-09-23T17:28:51.402245] [INFO ] [REMOTE ] BBU: Fetching primary data for 2024-12. [2025-09-23T17:28:51.666984] [WARN ] [MAIN ] BBUC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:28:51.668186] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-09-23T17:28:51.668569] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-09-23T17:28:51.670590] [DEBUG] [LOCAL ] BBUC: Deleted primary data file. [2025-09-23T17:28:51.671240] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-09-23T17:28:51.866811] [DEBUG] [LOCAL ] BBAI: Primary data saved (53820 records). [2025-09-23T17:28:51.878483] [INFO ] [MAIN ] BBAI: Full history saved. [2025-09-23T17:28:51.932708] [INFO ] [MAIN ] Update Progress: 223/2372 symbols completed. BBAI took 1m 1s. Estimated remaining: 4h 37m 39s. Rate: 7.7 symbols/min [2025-09-23T17:28:52.203919] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-02. [2025-09-23T17:28:52.203775] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-23T17:28:52.197606] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:28:52.271138] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:28:52.323551] [DEBUG] [LOCAL ] BBVA: Loaded 49550 existing records from primary storage. [2025-09-23T17:28:52.323733] [INFO ] [MAIN ] BBVA: Loaded 49550 existing records. [2025-09-23T17:28:52.440194] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:28:52.467873] [WARN ] [REMOTE ] BBT: No data returned for month 2025-02 [2025-09-23T17:28:52.504794] [WARN ] [MAIN ] BBVA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:28:52.505046] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-09-23T17:28:52.505095] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-09-23T17:28:52.508299] [DEBUG] [LOCAL ] BBVA: Deleted primary data file. [2025-09-23T17:28:52.508363] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-09-23T17:28:52.866464] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:28:53.002201] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2024-12. [2025-09-23T17:28:53.536502] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-23T17:28:53.802248] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-01. [2025-09-23T17:28:54.305505] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-23T17:28:54.602191] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-09-23T17:28:55.062855] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-23T17:28:55.402207] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-01. [2025-09-23T17:28:55.980365] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-23T17:28:56.202204] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-03. [2025-09-23T17:28:56.417557] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:28:56.417988] [WARN ] [REMOTE ] BBT: No data returned for month 2025-03 [2025-09-23T17:28:57.002242] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-04. [2025-09-23T17:28:57.198153] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:28:57.198470] [WARN ] [REMOTE ] BBT: No data returned for month 2025-04 [2025-09-23T17:28:57.802204] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-09-23T17:28:58.602202] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-05. [2025-09-23T17:28:58.821296] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:28:58.821799] [WARN ] [REMOTE ] BBT: No data returned for month 2025-05 [2025-09-23T17:28:58.836332] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-23T17:28:59.402298] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-06. [2025-09-23T17:28:59.603463] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:28:59.603844] [WARN ] [REMOTE ] BBT: No data returned for month 2025-06 [2025-09-23T17:29:00.202188] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-07. [2025-09-23T17:29:00.447431] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:29:00.447805] [WARN ] [REMOTE ] BBT: No data returned for month 2025-07 [2025-09-23T17:29:01.002212] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2024-12. [2025-09-23T17:29:01.802258] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-09-23T17:29:02.339462] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-23T17:29:02.463354] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-23T17:29:02.602229] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-09-23T17:29:03.402193] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-01. [2025-09-23T17:29:03.578690] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-23T17:29:04.202229] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-09-23T17:29:04.736611] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-23T17:29:04.876518] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-23T17:29:05.002243] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-09-23T17:29:05.351123] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-23T17:29:05.802216] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-09-23T17:29:06.174291] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-23T17:29:06.602221] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-09-23T17:29:07.125982] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-23T17:29:07.402205] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-07. [2025-09-23T17:29:08.202211] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-08. [2025-09-23T17:29:08.298670] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-23T17:29:08.417304] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:29:08.417897] [WARN ] [REMOTE ] BBT: No data returned for month 2025-08 [2025-09-23T17:29:09.002233] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-08. [2025-09-23T17:29:09.569599] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-23T17:29:09.802212] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-09-23T17:29:10.602240] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-09. [2025-09-23T17:29:11.200461] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-23T17:29:11.402234] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-03. [2025-09-23T17:29:11.606993] [INFO ] [REMOTE ] BBT: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-23T17:29:11.614312] [INFO ] [REMOTE ] BBT: Full fetch complete (4861 records). [2025-09-23T17:29:11.614391] [DEBUG] [VALIDATOR ] BBT: Validating primary data. [2025-09-23T17:29:11.802027] [WARN ] [VALIDATOR ] BBT: Validation failed - insufficient historical data. Have 16 unique days, need 200 days [2025-09-23T17:29:11.802343] [FATAL] [MAIN ] BBT: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:29:11.802417] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:29:11.802471] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-09-23T17:29:11.802540] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-09-23T17:29:11.802576] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-09-23T17:29:11.802615] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-09-23T17:29:11.802713] [INFO ] [MAIN ] Update Progress: 224/2372 symbols completed. BBT took 23.9s. Estimated remaining: 4h 39m 28s. Rate: 7.7 symbols/min [2025-09-23T17:29:11.982090] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:29:12.013247] [DEBUG] [LOCAL ] BBW: Loaded 26617 existing records from primary storage. [2025-09-23T17:29:12.013478] [INFO ] [MAIN ] BBW: Loaded 26617 existing records. [2025-09-23T17:29:12.208557] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-09. [2025-09-23T17:29:12.210312] [WARN ] [MAIN ] BBW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:29:12.211797] [INFO ] [MAIN ] BBW: Wiping existing primary data before full refresh. [2025-09-23T17:29:12.211860] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-09-23T17:29:12.214258] [DEBUG] [LOCAL ] BBW: Deleted primary data file. [2025-09-23T17:29:12.214353] [INFO ] [MAIN ] BBW: Starting full primary refresh. [2025-09-23T17:29:12.573439] [INFO ] [REMOTE ] BBW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:29:12.830218] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-23T17:29:12.832797] [INFO ] [REMOTE ] BBUC: Full fetch complete (17326 records). [2025-09-23T17:29:12.832869] [DEBUG] [VALIDATOR ] BBUC: Validating primary data. [2025-09-23T17:29:13.009694] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-09-23T17:29:13.207866] [DEBUG] [VALIDATOR ] BBUC: All expected trading days are present. [2025-09-23T17:29:13.208017] [DEBUG] [VALIDATOR ] BBUC: Primary data validation passed. [2025-09-23T17:29:13.208397] [INFO ] [MAIN ] BBUC: Fetched primary data is valid. [2025-09-23T17:29:13.208441] [DEBUG] [LOCAL ] BBUC: Saving primary data. [2025-09-23T17:29:13.209057] [DEBUG] [LOCAL ] BBUC: Trimmed 17326 records to 13148 (keeping 200 days of data) [2025-09-23T17:29:13.309374] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-23T17:29:13.330385] [DEBUG] [LOCAL ] BBUC: Primary data saved (13148 records). [2025-09-23T17:29:13.330503] [INFO ] [MAIN ] BBUC: Full history saved. [2025-09-23T17:29:13.330582] [INFO ] [MAIN ] Update Progress: 225/2372 symbols completed. BBUC took 22.2s. Estimated remaining: 4h 38m 20s. Rate: 7.7 symbols/min [2025-09-23T17:29:13.503669] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:29:13.507908] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-23T17:29:13.561077] [DEBUG] [LOCAL ] BBWI: Loaded 53576 existing records from primary storage. [2025-09-23T17:29:13.561223] [INFO ] [MAIN ] BBWI: Loaded 53576 existing records. [2025-09-23T17:29:13.738596] [WARN ] [MAIN ] BBWI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:29:13.738846] [INFO ] [MAIN ] BBWI: Wiping existing primary data before full refresh. [2025-09-23T17:29:13.738902] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-09-23T17:29:13.742045] [DEBUG] [LOCAL ] BBWI: Deleted primary data file. [2025-09-23T17:29:13.742111] [INFO ] [MAIN ] BBWI: Starting full primary refresh. [2025-09-23T17:29:13.807290] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-04. [2025-09-23T17:29:14.099872] [INFO ] [REMOTE ] BBWI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:29:14.602185] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2024-12. [2025-09-23T17:29:15.336573] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-23T17:29:15.402195] [INFO ] [REMOTE ] BBW: Fetching primary data for 2024-12. [2025-09-23T17:29:16.081293] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-23T17:29:16.202165] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-01. [2025-09-23T17:29:16.571730] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-23T17:29:17.002202] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-01. [2025-09-23T17:29:17.544488] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-23T17:29:17.802210] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-05. [2025-09-23T17:29:17.954309] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-23T17:29:18.602196] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-02. [2025-09-23T17:29:19.143500] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-23T17:29:19.393668] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-23T17:29:19.402132] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-03. [2025-09-23T17:29:20.202190] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-06. [2025-09-23T17:29:20.296088] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-23T17:29:20.639287] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-23T17:29:21.002205] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-06. [2025-09-23T17:29:21.802191] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-04. [2025-09-23T17:29:22.183659] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-23T17:29:22.602283] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-02. [2025-09-23T17:29:22.698227] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-23T17:29:23.402216] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-07. [2025-09-23T17:29:24.202170] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-07. [2025-09-23T17:29:24.369282] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-23T17:29:24.769562] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-23T17:29:25.007323] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-08. [2025-09-23T17:29:25.028498] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-23T17:29:25.408124] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-23T17:29:25.802250] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-05. [2025-09-23T17:29:26.602192] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-03. [2025-09-23T17:29:27.113610] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-23T17:29:27.402199] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-09-23T17:29:27.911879] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-23T17:29:27.913803] [INFO ] [REMOTE ] BBU: Full fetch complete (6104 records). [2025-09-23T17:29:27.914002] [DEBUG] [VALIDATOR ] BBU: Validating primary data. [2025-09-23T17:29:28.209128] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-08. [2025-09-23T17:29:28.304804] [DEBUG] [VALIDATOR ] BBU: All expected trading days are present. [2025-09-23T17:29:28.320840] [DEBUG] [VALIDATOR ] BBU: Primary data validation passed. [2025-09-23T17:29:28.333783] [INFO ] [MAIN ] BBU: Fetched primary data is valid. [2025-09-23T17:29:28.334056] [DEBUG] [LOCAL ] BBU: Saving primary data. [2025-09-23T17:29:28.335859] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-23T17:29:28.346832] [DEBUG] [LOCAL ] BBU: Trimmed 6104 records to 4116 (keeping 200 days of data) [2025-09-23T17:29:28.373111] [DEBUG] [LOCAL ] BBU: Primary data saved (4116 records). [2025-09-23T17:29:28.373212] [INFO ] [MAIN ] BBU: Full history saved. [2025-09-23T17:29:28.373295] [INFO ] [MAIN ] Update Progress: 226/2372 symbols completed. BBU took 39.1s. Estimated remaining: 4h 39m 21s. Rate: 7.7 symbols/min [2025-09-23T17:29:28.542693] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:29:28.599610] [DEBUG] [LOCAL ] BBY: Loaded 53482 existing records from primary storage. [2025-09-23T17:29:28.599805] [INFO ] [MAIN ] BBY: Loaded 53482 existing records. [2025-09-23T17:29:28.777769] [WARN ] [MAIN ] BBY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:29:28.778053] [INFO ] [MAIN ] BBY: Wiping existing primary data before full refresh. [2025-09-23T17:29:28.778102] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-09-23T17:29:28.779609] [DEBUG] [LOCAL ] BBY: Deleted primary data file. [2025-09-23T17:29:28.779700] [INFO ] [MAIN ] BBY: Starting full primary refresh. [2025-09-23T17:29:29.010448] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-06. [2025-09-23T17:29:29.142178] [INFO ] [REMOTE ] BBY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:29:29.560197] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-23T17:29:29.802216] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-04. [2025-09-23T17:29:29.961430] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-23T17:29:30.602193] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-07. [2025-09-23T17:29:31.402208] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-09-23T17:29:31.454336] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-23T17:29:31.677471] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-23T17:29:32.202248] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-05. [2025-09-23T17:29:33.002179] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-08. [2025-09-23T17:29:33.078403] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-23T17:29:33.086797] [INFO ] [REMOTE ] BBVA: Full fetch complete (71591 records). [2025-09-23T17:29:33.086959] [DEBUG] [VALIDATOR ] BBVA: Validating primary data. [2025-09-23T17:29:33.488259] [DEBUG] [VALIDATOR ] BBVA: All expected trading days are present. [2025-09-23T17:29:33.488353] [DEBUG] [VALIDATOR ] BBVA: Primary data validation passed. [2025-09-23T17:29:33.489088] [INFO ] [MAIN ] BBVA: Fetched primary data is valid. [2025-09-23T17:29:33.489151] [DEBUG] [LOCAL ] BBVA: Saving primary data. [2025-09-23T17:29:33.490664] [DEBUG] [LOCAL ] BBVA: Trimmed 71591 records to 49510 (keeping 200 days of data) [2025-09-23T17:29:33.746537] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-23T17:29:33.813636] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-06. [2025-09-23T17:29:33.832057] [DEBUG] [LOCAL ] BBVA: Primary data saved (49510 records). [2025-09-23T17:29:33.832195] [INFO ] [MAIN ] BBVA: Full history saved. [2025-09-23T17:29:33.832282] [INFO ] [MAIN ] Update Progress: 227/2372 symbols completed. BBVA took 41.9s. Estimated remaining: 4h 38m 51s. Rate: 7.7 symbols/min [2025-09-23T17:29:34.004884] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:29:34.020617] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-23T17:29:34.066059] [DEBUG] [LOCAL ] BC: Loaded 44536 existing records from primary storage. [2025-09-23T17:29:34.066198] [INFO ] [MAIN ] BC: Loaded 44536 existing records. [2025-09-23T17:29:34.242492] [WARN ] [MAIN ] BC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:29:34.242785] [INFO ] [MAIN ] BC: Wiping existing primary data before full refresh. [2025-09-23T17:29:34.242838] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-09-23T17:29:34.246161] [DEBUG] [LOCAL ] BC: Deleted primary data file. [2025-09-23T17:29:34.246224] [INFO ] [MAIN ] BC: Starting full primary refresh. [2025-09-23T17:29:34.599067] [INFO ] [REMOTE ] BC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:29:34.602157] [INFO ] [REMOTE ] BC: Fetching primary data for 2024-12. [2025-09-23T17:29:35.338084] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-23T17:29:35.402150] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-07. [2025-09-23T17:29:35.993573] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-23T17:29:36.202204] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-09. [2025-09-23T17:29:36.856227] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-23T17:29:37.002192] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-08. [2025-09-23T17:29:37.407444] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-23T17:29:37.413321] [INFO ] [REMOTE ] BBW: Full fetch complete (39274 records). [2025-09-23T17:29:37.413404] [DEBUG] [VALIDATOR ] BBW: Validating primary data. [2025-09-23T17:29:37.787989] [DEBUG] [VALIDATOR ] BBW: All expected trading days are present. [2025-09-23T17:29:37.788082] [DEBUG] [VALIDATOR ] BBW: Primary data validation passed. [2025-09-23T17:29:37.788585] [INFO ] [MAIN ] BBW: Fetched primary data is valid. [2025-09-23T17:29:37.788633] [DEBUG] [LOCAL ] BBW: Saving primary data. [2025-09-23T17:29:37.789606] [DEBUG] [LOCAL ] BBW: Trimmed 39274 records to 26671 (keeping 200 days of data) [2025-09-23T17:29:37.842428] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-01. [2025-09-23T17:29:37.957274] [DEBUG] [LOCAL ] BBW: Primary data saved (26671 records). [2025-09-23T17:29:37.957418] [INFO ] [MAIN ] BBW: Full history saved. [2025-09-23T17:29:37.957503] [INFO ] [MAIN ] Update Progress: 228/2372 symbols completed. BBW took 26.2s. Estimated remaining: 4h 38m 9s. Rate: 7.7 symbols/min [2025-09-23T17:29:38.129502] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:29:38.166584] [DEBUG] [LOCAL ] BCAT: Loaded 34509 existing records from primary storage. [2025-09-23T17:29:38.166748] [INFO ] [MAIN ] BCAT: Loaded 34509 existing records. [2025-09-23T17:29:38.354798] [WARN ] [MAIN ] BCAT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:29:38.355319] [INFO ] [MAIN ] BCAT: Wiping existing primary data before full refresh. [2025-09-23T17:29:38.355487] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-09-23T17:29:38.357339] [DEBUG] [LOCAL ] BCAT: Deleted primary data file. [2025-09-23T17:29:38.357403] [INFO ] [MAIN ] BCAT: Starting full primary refresh. [2025-09-23T17:29:38.609408] [INFO ] [REMOTE ] BBY: Fetching primary data for 2024-12. [2025-09-23T17:29:38.708049] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-23T17:29:38.781095] [INFO ] [REMOTE ] BCAT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:29:39.334698] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-23T17:29:39.402157] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-09. [2025-09-23T17:29:40.202188] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2024-12. [2025-09-23T17:29:40.282012] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-23T17:29:40.974531] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-23T17:29:40.983783] [INFO ] [REMOTE ] BBWI: Full fetch complete (77413 records). [2025-09-23T17:29:40.983913] [DEBUG] [VALIDATOR ] BBWI: Validating primary data. [2025-09-23T17:29:41.007288] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-01. [2025-09-23T17:29:41.386997] [DEBUG] [VALIDATOR ] BBWI: All expected trading days are present. [2025-09-23T17:29:41.387302] [DEBUG] [VALIDATOR ] BBWI: Primary data validation passed. [2025-09-23T17:29:41.388230] [INFO ] [MAIN ] BBWI: Fetched primary data is valid. [2025-09-23T17:29:41.388339] [DEBUG] [LOCAL ] BBWI: Saving primary data. [2025-09-23T17:29:41.407940] [DEBUG] [LOCAL ] BBWI: Trimmed 77413 records to 53580 (keeping 200 days of data) [2025-09-23T17:29:41.408733] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-23T17:29:41.749505] [DEBUG] [LOCAL ] BBWI: Primary data saved (53580 records). [2025-09-23T17:29:41.749680] [INFO ] [MAIN ] BBWI: Full history saved. [2025-09-23T17:29:41.749790] [INFO ] [MAIN ] Update Progress: 229/2372 symbols completed. BBWI took 28.4s. Estimated remaining: 4h 37m 24s. Rate: 7.7 symbols/min [2025-09-23T17:29:41.814429] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-01. [2025-09-23T17:29:41.927902] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:29:41.959229] [DEBUG] [LOCAL ] BCC: Loaded 28411 existing records from primary storage. [2025-09-23T17:29:41.959400] [INFO ] [MAIN ] BCC: Loaded 28411 existing records. [2025-09-23T17:29:42.146248] [WARN ] [MAIN ] BCC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:29:42.146552] [INFO ] [MAIN ] BCC: Wiping existing primary data before full refresh. [2025-09-23T17:29:42.146602] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-09-23T17:29:42.147375] [DEBUG] [LOCAL ] BCC: Deleted primary data file. [2025-09-23T17:29:42.147439] [INFO ] [MAIN ] BCC: Starting full primary refresh. [2025-09-23T17:29:42.528808] [INFO ] [REMOTE ] BCC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:29:42.602194] [INFO ] [REMOTE ] BCC: Fetching primary data for 2024-12. [2025-09-23T17:29:42.762231] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-23T17:29:42.807809] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-23T17:29:43.402215] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-02. [2025-09-23T17:29:43.509678] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-23T17:29:44.202254] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-02. [2025-09-23T17:29:44.878495] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-23T17:29:45.002264] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-03. [2025-09-23T17:29:45.731198] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-23T17:29:45.802208] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-01. [2025-09-23T17:29:46.023243] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-23T17:29:46.602225] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-04. [2025-09-23T17:29:46.711131] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-23T17:29:47.402260] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-02. [2025-09-23T17:29:47.621693] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-23T17:29:48.202221] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-02. [2025-09-23T17:29:48.341614] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-23T17:29:49.002261] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-03. [2025-09-23T17:29:49.512346] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-23T17:29:49.802276] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-03. [2025-09-23T17:29:50.310318] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-23T17:29:50.602208] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-03. [2025-09-23T17:29:51.388753] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-23T17:29:51.402165] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-04. [2025-09-23T17:29:51.572396] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-23T17:29:52.202259] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-04. [2025-09-23T17:29:52.958393] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-23T17:29:53.002190] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-05. [2025-09-23T17:29:53.139504] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-23T17:29:53.802233] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-04. [2025-09-23T17:29:54.077249] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-23T17:29:54.602225] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-06. [2025-09-23T17:29:55.402281] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-05. [2025-09-23T17:29:55.469791] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-23T17:29:55.531834] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-23T17:29:56.202248] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-07. [2025-09-23T17:29:56.982307] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-23T17:29:57.002165] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-06. [2025-09-23T17:29:57.641822] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-23T17:29:57.802192] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-08. [2025-09-23T17:29:58.601503] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-23T17:29:58.611370] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-05. [2025-09-23T17:29:59.249082] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-23T17:29:59.402262] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-05. [2025-09-23T17:29:59.976479] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-23T17:30:00.202206] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-09. [2025-09-23T17:30:00.851874] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-23T17:30:01.002161] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-06. [2025-09-23T17:30:01.387719] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-23T17:30:01.393719] [INFO ] [REMOTE ] BCAT: Full fetch complete (49892 records). [2025-09-23T17:30:01.393834] [DEBUG] [VALIDATOR ] BCAT: Validating primary data. [2025-09-23T17:30:01.784717] [DEBUG] [VALIDATOR ] BCAT: All expected trading days are present. [2025-09-23T17:30:01.784849] [DEBUG] [VALIDATOR ] BCAT: Primary data validation passed. [2025-09-23T17:30:01.785798] [INFO ] [MAIN ] BCAT: Fetched primary data is valid. [2025-09-23T17:30:01.785897] [DEBUG] [LOCAL ] BCAT: Saving primary data. [2025-09-23T17:30:01.787501] [DEBUG] [LOCAL ] BCAT: Trimmed 49892 records to 34488 (keeping 200 days of data) [2025-09-23T17:30:01.859139] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-07. [2025-09-23T17:30:02.030012] [DEBUG] [LOCAL ] BCAT: Primary data saved (34488 records). [2025-09-23T17:30:02.030178] [INFO ] [MAIN ] BCAT: Full history saved. [2025-09-23T17:30:02.030272] [INFO ] [MAIN ] Update Progress: 230/2372 symbols completed. BCAT took 24.1s. Estimated remaining: 4h 39m 12s. Rate: 7.7 symbols/min [2025-09-23T17:30:02.220098] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:30:02.275238] [DEBUG] [LOCAL ] BCE: Loaded 52370 existing records from primary storage. [2025-09-23T17:30:02.275401] [INFO ] [MAIN ] BCE: Loaded 52370 existing records. [2025-09-23T17:30:02.459304] [WARN ] [MAIN ] BCE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:30:02.459637] [INFO ] [MAIN ] BCE: Wiping existing primary data before full refresh. [2025-09-23T17:30:02.459937] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-09-23T17:30:02.461411] [DEBUG] [LOCAL ] BCE: Deleted primary data file. [2025-09-23T17:30:02.461482] [INFO ] [MAIN ] BCE: Starting full primary refresh. [2025-09-23T17:30:02.615321] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-06. [2025-09-23T17:30:02.869975] [INFO ] [REMOTE ] BCE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:30:03.315840] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-09-23T17:30:03.402204] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-07. [2025-09-23T17:30:04.202244] [INFO ] [REMOTE ] BCE: Fetching primary data for 2024-12. [2025-09-23T17:30:05.865245] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-07 (4.01 seconds). [2025-09-23T17:30:05.881214] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-08. [2025-09-23T17:30:05.900101] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-06 (3.28 seconds). [2025-09-23T17:30:05.906856] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-07. [2025-09-23T17:30:06.420602] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-07 (3.02 seconds). [2025-09-23T17:30:06.602164] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-08. [2025-09-23T17:30:07.454021] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2024-12 (3.25 seconds). [2025-09-23T17:30:07.466956] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-01. [2025-09-23T17:30:07.652541] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-23T17:30:07.700028] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-23T17:30:08.126291] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-23T17:30:08.202171] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-09. [2025-09-23T17:30:08.896567] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-23T17:30:09.002228] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-09. [2025-09-23T17:30:09.737624] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-23T17:30:09.746813] [INFO ] [REMOTE ] BBY: Full fetch complete (77251 records). [2025-09-23T17:30:09.746956] [DEBUG] [VALIDATOR ] BBY: Validating primary data. [2025-09-23T17:30:09.811348] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-08. [2025-09-23T17:30:10.154604] [DEBUG] [VALIDATOR ] BBY: All expected trading days are present. [2025-09-23T17:30:10.154717] [DEBUG] [VALIDATOR ] BBY: Primary data validation passed. [2025-09-23T17:30:10.155540] [INFO ] [MAIN ] BBY: Fetched primary data is valid. [2025-09-23T17:30:10.155614] [DEBUG] [LOCAL ] BBY: Saving primary data. [2025-09-23T17:30:10.157184] [DEBUG] [LOCAL ] BBY: Trimmed 77251 records to 53480 (keeping 200 days of data) [2025-09-23T17:30:10.279132] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-23T17:30:10.292551] [INFO ] [REMOTE ] BC: Full fetch complete (63746 records). [2025-09-23T17:30:10.300692] [DEBUG] [VALIDATOR ] BC: Validating primary data. [2025-09-23T17:30:10.607152] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-02. [2025-09-23T17:30:10.824308] [DEBUG] [VALIDATOR ] BC: All expected trading days are present. [2025-09-23T17:30:10.824676] [DEBUG] [VALIDATOR ] BC: Primary data validation passed. [2025-09-23T17:30:10.826225] [INFO ] [MAIN ] BC: Fetched primary data is valid. [2025-09-23T17:30:10.826588] [DEBUG] [LOCAL ] BC: Saving primary data. [2025-09-23T17:30:10.834895] [DEBUG] [LOCAL ] BC: Trimmed 63746 records to 44506 (keeping 200 days of data) [2025-09-23T17:30:10.982121] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-23T17:30:11.245903] [DEBUG] [LOCAL ] BC: Primary data saved (44506 records). [2025-09-23T17:30:11.246586] [INFO ] [MAIN ] BC: Full history saved. [2025-09-23T17:30:11.246752] [INFO ] [MAIN ] Update Progress: 231/2372 symbols completed. BC took 37.4s. Estimated remaining: 4h 39m 17s. Rate: 7.7 symbols/min [2025-09-23T17:30:11.387941] [DEBUG] [LOCAL ] BBY: Primary data saved (53480 records). [2025-09-23T17:30:11.409056] [INFO ] [MAIN ] BBY: Full history saved. [2025-09-23T17:30:11.409252] [INFO ] [MAIN ] Update Progress: 232/2372 symbols completed. BBY took 43.0s. Estimated remaining: 4h 37m 59s. Rate: 7.7 symbols/min [2025-09-23T17:30:11.403694] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-09. [2025-09-23T17:30:11.535911] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:30:11.653484] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:30:11.676124] [DEBUG] [LOCAL ] BCH: Loaded 29570 existing records from primary storage. [2025-09-23T17:30:11.676364] [INFO ] [MAIN ] BCH: Loaded 29570 existing records. [2025-09-23T17:30:11.860024] [DEBUG] [LOCAL ] BCO: Loaded 26483 existing records from primary storage. [2025-09-23T17:30:11.881759] [INFO ] [MAIN ] BCO: Loaded 26483 existing records. [2025-09-23T17:30:11.881589] [WARN ] [MAIN ] BCH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:30:11.963445] [INFO ] [MAIN ] BCH: Wiping existing primary data before full refresh. [2025-09-23T17:30:11.982600] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-09-23T17:30:11.990815] [DEBUG] [LOCAL ] BCH: Deleted primary data file. [2025-09-23T17:30:12.001102] [INFO ] [MAIN ] BCH: Starting full primary refresh. [2025-09-23T17:30:12.158447] [WARN ] [MAIN ] BCO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:30:12.170852] [INFO ] [MAIN ] BCO: Wiping existing primary data before full refresh. [2025-09-23T17:30:12.192448] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-09-23T17:30:12.236708] [DEBUG] [LOCAL ] BCO: Deleted primary data file. [2025-09-23T17:30:12.251708] [INFO ] [MAIN ] BCO: Starting full primary refresh. [2025-09-23T17:30:12.755249] [INFO ] [REMOTE ] BCH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:30:12.798110] [INFO ] [REMOTE ] BCH: Fetching primary data for 2024-12. [2025-09-23T17:30:12.967043] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-09-23T17:30:12.964996] [INFO ] [REMOTE ] BCO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:30:12.974480] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-23T17:30:12.987425] [INFO ] [REMOTE ] BCC: Full fetch complete (40251 records). [2025-09-23T17:30:12.988003] [DEBUG] [VALIDATOR ] BCC: Validating primary data. [2025-09-23T17:30:13.011212] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-03. [2025-09-23T17:30:13.388980] [DEBUG] [VALIDATOR ] BCC: All expected trading days are present. [2025-09-23T17:30:13.389090] [DEBUG] [VALIDATOR ] BCC: Primary data validation passed. [2025-09-23T17:30:13.389753] [INFO ] [MAIN ] BCC: Fetched primary data is valid. [2025-09-23T17:30:13.389845] [DEBUG] [LOCAL ] BCC: Saving primary data. [2025-09-23T17:30:13.391039] [DEBUG] [LOCAL ] BCC: Trimmed 40251 records to 28407 (keeping 200 days of data) [2025-09-23T17:30:13.588936] [DEBUG] [LOCAL ] BCC: Primary data saved (28407 records). [2025-09-23T17:30:13.589077] [INFO ] [MAIN ] BCC: Full history saved. [2025-09-23T17:30:13.589180] [INFO ] [MAIN ] Update Progress: 233/2372 symbols completed. BCC took 31.8s. Estimated remaining: 4h 36m 60s. Rate: 7.7 symbols/min [2025-09-23T17:30:13.782109] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:30:13.801202] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-23T17:30:13.807350] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-01. [2025-09-23T17:30:13.867259] [DEBUG] [LOCAL ] BCS: Loaded 53472 existing records from primary storage. [2025-09-23T17:30:13.867459] [INFO ] [MAIN ] BCS: Loaded 53472 existing records. [2025-09-23T17:30:14.052576] [WARN ] [MAIN ] BCS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:30:14.052942] [INFO ] [MAIN ] BCS: Wiping existing primary data before full refresh. [2025-09-23T17:30:14.053000] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-09-23T17:30:14.054193] [DEBUG] [LOCAL ] BCS: Deleted primary data file. [2025-09-23T17:30:14.054253] [INFO ] [MAIN ] BCS: Starting full primary refresh. [2025-09-23T17:30:14.419675] [INFO ] [REMOTE ] BCS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:30:14.533102] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-23T17:30:14.604305] [INFO ] [REMOTE ] BCO: Fetching primary data for 2024-12. [2025-09-23T17:30:14.607951] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-23T17:30:15.402258] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-02. [2025-09-23T17:30:15.689819] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-23T17:30:16.127931] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-23T17:30:16.202164] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-03. [2025-09-23T17:30:17.002197] [INFO ] [REMOTE ] BCS: Fetching primary data for 2024-12. [2025-09-23T17:30:17.128196] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-23T17:30:17.802208] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-04. [2025-09-23T17:30:18.449688] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-23T17:30:18.602193] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-04. [2025-09-23T17:30:18.673718] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-23T17:30:19.402232] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-01. [2025-09-23T17:30:20.202264] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-05. [2025-09-23T17:30:21.002280] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-01. [2025-09-23T17:30:21.109230] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-09-23T17:30:21.535916] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-23T17:30:21.802249] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-05. [2025-09-23T17:30:21.887588] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-23T17:30:22.497623] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-09-23T17:30:22.602158] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-06. [2025-09-23T17:30:23.258370] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-23T17:30:23.402142] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-06. [2025-09-23T17:30:23.727384] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-23T17:30:24.202201] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-02. [2025-09-23T17:30:24.631367] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-23T17:30:25.002213] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-02. [2025-09-23T17:30:25.684392] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-23T17:30:25.802228] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-03. [2025-09-23T17:30:26.039781] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-23T17:30:26.602215] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-03. [2025-09-23T17:30:27.412866] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-07. [2025-09-23T17:30:27.439032] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-23T17:30:27.474463] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-23T17:30:28.202198] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-04. [2025-09-23T17:30:29.002339] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-04. [2025-09-23T17:30:29.007987] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-23T17:30:29.219211] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-23T17:30:29.802199] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-08. [2025-09-23T17:30:30.602184] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-07. [2025-09-23T17:30:31.173565] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-23T17:30:31.233459] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-23T17:30:31.402203] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-05. [2025-09-23T17:30:31.576227] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-23T17:30:32.202206] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-08. [2025-09-23T17:30:32.829558] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-23T17:30:33.002202] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-06. [2025-09-23T17:30:33.078897] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-23T17:30:33.802201] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-05. [2025-09-23T17:30:34.518027] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-23T17:30:34.602196] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-07. [2025-09-23T17:30:34.978367] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-23T17:30:35.402196] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-09. [2025-09-23T17:30:36.200396] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-23T17:30:36.210896] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-06. [2025-09-23T17:30:36.573986] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-23T17:30:36.587753] [INFO ] [REMOTE ] BCE: Full fetch complete (76152 records). [2025-09-23T17:30:36.588009] [DEBUG] [VALIDATOR ] BCE: Validating primary data. [2025-09-23T17:30:37.011322] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-09-23T17:30:37.263682] [DEBUG] [VALIDATOR ] BCE: All expected trading days are present. [2025-09-23T17:30:37.263826] [DEBUG] [VALIDATOR ] BCE: Primary data validation passed. [2025-09-23T17:30:37.265225] [INFO ] [MAIN ] BCE: Fetched primary data is valid. [2025-09-23T17:30:37.265434] [DEBUG] [LOCAL ] BCE: Saving primary data. [2025-09-23T17:30:37.275391] [DEBUG] [LOCAL ] BCE: Trimmed 76152 records to 52350 (keeping 200 days of data) [2025-09-23T17:30:37.613042] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-23T17:30:37.756111] [DEBUG] [LOCAL ] BCE: Primary data saved (52350 records). [2025-09-23T17:30:37.756276] [INFO ] [MAIN ] BCE: Full history saved. [2025-09-23T17:30:37.756422] [INFO ] [MAIN ] Update Progress: 234/2372 symbols completed. BCE took 35.7s. Estimated remaining: 4h 39m 22s. Rate: 7.7 symbols/min [2025-09-23T17:30:37.807340] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-07. [2025-09-23T17:30:37.941789] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:30:37.976724] [DEBUG] [LOCAL ] BCSF: Loaded 27741 existing records from primary storage. [2025-09-23T17:30:37.976867] [INFO ] [MAIN ] BCSF: Loaded 27741 existing records. [2025-09-23T17:30:38.159634] [WARN ] [MAIN ] BCSF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:30:38.160047] [INFO ] [MAIN ] BCSF: Wiping existing primary data before full refresh. [2025-09-23T17:30:38.160131] [INFO ] [LOCAL ] BCSF: Starting deletion of primary data. [2025-09-23T17:30:38.167534] [DEBUG] [LOCAL ] BCSF: Deleted primary data file. [2025-09-23T17:30:38.174212] [INFO ] [MAIN ] BCSF: Starting full primary refresh. [2025-09-23T17:30:38.253169] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-23T17:30:38.297146] [INFO ] [REMOTE ] BCH: Full fetch complete (40904 records). [2025-09-23T17:30:38.307520] [DEBUG] [VALIDATOR ] BCH: Validating primary data. [2025-09-23T17:30:38.602245] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-08. [2025-09-23T17:30:38.772467] [INFO ] [REMOTE ] BCSF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:30:38.944056] [DEBUG] [VALIDATOR ] BCH: All expected trading days are present. [2025-09-23T17:30:38.944138] [DEBUG] [VALIDATOR ] BCH: Primary data validation passed. [2025-09-23T17:30:38.944670] [INFO ] [MAIN ] BCH: Fetched primary data is valid. [2025-09-23T17:30:38.944744] [DEBUG] [LOCAL ] BCH: Saving primary data. [2025-09-23T17:30:38.946160] [DEBUG] [LOCAL ] BCH: Trimmed 40904 records to 29617 (keeping 200 days of data) [2025-09-23T17:30:39.069516] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-23T17:30:39.151345] [DEBUG] [LOCAL ] BCH: Primary data saved (29617 records). [2025-09-23T17:30:39.151483] [INFO ] [MAIN ] BCH: Full history saved. [2025-09-23T17:30:39.151588] [INFO ] [MAIN ] Update Progress: 235/2372 symbols completed. BCH took 27.9s. Estimated remaining: 4h 38m 15s. Rate: 7.7 symbols/min [2025-09-23T17:30:39.321867] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:30:39.344324] [DEBUG] [LOCAL ] BCX: Loaded 21767 existing records from primary storage. [2025-09-23T17:30:39.344444] [INFO ] [MAIN ] BCX: Loaded 21767 existing records. [2025-09-23T17:30:39.407357] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-08. [2025-09-23T17:30:39.522725] [WARN ] [MAIN ] BCX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:30:39.523278] [INFO ] [MAIN ] BCX: Wiping existing primary data before full refresh. [2025-09-23T17:30:39.523341] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-09-23T17:30:39.524096] [DEBUG] [LOCAL ] BCX: Deleted primary data file. [2025-09-23T17:30:39.524155] [INFO ] [MAIN ] BCX: Starting full primary refresh. [2025-09-23T17:30:39.882754] [INFO ] [REMOTE ] BCX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:30:40.111240] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-23T17:30:40.202251] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-09-23T17:30:40.288631] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-23T17:30:41.002196] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2024-12. [2025-09-23T17:30:41.754304] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-23T17:30:41.762723] [INFO ] [REMOTE ] BCS: Full fetch complete (76876 records). [2025-09-23T17:30:41.762862] [DEBUG] [VALIDATOR ] BCS: Validating primary data. [2025-09-23T17:30:41.763746] [FATAL] [VALIDATOR ] BCS: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:30:41.763837] [FATAL] [MAIN ] BCS: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:30:41.763915] [WARN ] [MAIN ] BCS: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:30:41.763990] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-09-23T17:30:41.764056] [DEBUG] [LOCAL ] BCS: No primary data file found to delete. [2025-09-23T17:30:41.764104] [INFO ] [LOCAL ] BCS: Starting deletion of derivative data. [2025-09-23T17:30:41.764543] [DEBUG] [LOCAL ] BCS: Deleted derivative data file. [2025-09-23T17:30:41.764677] [INFO ] [MAIN ] Update Progress: 236/2372 symbols completed. BCS took 28.2s. Estimated remaining: 4h 37m 20s. Rate: 7.7 symbols/min [2025-09-23T17:30:41.807390] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-09. [2025-09-23T17:30:41.947686] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:30:41.970912] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-23T17:30:41.994891] [DEBUG] [LOCAL ] BDC: Loaded 24906 existing records from primary storage. [2025-09-23T17:30:41.995046] [INFO ] [MAIN ] BDC: Loaded 24906 existing records. [2025-09-23T17:30:42.172450] [WARN ] [MAIN ] BDC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:30:42.172864] [INFO ] [MAIN ] BDC: Wiping existing primary data before full refresh. [2025-09-23T17:30:42.172919] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-09-23T17:30:42.173729] [DEBUG] [LOCAL ] BDC: Deleted primary data file. [2025-09-23T17:30:42.173790] [INFO ] [MAIN ] BDC: Starting full primary refresh. [2025-09-23T17:30:42.561502] [INFO ] [REMOTE ] BDC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:30:42.602234] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-01. [2025-09-23T17:30:43.015287] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-23T17:30:43.019751] [INFO ] [REMOTE ] BCO: Full fetch complete (36630 records). [2025-09-23T17:30:43.019851] [DEBUG] [VALIDATOR ] BCO: Validating primary data. [2025-09-23T17:30:43.022011] [FATAL] [VALIDATOR ] BCO: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:30:43.022101] [FATAL] [MAIN ] BCO: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:30:43.022144] [WARN ] [MAIN ] BCO: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:30:43.022183] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-09-23T17:30:43.022242] [DEBUG] [LOCAL ] BCO: No primary data file found to delete. [2025-09-23T17:30:43.022280] [INFO ] [LOCAL ] BCO: Starting deletion of derivative data. [2025-09-23T17:30:43.022730] [DEBUG] [LOCAL ] BCO: Deleted derivative data file. [2025-09-23T17:30:43.022829] [INFO ] [MAIN ] Update Progress: 237/2372 symbols completed. BCO took 31.6s. Estimated remaining: 4h 36m 14s. Rate: 7.7 symbols/min [2025-09-23T17:30:43.408111] [INFO ] [REMOTE ] BDC: Fetching primary data for 2024-12. [2025-09-23T17:30:43.410329] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-23T17:30:44.202220] [INFO ] [REMOTE ] BCX: Fetching primary data for 2024-12. [2025-09-23T17:30:44.306526] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-23T17:30:45.002209] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-02. [2025-09-23T17:30:45.432181] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-23T17:30:45.744134] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-23T17:30:45.802198] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-01. [2025-09-23T17:30:46.579202] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-23T17:30:46.602168] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-03. [2025-09-23T17:30:47.402252] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-01. [2025-09-23T17:30:47.582381] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-23T17:30:48.202213] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-02. [2025-09-23T17:30:48.668874] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-23T17:30:49.002229] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-02. [2025-09-23T17:30:49.346286] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-23T17:30:49.702335] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-23T17:30:49.802227] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-04. [2025-09-23T17:30:50.602211] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-03. [2025-09-23T17:30:50.913239] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-23T17:30:51.449249] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-05. [2025-09-23T17:30:51.466135] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-23T17:30:52.202259] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-04. [2025-09-23T17:30:52.400269] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-23T17:30:53.002175] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-06. [2025-09-23T17:30:53.466590] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-23T17:30:53.802198] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-05. [2025-09-23T17:30:53.907577] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-23T17:30:54.562294] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-23T17:30:54.602143] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-06. [2025-09-23T17:30:55.402222] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-07. [2025-09-23T17:30:55.778008] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-23T17:30:56.202195] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-03. [2025-09-23T17:30:56.318887] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-23T17:30:57.002195] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-07. [2025-09-23T17:30:57.375867] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-23T17:30:57.802223] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-08. [2025-09-23T17:30:57.949616] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-23T17:30:58.602225] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-04. [2025-09-23T17:30:58.704480] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-23T17:30:59.402223] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-09. [2025-09-23T17:30:59.537302] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-23T17:31:00.202210] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-08. [2025-09-23T17:31:00.725824] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-23T17:31:00.731448] [INFO ] [REMOTE ] BCSF: Full fetch complete (37905 records). [2025-09-23T17:31:00.731561] [DEBUG] [VALIDATOR ] BCSF: Validating primary data. [2025-09-23T17:31:01.007429] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-05. [2025-09-23T17:31:01.047812] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-23T17:31:01.128827] [DEBUG] [VALIDATOR ] BCSF: All expected trading days are present. [2025-09-23T17:31:01.128917] [DEBUG] [VALIDATOR ] BCSF: Primary data validation passed. [2025-09-23T17:31:01.129381] [INFO ] [MAIN ] BCSF: Fetched primary data is valid. [2025-09-23T17:31:01.129485] [DEBUG] [LOCAL ] BCSF: Saving primary data. [2025-09-23T17:31:01.130444] [DEBUG] [LOCAL ] BCSF: Trimmed 37905 records to 27779 (keeping 200 days of data) [2025-09-23T17:31:01.301575] [DEBUG] [LOCAL ] BCSF: Primary data saved (27779 records). [2025-09-23T17:31:01.301736] [INFO ] [MAIN ] BCSF: Full history saved. [2025-09-23T17:31:01.301859] [INFO ] [MAIN ] Update Progress: 238/2372 symbols completed. BCSF took 23.5s. Estimated remaining: 4h 37m 40s. Rate: 7.7 symbols/min [2025-09-23T17:31:01.781089] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-23T17:31:01.802148] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-06. [2025-09-23T17:31:02.602241] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-09. [2025-09-23T17:31:02.892297] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-23T17:31:03.402167] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-07. [2025-09-23T17:31:03.594775] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-23T17:31:03.598433] [INFO ] [REMOTE ] BCX: Full fetch complete (33928 records). [2025-09-23T17:31:03.598613] [DEBUG] [VALIDATOR ] BCX: Validating primary data. [2025-09-23T17:31:03.979296] [DEBUG] [VALIDATOR ] BCX: All expected trading days are present. [2025-09-23T17:31:03.979381] [DEBUG] [VALIDATOR ] BCX: Primary data validation passed. [2025-09-23T17:31:03.979863] [INFO ] [MAIN ] BCX: Fetched primary data is valid. [2025-09-23T17:31:03.979930] [DEBUG] [LOCAL ] BCX: Saving primary data. [2025-09-23T17:31:03.980899] [DEBUG] [LOCAL ] BCX: Trimmed 33928 records to 21721 (keeping 200 days of data) [2025-09-23T17:31:04.109142] [DEBUG] [LOCAL ] BCX: Primary data saved (21721 records). [2025-09-23T17:31:04.109275] [INFO ] [MAIN ] BCX: Full history saved. [2025-09-23T17:31:04.109359] [INFO ] [MAIN ] Update Progress: 239/2372 symbols completed. BCX took 25.0s. Estimated remaining: 4h 36m 48s. Rate: 7.7 symbols/min [2025-09-23T17:31:04.374549] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-23T17:31:04.380864] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-08. [2025-09-23T17:31:05.570987] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-23T17:31:05.576987] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-09. [2025-09-23T17:31:06.595097] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-23T17:31:06.599396] [INFO ] [REMOTE ] BDC: Full fetch complete (35719 records). [2025-09-23T17:31:06.599490] [DEBUG] [VALIDATOR ] BDC: Validating primary data. [2025-09-23T17:31:06.996184] [DEBUG] [VALIDATOR ] BDC: All expected trading days are present. [2025-09-23T17:31:06.996279] [DEBUG] [VALIDATOR ] BDC: Primary data validation passed. [2025-09-23T17:31:06.996802] [INFO ] [MAIN ] BDC: Fetched primary data is valid. [2025-09-23T17:31:06.996869] [DEBUG] [LOCAL ] BDC: Saving primary data. [2025-09-23T17:31:06.998164] [DEBUG] [LOCAL ] BDC: Trimmed 35719 records to 24877 (keeping 200 days of data) [2025-09-23T17:31:07.171537] [DEBUG] [LOCAL ] BDC: Primary data saved (24877 records). [2025-09-23T17:31:07.171705] [INFO ] [MAIN ] BDC: Full history saved. [2025-09-23T17:31:07.171801] [INFO ] [MAIN ] Update Progress: 240/2372 symbols completed. BDC took 25.4s. Estimated remaining: 4h 35m 58s. Rate: 7.7 symbols/min [2025-09-23T17:31:07.700005] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:31:07.831732] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:31:07.867356] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:31:07.932394] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:31:08.007270] [DEBUG] [LOCAL ] BDJ: Loaded 28984 existing records from primary storage. [2025-09-23T17:31:08.007694] [INFO ] [MAIN ] BDJ: Loaded 28984 existing records. [2025-09-23T17:31:08.064493] [DEBUG] [LOCAL ] BE: Loaded 53653 existing records from primary storage. [2025-09-23T17:31:08.096688] [INFO ] [MAIN ] BE: Loaded 53653 existing records. [2025-09-23T17:31:08.186703] [DEBUG] [LOCAL ] BDN: Loaded 47620 existing records from primary storage. [2025-09-23T17:31:08.305859] [INFO ] [MAIN ] BDN: Loaded 47620 existing records. [2025-09-23T17:31:08.300567] [DEBUG] [LOCAL ] BDX: Loaded 52497 existing records from primary storage. [2025-09-23T17:31:08.322666] [INFO ] [MAIN ] BDX: Loaded 52497 existing records. [2025-09-23T17:31:08.563753] [WARN ] [MAIN ] BDJ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:31:08.615048] [WARN ] [MAIN ] BE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:31:08.633877] [INFO ] [MAIN ] BE: Wiping existing primary data before full refresh. [2025-09-23T17:31:08.634566] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-09-23T17:31:08.634106] [INFO ] [MAIN ] BDJ: Wiping existing primary data before full refresh. [2025-09-23T17:31:08.662188] [DEBUG] [LOCAL ] BE: Deleted primary data file. [2025-09-23T17:31:08.662137] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-09-23T17:31:08.667470] [INFO ] [MAIN ] BE: Starting full primary refresh. [2025-09-23T17:31:08.711101] [DEBUG] [LOCAL ] BDJ: Deleted primary data file. [2025-09-23T17:31:08.756301] [INFO ] [MAIN ] BDJ: Starting full primary refresh. [2025-09-23T17:31:08.990164] [WARN ] [MAIN ] BDN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:31:09.056266] [WARN ] [MAIN ] BDX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:31:09.066481] [INFO ] [MAIN ] BDN: Wiping existing primary data before full refresh. [2025-09-23T17:31:09.060762] [INFO ] [MAIN ] BDX: Wiping existing primary data before full refresh. [2025-09-23T17:31:09.082277] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-09-23T17:31:09.082381] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-09-23T17:31:09.121856] [DEBUG] [LOCAL ] BDN: Deleted primary data file. [2025-09-23T17:31:09.127186] [INFO ] [MAIN ] BDN: Starting full primary refresh. [2025-09-23T17:31:09.127305] [DEBUG] [LOCAL ] BDX: Deleted primary data file. [2025-09-23T17:31:09.132679] [INFO ] [MAIN ] BDX: Starting full primary refresh. [2025-09-23T17:31:09.969370] [INFO ] [REMOTE ] BE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:31:10.065423] [INFO ] [REMOTE ] BDJ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:31:10.075897] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2024-12. [2025-09-23T17:31:10.062283] [INFO ] [REMOTE ] BE: Fetching primary data for 2024-12. [2025-09-23T17:31:10.390900] [INFO ] [REMOTE ] BDN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:31:10.424670] [INFO ] [REMOTE ] BDN: Fetching primary data for 2024-12. [2025-09-23T17:31:10.464960] [INFO ] [REMOTE ] BDX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:31:10.465387] [INFO ] [REMOTE ] BDX: Fetching primary data for 2024-12. [2025-09-23T17:31:10.938293] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-23T17:31:10.944717] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-01. [2025-09-23T17:31:11.813736] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-23T17:31:11.833577] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-02. [2025-09-23T17:31:11.836612] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-23T17:31:11.848149] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-01. [2025-09-23T17:31:12.060701] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-23T17:31:12.072388] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-01. [2025-09-23T17:31:12.311525] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-09-23T17:31:12.322445] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-01. [2025-09-23T17:31:12.710520] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-23T17:31:13.002220] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-03. [2025-09-23T17:31:13.076124] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-23T17:31:13.460515] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-23T17:31:13.802238] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-02. [2025-09-23T17:31:14.065303] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-23T17:31:14.481537] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-23T17:31:14.602208] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-02. [2025-09-23T17:31:15.169396] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-23T17:31:15.402210] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-02. [2025-09-23T17:31:16.202177] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-03. [2025-09-23T17:31:16.527305] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-23T17:31:16.826268] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-23T17:31:17.002201] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-04. [2025-09-23T17:31:17.484129] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-23T17:31:17.802232] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-03. [2025-09-23T17:31:18.075004] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-23T17:31:18.602240] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-04. [2025-09-23T17:31:19.262662] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-23T17:31:19.402224] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-04. [2025-09-23T17:31:20.017054] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-23T17:31:20.202198] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-05. [2025-09-23T17:31:20.901002] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-23T17:31:21.002228] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-03. [2025-09-23T17:31:21.436209] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-23T17:31:21.802213] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-05. [2025-09-23T17:31:22.602186] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-05. [2025-09-23T17:31:23.183602] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-23T17:31:23.402198] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-06. [2025-09-23T17:31:23.430567] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-23T17:31:23.521877] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-23T17:31:24.202238] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-06. [2025-09-23T17:31:24.585533] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-23T17:31:25.002208] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-04. [2025-09-23T17:31:25.093991] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-23T17:31:25.802242] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-06. [2025-09-23T17:31:26.469336] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-23T17:31:26.602295] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-07. [2025-09-23T17:31:27.407361] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-05. [2025-09-23T17:31:27.419792] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-23T17:31:27.631915] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-23T17:31:28.202291] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-07. [2025-09-23T17:31:29.002282] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-08. [2025-09-23T17:31:29.503584] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-23T17:31:29.780021] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-23T17:31:29.803695] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-09. [2025-09-23T17:31:29.803560] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-23T17:31:30.602310] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-08. [2025-09-23T17:31:30.829412] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-23T17:31:30.837470] [INFO ] [REMOTE ] BDJ: Full fetch complete (42685 records). [2025-09-23T17:31:30.837677] [DEBUG] [VALIDATOR ] BDJ: Validating primary data. [2025-09-23T17:31:31.270422] [DEBUG] [VALIDATOR ] BDJ: All expected trading days are present. [2025-09-23T17:31:31.270515] [DEBUG] [VALIDATOR ] BDJ: Primary data validation passed. [2025-09-23T17:31:31.271114] [INFO ] [MAIN ] BDJ: Fetched primary data is valid. [2025-09-23T17:31:31.271180] [DEBUG] [LOCAL ] BDJ: Saving primary data. [2025-09-23T17:31:31.272339] [DEBUG] [LOCAL ] BDJ: Trimmed 42685 records to 28925 (keeping 200 days of data) [2025-09-23T17:31:31.403227] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-07. [2025-09-23T17:31:31.458458] [DEBUG] [LOCAL ] BDJ: Primary data saved (28925 records). [2025-09-23T17:31:31.458609] [INFO ] [MAIN ] BDJ: Full history saved. [2025-09-23T17:31:31.458727] [INFO ] [MAIN ] Update Progress: 241/2372 symbols completed. BDJ took 24.3s. Estimated remaining: 4h 38m 16s. Rate: 7.7 symbols/min [2025-09-23T17:31:31.673717] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:31:31.673991] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-09-23T17:31:31.674046] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-09-23T17:31:31.674190] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-09-23T17:31:31.674232] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-09-23T17:31:31.674272] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-09-23T17:31:31.674303] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-09-23T17:31:32.068525] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:31:32.195442] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-23T17:31:32.205811] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2024-12. [2025-09-23T17:31:32.645769] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-23T17:31:32.873723] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-23T17:31:33.002206] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-09. [2025-09-23T17:31:33.802242] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-06. [2025-09-23T17:31:34.459416] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-23T17:31:34.468251] [INFO ] [REMOTE ] BDX: Full fetch complete (75917 records). [2025-09-23T17:31:34.468464] [DEBUG] [VALIDATOR ] BDX: Validating primary data. [2025-09-23T17:31:34.620153] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-08. [2025-09-23T17:31:34.885577] [DEBUG] [VALIDATOR ] BDX: All expected trading days are present. [2025-09-23T17:31:34.885698] [DEBUG] [VALIDATOR ] BDX: Primary data validation passed. [2025-09-23T17:31:34.886541] [INFO ] [MAIN ] BDX: Fetched primary data is valid. [2025-09-23T17:31:34.886593] [DEBUG] [LOCAL ] BDX: Saving primary data. [2025-09-23T17:31:34.888270] [DEBUG] [LOCAL ] BDX: Trimmed 75917 records to 52492 (keeping 200 days of data) [2025-09-23T17:31:35.227306] [DEBUG] [LOCAL ] BDX: Primary data saved (52492 records). [2025-09-23T17:31:35.227461] [INFO ] [MAIN ] BDX: Full history saved. [2025-09-23T17:31:35.227552] [INFO ] [MAIN ] Update Progress: 242/2372 symbols completed. BDX took 28.1s. Estimated remaining: 4h 37m 33s. Rate: 7.7 symbols/min [2025-09-23T17:31:35.404554] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-01. [2025-09-23T17:31:35.410428] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:31:35.467373] [DEBUG] [LOCAL ] BEKE: Loaded 53261 existing records from primary storage. [2025-09-23T17:31:35.467523] [INFO ] [MAIN ] BEKE: Loaded 53261 existing records. [2025-09-23T17:31:35.650763] [WARN ] [MAIN ] BEKE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:31:35.651067] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-09-23T17:31:35.651122] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-09-23T17:31:35.652394] [DEBUG] [LOCAL ] BEKE: Deleted primary data file. [2025-09-23T17:31:35.652455] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-09-23T17:31:35.747796] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-23T17:31:36.030949] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:31:36.062289] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-09-23T17:31:36.202197] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2024-12. [2025-09-23T17:31:36.341684] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-23T17:31:37.002230] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-09-23T17:31:37.264279] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-09-23T17:31:37.590779] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-23T17:31:37.802203] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-07. [2025-09-23T17:31:38.602205] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-09-23T17:31:38.896264] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-09-23T17:31:39.402187] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-09. [2025-09-23T17:31:39.460415] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-23T17:31:40.202221] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-08. [2025-09-23T17:31:40.834846] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-23T17:31:40.843063] [INFO ] [REMOTE ] BDN: Full fetch complete (69271 records). [2025-09-23T17:31:40.843207] [DEBUG] [VALIDATOR ] BDN: Validating primary data. [2025-09-23T17:31:41.007319] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-01. [2025-09-23T17:31:41.266397] [DEBUG] [VALIDATOR ] BDN: All expected trading days are present. [2025-09-23T17:31:41.266476] [DEBUG] [VALIDATOR ] BDN: Primary data validation passed. [2025-09-23T17:31:41.267196] [INFO ] [MAIN ] BDN: Fetched primary data is valid. [2025-09-23T17:31:41.267260] [DEBUG] [LOCAL ] BDN: Saving primary data. [2025-09-23T17:31:41.268589] [DEBUG] [LOCAL ] BDN: Trimmed 69271 records to 47615 (keeping 200 days of data) [2025-09-23T17:31:41.541920] [DEBUG] [LOCAL ] BDN: Primary data saved (47615 records). [2025-09-23T17:31:41.542059] [INFO ] [MAIN ] BDN: Full history saved. [2025-09-23T17:31:41.542145] [INFO ] [MAIN ] Update Progress: 243/2372 symbols completed. BDN took 34.4s. Estimated remaining: 4h 37m 12s. Rate: 7.7 symbols/min [2025-09-23T17:31:41.712181] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:31:41.765961] [DEBUG] [LOCAL ] BEN: Loaded 53067 existing records from primary storage. [2025-09-23T17:31:41.766218] [INFO ] [MAIN ] BEN: Loaded 53067 existing records. [2025-09-23T17:31:41.822416] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-09-23T17:31:41.956521] [WARN ] [MAIN ] BEN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:31:41.957012] [INFO ] [MAIN ] BEN: Wiping existing primary data before full refresh. [2025-09-23T17:31:41.957111] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-09-23T17:31:41.959940] [DEBUG] [LOCAL ] BEN: Deleted primary data file. [2025-09-23T17:31:41.960019] [INFO ] [MAIN ] BEN: Starting full primary refresh. [2025-09-23T17:31:42.294562] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-23T17:31:42.363558] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-23T17:31:42.437347] [INFO ] [REMOTE ] BEN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:31:42.527385] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-23T17:31:42.602190] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-09-23T17:31:43.402281] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-09. [2025-09-23T17:31:43.872394] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-23T17:31:44.202236] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-09-23T17:31:44.636443] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-23T17:31:45.002200] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-09-23T17:31:45.266898] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-09-23T17:31:45.377988] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-23T17:31:45.390498] [INFO ] [REMOTE ] BE: Full fetch complete (77272 records). [2025-09-23T17:31:45.390719] [DEBUG] [VALIDATOR ] BE: Validating primary data. [2025-09-23T17:31:45.391669] [FATAL] [VALIDATOR ] BE: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:31:45.391775] [FATAL] [MAIN ] BE: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:31:45.391818] [WARN ] [MAIN ] BE: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:31:45.391860] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-09-23T17:31:45.391960] [DEBUG] [LOCAL ] BE: No primary data file found to delete. [2025-09-23T17:31:45.392018] [INFO ] [LOCAL ] BE: Starting deletion of derivative data. [2025-09-23T17:31:45.392557] [DEBUG] [LOCAL ] BE: Deleted derivative data file. [2025-09-23T17:31:45.392745] [INFO ] [MAIN ] Update Progress: 244/2372 symbols completed. BE took 38.2s. Estimated remaining: 4h 36m 29s. Rate: 7.7 symbols/min [2025-09-23T17:31:45.569061] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:31:45.611118] [DEBUG] [LOCAL ] BEP: Loaded 38703 existing records from primary storage. [2025-09-23T17:31:45.611291] [INFO ] [MAIN ] BEP: Loaded 38703 existing records. [2025-09-23T17:31:45.805457] [INFO ] [REMOTE ] BEN: Fetching primary data for 2024-12. [2025-09-23T17:31:45.805758] [WARN ] [MAIN ] BEP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:31:45.807089] [INFO ] [MAIN ] BEP: Wiping existing primary data before full refresh. [2025-09-23T17:31:45.807164] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-09-23T17:31:45.808363] [DEBUG] [LOCAL ] BEP: Deleted primary data file. [2025-09-23T17:31:45.808434] [INFO ] [MAIN ] BEP: Starting full primary refresh. [2025-09-23T17:31:46.182319] [INFO ] [REMOTE ] BEP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:31:46.602208] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-09-23T17:31:47.402365] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-09-23T17:31:47.853358] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-23T17:31:47.899014] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-23T17:31:48.202190] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-09-23T17:31:48.450307] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.25 seconds). [2025-09-23T17:31:48.767306] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-23T17:31:49.002199] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-09-23T17:31:49.802460] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-01. [2025-09-23T17:31:50.591487] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-23T17:31:50.603887] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-09-23T17:31:50.988669] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-23T17:31:50.989454] [INFO ] [REMOTE ] BEDU: Full fetch complete (1400 records). [2025-09-23T17:31:50.989521] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-09-23T17:31:51.178025] [WARN ] [VALIDATOR ] BEDU: Validation failed - insufficient historical data. Have 168 unique days, need 200 days [2025-09-23T17:31:51.178255] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:31:51.178343] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:31:51.178439] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-09-23T17:31:51.178523] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-09-23T17:31:51.178561] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-09-23T17:31:51.178602] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-09-23T17:31:51.178691] [INFO ] [MAIN ] Update Progress: 245/2372 symbols completed. BEDU took 19.7s. Estimated remaining: 4h 36m 4s. Rate: 7.7 symbols/min [2025-09-23T17:31:51.353390] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:31:51.353709] [DEBUG] [LOCAL ] BEPC: No existing data file found in primary storage. [2025-09-23T17:31:51.353831] [WARN ] [MAIN ] BEPC: No existing data found, performing full refresh instead. [2025-09-23T17:31:51.354191] [INFO ] [MAIN ] BEPC: Wiping existing primary data before full refresh. [2025-09-23T17:31:51.354297] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-09-23T17:31:51.354369] [DEBUG] [LOCAL ] BEPC: No primary data file found to delete. [2025-09-23T17:31:51.354420] [INFO ] [MAIN ] BEPC: Starting full primary refresh. [2025-09-23T17:31:51.409680] [INFO ] [REMOTE ] BEP: Fetching primary data for 2024-12. [2025-09-23T17:31:51.742598] [INFO ] [REMOTE ] BEPC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:31:51.775004] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-23T17:31:52.202193] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-09-23T17:31:52.639996] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-23T17:31:53.002166] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-01. [2025-09-23T17:31:53.802199] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-02. [2025-09-23T17:31:54.043713] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-23T17:31:54.299027] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-23T17:31:54.602214] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-02. [2025-09-23T17:31:55.158526] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-23T17:31:55.402233] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-09-23T17:31:55.744956] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-23T17:31:56.202189] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-03. [2025-09-23T17:31:57.002192] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-03. [2025-09-23T17:31:57.133436] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-23T17:31:57.802222] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-09-23T17:31:58.031905] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-23T17:31:58.260462] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-23T17:31:58.602179] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-04. [2025-09-23T17:31:59.402177] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-04. [2025-09-23T17:31:59.467188] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-23T17:31:59.949205] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-23T17:32:00.202197] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-05. [2025-09-23T17:32:00.576418] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-23T17:32:01.002192] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-05. [2025-09-23T17:32:01.482587] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-23T17:32:01.802213] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2024-12. [2025-09-23T17:32:02.032624] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-23T17:32:02.602245] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-06. [2025-09-23T17:32:03.358044] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-23T17:32:03.402241] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-01. [2025-09-23T17:32:03.696467] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-23T17:32:04.202192] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-07. [2025-09-23T17:32:04.675743] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-23T17:32:05.002201] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-06. [2025-09-23T17:32:05.461959] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-23T17:32:05.802202] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-02. [2025-09-23T17:32:06.602209] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-08. [2025-09-23T17:32:06.741471] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-23T17:32:06.960832] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-23T17:32:07.402191] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-07. [2025-09-23T17:32:07.724678] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-23T17:32:08.202189] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-03. [2025-09-23T17:32:09.002248] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-09-23T17:32:09.065736] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-23T17:32:09.489293] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-23T17:32:09.802200] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-08. [2025-09-23T17:32:10.127154] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-23T17:32:10.133378] [INFO ] [REMOTE ] BEP: Full fetch complete (58350 records). [2025-09-23T17:32:10.133507] [DEBUG] [VALIDATOR ] BEP: Validating primary data. [2025-09-23T17:32:10.518589] [DEBUG] [VALIDATOR ] BEP: All expected trading days are present. [2025-09-23T17:32:10.518730] [DEBUG] [VALIDATOR ] BEP: Primary data validation passed. [2025-09-23T17:32:10.519386] [INFO ] [MAIN ] BEP: Fetched primary data is valid. [2025-09-23T17:32:10.519431] [DEBUG] [LOCAL ] BEP: Saving primary data. [2025-09-23T17:32:10.520887] [DEBUG] [LOCAL ] BEP: Trimmed 58350 records to 38607 (keeping 200 days of data) [2025-09-23T17:32:10.611017] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-04. [2025-09-23T17:32:10.763613] [DEBUG] [LOCAL ] BEP: Primary data saved (38607 records). [2025-09-23T17:32:10.763782] [INFO ] [MAIN ] BEP: Full history saved. [2025-09-23T17:32:10.763883] [INFO ] [MAIN ] Update Progress: 246/2372 symbols completed. BEP took 25.4s. Estimated remaining: 4h 37m 38s. Rate: 7.7 symbols/min [2025-09-23T17:32:10.932530] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:32:10.940192] [DEBUG] [LOCAL ] BEPH: Loaded 5153 existing records from primary storage. [2025-09-23T17:32:10.940294] [INFO ] [MAIN ] BEPH: Loaded 5153 existing records. [2025-09-23T17:32:11.119841] [WARN ] [MAIN ] BEPH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:32:11.120108] [INFO ] [MAIN ] BEPH: Wiping existing primary data before full refresh. [2025-09-23T17:32:11.120155] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-09-23T17:32:11.120498] [DEBUG] [LOCAL ] BEPH: Deleted primary data file. [2025-09-23T17:32:11.120558] [INFO ] [MAIN ] BEPH: Starting full primary refresh. [2025-09-23T17:32:11.404699] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-09-23T17:32:11.499935] [INFO ] [REMOTE ] BEPH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:32:11.519626] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-23T17:32:11.820284] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-23T17:32:12.202209] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-09. [2025-09-23T17:32:13.002238] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2024-12. [2025-09-23T17:32:13.142850] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-23T17:32:13.654087] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-23T17:32:13.663041] [INFO ] [REMOTE ] BEN: Full fetch complete (76885 records). [2025-09-23T17:32:13.663208] [DEBUG] [VALIDATOR ] BEN: Validating primary data. [2025-09-23T17:32:13.784733] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-23T17:32:13.802288] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-05. [2025-09-23T17:32:14.079792] [DEBUG] [VALIDATOR ] BEN: All expected trading days are present. [2025-09-23T17:32:14.079875] [DEBUG] [VALIDATOR ] BEN: Primary data validation passed. [2025-09-23T17:32:14.080617] [INFO ] [MAIN ] BEN: Fetched primary data is valid. [2025-09-23T17:32:14.080692] [DEBUG] [LOCAL ] BEN: Saving primary data. [2025-09-23T17:32:14.082168] [DEBUG] [LOCAL ] BEN: Trimmed 76885 records to 53062 (keeping 200 days of data) [2025-09-23T17:32:14.406234] [DEBUG] [LOCAL ] BEN: Primary data saved (53062 records). [2025-09-23T17:32:14.406365] [INFO ] [MAIN ] BEN: Full history saved. [2025-09-23T17:32:14.406449] [INFO ] [MAIN ] Update Progress: 247/2372 symbols completed. BEN took 32.9s. Estimated remaining: 4h 36m 54s. Rate: 7.7 symbols/min [2025-09-23T17:32:14.579618] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:32:14.585186] [DEBUG] [LOCAL ] BEPI: Loaded 3415 existing records from primary storage. [2025-09-23T17:32:14.585326] [INFO ] [MAIN ] BEPI: Loaded 3415 existing records. [2025-09-23T17:32:14.607331] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-09-23T17:32:14.776155] [WARN ] [MAIN ] BEPI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:32:14.776484] [INFO ] [MAIN ] BEPI: Wiping existing primary data before full refresh. [2025-09-23T17:32:14.776544] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-09-23T17:32:14.776853] [DEBUG] [LOCAL ] BEPI: Deleted primary data file. [2025-09-23T17:32:14.776914] [INFO ] [MAIN ] BEPI: Starting full primary refresh. [2025-09-23T17:32:15.137765] [INFO ] [REMOTE ] BEPI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:32:15.201046] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-23T17:32:15.402243] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-06. [2025-09-23T17:32:16.202231] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-01. [2025-09-23T17:32:16.360635] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-23T17:32:16.369987] [INFO ] [REMOTE ] BEKE: Full fetch complete (77204 records). [2025-09-23T17:32:16.370134] [DEBUG] [VALIDATOR ] BEKE: Validating primary data. [2025-09-23T17:32:16.715902] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-23T17:32:16.828290] [DEBUG] [VALIDATOR ] BEKE: All expected trading days are present. [2025-09-23T17:32:16.828399] [DEBUG] [VALIDATOR ] BEKE: Primary data validation passed. [2025-09-23T17:32:16.829252] [INFO ] [MAIN ] BEKE: Fetched primary data is valid. [2025-09-23T17:32:16.829447] [DEBUG] [LOCAL ] BEKE: Saving primary data. [2025-09-23T17:32:16.831103] [DEBUG] [LOCAL ] BEKE: Trimmed 77204 records to 53257 (keeping 200 days of data) [2025-09-23T17:32:16.966930] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-23T17:32:17.044245] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-07. [2025-09-23T17:32:17.200081] [DEBUG] [LOCAL ] BEKE: Primary data saved (53257 records). [2025-09-23T17:32:17.200251] [INFO ] [MAIN ] BEKE: Full history saved. [2025-09-23T17:32:17.200364] [INFO ] [MAIN ] Update Progress: 248/2372 symbols completed. BEKE took 42.0s. Estimated remaining: 4h 36m 4s. Rate: 7.7 symbols/min [2025-09-23T17:32:17.370831] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:32:17.375700] [DEBUG] [LOCAL ] BEPJ: Loaded 3285 existing records from primary storage. [2025-09-23T17:32:17.375780] [INFO ] [MAIN ] BEPJ: Loaded 3285 existing records. [2025-09-23T17:32:17.551498] [WARN ] [MAIN ] BEPJ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:32:17.551829] [INFO ] [MAIN ] BEPJ: Wiping existing primary data before full refresh. [2025-09-23T17:32:17.551878] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-09-23T17:32:17.552166] [DEBUG] [LOCAL ] BEPJ: Deleted primary data file. [2025-09-23T17:32:17.552224] [INFO ] [MAIN ] BEPJ: Starting full primary refresh. [2025-09-23T17:32:17.807410] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2024-12. [2025-09-23T17:32:17.907369] [INFO ] [REMOTE ] BEPJ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:32:18.209057] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-23T17:32:18.335338] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-23T17:32:18.602213] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-08. [2025-09-23T17:32:19.402222] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-02. [2025-09-23T17:32:19.968750] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-23T17:32:20.202241] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-01. [2025-09-23T17:32:20.334351] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-23T17:32:20.685957] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-23T17:32:21.002435] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-02. [2025-09-23T17:32:21.329399] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-23T17:32:21.802278] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2024-12. [2025-09-23T17:32:22.379409] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-23T17:32:22.602251] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-09. [2025-09-23T17:32:23.402235] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-03. [2025-09-23T17:32:23.612768] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-23T17:32:23.621256] [INFO ] [REMOTE ] BEPC: Full fetch complete (68403 records). [2025-09-23T17:32:23.621400] [DEBUG] [VALIDATOR ] BEPC: Validating primary data. [2025-09-23T17:32:23.822981] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-23T17:32:24.076727] [DEBUG] [VALIDATOR ] BEPC: All expected trading days are present. [2025-09-23T17:32:24.076845] [DEBUG] [VALIDATOR ] BEPC: Primary data validation passed. [2025-09-23T17:32:24.077679] [INFO ] [MAIN ] BEPC: Fetched primary data is valid. [2025-09-23T17:32:24.077749] [DEBUG] [LOCAL ] BEPC: Saving primary data. [2025-09-23T17:32:24.079289] [DEBUG] [LOCAL ] BEPC: Trimmed 68403 records to 46516 (keeping 200 days of data) [2025-09-23T17:32:24.202785] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-03. [2025-09-23T17:32:24.395526] [DEBUG] [LOCAL ] BEPC: Primary data saved (46516 records). [2025-09-23T17:32:24.395702] [INFO ] [MAIN ] BEPC: Full history saved. [2025-09-23T17:32:24.395800] [INFO ] [MAIN ] Update Progress: 249/2372 symbols completed. BEPC took 33.2s. Estimated remaining: 4h 35m 51s. Rate: 7.7 symbols/min [2025-09-23T17:32:24.567264] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:32:24.606338] [DEBUG] [LOCAL ] BFAM: Loaded 33000 existing records from primary storage. [2025-09-23T17:32:24.606537] [INFO ] [MAIN ] BFAM: Loaded 33000 existing records. [2025-09-23T17:32:24.788686] [WARN ] [MAIN ] BFAM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:32:24.793874] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-23T17:32:24.796395] [INFO ] [MAIN ] BFAM: Wiping existing primary data before full refresh. [2025-09-23T17:32:24.796461] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-09-23T17:32:24.797602] [DEBUG] [LOCAL ] BFAM: Deleted primary data file. [2025-09-23T17:32:24.797701] [INFO ] [MAIN ] BFAM: Starting full primary refresh. [2025-09-23T17:32:25.012416] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-01. [2025-09-23T17:32:25.176987] [INFO ] [REMOTE ] BFAM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:32:25.709435] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-23T17:32:25.802244] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2024-12. [2025-09-23T17:32:26.602194] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-04. [2025-09-23T17:32:26.986849] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-23T17:32:27.237842] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-23T17:32:27.402198] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-05. [2025-09-23T17:32:27.811978] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-23T17:32:28.202194] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-04. [2025-09-23T17:32:28.595099] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-23T17:32:29.002241] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-01. [2025-09-23T17:32:29.802214] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-05. [2025-09-23T17:32:29.922008] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-23T17:32:30.171989] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-23T17:32:30.602199] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-06. [2025-09-23T17:32:31.275939] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-23T17:32:31.402257] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-02. [2025-09-23T17:32:31.739604] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-23T17:32:32.202213] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-06. [2025-09-23T17:32:32.701060] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-23T17:32:33.002203] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-07. [2025-09-23T17:32:33.383434] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-23T17:32:33.802214] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-07. [2025-09-23T17:32:34.152148] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-23T17:32:34.602249] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-08. [2025-09-23T17:32:34.939074] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-23T17:32:35.402230] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-02. [2025-09-23T17:32:36.202238] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-03. [2025-09-23T17:32:36.327243] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-23T17:32:36.709303] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-23T17:32:37.002239] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-09. [2025-09-23T17:32:37.477215] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-23T17:32:37.478240] [INFO ] [REMOTE ] BEPI: Full fetch complete (4954 records). [2025-09-23T17:32:37.478315] [DEBUG] [VALIDATOR ] BEPI: Validating primary data. [2025-09-23T17:32:37.478731] [FATAL] [VALIDATOR ] BEPI: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:32:37.478817] [FATAL] [MAIN ] BEPI: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:32:37.478861] [WARN ] [MAIN ] BEPI: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:32:37.478931] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-09-23T17:32:37.479030] [DEBUG] [LOCAL ] BEPI: No primary data file found to delete. [2025-09-23T17:32:37.479104] [INFO ] [LOCAL ] BEPI: Starting deletion of derivative data. [2025-09-23T17:32:37.479753] [DEBUG] [LOCAL ] BEPI: Deleted derivative data file. [2025-09-23T17:32:37.479854] [INFO ] [MAIN ] Update Progress: 250/2372 symbols completed. BEPI took 23.1s. Estimated remaining: 4h 36m 28s. Rate: 7.7 symbols/min [2025-09-23T17:32:37.652434] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:32:37.691448] [DEBUG] [LOCAL ] BFH: Loaded 41822 existing records from primary storage. [2025-09-23T17:32:37.691586] [INFO ] [MAIN ] BFH: Loaded 41822 existing records. [2025-09-23T17:32:37.807348] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-03. [2025-09-23T17:32:37.885358] [WARN ] [MAIN ] BFH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:32:37.885636] [INFO ] [MAIN ] BFH: Wiping existing primary data before full refresh. [2025-09-23T17:32:37.885717] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-09-23T17:32:37.887035] [DEBUG] [LOCAL ] BFH: Deleted primary data file. [2025-09-23T17:32:37.887106] [INFO ] [MAIN ] BFH: Starting full primary refresh. [2025-09-23T17:32:38.264908] [INFO ] [REMOTE ] BFH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:32:38.602224] [INFO ] [REMOTE ] BFH: Fetching primary data for 2024-12. [2025-09-23T17:32:38.847003] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-23T17:32:39.402227] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-08. [2025-09-23T17:32:39.720162] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-23T17:32:39.867558] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-23T17:32:40.202239] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-04. [2025-09-23T17:32:40.505458] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-09-23T17:32:41.002248] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-01. [2025-09-23T17:32:41.802232] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-04. [2025-09-23T17:32:42.537868] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-23T17:32:42.602153] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-02. [2025-09-23T17:32:42.920131] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-23T17:32:43.402213] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-05. [2025-09-23T17:32:43.611619] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-23T17:32:44.202397] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-09. [2025-09-23T17:32:44.715383] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-23T17:32:44.717919] [INFO ] [REMOTE ] BEPH: Full fetch complete (7500 records). [2025-09-23T17:32:44.718052] [DEBUG] [VALIDATOR ] BEPH: Validating primary data. [2025-09-23T17:32:44.868044] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-23T17:32:45.007336] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-05. [2025-09-23T17:32:45.151409] [DEBUG] [VALIDATOR ] BEPH: All expected trading days are present. [2025-09-23T17:32:45.151492] [DEBUG] [VALIDATOR ] BEPH: Primary data validation passed. [2025-09-23T17:32:45.151705] [INFO ] [MAIN ] BEPH: Fetched primary data is valid. [2025-09-23T17:32:45.151766] [DEBUG] [LOCAL ] BEPH: Saving primary data. [2025-09-23T17:32:45.152164] [DEBUG] [LOCAL ] BEPH: Trimmed 7500 records to 5122 (keeping 200 days of data) [2025-09-23T17:32:45.186542] [DEBUG] [LOCAL ] BEPH: Primary data saved (5122 records). [2025-09-23T17:32:45.186622] [INFO ] [MAIN ] BEPH: Full history saved. [2025-09-23T17:32:45.186735] [INFO ] [MAIN ] Update Progress: 251/2372 symbols completed. BEPH took 34.4s. Estimated remaining: 4h 36m 19s. Rate: 7.7 symbols/min [2025-09-23T17:32:45.353267] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:32:45.368854] [DEBUG] [LOCAL ] BFK: Loaded 14045 existing records from primary storage. [2025-09-23T17:32:45.368978] [INFO ] [MAIN ] BFK: Loaded 14045 existing records. [2025-09-23T17:32:45.481927] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-23T17:32:45.562096] [WARN ] [MAIN ] BFK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:32:45.562372] [INFO ] [MAIN ] BFK: Wiping existing primary data before full refresh. [2025-09-23T17:32:45.562478] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-09-23T17:32:45.563052] [DEBUG] [LOCAL ] BFK: Deleted primary data file. [2025-09-23T17:32:45.563122] [INFO ] [MAIN ] BFK: Starting full primary refresh. [2025-09-23T17:32:45.807435] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-06. [2025-09-23T17:32:45.914572] [INFO ] [REMOTE ] BFK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:32:46.216242] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-23T17:32:46.602209] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-06. [2025-09-23T17:32:47.402223] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-03. [2025-09-23T17:32:47.499602] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-23T17:32:48.202202] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-07. [2025-09-23T17:32:48.721570] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-23T17:32:48.869049] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-23T17:32:49.002197] [INFO ] [REMOTE ] BFK: Fetching primary data for 2024-12. [2025-09-23T17:32:49.717756] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-23T17:32:49.802213] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-01. [2025-09-23T17:32:50.358963] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-23T17:32:50.602214] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-02. [2025-09-23T17:32:51.402227] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-07. [2025-09-23T17:32:51.504704] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-23T17:32:52.202220] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-04. [2025-09-23T17:32:52.836119] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-23T17:32:53.002210] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-08. [2025-09-23T17:32:53.324037] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-23T17:32:53.580781] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-23T17:32:53.802207] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-03. [2025-09-23T17:32:54.602261] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-08. [2025-09-23T17:32:54.623168] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-23T17:32:55.402196] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-04. [2025-09-23T17:32:55.842552] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-23T17:32:56.037216] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-23T17:32:56.202233] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-09. [2025-09-23T17:32:57.002212] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-05. [2025-09-23T17:32:57.814404] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-09. [2025-09-23T17:32:57.835618] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-23T17:32:57.836694] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-23T17:32:57.845353] [INFO ] [REMOTE ] BFAM: Full fetch complete (47055 records). [2025-09-23T17:32:57.845745] [DEBUG] [VALIDATOR ] BFAM: Validating primary data. [2025-09-23T17:32:58.255386] [DEBUG] [VALIDATOR ] BFAM: All expected trading days are present. [2025-09-23T17:32:58.255546] [DEBUG] [VALIDATOR ] BFAM: Primary data validation passed. [2025-09-23T17:32:58.256436] [INFO ] [MAIN ] BFAM: Fetched primary data is valid. [2025-09-23T17:32:58.256533] [DEBUG] [LOCAL ] BFAM: Saving primary data. [2025-09-23T17:32:58.262399] [DEBUG] [LOCAL ] BFAM: Trimmed 47055 records to 33044 (keeping 200 days of data) [2025-09-23T17:32:58.329874] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-23T17:32:58.357763] [INFO ] [REMOTE ] BEPJ: Full fetch complete (4516 records). [2025-09-23T17:32:58.358300] [DEBUG] [VALIDATOR ] BEPJ: Validating primary data. [2025-09-23T17:32:58.611320] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-05. [2025-09-23T17:32:58.750923] [DEBUG] [VALIDATOR ] BEPJ: All expected trading days are present. [2025-09-23T17:32:58.751806] [DEBUG] [VALIDATOR ] BEPJ: Primary data validation passed. [2025-09-23T17:32:58.752242] [INFO ] [MAIN ] BEPJ: Fetched primary data is valid. [2025-09-23T17:32:58.752315] [DEBUG] [LOCAL ] BEPJ: Saving primary data. [2025-09-23T17:32:58.754147] [DEBUG] [LOCAL ] BEPJ: Trimmed 4516 records to 3259 (keeping 200 days of data) [2025-09-23T17:32:58.778469] [DEBUG] [LOCAL ] BEPJ: Primary data saved (3259 records). [2025-09-23T17:32:58.778830] [INFO ] [MAIN ] BEPJ: Full history saved. [2025-09-23T17:32:58.778977] [INFO ] [MAIN ] Update Progress: 252/2372 symbols completed. BEPJ took 41.6s. Estimated remaining: 4h 36m 60s. Rate: 7.7 symbols/min [2025-09-23T17:32:58.967497] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:32:59.051199] [DEBUG] [LOCAL ] BFAM: Primary data saved (33044 records). [2025-09-23T17:32:59.051344] [INFO ] [MAIN ] BFAM: Full history saved. [2025-09-23T17:32:59.051457] [INFO ] [MAIN ] Update Progress: 253/2372 symbols completed. BFAM took 34.7s. Estimated remaining: 4h 35m 49s. Rate: 7.7 symbols/min [2025-09-23T17:32:59.211885] [DEBUG] [LOCAL ] BFLY: Loaded 51829 existing records from primary storage. [2025-09-23T17:32:59.237288] [INFO ] [MAIN ] BFLY: Loaded 51829 existing records. [2025-09-23T17:32:59.263225] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:32:59.415086] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-06. [2025-09-23T17:32:59.459247] [DEBUG] [LOCAL ] BFS: Loaded 8996 existing records from primary storage. [2025-09-23T17:32:59.463409] [INFO ] [MAIN ] BFS: Loaded 8996 existing records. [2025-09-23T17:32:59.463538] [WARN ] [MAIN ] BFLY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:32:59.496434] [INFO ] [MAIN ] BFLY: Wiping existing primary data before full refresh. [2025-09-23T17:32:59.496603] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-09-23T17:32:59.547251] [DEBUG] [LOCAL ] BFLY: Deleted primary data file. [2025-09-23T17:32:59.547352] [INFO ] [MAIN ] BFLY: Starting full primary refresh. [2025-09-23T17:32:59.779578] [WARN ] [MAIN ] BFS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:32:59.813978] [INFO ] [MAIN ] BFS: Wiping existing primary data before full refresh. [2025-09-23T17:32:59.817550] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-09-23T17:32:59.839524] [DEBUG] [LOCAL ] BFS: Deleted primary data file. [2025-09-23T17:32:59.866329] [INFO ] [MAIN ] BFS: Starting full primary refresh. [2025-09-23T17:33:00.211495] [INFO ] [REMOTE ] BFLY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:33:00.250941] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2024-12. [2025-09-23T17:33:00.407609] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-23T17:33:00.497570] [INFO ] [REMOTE ] BFS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:33:00.543597] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-23T17:33:01.002189] [INFO ] [REMOTE ] BFS: Fetching primary data for 2024-12. [2025-09-23T17:33:01.802204] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-07. [2025-09-23T17:33:01.875224] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-23T17:33:02.488774] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-09-23T17:33:02.602150] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-01. [2025-09-23T17:33:03.402192] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-06. [2025-09-23T17:33:04.202200] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-01. [2025-09-23T17:33:04.858082] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-07 (3.06 seconds). [2025-09-23T17:33:05.002188] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-08. [2025-09-23T17:33:05.522423] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-01 (2.92 seconds). [2025-09-23T17:33:05.709725] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-09-23T17:33:05.802264] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-07. [2025-09-23T17:33:06.171794] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-23T17:33:06.602182] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-09. [2025-09-23T17:33:06.747388] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-01 (2.55 seconds). [2025-09-23T17:33:07.360178] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-23T17:33:07.402159] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-08. [2025-09-23T17:33:07.471947] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-23T17:33:07.475332] [INFO ] [REMOTE ] BFK: Full fetch complete (19239 records). [2025-09-23T17:33:07.475427] [DEBUG] [VALIDATOR ] BFK: Validating primary data. [2025-09-23T17:33:07.476245] [FATAL] [VALIDATOR ] BFK: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:33:07.476330] [FATAL] [MAIN ] BFK: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:33:07.476388] [WARN ] [MAIN ] BFK: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:33:07.476461] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-09-23T17:33:07.476559] [DEBUG] [LOCAL ] BFK: No primary data file found to delete. [2025-09-23T17:33:07.476611] [INFO ] [LOCAL ] BFK: Starting deletion of derivative data. [2025-09-23T17:33:07.477113] [DEBUG] [LOCAL ] BFK: Deleted derivative data file. [2025-09-23T17:33:07.477281] [INFO ] [MAIN ] Update Progress: 254/2372 symbols completed. BFK took 22.3s. Estimated remaining: 4h 35m 46s. Rate: 7.7 symbols/min [2025-09-23T17:33:07.650716] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:33:07.667152] [DEBUG] [LOCAL ] BFZ: Loaded 11524 existing records from primary storage. [2025-09-23T17:33:07.667271] [INFO ] [MAIN ] BFZ: Loaded 11524 existing records. [2025-09-23T17:33:07.843706] [WARN ] [MAIN ] BFZ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:33:07.843972] [INFO ] [MAIN ] BFZ: Wiping existing primary data before full refresh. [2025-09-23T17:33:07.844019] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-09-23T17:33:07.844449] [DEBUG] [LOCAL ] BFZ: Deleted primary data file. [2025-09-23T17:33:07.844508] [INFO ] [MAIN ] BFZ: Starting full primary refresh. [2025-09-23T17:33:08.201730] [INFO ] [REMOTE ] BFZ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:33:08.202055] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2024-12. [2025-09-23T17:33:08.722538] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-23T17:33:08.928749] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-23T17:33:09.002202] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-02. [2025-09-23T17:33:09.802219] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-09. [2025-09-23T17:33:10.463304] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-23T17:33:10.602185] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-03. [2025-09-23T17:33:11.290878] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-23T17:33:11.298296] [INFO ] [REMOTE ] BFH: Full fetch complete (59586 records). [2025-09-23T17:33:11.298451] [DEBUG] [VALIDATOR ] BFH: Validating primary data. [2025-09-23T17:33:11.408434] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-02. [2025-09-23T17:33:11.703637] [DEBUG] [VALIDATOR ] BFH: All expected trading days are present. [2025-09-23T17:33:11.703762] [DEBUG] [VALIDATOR ] BFH: Primary data validation passed. [2025-09-23T17:33:11.704473] [INFO ] [MAIN ] BFH: Fetched primary data is valid. [2025-09-23T17:33:11.704517] [DEBUG] [LOCAL ] BFH: Saving primary data. [2025-09-23T17:33:11.708279] [DEBUG] [LOCAL ] BFH: Trimmed 59586 records to 41829 (keeping 200 days of data) [2025-09-23T17:33:11.982537] [DEBUG] [LOCAL ] BFH: Primary data saved (41829 records). [2025-09-23T17:33:11.982748] [INFO ] [MAIN ] BFH: Full history saved. [2025-09-23T17:33:11.982871] [INFO ] [MAIN ] Update Progress: 255/2372 symbols completed. BFH took 34.5s. Estimated remaining: 4h 35m 11s. Rate: 7.7 symbols/min [2025-09-23T17:33:12.158083] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:33:12.200123] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-23T17:33:12.210378] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-01. [2025-09-23T17:33:12.257491] [DEBUG] [LOCAL ] BG: Loaded 50380 existing records from primary storage. [2025-09-23T17:33:12.257684] [INFO ] [MAIN ] BG: Loaded 50380 existing records. [2025-09-23T17:33:12.442269] [WARN ] [MAIN ] BG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:33:12.443079] [INFO ] [MAIN ] BG: Wiping existing primary data before full refresh. [2025-09-23T17:33:12.449734] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-09-23T17:33:12.452627] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-23T17:33:12.454543] [DEBUG] [LOCAL ] BG: Deleted primary data file. [2025-09-23T17:33:12.454932] [INFO ] [MAIN ] BG: Starting full primary refresh. [2025-09-23T17:33:12.818008] [INFO ] [REMOTE ] BG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:33:12.826530] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-23T17:33:13.002228] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-03. [2025-09-23T17:33:13.543496] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-23T17:33:13.802201] [INFO ] [REMOTE ] BG: Fetching primary data for 2024-12. [2025-09-23T17:33:14.602222] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-04. [2025-09-23T17:33:15.356364] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-23T17:33:15.402145] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-01. [2025-09-23T17:33:16.202164] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-02. [2025-09-23T17:33:16.305060] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-23T17:33:16.687543] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-23T17:33:17.002227] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-05. [2025-09-23T17:33:17.081195] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-23T17:33:17.802265] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-03. [2025-09-23T17:33:18.298798] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-23T17:33:18.426720] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-23T17:33:18.602184] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-06. [2025-09-23T17:33:19.402201] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-02. [2025-09-23T17:33:19.983409] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-23T17:33:20.202189] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-07. [2025-09-23T17:33:20.750471] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-23T17:33:21.002240] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-04. [2025-09-23T17:33:21.802189] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-04. [2025-09-23T17:33:21.863240] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-23T17:33:21.934946] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-23T17:33:22.521394] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-23T17:33:22.602167] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-05. [2025-09-23T17:33:23.131886] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-23T17:33:23.402209] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-06. [2025-09-23T17:33:23.891431] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-23T17:33:24.202242] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-08. [2025-09-23T17:33:25.002256] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-07. [2025-09-23T17:33:25.646313] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-23T17:33:25.700805] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-23T17:33:25.802206] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-09. [2025-09-23T17:33:26.602202] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-05. [2025-09-23T17:33:27.047870] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-23T17:33:27.213367] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-23T17:33:27.222893] [INFO ] [REMOTE ] BFLY: Full fetch complete (75222 records). [2025-09-23T17:33:27.223032] [DEBUG] [VALIDATOR ] BFLY: Validating primary data. [2025-09-23T17:33:27.402344] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-03. [2025-09-23T17:33:27.638783] [DEBUG] [VALIDATOR ] BFLY: All expected trading days are present. [2025-09-23T17:33:27.638879] [DEBUG] [VALIDATOR ] BFLY: Primary data validation passed. [2025-09-23T17:33:27.639723] [INFO ] [MAIN ] BFLY: Fetched primary data is valid. [2025-09-23T17:33:27.639789] [DEBUG] [LOCAL ] BFLY: Saving primary data. [2025-09-23T17:33:27.641342] [DEBUG] [LOCAL ] BFLY: Trimmed 75222 records to 51830 (keeping 200 days of data) [2025-09-23T17:33:27.942141] [DEBUG] [LOCAL ] BFLY: Primary data saved (51830 records). [2025-09-23T17:33:27.942276] [INFO ] [MAIN ] BFLY: Full history saved. [2025-09-23T17:33:27.942385] [INFO ] [MAIN ] Update Progress: 256/2372 symbols completed. BFLY took 29.2s. Estimated remaining: 4h 36m 10s. Rate: 7.7 symbols/min [2025-09-23T17:33:28.115741] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:33:28.135720] [DEBUG] [LOCAL ] BGB: Loaded 17407 existing records from primary storage. [2025-09-23T17:33:28.135836] [INFO ] [MAIN ] BGB: Loaded 17407 existing records. [2025-09-23T17:33:28.208708] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-06. [2025-09-23T17:33:28.315633] [WARN ] [MAIN ] BGB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:33:28.315911] [INFO ] [MAIN ] BGB: Wiping existing primary data before full refresh. [2025-09-23T17:33:28.315960] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-09-23T17:33:28.316763] [DEBUG] [LOCAL ] BGB: Deleted primary data file. [2025-09-23T17:33:28.316825] [INFO ] [MAIN ] BGB: Starting full primary refresh. [2025-09-23T17:33:28.672661] [INFO ] [REMOTE ] BGB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:33:28.967220] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-23T17:33:29.002201] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-07. [2025-09-23T17:33:29.620332] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-23T17:33:29.621168] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-23T17:33:29.802211] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-08. [2025-09-23T17:33:30.301340] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-23T17:33:30.602177] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-09. [2025-09-23T17:33:31.377787] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-23T17:33:31.380067] [INFO ] [REMOTE ] BFS: Full fetch complete (12473 records). [2025-09-23T17:33:31.380146] [DEBUG] [VALIDATOR ] BFS: Validating primary data. [2025-09-23T17:33:31.409929] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-08. [2025-09-23T17:33:31.765552] [DEBUG] [VALIDATOR ] BFS: All expected trading days are present. [2025-09-23T17:33:31.765635] [DEBUG] [VALIDATOR ] BFS: Primary data validation passed. [2025-09-23T17:33:31.765967] [INFO ] [MAIN ] BFS: Fetched primary data is valid. [2025-09-23T17:33:31.766026] [DEBUG] [LOCAL ] BFS: Saving primary data. [2025-09-23T17:33:31.766697] [DEBUG] [LOCAL ] BFS: Trimmed 12473 records to 9015 (keeping 200 days of data) [2025-09-23T17:33:31.829734] [DEBUG] [LOCAL ] BFS: Primary data saved (9015 records). [2025-09-23T17:33:31.829884] [INFO ] [MAIN ] BFS: Full history saved. [2025-09-23T17:33:31.829978] [INFO ] [MAIN ] Update Progress: 257/2372 symbols completed. BFS took 32.8s. Estimated remaining: 4h 35m 30s. Rate: 7.7 symbols/min [2025-09-23T17:33:32.017921] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:33:32.039061] [DEBUG] [LOCAL ] BGH: Loaded 16404 existing records from primary storage. [2025-09-23T17:33:32.039199] [INFO ] [MAIN ] BGH: Loaded 16404 existing records. [2025-09-23T17:33:32.208168] [INFO ] [REMOTE ] BGB: Fetching primary data for 2024-12. [2025-09-23T17:33:32.213264] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-23T17:33:32.237669] [WARN ] [MAIN ] BGH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:33:32.238180] [INFO ] [MAIN ] BGH: Wiping existing primary data before full refresh. [2025-09-23T17:33:32.238229] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-09-23T17:33:32.238991] [DEBUG] [LOCAL ] BGH: Deleted primary data file. [2025-09-23T17:33:32.239053] [INFO ] [MAIN ] BGH: Starting full primary refresh. [2025-09-23T17:33:32.662603] [INFO ] [REMOTE ] BGH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:33:32.937571] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-23T17:33:33.002279] [INFO ] [REMOTE ] BGH: Fetching primary data for 2024-12. [2025-09-23T17:33:33.802214] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-04. [2025-09-23T17:33:33.872872] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-23T17:33:34.602187] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-09. [2025-09-23T17:33:35.402263] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-01. [2025-09-23T17:33:36.198984] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-23T17:33:36.203279] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-01. [2025-09-23T17:33:36.359690] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-23T17:33:36.362826] [INFO ] [REMOTE ] BFZ: Full fetch complete (17968 records). [2025-09-23T17:33:36.362899] [DEBUG] [VALIDATOR ] BFZ: Validating primary data. [2025-09-23T17:33:36.764184] [DEBUG] [VALIDATOR ] BFZ: All expected trading days are present. [2025-09-23T17:33:36.775035] [DEBUG] [VALIDATOR ] BFZ: Primary data validation passed. [2025-09-23T17:33:36.775553] [INFO ] [MAIN ] BFZ: Fetched primary data is valid. [2025-09-23T17:33:36.777746] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-04 (2.98 seconds). [2025-09-23T17:33:36.775826] [DEBUG] [LOCAL ] BFZ: Saving primary data. [2025-09-23T17:33:36.795050] [DEBUG] [LOCAL ] BFZ: Trimmed 17968 records to 11731 (keeping 200 days of data) [2025-09-23T17:33:36.796976] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-23T17:33:36.869567] [DEBUG] [LOCAL ] BFZ: Primary data saved (11731 records). [2025-09-23T17:33:36.869717] [INFO ] [MAIN ] BFZ: Full history saved. [2025-09-23T17:33:36.869810] [INFO ] [MAIN ] Update Progress: 258/2372 symbols completed. BFZ took 29.4s. Estimated remaining: 4h 34m 59s. Rate: 7.7 symbols/min [2025-09-23T17:33:37.010099] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-05. [2025-09-23T17:33:37.042011] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:33:37.057411] [DEBUG] [LOCAL ] BGR: Loaded 13484 existing records from primary storage. [2025-09-23T17:33:37.057524] [INFO ] [MAIN ] BGR: Loaded 13484 existing records. [2025-09-23T17:33:37.237542] [WARN ] [MAIN ] BGR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:33:37.237817] [INFO ] [MAIN ] BGR: Wiping existing primary data before full refresh. [2025-09-23T17:33:37.237867] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-09-23T17:33:37.238433] [DEBUG] [LOCAL ] BGR: Deleted primary data file. [2025-09-23T17:33:37.238502] [INFO ] [MAIN ] BGR: Starting full primary refresh. [2025-09-23T17:33:37.590531] [INFO ] [REMOTE ] BGR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:33:37.802148] [INFO ] [REMOTE ] BGR: Fetching primary data for 2024-12. [2025-09-23T17:33:38.466254] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-23T17:33:38.522149] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-23T17:33:38.602215] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-02. [2025-09-23T17:33:39.329892] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-23T17:33:39.402157] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-02. [2025-09-23T17:33:39.926001] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-23T17:33:40.202181] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-03. [2025-09-23T17:33:40.778042] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-23T17:33:41.002218] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-04. [2025-09-23T17:33:41.802210] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-06. [2025-09-23T17:33:42.081135] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-23T17:33:42.602235] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-05. [2025-09-23T17:33:43.128265] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-23T17:33:43.304859] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-23T17:33:43.402144] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-06. [2025-09-23T17:33:43.943160] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-23T17:33:44.202226] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-01. [2025-09-23T17:33:44.759987] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-23T17:33:45.002231] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-07. [2025-09-23T17:33:45.722765] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-23T17:33:45.802213] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-08. [2025-09-23T17:33:46.602189] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-07. [2025-09-23T17:33:46.824015] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-23T17:33:47.402245] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-03. [2025-09-23T17:33:48.202248] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-09. [2025-09-23T17:33:48.615078] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-23T17:33:49.002210] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-04. [2025-09-23T17:33:49.343017] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-07 (2.74 seconds). [2025-09-23T17:33:49.802230] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-08. [2025-09-23T17:33:49.912829] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-23T17:33:49.917235] [INFO ] [REMOTE ] BGH: Full fetch complete (21735 records). [2025-09-23T17:33:49.917353] [DEBUG] [VALIDATOR ] BGH: Validating primary data. [2025-09-23T17:33:50.301156] [DEBUG] [VALIDATOR ] BGH: All expected trading days are present. [2025-09-23T17:33:50.301241] [DEBUG] [VALIDATOR ] BGH: Primary data validation passed. [2025-09-23T17:33:50.301577] [INFO ] [MAIN ] BGH: Fetched primary data is valid. [2025-09-23T17:33:50.301617] [DEBUG] [LOCAL ] BGH: Saving primary data. [2025-09-23T17:33:50.302272] [DEBUG] [LOCAL ] BGH: Trimmed 21735 records to 16373 (keeping 200 days of data) [2025-09-23T17:33:50.407002] [DEBUG] [LOCAL ] BGH: Primary data saved (16373 records). [2025-09-23T17:33:50.407159] [INFO ] [MAIN ] BGH: Full history saved. [2025-09-23T17:33:50.407248] [INFO ] [MAIN ] Update Progress: 259/2372 symbols completed. BGH took 18.6s. Estimated remaining: 4h 35m 38s. Rate: 7.7 symbols/min [2025-09-23T17:33:50.597790] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:33:50.602192] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-02. [2025-09-23T17:33:50.636275] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-23T17:33:50.673685] [DEBUG] [LOCAL ] BGS: Loaded 50448 existing records from primary storage. [2025-09-23T17:33:50.673843] [INFO ] [MAIN ] BGS: Loaded 50448 existing records. [2025-09-23T17:33:50.850938] [WARN ] [MAIN ] BGS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:33:50.851217] [INFO ] [MAIN ] BGS: Wiping existing primary data before full refresh. [2025-09-23T17:33:50.851267] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-09-23T17:33:50.852593] [DEBUG] [LOCAL ] BGS: Deleted primary data file. [2025-09-23T17:33:50.852682] [INFO ] [MAIN ] BGS: Starting full primary refresh. [2025-09-23T17:33:51.232215] [INFO ] [REMOTE ] BGS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:33:51.306552] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-23T17:33:51.327314] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-23T17:33:51.402190] [INFO ] [REMOTE ] BGS: Fetching primary data for 2024-12. [2025-09-23T17:33:52.202204] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-09. [2025-09-23T17:33:53.002175] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-03. [2025-09-23T17:33:53.085149] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-23T17:33:53.533358] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-23T17:33:53.804049] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-05. [2025-09-23T17:33:53.806809] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-23T17:33:53.815684] [INFO ] [REMOTE ] BG: Full fetch complete (72774 records). [2025-09-23T17:33:53.815842] [DEBUG] [VALIDATOR ] BG: Validating primary data. [2025-09-23T17:33:54.226289] [DEBUG] [VALIDATOR ] BG: All expected trading days are present. [2025-09-23T17:33:54.226385] [DEBUG] [VALIDATOR ] BG: Primary data validation passed. [2025-09-23T17:33:54.227147] [INFO ] [MAIN ] BG: Fetched primary data is valid. [2025-09-23T17:33:54.227217] [DEBUG] [LOCAL ] BG: Saving primary data. [2025-09-23T17:33:54.228810] [DEBUG] [LOCAL ] BG: Trimmed 72774 records to 50394 (keeping 200 days of data) [2025-09-23T17:33:54.497985] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-23T17:33:54.565203] [DEBUG] [LOCAL ] BG: Primary data saved (50394 records). [2025-09-23T17:33:54.565332] [INFO ] [MAIN ] BG: Full history saved. [2025-09-23T17:33:54.565406] [INFO ] [MAIN ] Update Progress: 260/2372 symbols completed. BG took 42.6s. Estimated remaining: 4h 35m 1s. Rate: 7.7 symbols/min [2025-09-23T17:33:54.607367] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-04. [2025-09-23T17:33:54.740802] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:33:54.749296] [DEBUG] [LOCAL ] BGSF: Loaded 6537 existing records from primary storage. [2025-09-23T17:33:54.749415] [INFO ] [MAIN ] BGSF: Loaded 6537 existing records. [2025-09-23T17:33:54.943306] [WARN ] [MAIN ] BGSF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:33:54.943565] [INFO ] [MAIN ] BGSF: Wiping existing primary data before full refresh. [2025-09-23T17:33:54.943614] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-09-23T17:33:54.944008] [DEBUG] [LOCAL ] BGSF: Deleted primary data file. [2025-09-23T17:33:54.944072] [INFO ] [MAIN ] BGSF: Starting full primary refresh. [2025-09-23T17:33:55.327469] [INFO ] [REMOTE ] BGSF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:33:55.393149] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-23T17:33:55.402133] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-05. [2025-09-23T17:33:55.969079] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-23T17:33:56.202191] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2024-12. [2025-09-23T17:33:56.563561] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-23T17:33:57.002235] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-01. [2025-09-23T17:33:57.802202] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-01. [2025-09-23T17:33:58.138095] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-23T17:33:58.207980] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-23T17:33:58.602187] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-02. [2025-09-23T17:33:59.402236] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-02. [2025-09-23T17:33:59.704848] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-09-23T17:33:59.856791] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-23T17:34:00.202233] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-06. [2025-09-23T17:34:00.918250] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-23T17:34:01.002181] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-03. [2025-09-23T17:34:01.802195] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-07. [2025-09-23T17:34:02.396889] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-23T17:34:02.459637] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-23T17:34:02.602191] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-04. [2025-09-23T17:34:03.402203] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-06. [2025-09-23T17:34:03.953499] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-23T17:34:04.059514] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-23T17:34:04.202240] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-07. [2025-09-23T17:34:04.875523] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-23T17:34:05.002219] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-03. [2025-09-23T17:34:05.504463] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-23T17:34:05.802258] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-05. [2025-09-23T17:34:06.602231] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-04. [2025-09-23T17:34:06.924825] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-09-23T17:34:07.402237] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-08. [2025-09-23T17:34:07.828591] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-23T17:34:07.994998] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-23T17:34:08.202225] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-09. [2025-09-23T17:34:09.002213] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-08. [2025-09-23T17:34:09.195402] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-23T17:34:09.198148] [INFO ] [REMOTE ] BGR: Full fetch complete (20319 records). [2025-09-23T17:34:09.198222] [DEBUG] [VALIDATOR ] BGR: Validating primary data. [2025-09-23T17:34:09.562841] [DEBUG] [VALIDATOR ] BGR: All expected trading days are present. [2025-09-23T17:34:09.562939] [DEBUG] [VALIDATOR ] BGR: Primary data validation passed. [2025-09-23T17:34:09.563256] [INFO ] [MAIN ] BGR: Fetched primary data is valid. [2025-09-23T17:34:09.563300] [DEBUG] [LOCAL ] BGR: Saving primary data. [2025-09-23T17:34:09.563905] [DEBUG] [LOCAL ] BGR: Trimmed 20319 records to 13481 (keeping 200 days of data) [2025-09-23T17:34:09.655579] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-23T17:34:09.662076] [DEBUG] [LOCAL ] BGR: Primary data saved (13481 records). [2025-09-23T17:34:09.662280] [INFO ] [MAIN ] BGR: Full history saved. [2025-09-23T17:34:09.662693] [INFO ] [MAIN ] Update Progress: 261/2372 symbols completed. BGR took 32.8s. Estimated remaining: 4h 35m 52s. Rate: 7.7 symbols/min [2025-09-23T17:34:09.807285] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-09. [2025-09-23T17:34:09.832528] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:34:09.849835] [DEBUG] [LOCAL ] BGT: Loaded 16570 existing records from primary storage. [2025-09-23T17:34:09.849972] [INFO ] [MAIN ] BGT: Loaded 16570 existing records. [2025-09-23T17:34:10.031316] [WARN ] [MAIN ] BGT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:34:10.031547] [INFO ] [MAIN ] BGT: Wiping existing primary data before full refresh. [2025-09-23T17:34:10.031594] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-09-23T17:34:10.032289] [DEBUG] [LOCAL ] BGT: Deleted primary data file. [2025-09-23T17:34:10.032350] [INFO ] [MAIN ] BGT: Starting full primary refresh. [2025-09-23T17:34:10.389123] [INFO ] [REMOTE ] BGT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:34:10.548404] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-23T17:34:10.551444] [INFO ] [REMOTE ] BGB: Full fetch complete (26853 records). [2025-09-23T17:34:10.551524] [DEBUG] [VALIDATOR ] BGB: Validating primary data. [2025-09-23T17:34:10.607309] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-06. [2025-09-23T17:34:10.926385] [DEBUG] [VALIDATOR ] BGB: All expected trading days are present. [2025-09-23T17:34:10.926463] [DEBUG] [VALIDATOR ] BGB: Primary data validation passed. [2025-09-23T17:34:10.926871] [INFO ] [MAIN ] BGB: Fetched primary data is valid. [2025-09-23T17:34:10.926934] [DEBUG] [LOCAL ] BGB: Saving primary data. [2025-09-23T17:34:10.927588] [DEBUG] [LOCAL ] BGB: Trimmed 26853 records to 17392 (keeping 200 days of data) [2025-09-23T17:34:11.038312] [DEBUG] [LOCAL ] BGB: Primary data saved (17392 records). [2025-09-23T17:34:11.038455] [INFO ] [MAIN ] BGB: Full history saved. [2025-09-23T17:34:11.038598] [INFO ] [MAIN ] Update Progress: 262/2372 symbols completed. BGB took 43.1s. Estimated remaining: 4h 34m 52s. Rate: 7.7 symbols/min [2025-09-23T17:34:11.207490] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:34:11.219722] [DEBUG] [LOCAL ] BGX: Loaded 10738 existing records from primary storage. [2025-09-23T17:34:11.219821] [INFO ] [MAIN ] BGX: Loaded 10738 existing records. [2025-09-23T17:34:11.401633] [WARN ] [MAIN ] BGX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:34:11.401899] [INFO ] [MAIN ] BGX: Wiping existing primary data before full refresh. [2025-09-23T17:34:11.401946] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-09-23T17:34:11.402166] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-05. [2025-09-23T17:34:11.402986] [DEBUG] [LOCAL ] BGX: Deleted primary data file. [2025-09-23T17:34:11.403049] [INFO ] [MAIN ] BGX: Starting full primary refresh. [2025-09-23T17:34:11.763306] [INFO ] [REMOTE ] BGX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:34:11.814805] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-23T17:34:11.966583] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-23T17:34:12.202165] [INFO ] [REMOTE ] BGT: Fetching primary data for 2024-12. [2025-09-23T17:34:12.867105] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-23T17:34:13.002176] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-01. [2025-09-23T17:34:13.750173] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-23T17:34:13.802193] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-02. [2025-09-23T17:34:14.382307] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-23T17:34:14.602218] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-03. [2025-09-23T17:34:15.215463] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-23T17:34:15.402191] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-04. [2025-09-23T17:34:16.178308] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-23T17:34:16.202175] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-05. [2025-09-23T17:34:17.002187] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-06. [2025-09-23T17:34:17.148709] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-23T17:34:17.602136] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-23T17:34:17.802229] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-06. [2025-09-23T17:34:18.536529] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-23T17:34:18.602152] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-07. [2025-09-23T17:34:19.279156] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-23T17:34:19.402243] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-08. [2025-09-23T17:34:20.054386] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-23T17:34:20.202230] [INFO ] [REMOTE ] BGX: Fetching primary data for 2024-12. [2025-09-23T17:34:21.002224] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-07. [2025-09-23T17:34:21.232108] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-23T17:34:21.802206] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-01. [2025-09-23T17:34:22.375143] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-23T17:34:22.602206] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-07. [2025-09-23T17:34:22.870786] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-23T17:34:23.056529] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-23T17:34:23.402235] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-09. [2025-09-23T17:34:24.202235] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-08. [2025-09-23T17:34:24.233270] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-23T17:34:24.236690] [INFO ] [REMOTE ] BGT: Full fetch complete (24371 records). [2025-09-23T17:34:24.236854] [DEBUG] [VALIDATOR ] BGT: Validating primary data. [2025-09-23T17:34:24.616786] [DEBUG] [VALIDATOR ] BGT: All expected trading days are present. [2025-09-23T17:34:24.620093] [DEBUG] [VALIDATOR ] BGT: Primary data validation passed. [2025-09-23T17:34:24.621154] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-23T17:34:24.621006] [INFO ] [MAIN ] BGT: Fetched primary data is valid. [2025-09-23T17:34:24.622701] [DEBUG] [LOCAL ] BGT: Saving primary data. [2025-09-23T17:34:24.623638] [DEBUG] [LOCAL ] BGT: Trimmed 24371 records to 16586 (keeping 200 days of data) [2025-09-23T17:34:24.725827] [DEBUG] [LOCAL ] BGT: Primary data saved (16586 records). [2025-09-23T17:34:24.725965] [INFO ] [MAIN ] BGT: Full history saved. [2025-09-23T17:34:24.726052] [INFO ] [MAIN ] Update Progress: 263/2372 symbols completed. BGT took 15.1s. Estimated remaining: 4h 35m 31s. Rate: 7.7 symbols/min [2025-09-23T17:34:24.897123] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:34:24.919977] [DEBUG] [LOCAL ] BGY: Loaded 22663 existing records from primary storage. [2025-09-23T17:34:24.920119] [INFO ] [MAIN ] BGY: Loaded 22663 existing records. [2025-09-23T17:34:25.007295] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-02. [2025-09-23T17:34:25.120309] [WARN ] [MAIN ] BGY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:34:25.120552] [INFO ] [MAIN ] BGY: Wiping existing primary data before full refresh. [2025-09-23T17:34:25.120601] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-09-23T17:34:25.121668] [DEBUG] [LOCAL ] BGY: Deleted primary data file. [2025-09-23T17:34:25.121736] [INFO ] [MAIN ] BGY: Starting full primary refresh. [2025-09-23T17:34:25.710549] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-23T17:34:25.752021] [INFO ] [REMOTE ] BGY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:34:25.802275] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-08. [2025-09-23T17:34:26.602184] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-03. [2025-09-23T17:34:27.106439] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-23T17:34:27.144393] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-23T17:34:27.402200] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-04. [2025-09-23T17:34:27.912672] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-23T17:34:28.202216] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-05. [2025-09-23T17:34:28.737099] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-23T17:34:29.002257] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-06. [2025-09-23T17:34:29.490591] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-23T17:34:29.802209] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-09. [2025-09-23T17:34:30.602219] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-09. [2025-09-23T17:34:30.768104] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-23T17:34:30.771395] [INFO ] [REMOTE ] BGSF: Full fetch complete (8067 records). [2025-09-23T17:34:30.771466] [DEBUG] [VALIDATOR ] BGSF: Validating primary data. [2025-09-23T17:34:31.136003] [DEBUG] [VALIDATOR ] BGSF: All expected trading days are present. [2025-09-23T17:34:31.136086] [DEBUG] [VALIDATOR ] BGSF: Primary data validation passed. [2025-09-23T17:34:31.136369] [INFO ] [MAIN ] BGSF: Fetched primary data is valid. [2025-09-23T17:34:31.136432] [DEBUG] [LOCAL ] BGSF: Saving primary data. [2025-09-23T17:34:31.136911] [DEBUG] [LOCAL ] BGSF: Trimmed 8067 records to 6707 (keeping 200 days of data) [2025-09-23T17:34:31.178326] [DEBUG] [LOCAL ] BGSF: Primary data saved (6707 records). [2025-09-23T17:34:31.178482] [INFO ] [MAIN ] BGSF: Full history saved. [2025-09-23T17:34:31.178585] [INFO ] [MAIN ] Update Progress: 264/2372 symbols completed. BGSF took 36.6s. Estimated remaining: 4h 35m 12s. Rate: 7.7 symbols/min [2025-09-23T17:34:31.362938] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:34:31.380495] [DEBUG] [LOCAL ] BH: Loaded 15425 existing records from primary storage. [2025-09-23T17:34:31.380675] [INFO ] [MAIN ] BH: Loaded 15425 existing records. [2025-09-23T17:34:31.414528] [INFO ] [REMOTE ] BGY: Fetching primary data for 2024-12. [2025-09-23T17:34:31.576171] [WARN ] [MAIN ] BH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:34:31.576421] [INFO ] [MAIN ] BH: Wiping existing primary data before full refresh. [2025-09-23T17:34:31.576473] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-09-23T17:34:31.577156] [DEBUG] [LOCAL ] BH: Deleted primary data file. [2025-09-23T17:34:31.577222] [INFO ] [MAIN ] BH: Starting full primary refresh. [2025-09-23T17:34:31.946136] [INFO ] [REMOTE ] BH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:34:31.970673] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-23T17:34:31.979299] [INFO ] [REMOTE ] BGS: Full fetch complete (72497 records). [2025-09-23T17:34:31.979439] [DEBUG] [VALIDATOR ] BGS: Validating primary data. [2025-09-23T17:34:32.207510] [INFO ] [REMOTE ] BH: Fetching primary data for 2024-12. [2025-09-23T17:34:32.398813] [DEBUG] [VALIDATOR ] BGS: All expected trading days are present. [2025-09-23T17:34:32.398943] [DEBUG] [VALIDATOR ] BGS: Primary data validation passed. [2025-09-23T17:34:32.400362] [INFO ] [MAIN ] BGS: Fetched primary data is valid. [2025-09-23T17:34:32.401094] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-23T17:34:32.405999] [DEBUG] [LOCAL ] BGS: Saving primary data. [2025-09-23T17:34:32.408463] [DEBUG] [LOCAL ] BGS: Trimmed 72497 records to 50467 (keeping 200 days of data) [2025-09-23T17:34:32.739412] [DEBUG] [LOCAL ] BGS: Primary data saved (50467 records). [2025-09-23T17:34:32.739599] [INFO ] [MAIN ] BGS: Full history saved. [2025-09-23T17:34:32.739748] [INFO ] [MAIN ] Update Progress: 265/2372 symbols completed. BGS took 42.3s. Estimated remaining: 4h 34m 15s. Rate: 7.7 symbols/min [2025-09-23T17:34:32.939469] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:34:32.986562] [DEBUG] [LOCAL ] BHC: Loaded 46804 existing records from primary storage. [2025-09-23T17:34:32.986804] [INFO ] [MAIN ] BHC: Loaded 46804 existing records. [2025-09-23T17:34:33.012009] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-01. [2025-09-23T17:34:33.172243] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-23T17:34:33.222725] [WARN ] [MAIN ] BHC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:34:33.223028] [INFO ] [MAIN ] BHC: Wiping existing primary data before full refresh. [2025-09-23T17:34:33.223088] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-09-23T17:34:33.224705] [DEBUG] [LOCAL ] BHC: Deleted primary data file. [2025-09-23T17:34:33.224786] [INFO ] [MAIN ] BHC: Starting full primary refresh. [2025-09-23T17:34:33.628243] [INFO ] [REMOTE ] BHC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:34:33.799770] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-23T17:34:33.804579] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-07. [2025-09-23T17:34:34.373801] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-23T17:34:34.602214] [INFO ] [REMOTE ] BHC: Fetching primary data for 2024-12. [2025-09-23T17:34:35.402217] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-08. [2025-09-23T17:34:35.940711] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-23T17:34:36.202233] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-09. [2025-09-23T17:34:36.363984] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-23T17:34:36.806848] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-23T17:34:36.810573] [INFO ] [REMOTE ] BGX: Full fetch complete (15734 records). [2025-09-23T17:34:36.810697] [DEBUG] [VALIDATOR ] BGX: Validating primary data. [2025-09-23T17:34:37.007332] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-01. [2025-09-23T17:34:37.201127] [DEBUG] [VALIDATOR ] BGX: All expected trading days are present. [2025-09-23T17:34:37.201209] [DEBUG] [VALIDATOR ] BGX: Primary data validation passed. [2025-09-23T17:34:37.201553] [INFO ] [MAIN ] BGX: Fetched primary data is valid. [2025-09-23T17:34:37.201593] [DEBUG] [LOCAL ] BGX: Saving primary data. [2025-09-23T17:34:37.202249] [DEBUG] [LOCAL ] BGX: Trimmed 15734 records to 10682 (keeping 200 days of data) [2025-09-23T17:34:37.274458] [DEBUG] [LOCAL ] BGX: Primary data saved (10682 records). [2025-09-23T17:34:37.274680] [INFO ] [MAIN ] BGX: Full history saved. [2025-09-23T17:34:37.274841] [INFO ] [MAIN ] Update Progress: 266/2372 symbols completed. BGX took 26.2s. Estimated remaining: 4h 33m 41s. Rate: 7.7 symbols/min [2025-09-23T17:34:37.459680] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:34:37.484015] [DEBUG] [LOCAL ] BHE: Loaded 25215 existing records from primary storage. [2025-09-23T17:34:37.484160] [INFO ] [MAIN ] BHE: Loaded 25215 existing records. [2025-09-23T17:34:37.668725] [WARN ] [MAIN ] BHE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:34:37.669004] [INFO ] [MAIN ] BHE: Wiping existing primary data before full refresh. [2025-09-23T17:34:37.669051] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-09-23T17:34:37.669864] [DEBUG] [LOCAL ] BHE: Deleted primary data file. [2025-09-23T17:34:37.669925] [INFO ] [MAIN ] BHE: Starting full primary refresh. [2025-09-23T17:34:37.812801] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-01. [2025-09-23T17:34:38.030922] [INFO ] [REMOTE ] BHE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:34:38.263034] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-23T17:34:38.360113] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-23T17:34:38.602249] [INFO ] [REMOTE ] BHE: Fetching primary data for 2024-12. [2025-09-23T17:34:39.402187] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-02. [2025-09-23T17:34:39.430972] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-23T17:34:40.094689] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-23T17:34:40.202244] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-02. [2025-09-23T17:34:40.661856] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-23T17:34:41.002225] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-02. [2025-09-23T17:34:41.802219] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-01. [2025-09-23T17:34:42.131602] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-23T17:34:42.602192] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-03. [2025-09-23T17:34:42.655412] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-23T17:34:43.402211] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-03. [2025-09-23T17:34:43.931040] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-23T17:34:44.202220] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-03. [2025-09-23T17:34:44.510583] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-23T17:34:45.002195] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-02. [2025-09-23T17:34:45.078407] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-23T17:34:45.802217] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-04. [2025-09-23T17:34:46.108989] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-23T17:34:46.507405] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-23T17:34:46.602182] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-03. [2025-09-23T17:34:47.402218] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-05. [2025-09-23T17:34:47.485246] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-23T17:34:48.065742] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-23T17:34:48.202156] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-06. [2025-09-23T17:34:48.999594] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-23T17:34:49.005036] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-04. [2025-09-23T17:34:49.802250] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-07. [2025-09-23T17:34:50.183231] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-23T17:34:50.602232] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-04. [2025-09-23T17:34:50.623576] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-23T17:34:51.402234] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-05. [2025-09-23T17:34:51.819666] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-23T17:34:52.202184] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-04. [2025-09-23T17:34:52.540325] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-23T17:34:53.002201] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-05. [2025-09-23T17:34:53.802191] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-06. [2025-09-23T17:34:54.290219] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-23T17:34:54.511895] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-23T17:34:54.602162] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-07. [2025-09-23T17:34:55.402223] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-08. [2025-09-23T17:34:55.441473] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-23T17:34:56.202226] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-08. [2025-09-23T17:34:56.342030] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-23T17:34:56.619284] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-04 (4.42 seconds). [2025-09-23T17:34:56.954544] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-23T17:34:57.002208] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-09-23T17:34:57.802235] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-06. [2025-09-23T17:34:58.139934] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-23T17:34:58.144505] [INFO ] [REMOTE ] BHE: Full fetch complete (36559 records). [2025-09-23T17:34:58.144622] [DEBUG] [VALIDATOR ] BHE: Validating primary data. [2025-09-23T17:34:58.525530] [DEBUG] [VALIDATOR ] BHE: All expected trading days are present. [2025-09-23T17:34:58.525629] [DEBUG] [VALIDATOR ] BHE: Primary data validation passed. [2025-09-23T17:34:58.526169] [INFO ] [MAIN ] BHE: Fetched primary data is valid. [2025-09-23T17:34:58.526226] [DEBUG] [LOCAL ] BHE: Saving primary data. [2025-09-23T17:34:58.527290] [DEBUG] [LOCAL ] BHE: Trimmed 36559 records to 25147 (keeping 200 days of data) [2025-09-23T17:34:58.614462] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-05. [2025-09-23T17:34:58.681810] [DEBUG] [LOCAL ] BHE: Primary data saved (25147 records). [2025-09-23T17:34:58.681952] [INFO ] [MAIN ] BHE: Full history saved. [2025-09-23T17:34:58.682041] [INFO ] [MAIN ] Update Progress: 267/2372 symbols completed. BHE took 21.4s. Estimated remaining: 4h 35m 20s. Rate: 7.6 symbols/min [2025-09-23T17:34:58.857016] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:34:58.879021] [DEBUG] [LOCAL ] BHK: Loaded 22486 existing records from primary storage. [2025-09-23T17:34:58.879147] [INFO ] [MAIN ] BHK: Loaded 22486 existing records. [2025-09-23T17:34:59.059516] [WARN ] [MAIN ] BHK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:34:59.059996] [INFO ] [MAIN ] BHK: Wiping existing primary data before full refresh. [2025-09-23T17:34:59.060080] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-09-23T17:34:59.061029] [DEBUG] [LOCAL ] BHK: Deleted primary data file. [2025-09-23T17:34:59.061095] [INFO ] [MAIN ] BHK: Starting full primary refresh. [2025-09-23T17:34:59.242546] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-23T17:34:59.403685] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-07. [2025-09-23T17:34:59.463788] [INFO ] [REMOTE ] BHK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:34:59.474564] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-23T17:35:00.202200] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-06. [2025-09-23T17:35:00.751053] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-23T17:35:00.935432] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-23T17:35:01.002191] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-07. [2025-09-23T17:35:01.786674] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-23T17:35:01.802191] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-09. [2025-09-23T17:35:02.602175] [INFO ] [REMOTE ] BHK: Fetching primary data for 2024-12. [2025-09-23T17:35:02.651268] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-23T17:35:02.655896] [INFO ] [REMOTE ] BGY: Full fetch complete (33366 records). [2025-09-23T17:35:02.656040] [DEBUG] [VALIDATOR ] BGY: Validating primary data. [2025-09-23T17:35:03.056345] [DEBUG] [VALIDATOR ] BGY: All expected trading days are present. [2025-09-23T17:35:03.056450] [DEBUG] [VALIDATOR ] BGY: Primary data validation passed. [2025-09-23T17:35:03.056935] [INFO ] [MAIN ] BGY: Fetched primary data is valid. [2025-09-23T17:35:03.056998] [DEBUG] [LOCAL ] BGY: Saving primary data. [2025-09-23T17:35:03.057986] [DEBUG] [LOCAL ] BGY: Trimmed 33366 records to 22573 (keeping 200 days of data) [2025-09-23T17:35:03.194039] [DEBUG] [LOCAL ] BGY: Primary data saved (22573 records). [2025-09-23T17:35:03.194178] [INFO ] [MAIN ] BGY: Full history saved. [2025-09-23T17:35:03.194295] [INFO ] [MAIN ] Update Progress: 268/2372 symbols completed. BGY took 38.5s. Estimated remaining: 4h 34m 46s. Rate: 7.7 symbols/min [2025-09-23T17:35:03.375769] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:35:03.413892] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-08. [2025-09-23T17:35:03.438432] [DEBUG] [LOCAL ] BHP: Loaded 53385 existing records from primary storage. [2025-09-23T17:35:03.438675] [INFO ] [MAIN ] BHP: Loaded 53385 existing records. [2025-09-23T17:35:03.529106] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-23T17:35:03.663520] [WARN ] [MAIN ] BHP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:35:03.663886] [INFO ] [MAIN ] BHP: Wiping existing primary data before full refresh. [2025-09-23T17:35:03.663962] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-09-23T17:35:03.665497] [DEBUG] [LOCAL ] BHP: Deleted primary data file. [2025-09-23T17:35:03.665560] [INFO ] [MAIN ] BHP: Starting full primary refresh. [2025-09-23T17:35:04.019056] [INFO ] [REMOTE ] BHP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:35:04.202176] [INFO ] [REMOTE ] BHP: Fetching primary data for 2024-12. [2025-09-23T17:35:05.002217] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-01. [2025-09-23T17:35:05.084548] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-23T17:35:05.729325] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-23T17:35:05.802238] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-08. [2025-09-23T17:35:06.044147] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-23T17:35:06.602254] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-01. [2025-09-23T17:35:06.662147] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-23T17:35:07.402231] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-09. [2025-09-23T17:35:08.202195] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-02. [2025-09-23T17:35:08.281575] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-23T17:35:08.673335] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-23T17:35:08.681376] [INFO ] [REMOTE ] BHC: Full fetch complete (66675 records). [2025-09-23T17:35:08.681554] [DEBUG] [VALIDATOR ] BHC: Validating primary data. [2025-09-23T17:35:09.010095] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-02. [2025-09-23T17:35:09.125453] [DEBUG] [VALIDATOR ] BHC: All expected trading days are present. [2025-09-23T17:35:09.125601] [DEBUG] [VALIDATOR ] BHC: Primary data validation passed. [2025-09-23T17:35:09.126376] [INFO ] [MAIN ] BHC: Fetched primary data is valid. [2025-09-23T17:35:09.126498] [DEBUG] [LOCAL ] BHC: Saving primary data. [2025-09-23T17:35:09.142157] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-23T17:35:09.148264] [DEBUG] [LOCAL ] BHC: Trimmed 66675 records to 46783 (keeping 200 days of data) [2025-09-23T17:35:09.430816] [DEBUG] [LOCAL ] BHC: Primary data saved (46783 records). [2025-09-23T17:35:09.430959] [INFO ] [MAIN ] BHC: Full history saved. [2025-09-23T17:35:09.431100] [INFO ] [MAIN ] Update Progress: 269/2372 symbols completed. BHC took 36.7s. Estimated remaining: 4h 34m 26s. Rate: 7.7 symbols/min [2025-09-23T17:35:09.602146] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:35:09.634960] [DEBUG] [LOCAL ] BHR: Loaded 21413 existing records from primary storage. [2025-09-23T17:35:09.635349] [INFO ] [MAIN ] BHR: Loaded 21413 existing records. [2025-09-23T17:35:09.807709] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-03. [2025-09-23T17:35:09.834356] [WARN ] [MAIN ] BHR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:35:09.834619] [INFO ] [MAIN ] BHR: Wiping existing primary data before full refresh. [2025-09-23T17:35:09.834703] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-09-23T17:35:09.835437] [DEBUG] [LOCAL ] BHR: Deleted primary data file. [2025-09-23T17:35:09.835503] [INFO ] [MAIN ] BHR: Starting full primary refresh. [2025-09-23T17:35:10.201079] [INFO ] [REMOTE ] BHR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:35:10.518128] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-23T17:35:10.551502] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-23T17:35:10.602159] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-03. [2025-09-23T17:35:11.402210] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-04. [2025-09-23T17:35:12.070889] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-23T17:35:12.207396] [INFO ] [REMOTE ] BHR: Fetching primary data for 2024-12. [2025-09-23T17:35:12.226789] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-23T17:35:13.002202] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-04. [2025-09-23T17:35:13.159556] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-23T17:35:13.802194] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-05. [2025-09-23T17:35:14.602172] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-01. [2025-09-23T17:35:14.679749] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-23T17:35:15.043112] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-23T17:35:15.402199] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-06. [2025-09-23T17:35:15.918252] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-23T17:35:16.202205] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-02. [2025-09-23T17:35:16.806177] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-23T17:35:16.869889] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-23T17:35:17.002209] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-07. [2025-09-23T17:35:17.809033] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-03. [2025-09-23T17:35:17.837805] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-23T17:35:18.602230] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-08. [2025-09-23T17:35:18.956487] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-23T17:35:19.345838] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-23T17:35:19.402195] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-09. [2025-09-23T17:35:20.202209] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-05. [2025-09-23T17:35:20.437156] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-23T17:35:20.441758] [INFO ] [REMOTE ] BHK: Full fetch complete (29619 records). [2025-09-23T17:35:20.441881] [DEBUG] [VALIDATOR ] BHK: Validating primary data. [2025-09-23T17:35:20.813802] [DEBUG] [VALIDATOR ] BHK: All expected trading days are present. [2025-09-23T17:35:20.813893] [DEBUG] [VALIDATOR ] BHK: Primary data validation passed. [2025-09-23T17:35:20.814487] [INFO ] [MAIN ] BHK: Fetched primary data is valid. [2025-09-23T17:35:20.814590] [DEBUG] [LOCAL ] BHK: Saving primary data. [2025-09-23T17:35:20.815439] [DEBUG] [LOCAL ] BHK: Trimmed 29619 records to 22454 (keeping 200 days of data) [2025-09-23T17:35:20.969408] [DEBUG] [LOCAL ] BHK: Primary data saved (22454 records). [2025-09-23T17:35:20.969591] [INFO ] [MAIN ] BHK: Full history saved. [2025-09-23T17:35:20.969915] [INFO ] [MAIN ] Update Progress: 270/2372 symbols completed. BHK took 22.3s. Estimated remaining: 4h 34m 47s. Rate: 7.6 symbols/min [2025-09-23T17:35:21.007389] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-04. [2025-09-23T17:35:21.146005] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:35:21.146181] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-09-23T17:35:21.146218] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-09-23T17:35:21.146356] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-09-23T17:35:21.146398] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-09-23T17:35:21.146438] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-09-23T17:35:21.146487] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-09-23T17:35:21.499728] [INFO ] [REMOTE ] BHV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:35:21.792396] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-23T17:35:21.807015] [INFO ] [REMOTE ] BHV: Fetching primary data for 2024-12. [2025-09-23T17:35:22.197094] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-09-23T17:35:22.242029] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-23T17:35:22.602206] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-09-23T17:35:23.402209] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-01. [2025-09-23T17:35:23.641270] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-23T17:35:23.650080] [INFO ] [REMOTE ] BH: Full fetch complete (19260 records). [2025-09-23T17:35:23.650482] [DEBUG] [VALIDATOR ] BH: Validating primary data. [2025-09-23T17:35:23.783718] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-23T17:35:24.045489] [DEBUG] [VALIDATOR ] BH: All expected trading days are present. [2025-09-23T17:35:24.045574] [DEBUG] [VALIDATOR ] BH: Primary data validation passed. [2025-09-23T17:35:24.045983] [INFO ] [MAIN ] BH: Fetched primary data is valid. [2025-09-23T17:35:24.046048] [DEBUG] [LOCAL ] BH: Saving primary data. [2025-09-23T17:35:24.047543] [DEBUG] [LOCAL ] BH: Trimmed 19260 records to 15557 (keeping 200 days of data) [2025-09-23T17:35:24.155071] [DEBUG] [LOCAL ] BH: Primary data saved (15557 records). [2025-09-23T17:35:24.155247] [INFO ] [MAIN ] BH: Full history saved. [2025-09-23T17:35:24.155366] [INFO ] [MAIN ] Update Progress: 271/2372 symbols completed. BH took 53.0s. Estimated remaining: 4h 34m 3s. Rate: 7.7 symbols/min [2025-09-23T17:35:24.208462] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-06. [2025-09-23T17:35:24.327912] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:35:24.388140] [DEBUG] [LOCAL ] BHVN: Loaded 49586 existing records from primary storage. [2025-09-23T17:35:24.388291] [INFO ] [MAIN ] BHVN: Loaded 49586 existing records. [2025-09-23T17:35:24.565095] [WARN ] [MAIN ] BHVN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:35:24.565464] [INFO ] [MAIN ] BHVN: Wiping existing primary data before full refresh. [2025-09-23T17:35:24.565528] [INFO ] [LOCAL ] BHVN: Starting deletion of primary data. [2025-09-23T17:35:24.566879] [DEBUG] [LOCAL ] BHVN: Deleted primary data file. [2025-09-23T17:35:24.566941] [INFO ] [MAIN ] BHVN: Starting full primary refresh. [2025-09-23T17:35:24.925943] [INFO ] [REMOTE ] BHVN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:35:25.002201] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2024-12. [2025-09-23T17:35:25.762144] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-23T17:35:25.802154] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-07. [2025-09-23T17:35:26.290556] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-23T17:35:26.602183] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-01. [2025-09-23T17:35:27.402958] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-09-23T17:35:27.409166] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-23T17:35:27.695961] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-09-23T17:35:27.802723] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-23T17:35:28.202215] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-05. [2025-09-23T17:35:28.996465] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-23T17:35:29.002139] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-06. [2025-09-23T17:35:29.720141] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-23T17:35:29.802191] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-07. [2025-09-23T17:35:30.394139] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-23T17:35:30.602201] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-08. [2025-09-23T17:35:31.402207] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-09-23T17:35:31.801378] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-23T17:35:32.202179] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-09-23T17:35:32.264245] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-23T17:35:32.645838] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-23T17:35:33.002196] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-09-23T17:35:33.302533] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-09-23T17:35:33.802215] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-09-23T17:35:34.076266] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-09-23T17:35:34.602179] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-02. [2025-09-23T17:35:35.402190] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-09. [2025-09-23T17:35:35.924521] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-23T17:35:36.202201] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-03. [2025-09-23T17:35:36.932142] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-23T17:35:36.942007] [INFO ] [REMOTE ] BHP: Full fetch complete (77237 records). [2025-09-23T17:35:36.942181] [DEBUG] [VALIDATOR ] BHP: Validating primary data. [2025-09-23T17:35:37.013118] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-09-23T17:35:37.372797] [DEBUG] [VALIDATOR ] BHP: All expected trading days are present. [2025-09-23T17:35:37.368874] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-23T17:35:37.373015] [DEBUG] [VALIDATOR ] BHP: Primary data validation passed. [2025-09-23T17:35:37.375395] [INFO ] [MAIN ] BHP: Fetched primary data is valid. [2025-09-23T17:35:37.375536] [DEBUG] [LOCAL ] BHP: Saving primary data. [2025-09-23T17:35:37.377636] [DEBUG] [LOCAL ] BHP: Trimmed 77237 records to 53376 (keeping 200 days of data) [2025-09-23T17:35:37.521863] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-23T17:35:37.764527] [DEBUG] [LOCAL ] BHP: Primary data saved (53376 records). [2025-09-23T17:35:37.764720] [INFO ] [MAIN ] BHP: Full history saved. [2025-09-23T17:35:37.764856] [INFO ] [MAIN ] Update Progress: 272/2372 symbols completed. BHP took 34.6s. Estimated remaining: 4h 34m 40s. Rate: 7.6 symbols/min [2025-09-23T17:35:37.807322] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-09-23T17:35:37.964874] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:35:37.965052] [DEBUG] [LOCAL ] BILL: No existing data file found in primary storage. [2025-09-23T17:35:37.965128] [WARN ] [MAIN ] BILL: No existing data found, performing full refresh instead. [2025-09-23T17:35:37.965290] [INFO ] [MAIN ] BILL: Wiping existing primary data before full refresh. [2025-09-23T17:35:37.965334] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-09-23T17:35:37.965377] [DEBUG] [LOCAL ] BILL: No primary data file found to delete. [2025-09-23T17:35:37.965410] [INFO ] [MAIN ] BILL: Starting full primary refresh. [2025-09-23T17:35:38.258343] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-23T17:35:38.347389] [INFO ] [REMOTE ] BILL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:35:38.602186] [INFO ] [REMOTE ] BILL: Fetching primary data for 2024-12. [2025-09-23T17:35:39.402192] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-09-23T17:35:39.806548] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-23T17:35:39.807524] [INFO ] [REMOTE ] BHV: Full fetch complete (1379 records). [2025-09-23T17:35:39.807593] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-09-23T17:35:39.995149] [WARN ] [VALIDATOR ] BHV: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-23T17:35:39.995398] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:35:39.995522] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:35:39.995585] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-09-23T17:35:39.995685] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-09-23T17:35:39.995753] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-09-23T17:35:39.995834] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-09-23T17:35:39.995927] [INFO ] [MAIN ] Update Progress: 273/2372 symbols completed. BHV took 19.0s. Estimated remaining: 4h 33m 49s. Rate: 7.7 symbols/min [2025-09-23T17:35:40.184538] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:35:40.208103] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-04. [2025-09-23T17:35:40.220133] [DEBUG] [LOCAL ] BIO: Loaded 25556 existing records from primary storage. [2025-09-23T17:35:40.220541] [INFO ] [MAIN ] BIO: Loaded 25556 existing records. [2025-09-23T17:35:40.409509] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-23T17:35:40.452238] [WARN ] [MAIN ] BIO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:35:40.453203] [INFO ] [MAIN ] BIO: Wiping existing primary data before full refresh. [2025-09-23T17:35:40.453255] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-09-23T17:35:40.454113] [DEBUG] [LOCAL ] BIO: Deleted primary data file. [2025-09-23T17:35:40.454175] [INFO ] [MAIN ] BIO: Starting full primary refresh. [2025-09-23T17:35:40.820301] [INFO ] [REMOTE ] BIO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:35:41.002192] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-08. [2025-09-23T17:35:41.614297] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-23T17:35:41.802199] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-05. [2025-09-23T17:35:41.852480] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-23T17:35:42.602342] [INFO ] [REMOTE ] BIO: Fetching primary data for 2024-12. [2025-09-23T17:35:43.149750] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-23T17:35:43.402197] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-09. [2025-09-23T17:35:43.469598] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-23T17:35:44.202197] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-06. [2025-09-23T17:35:44.351907] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-23T17:35:44.357488] [INFO ] [REMOTE ] BHR: Full fetch complete (30553 records). [2025-09-23T17:35:44.357603] [DEBUG] [VALIDATOR ] BHR: Validating primary data. [2025-09-23T17:35:44.743875] [DEBUG] [VALIDATOR ] BHR: All expected trading days are present. [2025-09-23T17:35:44.743951] [DEBUG] [VALIDATOR ] BHR: Primary data validation passed. [2025-09-23T17:35:44.744374] [INFO ] [MAIN ] BHR: Fetched primary data is valid. [2025-09-23T17:35:44.744442] [DEBUG] [LOCAL ] BHR: Saving primary data. [2025-09-23T17:35:44.746620] [DEBUG] [LOCAL ] BHR: Trimmed 30553 records to 21431 (keeping 200 days of data) [2025-09-23T17:35:44.880042] [DEBUG] [LOCAL ] BHR: Primary data saved (21431 records). [2025-09-23T17:35:44.880169] [INFO ] [MAIN ] BHR: Full history saved. [2025-09-23T17:35:44.880249] [INFO ] [MAIN ] Update Progress: 274/2372 symbols completed. BHR took 35.4s. Estimated remaining: 4h 33m 19s. Rate: 7.7 symbols/min [2025-09-23T17:35:45.007321] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-01. [2025-09-23T17:35:45.079190] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:35:45.121426] [DEBUG] [LOCAL ] BIP: Loaded 39680 existing records from primary storage. [2025-09-23T17:35:45.121608] [INFO ] [MAIN ] BIP: Loaded 39680 existing records. [2025-09-23T17:35:45.324383] [WARN ] [MAIN ] BIP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:35:45.324985] [INFO ] [MAIN ] BIP: Wiping existing primary data before full refresh. [2025-09-23T17:35:45.325209] [INFO ] [LOCAL ] BIP: Starting deletion of primary data. [2025-09-23T17:35:45.326451] [DEBUG] [LOCAL ] BIP: Deleted primary data file. [2025-09-23T17:35:45.326516] [INFO ] [MAIN ] BIP: Starting full primary refresh. [2025-09-23T17:35:45.687625] [INFO ] [REMOTE ] BIP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:35:45.726087] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-23T17:35:45.802156] [INFO ] [REMOTE ] BIP: Fetching primary data for 2024-12. [2025-09-23T17:35:46.376381] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-23T17:35:46.602191] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-02. [2025-09-23T17:35:46.906530] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-23T17:35:47.402214] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-07. [2025-09-23T17:35:48.202185] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-01. [2025-09-23T17:35:48.414589] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-23T17:35:48.959503] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-23T17:35:49.002165] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-08. [2025-09-23T17:35:49.272921] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-23T17:35:49.802197] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-03. [2025-09-23T17:35:50.309485] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-23T17:35:50.602221] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-02. [2025-09-23T17:35:51.327388] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-23T17:35:51.402158] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-09. [2025-09-23T17:35:51.464538] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-23T17:35:52.202201] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-04. [2025-09-23T17:35:52.757365] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-23T17:35:52.765708] [INFO ] [REMOTE ] BHVN: Full fetch complete (69345 records). [2025-09-23T17:35:52.765821] [DEBUG] [VALIDATOR ] BHVN: Validating primary data. [2025-09-23T17:35:53.012176] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-03. [2025-09-23T17:35:53.211993] [DEBUG] [VALIDATOR ] BHVN: All expected trading days are present. [2025-09-23T17:35:53.212091] [DEBUG] [VALIDATOR ] BHVN: Primary data validation passed. [2025-09-23T17:35:53.212916] [INFO ] [MAIN ] BHVN: Fetched primary data is valid. [2025-09-23T17:35:53.212980] [DEBUG] [LOCAL ] BHVN: Saving primary data. [2025-09-23T17:35:53.214367] [DEBUG] [LOCAL ] BHVN: Trimmed 69345 records to 49614 (keeping 200 days of data) [2025-09-23T17:35:53.506173] [DEBUG] [LOCAL ] BHVN: Primary data saved (49614 records). [2025-09-23T17:35:53.506322] [INFO ] [MAIN ] BHVN: Full history saved. [2025-09-23T17:35:53.506411] [INFO ] [MAIN ] Update Progress: 275/2372 symbols completed. BHVN took 29.4s. Estimated remaining: 4h 33m 17s. Rate: 7.7 symbols/min [2025-09-23T17:35:53.675191] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:35:53.714076] [DEBUG] [LOCAL ] BIPC: Loaded 41711 existing records from primary storage. [2025-09-23T17:35:53.714225] [INFO ] [MAIN ] BIPC: Loaded 41711 existing records. [2025-09-23T17:35:53.804051] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-01. [2025-09-23T17:35:53.900479] [WARN ] [MAIN ] BIPC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:35:53.900831] [INFO ] [MAIN ] BIPC: Wiping existing primary data before full refresh. [2025-09-23T17:35:53.900885] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-09-23T17:35:53.901786] [DEBUG] [LOCAL ] BIPC: Deleted primary data file. [2025-09-23T17:35:53.901846] [INFO ] [MAIN ] BIPC: Starting full primary refresh. [2025-09-23T17:35:54.231160] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-23T17:35:54.327867] [INFO ] [REMOTE ] BIPC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:35:54.377735] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-23T17:35:54.602206] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2024-12. [2025-09-23T17:35:54.799326] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-23T17:35:55.402224] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-05. [2025-09-23T17:35:55.695175] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-23T17:35:56.202204] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-01. [2025-09-23T17:35:56.824611] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-23T17:35:57.002189] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-04. [2025-09-23T17:35:57.479557] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-23T17:35:57.802195] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-02. [2025-09-23T17:35:57.959148] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-23T17:35:58.602198] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-02. [2025-09-23T17:35:58.865153] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-23T17:35:59.402189] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-06. [2025-09-23T17:35:59.718293] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-23T17:36:00.202196] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-03. [2025-09-23T17:36:01.002184] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-03. [2025-09-23T17:36:01.178364] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-23T17:36:01.802201] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-07. [2025-09-23T17:36:01.898982] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-23T17:36:02.602217] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-05. [2025-09-23T17:36:03.219760] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-23T17:36:03.402177] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-04. [2025-09-23T17:36:04.202218] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-04. [2025-09-23T17:36:04.883319] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-07 (3.08 seconds). [2025-09-23T17:36:05.002189] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-08. [2025-09-23T17:36:05.095445] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-23T17:36:05.507903] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-05 (2.91 seconds). [2025-09-23T17:36:05.684999] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-23T17:36:05.802197] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-05. [2025-09-23T17:36:06.437422] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-23T17:36:06.602161] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-09. [2025-09-23T17:36:07.357513] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-23T17:36:07.402203] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-06. [2025-09-23T17:36:08.110416] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-23T17:36:08.122940] [INFO ] [REMOTE ] BILL: Full fetch complete (75583 records). [2025-09-23T17:36:08.123144] [DEBUG] [VALIDATOR ] BILL: Validating primary data. [2025-09-23T17:36:08.207314] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-05. [2025-09-23T17:36:08.537560] [DEBUG] [VALIDATOR ] BILL: All expected trading days are present. [2025-09-23T17:36:08.537778] [DEBUG] [VALIDATOR ] BILL: Primary data validation passed. [2025-09-23T17:36:08.538583] [INFO ] [MAIN ] BILL: Fetched primary data is valid. [2025-09-23T17:36:08.538813] [DEBUG] [LOCAL ] BILL: Saving primary data. [2025-09-23T17:36:08.542753] [DEBUG] [LOCAL ] BILL: Trimmed 75583 records to 52325 (keeping 200 days of data) [2025-09-23T17:36:08.655054] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-23T17:36:08.891919] [DEBUG] [LOCAL ] BILL: Primary data saved (52325 records). [2025-09-23T17:36:08.892065] [INFO ] [MAIN ] BILL: Full history saved. [2025-09-23T17:36:08.892149] [INFO ] [MAIN ] Update Progress: 276/2372 symbols completed. BILL took 31.1s. Estimated remaining: 4h 34m 7s. Rate: 7.6 symbols/min [2025-09-23T17:36:09.007341] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-06. [2025-09-23T17:36:09.075755] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:36:09.080743] [DEBUG] [LOCAL ] BIPH: Loaded 2646 existing records from primary storage. [2025-09-23T17:36:09.080866] [INFO ] [MAIN ] BIPH: Loaded 2646 existing records. [2025-09-23T17:36:09.268694] [WARN ] [MAIN ] BIPH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:36:09.268959] [INFO ] [MAIN ] BIPH: Wiping existing primary data before full refresh. [2025-09-23T17:36:09.269009] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-09-23T17:36:09.269327] [DEBUG] [LOCAL ] BIPH: Deleted primary data file. [2025-09-23T17:36:09.269387] [INFO ] [MAIN ] BIPH: Starting full primary refresh. [2025-09-23T17:36:09.640113] [INFO ] [REMOTE ] BIPH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:36:09.660951] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-23T17:36:09.802150] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-06. [2025-09-23T17:36:09.931529] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-23T17:36:10.602283] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-07. [2025-09-23T17:36:10.884352] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-23T17:36:11.402273] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2024-12. [2025-09-23T17:36:11.761832] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-23T17:36:11.968792] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-23T17:36:12.202221] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-08. [2025-09-23T17:36:13.002265] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-01. [2025-09-23T17:36:13.404098] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-23T17:36:13.428571] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-23T17:36:13.802187] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-02. [2025-09-23T17:36:14.297941] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-23T17:36:14.602256] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-09. [2025-09-23T17:36:15.402242] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-03. [2025-09-23T17:36:16.202207] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-07. [2025-09-23T17:36:16.236814] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-23T17:36:16.417897] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-23T17:36:16.424514] [INFO ] [REMOTE ] BIPC: Full fetch complete (59473 records). [2025-09-23T17:36:16.424629] [DEBUG] [VALIDATOR ] BIPC: Validating primary data. [2025-09-23T17:36:16.824098] [DEBUG] [VALIDATOR ] BIPC: All expected trading days are present. [2025-09-23T17:36:16.824184] [DEBUG] [VALIDATOR ] BIPC: Primary data validation passed. [2025-09-23T17:36:16.824860] [INFO ] [MAIN ] BIPC: Fetched primary data is valid. [2025-09-23T17:36:16.824950] [DEBUG] [LOCAL ] BIPC: Saving primary data. [2025-09-23T17:36:16.826321] [DEBUG] [LOCAL ] BIPC: Trimmed 59473 records to 41701 (keeping 200 days of data) [2025-09-23T17:36:17.014170] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-07. [2025-09-23T17:36:17.109754] [DEBUG] [LOCAL ] BIPC: Primary data saved (41701 records). [2025-09-23T17:36:17.109908] [INFO ] [MAIN ] BIPC: Full history saved. [2025-09-23T17:36:17.110032] [INFO ] [MAIN ] Update Progress: 277/2372 symbols completed. BIPC took 23.6s. Estimated remaining: 4h 34m 1s. Rate: 7.6 symbols/min [2025-09-23T17:36:17.390914] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-23T17:36:17.802207] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-08. [2025-09-23T17:36:18.261058] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-23T17:36:18.602218] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-04. [2025-09-23T17:36:18.711442] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-23T17:36:19.029855] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-23T17:36:19.402238] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-08. [2025-09-23T17:36:20.202221] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-09. [2025-09-23T17:36:20.686143] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-23T17:36:21.006000] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-05. [2025-09-23T17:36:21.007203] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-23T17:36:21.011772] [INFO ] [REMOTE ] BIO: Full fetch complete (34253 records). [2025-09-23T17:36:21.011873] [DEBUG] [VALIDATOR ] BIO: Validating primary data. [2025-09-23T17:36:21.396920] [DEBUG] [VALIDATOR ] BIO: All expected trading days are present. [2025-09-23T17:36:21.397006] [DEBUG] [VALIDATOR ] BIO: Primary data validation passed. [2025-09-23T17:36:21.397475] [INFO ] [MAIN ] BIO: Fetched primary data is valid. [2025-09-23T17:36:21.397516] [DEBUG] [LOCAL ] BIO: Saving primary data. [2025-09-23T17:36:21.398413] [DEBUG] [LOCAL ] BIO: Trimmed 34253 records to 25445 (keeping 200 days of data) [2025-09-23T17:36:21.543143] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-23T17:36:21.563964] [DEBUG] [LOCAL ] BIO: Primary data saved (25445 records). [2025-09-23T17:36:21.564126] [INFO ] [MAIN ] BIO: Full history saved. [2025-09-23T17:36:21.564233] [INFO ] [MAIN ] Update Progress: 278/2372 symbols completed. BIO took 41.6s. Estimated remaining: 4h 33m 28s. Rate: 7.7 symbols/min [2025-09-23T17:36:21.802236] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-06. [2025-09-23T17:36:22.602206] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-09. [2025-09-23T17:36:23.027165] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-23T17:36:23.402256] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-07. [2025-09-23T17:36:23.707862] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-23T17:36:23.758175] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-23T17:36:23.765099] [INFO ] [REMOTE ] BIP: Full fetch complete (56365 records). [2025-09-23T17:36:23.765264] [DEBUG] [VALIDATOR ] BIP: Validating primary data. [2025-09-23T17:36:24.166325] [DEBUG] [VALIDATOR ] BIP: All expected trading days are present. [2025-09-23T17:36:24.166414] [DEBUG] [VALIDATOR ] BIP: Primary data validation passed. [2025-09-23T17:36:24.167053] [INFO ] [MAIN ] BIP: Fetched primary data is valid. [2025-09-23T17:36:24.167117] [DEBUG] [LOCAL ] BIP: Saving primary data. [2025-09-23T17:36:24.168367] [DEBUG] [LOCAL ] BIP: Trimmed 56365 records to 39590 (keeping 200 days of data) [2025-09-23T17:36:24.227949] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-08. [2025-09-23T17:36:24.417701] [DEBUG] [LOCAL ] BIP: Primary data saved (39590 records). [2025-09-23T17:36:24.417858] [INFO ] [MAIN ] BIP: Full history saved. [2025-09-23T17:36:24.417976] [INFO ] [MAIN ] Update Progress: 279/2372 symbols completed. BIP took 39.5s. Estimated remaining: 4h 32m 43s. Rate: 7.7 symbols/min [2025-09-23T17:36:24.593529] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-23T17:36:25.002236] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-09. [2025-09-23T17:36:25.474984] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-23T17:36:25.476045] [INFO ] [REMOTE ] BIPH: Full fetch complete (4318 records). [2025-09-23T17:36:25.476133] [DEBUG] [VALIDATOR ] BIPH: Validating primary data. [2025-09-23T17:36:25.839606] [DEBUG] [VALIDATOR ] BIPH: All expected trading days are present. [2025-09-23T17:36:25.839708] [DEBUG] [VALIDATOR ] BIPH: Primary data validation passed. [2025-09-23T17:36:25.839847] [INFO ] [MAIN ] BIPH: Fetched primary data is valid. [2025-09-23T17:36:25.839885] [DEBUG] [LOCAL ] BIPH: Saving primary data. [2025-09-23T17:36:25.840237] [DEBUG] [LOCAL ] BIPH: Trimmed 4318 records to 2635 (keeping 200 days of data) [2025-09-23T17:36:25.856289] [DEBUG] [LOCAL ] BIPH: Primary data saved (2635 records). [2025-09-23T17:36:25.856362] [INFO ] [MAIN ] BIPH: Full history saved. [2025-09-23T17:36:25.856444] [INFO ] [MAIN ] Update Progress: 280/2372 symbols completed. BIPH took 17.0s. Estimated remaining: 4h 31m 47s. Rate: 7.7 symbols/min [2025-09-23T17:36:26.421405] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:36:26.583516] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:36:26.523803] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:36:26.585105] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:36:26.592446] [DEBUG] [LOCAL ] BIPI: Loaded 3354 existing records from primary storage. [2025-09-23T17:36:26.592800] [INFO ] [MAIN ] BIPI: Loaded 3354 existing records. [2025-09-23T17:36:26.618360] [DEBUG] [LOCAL ] BIPJ: Loaded 2937 existing records from primary storage. [2025-09-23T17:36:26.650322] [INFO ] [MAIN ] BIPJ: Loaded 2937 existing records. [2025-09-23T17:36:26.794468] [DEBUG] [LOCAL ] BIT: Loaded 22270 existing records from primary storage. [2025-09-23T17:36:26.864033] [INFO ] [MAIN ] BIT: Loaded 22270 existing records. [2025-09-23T17:36:26.962791] [WARN ] [MAIN ] BIPI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:36:27.117567] [WARN ] [MAIN ] BIPJ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:36:27.134169] [DEBUG] [LOCAL ] BIRK: Loaded 50882 existing records from primary storage. [2025-09-23T17:36:27.064258] [INFO ] [MAIN ] BIPI: Wiping existing primary data before full refresh. [2025-09-23T17:36:27.154254] [INFO ] [MAIN ] BIPJ: Wiping existing primary data before full refresh. [2025-09-23T17:36:27.154012] [INFO ] [MAIN ] BIRK: Loaded 50882 existing records. [2025-09-23T17:36:27.154451] [INFO ] [LOCAL ] BIPI: Starting deletion of primary data. [2025-09-23T17:36:27.171880] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-09-23T17:36:27.223132] [DEBUG] [LOCAL ] BIPJ: Deleted primary data file. [2025-09-23T17:36:27.223062] [DEBUG] [LOCAL ] BIPI: Deleted primary data file. [2025-09-23T17:36:27.262666] [INFO ] [MAIN ] BIPJ: Starting full primary refresh. [2025-09-23T17:36:27.275585] [INFO ] [MAIN ] BIPI: Starting full primary refresh. [2025-09-23T17:36:27.417147] [WARN ] [MAIN ] BIT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:36:27.544141] [INFO ] [MAIN ] BIT: Wiping existing primary data before full refresh. [2025-09-23T17:36:27.572991] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-09-23T17:36:27.678540] [WARN ] [MAIN ] BIRK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:36:27.689042] [DEBUG] [LOCAL ] BIT: Deleted primary data file. [2025-09-23T17:36:27.718868] [INFO ] [MAIN ] BIT: Starting full primary refresh. [2025-09-23T17:36:27.760811] [INFO ] [MAIN ] BIRK: Wiping existing primary data before full refresh. [2025-09-23T17:36:27.819348] [INFO ] [LOCAL ] BIRK: Starting deletion of primary data. [2025-09-23T17:36:27.919384] [DEBUG] [LOCAL ] BIRK: Deleted primary data file. [2025-09-23T17:36:27.931688] [INFO ] [MAIN ] BIRK: Starting full primary refresh. [2025-09-23T17:36:28.544530] [INFO ] [REMOTE ] BIPI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:36:28.641288] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2024-12. [2025-09-23T17:36:28.714139] [INFO ] [REMOTE ] BIPJ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:36:28.766752] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2024-12. [2025-09-23T17:36:28.932284] [INFO ] [REMOTE ] BIT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:36:28.949696] [INFO ] [REMOTE ] BIT: Fetching primary data for 2024-12. [2025-09-23T17:36:28.974216] [INFO ] [REMOTE ] BIRK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:36:28.974499] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2024-12. [2025-09-23T17:36:29.278995] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-23T17:36:29.280486] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-01. [2025-09-23T17:36:29.582519] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-23T17:36:29.605507] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-23T17:36:29.784585] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-23T17:36:29.802176] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-02. [2025-09-23T17:36:30.194601] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-23T17:36:30.312342] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-23T17:36:30.602198] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-03. [2025-09-23T17:36:31.044663] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-23T17:36:31.402225] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-01. [2025-09-23T17:36:31.990622] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-23T17:36:32.202201] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-02. [2025-09-23T17:36:32.884552] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-23T17:36:33.002202] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-04. [2025-09-23T17:36:33.476188] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-23T17:36:33.802202] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-01. [2025-09-23T17:36:34.344462] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-23T17:36:34.602223] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-05. [2025-09-23T17:36:34.967980] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-23T17:36:35.402223] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-06. [2025-09-23T17:36:35.769431] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-23T17:36:36.202210] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-03. [2025-09-23T17:36:36.880450] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-23T17:36:37.002199] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-07. [2025-09-23T17:36:37.340059] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-23T17:36:37.802189] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-01. [2025-09-23T17:36:38.602229] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-02. [2025-09-23T17:36:39.043247] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-23T17:36:39.142265] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-23T17:36:39.402212] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-02. [2025-09-23T17:36:40.202253] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-04. [2025-09-23T17:36:40.527809] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-23T17:36:41.002177] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-03. [2025-09-23T17:36:41.312879] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-23T17:36:41.512837] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-23T17:36:41.802203] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-03. [2025-09-23T17:36:42.602231] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-05. [2025-09-23T17:36:43.026640] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-23T17:36:43.402158] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-04. [2025-09-23T17:36:43.551482] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-23T17:36:44.202282] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-08. [2025-09-23T17:36:44.579635] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-23T17:36:44.697980] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-23T17:36:45.002193] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-05. [2025-09-23T17:36:45.802219] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-06. [2025-09-23T17:36:46.286567] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-23T17:36:46.602192] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-04. [2025-09-23T17:36:46.850346] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-23T17:36:46.949341] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-23T17:36:47.402206] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-05. [2025-09-23T17:36:47.675508] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-09-23T17:36:48.202200] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-06. [2025-09-23T17:36:48.635868] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-23T17:36:49.002194] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-07. [2025-09-23T17:36:49.382427] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-23T17:36:49.802221] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-09. [2025-09-23T17:36:50.222551] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-23T17:36:50.223771] [INFO ] [REMOTE ] BIPJ: Full fetch complete (4325 records). [2025-09-23T17:36:50.223839] [DEBUG] [VALIDATOR ] BIPJ: Validating primary data. [2025-09-23T17:36:50.603335] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-07. [2025-09-23T17:36:50.608740] [DEBUG] [VALIDATOR ] BIPJ: All expected trading days are present. [2025-09-23T17:36:50.609763] [DEBUG] [VALIDATOR ] BIPJ: Primary data validation passed. [2025-09-23T17:36:50.609932] [INFO ] [MAIN ] BIPJ: Fetched primary data is valid. [2025-09-23T17:36:50.609993] [DEBUG] [LOCAL ] BIPJ: Saving primary data. [2025-09-23T17:36:50.610408] [DEBUG] [LOCAL ] BIPJ: Trimmed 4325 records to 2951 (keeping 200 days of data) [2025-09-23T17:36:50.630630] [DEBUG] [LOCAL ] BIPJ: Primary data saved (2951 records). [2025-09-23T17:36:50.630787] [INFO ] [MAIN ] BIPJ: Full history saved. [2025-09-23T17:36:50.631065] [INFO ] [MAIN ] Update Progress: 281/2372 symbols completed. BIPJ took 24.8s. Estimated remaining: 4h 33m 46s. Rate: 7.6 symbols/min [2025-09-23T17:36:50.804437] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:36:50.863749] [DEBUG] [LOCAL ] BJ: Loaded 51426 existing records from primary storage. [2025-09-23T17:36:50.863916] [INFO ] [MAIN ] BJ: Loaded 51426 existing records. [2025-09-23T17:36:51.045626] [WARN ] [MAIN ] BJ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:36:51.045904] [INFO ] [MAIN ] BJ: Wiping existing primary data before full refresh. [2025-09-23T17:36:51.045960] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-09-23T17:36:51.047494] [DEBUG] [LOCAL ] BJ: Deleted primary data file. [2025-09-23T17:36:51.047556] [INFO ] [MAIN ] BJ: Starting full primary refresh. [2025-09-23T17:36:51.405593] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-06. [2025-09-23T17:36:51.405490] [INFO ] [REMOTE ] BJ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:36:51.952431] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-23T17:36:52.202193] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-08. [2025-09-23T17:36:52.624223] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-23T17:36:53.002172] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-09. [2025-09-23T17:36:53.131492] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-23T17:36:53.468374] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-23T17:36:53.469705] [INFO ] [REMOTE ] BIPI: Full fetch complete (5260 records). [2025-09-23T17:36:53.469776] [DEBUG] [VALIDATOR ] BIPI: Validating primary data. [2025-09-23T17:36:53.803527] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-08. [2025-09-23T17:36:53.865800] [DEBUG] [VALIDATOR ] BIPI: All expected trading days are present. [2025-09-23T17:36:53.865877] [DEBUG] [VALIDATOR ] BIPI: Primary data validation passed. [2025-09-23T17:36:53.866076] [INFO ] [MAIN ] BIPI: Fetched primary data is valid. [2025-09-23T17:36:53.866138] [DEBUG] [LOCAL ] BIPI: Saving primary data. [2025-09-23T17:36:53.866534] [DEBUG] [LOCAL ] BIPI: Trimmed 5260 records to 3293 (keeping 200 days of data) [2025-09-23T17:36:53.887759] [DEBUG] [LOCAL ] BIPI: Primary data saved (3293 records). [2025-09-23T17:36:53.887845] [INFO ] [MAIN ] BIPI: Full history saved. [2025-09-23T17:36:53.887922] [INFO ] [MAIN ] Update Progress: 282/2372 symbols completed. BIPI took 28.0s. Estimated remaining: 4h 33m 4s. Rate: 7.7 symbols/min [2025-09-23T17:36:54.073706] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:36:54.129601] [DEBUG] [LOCAL ] BK: Loaded 53562 existing records from primary storage. [2025-09-23T17:36:54.129777] [INFO ] [MAIN ] BK: Loaded 53562 existing records. [2025-09-23T17:36:54.312294] [WARN ] [MAIN ] BK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:36:54.312587] [INFO ] [MAIN ] BK: Wiping existing primary data before full refresh. [2025-09-23T17:36:54.312677] [INFO ] [LOCAL ] BK: Starting deletion of primary data. [2025-09-23T17:36:54.315750] [DEBUG] [LOCAL ] BK: Deleted primary data file. [2025-09-23T17:36:54.315817] [INFO ] [MAIN ] BK: Starting full primary refresh. [2025-09-23T17:36:54.607267] [INFO ] [REMOTE ] BJ: Fetching primary data for 2024-12. [2025-09-23T17:36:54.706796] [INFO ] [REMOTE ] BK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:36:54.800110] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-23T17:36:55.402206] [INFO ] [REMOTE ] BK: Fetching primary data for 2024-12. [2025-09-23T17:36:55.979058] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-23T17:36:56.202196] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-09. [2025-09-23T17:36:56.926129] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-23T17:36:57.002203] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-07. [2025-09-23T17:36:57.162523] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-23T17:36:57.172016] [INFO ] [REMOTE ] BIT: Full fetch complete (31054 records). [2025-09-23T17:36:57.172168] [DEBUG] [VALIDATOR ] BIT: Validating primary data. [2025-09-23T17:36:57.540069] [DEBUG] [VALIDATOR ] BIT: All expected trading days are present. [2025-09-23T17:36:57.540150] [DEBUG] [VALIDATOR ] BIT: Primary data validation passed. [2025-09-23T17:36:57.540574] [INFO ] [MAIN ] BIT: Fetched primary data is valid. [2025-09-23T17:36:57.540613] [DEBUG] [LOCAL ] BIT: Saving primary data. [2025-09-23T17:36:57.541409] [DEBUG] [LOCAL ] BIT: Trimmed 31054 records to 22326 (keeping 200 days of data) [2025-09-23T17:36:57.676863] [DEBUG] [LOCAL ] BIT: Primary data saved (22326 records). [2025-09-23T17:36:57.676997] [INFO ] [MAIN ] BIT: Full history saved. [2025-09-23T17:36:57.677081] [INFO ] [MAIN ] Update Progress: 283/2372 symbols completed. BIT took 31.8s. Estimated remaining: 4h 32m 26s. Rate: 7.7 symbols/min [2025-09-23T17:36:57.816756] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-01. [2025-09-23T17:36:57.850997] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:36:57.900967] [DEBUG] [LOCAL ] BKD: Loaded 50100 existing records from primary storage. [2025-09-23T17:36:57.901150] [INFO ] [MAIN ] BKD: Loaded 50100 existing records. [2025-09-23T17:36:58.092177] [WARN ] [MAIN ] BKD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:36:58.092560] [INFO ] [MAIN ] BKD: Wiping existing primary data before full refresh. [2025-09-23T17:36:58.092686] [INFO ] [LOCAL ] BKD: Starting deletion of primary data. [2025-09-23T17:36:58.094187] [DEBUG] [LOCAL ] BKD: Deleted primary data file. [2025-09-23T17:36:58.094251] [INFO ] [MAIN ] BKD: Starting full primary refresh. [2025-09-23T17:36:58.466995] [INFO ] [REMOTE ] BKD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:36:58.531281] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-23T17:36:58.602154] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-08. [2025-09-23T17:36:59.402249] [INFO ] [REMOTE ] BKD: Fetching primary data for 2024-12. [2025-09-23T17:36:59.435255] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-23T17:36:59.865165] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-23T17:37:00.202203] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-01. [2025-09-23T17:37:00.697268] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-23T17:37:01.002195] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-09. [2025-09-23T17:37:01.802253] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-01. [2025-09-23T17:37:02.088812] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-23T17:37:02.602232] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-02. [2025-09-23T17:37:02.718381] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-23T17:37:02.726926] [INFO ] [REMOTE ] BIRK: Full fetch complete (72711 records). [2025-09-23T17:37:02.727067] [DEBUG] [VALIDATOR ] BIRK: Validating primary data. [2025-09-23T17:37:03.129442] [DEBUG] [VALIDATOR ] BIRK: All expected trading days are present. [2025-09-23T17:37:03.129637] [DEBUG] [VALIDATOR ] BIRK: Primary data validation passed. [2025-09-23T17:37:03.130535] [INFO ] [MAIN ] BIRK: Fetched primary data is valid. [2025-09-23T17:37:03.130677] [DEBUG] [LOCAL ] BIRK: Saving primary data. [2025-09-23T17:37:03.157085] [DEBUG] [LOCAL ] BIRK: Trimmed 72711 records to 50900 (keeping 200 days of data) [2025-09-23T17:37:03.158338] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-23T17:37:03.402633] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-02. [2025-09-23T17:37:03.467752] [DEBUG] [LOCAL ] BIRK: Primary data saved (50900 records). [2025-09-23T17:37:03.467910] [INFO ] [MAIN ] BIRK: Full history saved. [2025-09-23T17:37:03.470783] [INFO ] [MAIN ] Update Progress: 284/2372 symbols completed. BIRK took 37.6s. Estimated remaining: 4h 32m 4s. Rate: 7.7 symbols/min [2025-09-23T17:37:03.641845] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:37:03.677625] [DEBUG] [LOCAL ] BKE: Loaded 34839 existing records from primary storage. [2025-09-23T17:37:03.677795] [INFO ] [MAIN ] BKE: Loaded 34839 existing records. [2025-09-23T17:37:03.854405] [WARN ] [MAIN ] BKE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:37:03.854778] [INFO ] [MAIN ] BKE: Wiping existing primary data before full refresh. [2025-09-23T17:37:03.854852] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-09-23T17:37:03.856113] [DEBUG] [LOCAL ] BKE: Deleted primary data file. [2025-09-23T17:37:03.856176] [INFO ] [MAIN ] BKE: Starting full primary refresh. [2025-09-23T17:37:04.204911] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-02. [2025-09-23T17:37:04.227149] [INFO ] [REMOTE ] BKE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:37:04.290789] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-23T17:37:04.792896] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-23T17:37:05.002221] [INFO ] [REMOTE ] BKE: Fetching primary data for 2024-12. [2025-09-23T17:37:05.547984] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-23T17:37:05.802224] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-03. [2025-09-23T17:37:06.215760] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-23T17:37:06.602215] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-03. [2025-09-23T17:37:07.097046] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-23T17:37:07.402205] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-03. [2025-09-23T17:37:08.202192] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-01. [2025-09-23T17:37:08.504158] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-23T17:37:08.931526] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-23T17:37:09.002153] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-04. [2025-09-23T17:37:09.302070] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-23T17:37:09.802190] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-02. [2025-09-23T17:37:10.607317] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-04. [2025-09-23T17:37:10.623424] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-23T17:37:10.759982] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-23T17:37:11.402246] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-03. [2025-09-23T17:37:12.073353] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-23T17:37:12.202210] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-05. [2025-09-23T17:37:12.531766] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-23T17:37:13.002197] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-04. [2025-09-23T17:37:13.779998] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-23T17:37:13.802144] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-06. [2025-09-23T17:37:14.097369] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-23T17:37:14.602257] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-04. [2025-09-23T17:37:15.080237] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-23T17:37:15.402232] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-05. [2025-09-23T17:37:16.145706] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-23T17:37:16.202176] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-05. [2025-09-23T17:37:16.580752] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-23T17:37:17.002210] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-07. [2025-09-23T17:37:17.376228] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-23T17:37:17.802210] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-06. [2025-09-23T17:37:18.458420] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-23T17:37:18.602159] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-08. [2025-09-23T17:37:18.652363] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-23T17:37:19.402213] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-06. [2025-09-23T17:37:20.202214] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-07. [2025-09-23T17:37:20.435798] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-23T17:37:20.554908] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-23T17:37:21.002196] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-07. [2025-09-23T17:37:21.145685] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-23T17:37:21.802228] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-09. [2025-09-23T17:37:22.239231] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-23T17:37:22.602358] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-08. [2025-09-23T17:37:23.311841] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-23T17:37:23.320669] [INFO ] [REMOTE ] BJ: Full fetch complete (73326 records). [2025-09-23T17:37:23.320842] [DEBUG] [VALIDATOR ] BJ: Validating primary data. [2025-09-23T17:37:23.321888] [FATAL] [VALIDATOR ] BJ: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:37:23.322001] [FATAL] [MAIN ] BJ: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:37:23.322045] [WARN ] [MAIN ] BJ: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:37:23.322110] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-09-23T17:37:23.322199] [DEBUG] [LOCAL ] BJ: No primary data file found to delete. [2025-09-23T17:37:23.322256] [INFO ] [LOCAL ] BJ: Starting deletion of derivative data. [2025-09-23T17:37:23.322921] [DEBUG] [LOCAL ] BJ: Deleted derivative data file. [2025-09-23T17:37:23.323025] [INFO ] [MAIN ] Update Progress: 285/2372 symbols completed. BJ took 32.7s. Estimated remaining: 4h 33m 24s. Rate: 7.6 symbols/min [2025-09-23T17:37:23.407483] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-08. [2025-09-23T17:37:23.501502] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:37:23.540827] [DEBUG] [LOCAL ] BKH: Loaded 36644 existing records from primary storage. [2025-09-23T17:37:23.540978] [INFO ] [MAIN ] BKH: Loaded 36644 existing records. [2025-09-23T17:37:23.688375] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-23T17:37:23.756203] [WARN ] [MAIN ] BKH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:37:23.756472] [INFO ] [MAIN ] BKH: Wiping existing primary data before full refresh. [2025-09-23T17:37:23.756521] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-09-23T17:37:23.757784] [DEBUG] [LOCAL ] BKH: Deleted primary data file. [2025-09-23T17:37:23.757847] [INFO ] [MAIN ] BKH: Starting full primary refresh. [2025-09-23T17:37:24.129688] [INFO ] [REMOTE ] BKH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:37:24.202207] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-09. [2025-09-23T17:37:24.727705] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-23T17:37:25.002214] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-09. [2025-09-23T17:37:25.802256] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-05. [2025-09-23T17:37:25.837892] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-23T17:37:25.843666] [INFO ] [REMOTE ] BKE: Full fetch complete (50070 records). [2025-09-23T17:37:25.843853] [DEBUG] [VALIDATOR ] BKE: Validating primary data. [2025-09-23T17:37:25.844611] [FATAL] [VALIDATOR ] BKE: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:37:25.844732] [FATAL] [MAIN ] BKE: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:37:25.844802] [WARN ] [MAIN ] BKE: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:37:25.844876] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-09-23T17:37:25.844942] [DEBUG] [LOCAL ] BKE: No primary data file found to delete. [2025-09-23T17:37:25.845021] [INFO ] [LOCAL ] BKE: Starting deletion of derivative data. [2025-09-23T17:37:25.845461] [DEBUG] [LOCAL ] BKE: Deleted derivative data file. [2025-09-23T17:37:25.845563] [INFO ] [MAIN ] Update Progress: 286/2372 symbols completed. BKE took 22.4s. Estimated remaining: 4h 32m 37s. Rate: 7.7 symbols/min [2025-09-23T17:37:26.014031] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:37:26.049678] [DEBUG] [LOCAL ] BKKT: Loaded 34157 existing records from primary storage. [2025-09-23T17:37:26.049819] [INFO ] [MAIN ] BKKT: Loaded 34157 existing records. [2025-09-23T17:37:26.224111] [WARN ] [MAIN ] BKKT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:37:26.224358] [INFO ] [MAIN ] BKKT: Wiping existing primary data before full refresh. [2025-09-23T17:37:26.224412] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-09-23T17:37:26.226046] [DEBUG] [LOCAL ] BKKT: Deleted primary data file. [2025-09-23T17:37:26.226108] [INFO ] [MAIN ] BKKT: Starting full primary refresh. [2025-09-23T17:37:26.604924] [INFO ] [REMOTE ] BKH: Fetching primary data for 2024-12. [2025-09-23T17:37:26.604765] [INFO ] [REMOTE ] BKKT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:37:26.631573] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-23T17:37:26.640173] [INFO ] [REMOTE ] BKD: Full fetch complete (71057 records). [2025-09-23T17:37:26.640338] [DEBUG] [VALIDATOR ] BKD: Validating primary data. [2025-09-23T17:37:26.641160] [FATAL] [VALIDATOR ] BKD: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:37:26.641265] [FATAL] [MAIN ] BKD: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:37:26.641308] [WARN ] [MAIN ] BKD: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:37:26.641366] [INFO ] [LOCAL ] BKD: Starting deletion of primary data. [2025-09-23T17:37:26.641472] [DEBUG] [LOCAL ] BKD: No primary data file found to delete. [2025-09-23T17:37:26.641530] [INFO ] [LOCAL ] BKD: Starting deletion of derivative data. [2025-09-23T17:37:26.642026] [DEBUG] [LOCAL ] BKD: Deleted derivative data file. [2025-09-23T17:37:26.642155] [INFO ] [MAIN ] Update Progress: 287/2372 symbols completed. BKD took 29.0s. Estimated remaining: 4h 31m 38s. Rate: 7.7 symbols/min [2025-09-23T17:37:26.826479] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:37:26.836992] [DEBUG] [LOCAL ] BKN: Loaded 7678 existing records from primary storage. [2025-09-23T17:37:26.837122] [INFO ] [MAIN ] BKN: Loaded 7678 existing records. [2025-09-23T17:37:27.013679] [WARN ] [MAIN ] BKN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:37:27.013964] [INFO ] [MAIN ] BKN: Wiping existing primary data before full refresh. [2025-09-23T17:37:27.014012] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-09-23T17:37:27.014438] [DEBUG] [LOCAL ] BKN: Deleted primary data file. [2025-09-23T17:37:27.014497] [INFO ] [MAIN ] BKN: Starting full primary refresh. [2025-09-23T17:37:27.371323] [INFO ] [REMOTE ] BKN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:37:27.402136] [INFO ] [REMOTE ] BKN: Fetching primary data for 2024-12. [2025-09-23T17:37:27.435149] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-23T17:37:27.722023] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-23T17:37:28.118545] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-23T17:37:28.202248] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-01. [2025-09-23T17:37:29.002198] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2024-12. [2025-09-23T17:37:29.371840] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-23T17:37:29.802200] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-06. [2025-09-23T17:37:30.602255] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-01. [2025-09-23T17:37:30.723412] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-23T17:37:31.102234] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-23T17:37:31.169600] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-23T17:37:31.402193] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-01. [2025-09-23T17:37:32.202203] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-07. [2025-09-23T17:37:32.535023] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-23T17:37:33.002231] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-02. [2025-09-23T17:37:33.381094] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-23T17:37:33.802184] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-03. [2025-09-23T17:37:34.152002] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-23T17:37:34.284584] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-23T17:37:34.602244] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-02. [2025-09-23T17:37:35.402222] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-02. [2025-09-23T17:37:35.561477] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-23T17:37:36.202201] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-04. [2025-09-23T17:37:36.707738] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-23T17:37:36.732994] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-23T17:37:37.002225] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-03. [2025-09-23T17:37:37.802188] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-03. [2025-09-23T17:37:38.233607] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-23T17:37:38.602193] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-04. [2025-09-23T17:37:39.318670] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-23T17:37:39.402166] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-05. [2025-09-23T17:37:39.427503] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-23T17:37:40.050426] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-23T17:37:40.202212] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-08. [2025-09-23T17:37:41.002206] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-04. [2025-09-23T17:37:41.780469] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-23T17:37:41.802166] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-09. [2025-09-23T17:37:41.999847] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-23T17:37:42.602264] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-05. [2025-09-23T17:37:43.253604] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-23T17:37:43.264939] [INFO ] [REMOTE ] BK: Full fetch complete (77484 records). [2025-09-23T17:37:43.265079] [DEBUG] [VALIDATOR ] BK: Validating primary data. [2025-09-23T17:37:43.407416] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-06. [2025-09-23T17:37:43.671148] [DEBUG] [VALIDATOR ] BK: All expected trading days are present. [2025-09-23T17:37:43.671325] [DEBUG] [VALIDATOR ] BK: Primary data validation passed. [2025-09-23T17:37:43.672391] [INFO ] [MAIN ] BK: Fetched primary data is valid. [2025-09-23T17:37:43.672464] [DEBUG] [LOCAL ] BK: Saving primary data. [2025-09-23T17:37:43.676889] [DEBUG] [LOCAL ] BK: Trimmed 77484 records to 53555 (keeping 200 days of data) [2025-09-23T17:37:43.914551] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-23T17:37:43.937732] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-23T17:37:44.049558] [DEBUG] [LOCAL ] BK: Primary data saved (53555 records). [2025-09-23T17:37:44.049739] [INFO ] [MAIN ] BK: Full history saved. [2025-09-23T17:37:44.049854] [INFO ] [MAIN ] Update Progress: 288/2372 symbols completed. BK took 50.2s. Estimated remaining: 4h 32m 40s. Rate: 7.6 symbols/min [2025-09-23T17:37:44.209337] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-07. [2025-09-23T17:37:44.228862] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:37:44.279975] [DEBUG] [LOCAL ] BKSY: Loaded 48277 existing records from primary storage. [2025-09-23T17:37:44.280144] [INFO ] [MAIN ] BKSY: Loaded 48277 existing records. [2025-09-23T17:37:44.503222] [WARN ] [MAIN ] BKSY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:37:44.503886] [INFO ] [MAIN ] BKSY: Wiping existing primary data before full refresh. [2025-09-23T17:37:44.503961] [INFO ] [LOCAL ] BKSY: Starting deletion of primary data. [2025-09-23T17:37:44.505285] [DEBUG] [LOCAL ] BKSY: Deleted primary data file. [2025-09-23T17:37:44.505348] [INFO ] [MAIN ] BKSY: Starting full primary refresh. [2025-09-23T17:37:44.838144] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-23T17:37:44.926117] [INFO ] [REMOTE ] BKSY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:37:45.002233] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-05. [2025-09-23T17:37:45.802214] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-08. [2025-09-23T17:37:45.994186] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-23T17:37:46.222134] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-23T17:37:46.602205] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2024-12. [2025-09-23T17:37:47.402209] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-09. [2025-09-23T17:37:47.933822] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-23T17:37:47.969523] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-23T17:37:47.971499] [INFO ] [REMOTE ] BKN: Full fetch complete (11995 records). [2025-09-23T17:37:47.971601] [DEBUG] [VALIDATOR ] BKN: Validating primary data. [2025-09-23T17:37:48.207334] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-06. [2025-09-23T17:37:48.339535] [DEBUG] [VALIDATOR ] BKN: All expected trading days are present. [2025-09-23T17:37:48.339613] [DEBUG] [VALIDATOR ] BKN: Primary data validation passed. [2025-09-23T17:37:48.339957] [INFO ] [MAIN ] BKN: Fetched primary data is valid. [2025-09-23T17:37:48.340063] [DEBUG] [LOCAL ] BKN: Saving primary data. [2025-09-23T17:37:48.340566] [DEBUG] [LOCAL ] BKN: Trimmed 11995 records to 7722 (keeping 200 days of data) [2025-09-23T17:37:48.391279] [DEBUG] [LOCAL ] BKN: Primary data saved (7722 records). [2025-09-23T17:37:48.391397] [INFO ] [MAIN ] BKN: Full history saved. [2025-09-23T17:37:48.391545] [INFO ] [MAIN ] Update Progress: 289/2372 symbols completed. BKN took 21.7s. Estimated remaining: 4h 32m 6s. Rate: 7.7 symbols/min [2025-09-23T17:37:48.558663] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:37:48.575351] [DEBUG] [LOCAL ] BKT: Loaded 10780 existing records from primary storage. [2025-09-23T17:37:48.575474] [INFO ] [MAIN ] BKT: Loaded 10780 existing records. [2025-09-23T17:37:48.748855] [WARN ] [MAIN ] BKT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:37:48.749103] [INFO ] [MAIN ] BKT: Wiping existing primary data before full refresh. [2025-09-23T17:37:48.749150] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-09-23T17:37:48.749603] [DEBUG] [LOCAL ] BKT: Deleted primary data file. [2025-09-23T17:37:48.749716] [INFO ] [MAIN ] BKT: Starting full primary refresh. [2025-09-23T17:37:49.007392] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-06. [2025-09-23T17:37:49.140804] [INFO ] [REMOTE ] BKT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:37:49.420902] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-23T17:37:49.802205] [INFO ] [REMOTE ] BKT: Fetching primary data for 2024-12. [2025-09-23T17:37:50.602165] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-01. [2025-09-23T17:37:50.779569] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-23T17:37:50.958861] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-23T17:37:51.402196] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-07. [2025-09-23T17:37:51.977051] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-23T17:37:52.202196] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-02. [2025-09-23T17:37:53.002205] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-07. [2025-09-23T17:37:53.067377] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-23T17:37:53.798285] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-23T17:37:53.807781] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-08. [2025-09-23T17:37:54.119045] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-23T17:37:54.602195] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-03. [2025-09-23T17:37:55.402217] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-01. [2025-09-23T17:37:55.482078] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-23T17:37:56.115919] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-23T17:37:56.202164] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-02. [2025-09-23T17:37:56.368715] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-23T17:37:56.781227] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-23T17:37:57.002208] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-03. [2025-09-23T17:37:57.425220] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-23T17:37:57.802178] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-04. [2025-09-23T17:37:58.391275] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-23T17:37:58.602352] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-09. [2025-09-23T17:37:59.402213] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-05. [2025-09-23T17:37:59.922113] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-23T17:38:00.202234] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-06. [2025-09-23T17:38:00.382397] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-23T17:38:00.389989] [INFO ] [REMOTE ] BKKT: Full fetch complete (49604 records). [2025-09-23T17:38:00.390107] [DEBUG] [VALIDATOR ] BKKT: Validating primary data. [2025-09-23T17:38:00.774179] [DEBUG] [VALIDATOR ] BKKT: All expected trading days are present. [2025-09-23T17:38:00.774285] [DEBUG] [VALIDATOR ] BKKT: Primary data validation passed. [2025-09-23T17:38:00.774910] [INFO ] [MAIN ] BKKT: Fetched primary data is valid. [2025-09-23T17:38:00.774973] [DEBUG] [LOCAL ] BKKT: Saving primary data. [2025-09-23T17:38:00.776052] [DEBUG] [LOCAL ] BKKT: Trimmed 49604 records to 34261 (keeping 200 days of data) [2025-09-23T17:38:00.895776] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-23T17:38:01.001194] [DEBUG] [LOCAL ] BKKT: Primary data saved (34261 records). [2025-09-23T17:38:01.001345] [INFO ] [MAIN ] BKKT: Full history saved. [2025-09-23T17:38:01.001451] [INFO ] [MAIN ] Update Progress: 290/2372 symbols completed. BKKT took 35.2s. Estimated remaining: 4h 32m 33s. Rate: 7.6 symbols/min [2025-09-23T17:38:01.007398] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-08. [2025-09-23T17:38:01.180421] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:38:01.223026] [DEBUG] [LOCAL ] BKU: Loaded 42017 existing records from primary storage. [2025-09-23T17:38:01.223165] [INFO ] [MAIN ] BKU: Loaded 42017 existing records. [2025-09-23T17:38:01.401724] [WARN ] [MAIN ] BKU: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:38:01.402006] [INFO ] [MAIN ] BKU: Wiping existing primary data before full refresh. [2025-09-23T17:38:01.402067] [INFO ] [LOCAL ] BKU: Starting deletion of primary data. [2025-09-23T17:38:01.403387] [DEBUG] [LOCAL ] BKU: Deleted primary data file. [2025-09-23T17:38:01.403450] [INFO ] [MAIN ] BKU: Starting full primary refresh. [2025-09-23T17:38:01.802176] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-07. [2025-09-23T17:38:01.824527] [INFO ] [REMOTE ] BKU: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:38:02.362405] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-23T17:38:02.602175] [INFO ] [REMOTE ] BKU: Fetching primary data for 2024-12. [2025-09-23T17:38:02.649394] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-23T17:38:03.402233] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-08. [2025-09-23T17:38:03.696502] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-23T17:38:03.916465] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-23T17:38:04.202240] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-04. [2025-09-23T17:38:05.002205] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-09. [2025-09-23T17:38:05.709516] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-23T17:38:05.802211] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-05. [2025-09-23T17:38:06.099062] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-23T17:38:06.112293] [INFO ] [REMOTE ] BKH: Full fetch complete (52033 records). [2025-09-23T17:38:06.113151] [DEBUG] [VALIDATOR ] BKH: Validating primary data. [2025-09-23T17:38:06.500950] [DEBUG] [VALIDATOR ] BKH: All expected trading days are present. [2025-09-23T17:38:06.501059] [DEBUG] [VALIDATOR ] BKH: Primary data validation passed. [2025-09-23T17:38:06.501698] [INFO ] [MAIN ] BKH: Fetched primary data is valid. [2025-09-23T17:38:06.501764] [DEBUG] [LOCAL ] BKH: Saving primary data. [2025-09-23T17:38:06.503130] [DEBUG] [LOCAL ] BKH: Trimmed 52033 records to 36620 (keeping 200 days of data) [2025-09-23T17:38:06.604677] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-01. [2025-09-23T17:38:06.735946] [DEBUG] [LOCAL ] BKH: Primary data saved (36620 records). [2025-09-23T17:38:06.736114] [INFO ] [MAIN ] BKH: Full history saved. [2025-09-23T17:38:06.736240] [INFO ] [MAIN ] Update Progress: 291/2372 symbols completed. BKH took 43.4s. Estimated remaining: 4h 32m 10s. Rate: 7.6 symbols/min [2025-09-23T17:38:06.910616] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:38:06.944000] [DEBUG] [LOCAL ] BKV: Loaded 29866 existing records from primary storage. [2025-09-23T17:38:06.944135] [INFO ] [MAIN ] BKV: Loaded 29866 existing records. [2025-09-23T17:38:07.121782] [WARN ] [MAIN ] BKV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:38:07.122049] [INFO ] [MAIN ] BKV: Wiping existing primary data before full refresh. [2025-09-23T17:38:07.122096] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-09-23T17:38:07.123096] [DEBUG] [LOCAL ] BKV: Deleted primary data file. [2025-09-23T17:38:07.123157] [INFO ] [MAIN ] BKV: Starting full primary refresh. [2025-09-23T17:38:07.406957] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-09. [2025-09-23T17:38:07.492266] [INFO ] [REMOTE ] BKV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:38:07.549572] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-23T17:38:07.771314] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-23T17:38:08.202233] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-06. [2025-09-23T17:38:08.578096] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-23T17:38:08.582391] [INFO ] [REMOTE ] BKT: Full fetch complete (14922 records). [2025-09-23T17:38:08.582489] [DEBUG] [VALIDATOR ] BKT: Validating primary data. [2025-09-23T17:38:08.961193] [DEBUG] [VALIDATOR ] BKT: All expected trading days are present. [2025-09-23T17:38:08.961537] [DEBUG] [VALIDATOR ] BKT: Primary data validation passed. [2025-09-23T17:38:08.961889] [INFO ] [MAIN ] BKT: Fetched primary data is valid. [2025-09-23T17:38:08.961963] [DEBUG] [LOCAL ] BKT: Saving primary data. [2025-09-23T17:38:08.962762] [DEBUG] [LOCAL ] BKT: Trimmed 14922 records to 10811 (keeping 200 days of data) [2025-09-23T17:38:09.013522] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-02. [2025-09-23T17:38:09.035101] [DEBUG] [LOCAL ] BKT: Primary data saved (10811 records). [2025-09-23T17:38:09.035305] [INFO ] [MAIN ] BKT: Full history saved. [2025-09-23T17:38:09.035395] [INFO ] [MAIN ] Update Progress: 292/2372 symbols completed. BKT took 20.6s. Estimated remaining: 4h 31m 23s. Rate: 7.7 symbols/min [2025-09-23T17:38:09.216232] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:38:09.260265] [DEBUG] [LOCAL ] BLCO: Loaded 35903 existing records from primary storage. [2025-09-23T17:38:09.260451] [INFO ] [MAIN ] BLCO: Loaded 35903 existing records. [2025-09-23T17:38:09.441239] [WARN ] [MAIN ] BLCO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:38:09.441550] [INFO ] [MAIN ] BLCO: Wiping existing primary data before full refresh. [2025-09-23T17:38:09.441597] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-09-23T17:38:09.442856] [DEBUG] [LOCAL ] BLCO: Deleted primary data file. [2025-09-23T17:38:09.442918] [INFO ] [MAIN ] BLCO: Starting full primary refresh. [2025-09-23T17:38:09.812160] [INFO ] [REMOTE ] BLCO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:38:09.807411] [INFO ] [REMOTE ] BKV: Fetching primary data for 2024-12. [2025-09-23T17:38:10.049316] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-23T17:38:10.169707] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-23T17:38:10.602201] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-07. [2025-09-23T17:38:10.933682] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-23T17:38:11.402241] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2024-12. [2025-09-23T17:38:12.202192] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-01. [2025-09-23T17:38:12.490485] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-23T17:38:12.839724] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-23T17:38:13.002204] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-01. [2025-09-23T17:38:13.282255] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-23T17:38:13.802252] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-08. [2025-09-23T17:38:14.359284] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-23T17:38:14.602275] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-03. [2025-09-23T17:38:15.402275] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-02. [2025-09-23T17:38:15.509101] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-23T17:38:15.806835] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-23T17:38:16.202210] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-09. [2025-09-23T17:38:16.629280] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-23T17:38:17.002241] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-02. [2025-09-23T17:38:17.802155] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-03. [2025-09-23T17:38:17.883248] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-23T17:38:17.891872] [INFO ] [REMOTE ] BKSY: Full fetch complete (69297 records). [2025-09-23T17:38:17.891999] [DEBUG] [VALIDATOR ] BKSY: Validating primary data. [2025-09-23T17:38:18.337363] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-23T17:38:18.343691] [DEBUG] [VALIDATOR ] BKSY: All expected trading days are present. [2025-09-23T17:38:18.344121] [DEBUG] [VALIDATOR ] BKSY: Primary data validation passed. [2025-09-23T17:38:18.345332] [INFO ] [MAIN ] BKSY: Fetched primary data is valid. [2025-09-23T17:38:18.345407] [DEBUG] [LOCAL ] BKSY: Saving primary data. [2025-09-23T17:38:18.346969] [DEBUG] [LOCAL ] BKSY: Trimmed 69297 records to 48276 (keeping 200 days of data) [2025-09-23T17:38:18.619726] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-03. [2025-09-23T17:38:18.652242] [DEBUG] [LOCAL ] BKSY: Primary data saved (48276 records). [2025-09-23T17:38:18.652395] [INFO ] [MAIN ] BKSY: Full history saved. [2025-09-23T17:38:18.652485] [INFO ] [MAIN ] Update Progress: 293/2372 symbols completed. BKSY took 34.6s. Estimated remaining: 4h 31m 27s. Rate: 7.7 symbols/min [2025-09-23T17:38:18.825002] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:38:18.853176] [DEBUG] [LOCAL ] BLD: Loaded 28136 existing records from primary storage. [2025-09-23T17:38:18.853443] [INFO ] [MAIN ] BLD: Loaded 28136 existing records. [2025-09-23T17:38:19.036838] [WARN ] [MAIN ] BLD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:38:19.037270] [INFO ] [MAIN ] BLD: Wiping existing primary data before full refresh. [2025-09-23T17:38:19.037440] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-09-23T17:38:19.045049] [DEBUG] [LOCAL ] BLD: Deleted primary data file. [2025-09-23T17:38:19.057824] [INFO ] [MAIN ] BLD: Starting full primary refresh. [2025-09-23T17:38:19.102260] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-23T17:38:19.413852] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-04. [2025-09-23T17:38:19.419336] [INFO ] [REMOTE ] BLD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:38:19.721114] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-23T17:38:20.202230] [INFO ] [REMOTE ] BLD: Fetching primary data for 2024-12. [2025-09-23T17:38:20.600459] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-23T17:38:21.002195] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-04. [2025-09-23T17:38:21.231074] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-23T17:38:21.802228] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-05. [2025-09-23T17:38:22.084714] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-23T17:38:22.602202] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-04. [2025-09-23T17:38:22.926881] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-23T17:38:23.402254] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-05. [2025-09-23T17:38:23.585845] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-23T17:38:24.202228] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-06. [2025-09-23T17:38:25.002314] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-05. [2025-09-23T17:38:25.046905] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-23T17:38:25.616104] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-23T17:38:25.802222] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-07. [2025-09-23T17:38:25.958050] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-23T17:38:26.602258] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-06. [2025-09-23T17:38:26.941471] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-23T17:38:27.402202] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-08. [2025-09-23T17:38:27.534205] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-23T17:38:28.202214] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-01. [2025-09-23T17:38:28.465821] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-23T17:38:29.002210] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-07. [2025-09-23T17:38:29.336077] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-23T17:38:29.802190] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-09. [2025-09-23T17:38:30.590091] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-23T17:38:30.602147] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-06. [2025-09-23T17:38:30.884023] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-23T17:38:30.890730] [INFO ] [REMOTE ] BKU: Full fetch complete (59678 records). [2025-09-23T17:38:30.890923] [DEBUG] [VALIDATOR ] BKU: Validating primary data. [2025-09-23T17:38:31.282079] [DEBUG] [VALIDATOR ] BKU: All expected trading days are present. [2025-09-23T17:38:31.282192] [DEBUG] [VALIDATOR ] BKU: Primary data validation passed. [2025-09-23T17:38:31.282895] [INFO ] [MAIN ] BKU: Fetched primary data is valid. [2025-09-23T17:38:31.282960] [DEBUG] [LOCAL ] BKU: Saving primary data. [2025-09-23T17:38:31.284437] [DEBUG] [LOCAL ] BKU: Trimmed 59678 records to 41950 (keeping 200 days of data) [2025-09-23T17:38:31.405900] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-02. [2025-09-23T17:38:31.541731] [DEBUG] [LOCAL ] BKU: Primary data saved (41950 records). [2025-09-23T17:38:31.542049] [INFO ] [MAIN ] BKU: Full history saved. [2025-09-23T17:38:31.542190] [INFO ] [MAIN ] Update Progress: 294/2372 symbols completed. BKU took 30.5s. Estimated remaining: 4h 31m 55s. Rate: 7.6 symbols/min [2025-09-23T17:38:31.641925] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-23T17:38:31.742249] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:38:31.796308] [DEBUG] [LOCAL ] BLDR: Loaded 51653 existing records from primary storage. [2025-09-23T17:38:31.796463] [INFO ] [MAIN ] BLDR: Loaded 51653 existing records. [2025-09-23T17:38:31.973874] [WARN ] [MAIN ] BLDR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:38:31.974146] [INFO ] [MAIN ] BLDR: Wiping existing primary data before full refresh. [2025-09-23T17:38:31.974194] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-09-23T17:38:31.975603] [DEBUG] [LOCAL ] BLDR: Deleted primary data file. [2025-09-23T17:38:31.975697] [INFO ] [MAIN ] BLDR: Starting full primary refresh. [2025-09-23T17:38:32.209856] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-08. [2025-09-23T17:38:32.342039] [INFO ] [REMOTE ] BLDR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:38:33.003198] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-23T17:38:33.002630] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2024-12. [2025-09-23T17:38:33.189026] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-23T17:38:33.802249] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-09. [2025-09-23T17:38:34.473239] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-23T17:38:34.602195] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-01. [2025-09-23T17:38:34.850980] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-23T17:38:34.856049] [INFO ] [REMOTE ] BLCO: Full fetch complete (52599 records). [2025-09-23T17:38:34.856149] [DEBUG] [VALIDATOR ] BLCO: Validating primary data. [2025-09-23T17:38:35.232404] [DEBUG] [VALIDATOR ] BLCO: All expected trading days are present. [2025-09-23T17:38:35.232500] [DEBUG] [VALIDATOR ] BLCO: Primary data validation passed. [2025-09-23T17:38:35.233105] [INFO ] [MAIN ] BLCO: Fetched primary data is valid. [2025-09-23T17:38:35.233170] [DEBUG] [LOCAL ] BLCO: Saving primary data. [2025-09-23T17:38:35.234352] [DEBUG] [LOCAL ] BLCO: Trimmed 52599 records to 35761 (keeping 200 days of data) [2025-09-23T17:38:35.403453] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-07. [2025-09-23T17:38:35.451232] [DEBUG] [LOCAL ] BLCO: Primary data saved (35761 records). [2025-09-23T17:38:35.451340] [INFO ] [MAIN ] BLCO: Full history saved. [2025-09-23T17:38:35.451445] [INFO ] [MAIN ] Update Progress: 295/2372 symbols completed. BLCO took 26.4s. Estimated remaining: 4h 31m 20s. Rate: 7.7 symbols/min [2025-09-23T17:38:35.623620] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:38:35.623792] [DEBUG] [LOCAL ] BLE: No existing data file found in primary storage. [2025-09-23T17:38:35.623834] [WARN ] [MAIN ] BLE: No existing data found, performing full refresh instead. [2025-09-23T17:38:35.623975] [INFO ] [MAIN ] BLE: Wiping existing primary data before full refresh. [2025-09-23T17:38:35.624018] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-09-23T17:38:35.624059] [DEBUG] [LOCAL ] BLE: No primary data file found to delete. [2025-09-23T17:38:35.624091] [INFO ] [MAIN ] BLE: Starting full primary refresh. [2025-09-23T17:38:35.978912] [INFO ] [REMOTE ] BLE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:38:36.202161] [INFO ] [REMOTE ] BLE: Fetching primary data for 2024-12. [2025-09-23T17:38:36.314748] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-23T17:38:36.479111] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-23T17:38:36.971247] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-23T17:38:37.002207] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-02. [2025-09-23T17:38:37.802238] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-01. [2025-09-23T17:38:38.333506] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-23T17:38:38.593698] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-23T17:38:38.602146] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-02. [2025-09-23T17:38:39.132761] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-23T17:38:39.402210] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-03. [2025-09-23T17:38:40.202199] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-08. [2025-09-23T17:38:40.329781] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-23T17:38:40.925694] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-23T17:38:41.002266] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-09. [2025-09-23T17:38:41.804047] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-03. [2025-09-23T17:38:41.808491] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-23T17:38:41.815215] [INFO ] [REMOTE ] BKV: Full fetch complete (44890 records). [2025-09-23T17:38:41.815344] [DEBUG] [VALIDATOR ] BKV: Validating primary data. [2025-09-23T17:38:42.212763] [DEBUG] [VALIDATOR ] BKV: All expected trading days are present. [2025-09-23T17:38:42.212869] [DEBUG] [VALIDATOR ] BKV: Primary data validation passed. [2025-09-23T17:38:42.213670] [INFO ] [MAIN ] BKV: Fetched primary data is valid. [2025-09-23T17:38:42.213734] [DEBUG] [LOCAL ] BKV: Saving primary data. [2025-09-23T17:38:42.215333] [DEBUG] [LOCAL ] BKV: Trimmed 44890 records to 29765 (keeping 200 days of data) [2025-09-23T17:38:42.393171] [DEBUG] [LOCAL ] BKV: Primary data saved (29765 records). [2025-09-23T17:38:42.393333] [INFO ] [MAIN ] BKV: Full history saved. [2025-09-23T17:38:42.393430] [INFO ] [MAIN ] Update Progress: 296/2372 symbols completed. BKV took 35.7s. Estimated remaining: 4h 31m 6s. Rate: 7.7 symbols/min [2025-09-23T17:38:42.585034] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:38:42.586989] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-23T17:38:42.602154] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-04. [2025-09-23T17:38:42.641806] [DEBUG] [LOCAL ] BLK: Loaded 35027 existing records from primary storage. [2025-09-23T17:38:42.641954] [INFO ] [MAIN ] BLK: Loaded 35027 existing records. [2025-09-23T17:38:42.827236] [WARN ] [MAIN ] BLK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:38:42.827480] [INFO ] [MAIN ] BLK: Wiping existing primary data before full refresh. [2025-09-23T17:38:42.827529] [INFO ] [LOCAL ] BLK: Starting deletion of primary data. [2025-09-23T17:38:42.828541] [DEBUG] [LOCAL ] BLK: Deleted primary data file. [2025-09-23T17:38:42.828606] [INFO ] [MAIN ] BLK: Starting full primary refresh. [2025-09-23T17:38:43.212862] [INFO ] [REMOTE ] BLK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:38:43.334928] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-23T17:38:43.402192] [INFO ] [REMOTE ] BLK: Fetching primary data for 2024-12. [2025-09-23T17:38:44.202192] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-03. [2025-09-23T17:38:44.976207] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-23T17:38:45.002146] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-01. [2025-09-23T17:38:45.802219] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-04. [2025-09-23T17:38:46.160459] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-23T17:38:46.555218] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-23T17:38:46.602163] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-02. [2025-09-23T17:38:46.810795] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-23T17:38:47.402204] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-05. [2025-09-23T17:38:48.202231] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-05. [2025-09-23T17:38:48.322356] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-23T17:38:48.436559] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-23T17:38:48.878721] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-23T17:38:49.002158] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-06. [2025-09-23T17:38:49.802253] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-04. [2025-09-23T17:38:50.025482] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-23T17:38:50.602216] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-03. [2025-09-23T17:38:51.402203] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-07. [2025-09-23T17:38:51.823424] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-23T17:38:51.985345] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-23T17:38:52.111160] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-23T17:38:52.202168] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-04. [2025-09-23T17:38:53.002204] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-06. [2025-09-23T17:38:53.645424] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-23T17:38:53.802203] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-05. [2025-09-23T17:38:53.886729] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-23T17:38:54.602235] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-07. [2025-09-23T17:38:55.064961] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-23T17:38:55.402201] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-06. [2025-09-23T17:38:55.525463] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-23T17:38:56.202189] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-08. [2025-09-23T17:38:56.698486] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-23T17:38:56.724970] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-23T17:38:57.002205] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-08. [2025-09-23T17:38:57.802203] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-09. [2025-09-23T17:38:58.129824] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-23T17:38:58.427213] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-23T17:38:58.429950] [INFO ] [REMOTE ] BLE: Full fetch complete (20600 records). [2025-09-23T17:38:58.430060] [DEBUG] [VALIDATOR ] BLE: Validating primary data. [2025-09-23T17:38:58.605032] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-07. [2025-09-23T17:38:58.837310] [DEBUG] [VALIDATOR ] BLE: All expected trading days are present. [2025-09-23T17:38:58.837395] [DEBUG] [VALIDATOR ] BLE: Primary data validation passed. [2025-09-23T17:38:58.837884] [INFO ] [MAIN ] BLE: Fetched primary data is valid. [2025-09-23T17:38:58.837951] [DEBUG] [LOCAL ] BLE: Saving primary data. [2025-09-23T17:38:58.838583] [DEBUG] [LOCAL ] BLE: Trimmed 20600 records to 14633 (keeping 200 days of data) [2025-09-23T17:38:58.928125] [DEBUG] [LOCAL ] BLE: Primary data saved (14633 records). [2025-09-23T17:38:58.928267] [INFO ] [MAIN ] BLE: Full history saved. [2025-09-23T17:38:58.928347] [INFO ] [MAIN ] Update Progress: 297/2372 symbols completed. BLE took 23.5s. Estimated remaining: 4h 31m 58s. Rate: 7.6 symbols/min [2025-09-23T17:38:59.107376] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:38:59.153412] [DEBUG] [LOCAL ] BLND: Loaded 49488 existing records from primary storage. [2025-09-23T17:38:59.153564] [INFO ] [MAIN ] BLND: Loaded 49488 existing records. [2025-09-23T17:38:59.350798] [WARN ] [MAIN ] BLND: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:38:59.351057] [INFO ] [MAIN ] BLND: Wiping existing primary data before full refresh. [2025-09-23T17:38:59.351106] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-09-23T17:38:59.352387] [DEBUG] [LOCAL ] BLND: Deleted primary data file. [2025-09-23T17:38:59.352451] [INFO ] [MAIN ] BLND: Starting full primary refresh. [2025-09-23T17:38:59.414361] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-09. [2025-09-23T17:38:59.712144] [INFO ] [REMOTE ] BLND: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:39:00.212845] [INFO ] [REMOTE ] BLND: Fetching primary data for 2024-12. [2025-09-23T17:39:00.215791] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-23T17:39:00.872049] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-23T17:39:00.877175] [INFO ] [REMOTE ] BLD: Full fetch complete (40555 records). [2025-09-23T17:39:00.877277] [DEBUG] [VALIDATOR ] BLD: Validating primary data. [2025-09-23T17:39:01.017733] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-05. [2025-09-23T17:39:01.259098] [DEBUG] [VALIDATOR ] BLD: All expected trading days are present. [2025-09-23T17:39:01.259196] [DEBUG] [VALIDATOR ] BLD: Primary data validation passed. [2025-09-23T17:39:01.259816] [INFO ] [MAIN ] BLD: Fetched primary data is valid. [2025-09-23T17:39:01.259883] [DEBUG] [LOCAL ] BLD: Saving primary data. [2025-09-23T17:39:01.261207] [DEBUG] [LOCAL ] BLD: Trimmed 40555 records to 28198 (keeping 200 days of data) [2025-09-23T17:39:01.436192] [DEBUG] [LOCAL ] BLD: Primary data saved (28198 records). [2025-09-23T17:39:01.436346] [INFO ] [MAIN ] BLD: Full history saved. [2025-09-23T17:39:01.436437] [INFO ] [MAIN ] Update Progress: 298/2372 symbols completed. BLD took 42.8s. Estimated remaining: 4h 31m 13s. Rate: 7.6 symbols/min [2025-09-23T17:39:01.608404] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:39:01.608612] [DEBUG] [LOCAL ] BLSH: No existing data file found in primary storage. [2025-09-23T17:39:01.608679] [WARN ] [MAIN ] BLSH: No existing data found, performing full refresh instead. [2025-09-23T17:39:01.608838] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-09-23T17:39:01.608881] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-09-23T17:39:01.608922] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-09-23T17:39:01.608955] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-09-23T17:39:01.814676] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-08. [2025-09-23T17:39:02.019969] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:39:02.158740] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-23T17:39:02.602218] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2024-12. [2025-09-23T17:39:03.325308] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-09-23T17:39:03.402188] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-06. [2025-09-23T17:39:03.753188] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:39:03.753514] [WARN ] [REMOTE ] BLSH: No data returned for month 2024-12 [2025-09-23T17:39:04.202243] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-01. [2025-09-23T17:39:04.472352] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-08 (2.66 seconds). [2025-09-23T17:39:04.511355] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:39:04.511714] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-01 [2025-09-23T17:39:05.002206] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-02. [2025-09-23T17:39:05.210381] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:39:05.210732] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-02 [2025-09-23T17:39:05.420128] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-23T17:39:05.802236] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-09. [2025-09-23T17:39:06.602206] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-07. [2025-09-23T17:39:07.033250] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-23T17:39:07.040720] [INFO ] [REMOTE ] BLK: Full fetch complete (52998 records). [2025-09-23T17:39:07.040893] [DEBUG] [VALIDATOR ] BLK: Validating primary data. [2025-09-23T17:39:07.410403] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-01. [2025-09-23T17:39:07.645746] [DEBUG] [VALIDATOR ] BLK: All expected trading days are present. [2025-09-23T17:39:07.645891] [DEBUG] [VALIDATOR ] BLK: Primary data validation passed. [2025-09-23T17:39:07.647074] [INFO ] [MAIN ] BLK: Fetched primary data is valid. [2025-09-23T17:39:07.647168] [DEBUG] [LOCAL ] BLK: Saving primary data. [2025-09-23T17:39:07.649233] [DEBUG] [LOCAL ] BLK: Trimmed 52998 records to 34927 (keeping 200 days of data) [2025-09-23T17:39:08.011398] [DEBUG] [LOCAL ] BLK: Primary data saved (34927 records). [2025-09-23T17:39:08.011628] [INFO ] [MAIN ] BLK: Full history saved. [2025-09-23T17:39:08.011799] [INFO ] [MAIN ] Update Progress: 299/2372 symbols completed. BLK took 25.6s. Estimated remaining: 4h 30m 57s. Rate: 7.7 symbols/min [2025-09-23T17:39:08.203796] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-03. [2025-09-23T17:39:08.240376] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:39:08.257854] [DEBUG] [LOCAL ] BLW: Loaded 12732 existing records from primary storage. [2025-09-23T17:39:08.258002] [INFO ] [MAIN ] BLW: Loaded 12732 existing records. [2025-09-23T17:39:08.464120] [WARN ] [MAIN ] BLW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:39:08.464629] [INFO ] [MAIN ] BLW: Wiping existing primary data before full refresh. [2025-09-23T17:39:08.464797] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-09-23T17:39:08.476821] [DEBUG] [LOCAL ] BLW: Deleted primary data file. [2025-09-23T17:39:08.493039] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:39:08.496359] [INFO ] [MAIN ] BLW: Starting full primary refresh. [2025-09-23T17:39:08.518442] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-03 [2025-09-23T17:39:08.585542] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-23T17:39:08.886857] [INFO ] [REMOTE ] BLW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:39:08.955300] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-23T17:39:09.002173] [INFO ] [REMOTE ] BLW: Fetching primary data for 2024-12. [2025-09-23T17:39:09.677480] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-23T17:39:09.802236] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-08. [2025-09-23T17:39:10.602216] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-04. [2025-09-23T17:39:10.813781] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:39:10.814058] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-04 [2025-09-23T17:39:11.305375] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-23T17:39:11.402150] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-09. [2025-09-23T17:39:12.202284] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-05. [2025-09-23T17:39:12.407050] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:39:12.407478] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-05 [2025-09-23T17:39:13.002215] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-02. [2025-09-23T17:39:13.269526] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-23T17:39:13.278749] [INFO ] [REMOTE ] BLDR: Full fetch complete (74302 records). [2025-09-23T17:39:13.278959] [DEBUG] [VALIDATOR ] BLDR: Validating primary data. [2025-09-23T17:39:13.690606] [DEBUG] [VALIDATOR ] BLDR: All expected trading days are present. [2025-09-23T17:39:13.690735] [DEBUG] [VALIDATOR ] BLDR: Primary data validation passed. [2025-09-23T17:39:13.691599] [INFO ] [MAIN ] BLDR: Fetched primary data is valid. [2025-09-23T17:39:13.691693] [DEBUG] [LOCAL ] BLDR: Saving primary data. [2025-09-23T17:39:13.693247] [DEBUG] [LOCAL ] BLDR: Trimmed 74302 records to 51666 (keeping 200 days of data) [2025-09-23T17:39:13.803751] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-06. [2025-09-23T17:39:14.014035] [DEBUG] [LOCAL ] BLDR: Primary data saved (51666 records). [2025-09-23T17:39:14.014258] [INFO ] [MAIN ] BLDR: Full history saved. [2025-09-23T17:39:14.014365] [INFO ] [MAIN ] Update Progress: 300/2372 symbols completed. BLDR took 42.5s. Estimated remaining: 4h 30m 36s. Rate: 7.7 symbols/min [2025-09-23T17:39:14.182475] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:39:14.199702] [DEBUG] [LOCAL ] BLX: Loaded 15777 existing records from primary storage. [2025-09-23T17:39:14.199864] [INFO ] [MAIN ] BLX: Loaded 15777 existing records. [2025-09-23T17:39:14.399284] [WARN ] [MAIN ] BLX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:39:14.399520] [INFO ] [MAIN ] BLX: Wiping existing primary data before full refresh. [2025-09-23T17:39:14.399570] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-09-23T17:39:14.400128] [DEBUG] [LOCAL ] BLX: Deleted primary data file. [2025-09-23T17:39:14.400192] [INFO ] [MAIN ] BLX: Starting full primary refresh. [2025-09-23T17:39:14.467360] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:39:14.497601] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-06 [2025-09-23T17:39:14.607446] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-01. [2025-09-23T17:39:14.773726] [INFO ] [REMOTE ] BLX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:39:15.045854] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-23T17:39:15.402207] [INFO ] [REMOTE ] BLX: Fetching primary data for 2024-12. [2025-09-23T17:39:15.661841] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-23T17:39:16.202251] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-02. [2025-09-23T17:39:16.261437] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-23T17:39:16.766355] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-23T17:39:17.002224] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-01. [2025-09-23T17:39:17.810751] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-03. [2025-09-23T17:39:17.811781] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-23T17:39:18.602255] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-03. [2025-09-23T17:39:19.151888] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-23T17:39:19.191942] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-23T17:39:19.402174] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-04. [2025-09-23T17:39:20.202253] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-04. [2025-09-23T17:39:20.626328] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-23T17:39:21.002255] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-02. [2025-09-23T17:39:21.045602] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-23T17:39:21.619050] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-23T17:39:21.802197] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-05. [2025-09-23T17:39:22.602230] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-05. [2025-09-23T17:39:23.167755] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-23T17:39:23.210506] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-23T17:39:23.402191] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-03. [2025-09-23T17:39:24.047569] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-23T17:39:24.202207] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-04. [2025-09-23T17:39:24.899750] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-23T17:39:25.002255] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-07. [2025-09-23T17:39:25.213210] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:39:25.213631] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-07 [2025-09-23T17:39:25.802222] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-08. [2025-09-23T17:39:26.602206] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-06. [2025-09-23T17:39:27.346978] [INFO ] [REMOTE ] BLSH: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-23T17:39:27.406022] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-05. [2025-09-23T17:39:27.408716] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-23T17:39:28.138617] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-23T17:39:28.202157] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-06. [2025-09-23T17:39:28.783673] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-23T17:39:29.002241] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-09. [2025-09-23T17:39:29.802253] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-07. [2025-09-23T17:39:30.426750] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-23T17:39:30.602280] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-06. [2025-09-23T17:39:31.402252] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-08. [2025-09-23T17:39:31.462665] [INFO ] [REMOTE ] BLSH: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-09-23T17:39:31.471445] [INFO ] [REMOTE ] BLSH: Full fetch complete (11051 records). [2025-09-23T17:39:31.471548] [DEBUG] [VALIDATOR ] BLSH: Validating primary data. [2025-09-23T17:39:31.678270] [WARN ] [VALIDATOR ] BLSH: Validation failed - insufficient historical data. Have 29 unique days, need 200 days [2025-09-23T17:39:31.678572] [FATAL] [MAIN ] BLSH: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:39:31.678688] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:39:31.678761] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-09-23T17:39:31.678844] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-09-23T17:39:31.678900] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-09-23T17:39:31.678957] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-09-23T17:39:31.679044] [INFO ] [MAIN ] Update Progress: 301/2372 symbols completed. BLSH took 30.2s. Estimated remaining: 4h 31m 36s. Rate: 7.6 symbols/min [2025-09-23T17:39:31.860374] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:39:31.911784] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-23T17:39:31.934996] [DEBUG] [LOCAL ] BMA: Loaded 34783 existing records from primary storage. [2025-09-23T17:39:31.935221] [INFO ] [MAIN ] BMA: Loaded 34783 existing records. [2025-09-23T17:39:32.126520] [WARN ] [MAIN ] BMA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:39:32.127163] [INFO ] [MAIN ] BMA: Wiping existing primary data before full refresh. [2025-09-23T17:39:32.127276] [INFO ] [LOCAL ] BMA: Starting deletion of primary data. [2025-09-23T17:39:32.133483] [DEBUG] [LOCAL ] BMA: Deleted primary data file. [2025-09-23T17:39:32.139328] [INFO ] [MAIN ] BMA: Starting full primary refresh. [2025-09-23T17:39:32.146566] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-23T17:39:32.202335] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-07. [2025-09-23T17:39:32.574907] [INFO ] [REMOTE ] BMA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:39:33.002253] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-09. [2025-09-23T17:39:33.412013] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-23T17:39:33.721244] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-23T17:39:33.724370] [INFO ] [REMOTE ] BLX: Full fetch complete (22762 records). [2025-09-23T17:39:33.724445] [DEBUG] [VALIDATOR ] BLX: Validating primary data. [2025-09-23T17:39:33.807421] [INFO ] [REMOTE ] BMA: Fetching primary data for 2024-12. [2025-09-23T17:39:34.108398] [DEBUG] [VALIDATOR ] BLX: All expected trading days are present. [2025-09-23T17:39:34.108517] [DEBUG] [VALIDATOR ] BLX: Primary data validation passed. [2025-09-23T17:39:34.108988] [INFO ] [MAIN ] BLX: Fetched primary data is valid. [2025-09-23T17:39:34.109051] [DEBUG] [LOCAL ] BLX: Saving primary data. [2025-09-23T17:39:34.109706] [DEBUG] [LOCAL ] BLX: Trimmed 22762 records to 15743 (keeping 200 days of data) [2025-09-23T17:39:34.204126] [DEBUG] [LOCAL ] BLX: Primary data saved (15743 records). [2025-09-23T17:39:34.204267] [INFO ] [MAIN ] BLX: Full history saved. [2025-09-23T17:39:34.204354] [INFO ] [MAIN ] Update Progress: 302/2372 symbols completed. BLX took 20.2s. Estimated remaining: 4h 30m 51s. Rate: 7.6 symbols/min [2025-09-23T17:39:34.373780] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:39:34.385531] [DEBUG] [LOCAL ] BME: Loaded 10829 existing records from primary storage. [2025-09-23T17:39:34.385659] [INFO ] [MAIN ] BME: Loaded 10829 existing records. [2025-09-23T17:39:34.563147] [WARN ] [MAIN ] BME: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:39:34.563372] [INFO ] [MAIN ] BME: Wiping existing primary data before full refresh. [2025-09-23T17:39:34.563422] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-09-23T17:39:34.563995] [DEBUG] [LOCAL ] BME: Deleted primary data file. [2025-09-23T17:39:34.564056] [INFO ] [MAIN ] BME: Starting full primary refresh. [2025-09-23T17:39:34.607326] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-07. [2025-09-23T17:39:34.926078] [INFO ] [REMOTE ] BME: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:39:35.094930] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-23T17:39:35.388323] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-23T17:39:35.402146] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-08. [2025-09-23T17:39:36.202602] [INFO ] [REMOTE ] BME: Fetching primary data for 2024-12. [2025-09-23T17:39:36.203211] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-23T17:39:36.989842] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-23T17:39:37.002148] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-01. [2025-09-23T17:39:37.600474] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-23T17:39:37.802198] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-08. [2025-09-23T17:39:38.602203] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-01. [2025-09-23T17:39:39.087041] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-23T17:39:39.402213] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-09. [2025-09-23T17:39:40.139182] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-23T17:39:40.202173] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-09. [2025-09-23T17:39:40.765499] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-23T17:39:40.774025] [INFO ] [REMOTE ] BLND: Full fetch complete (72321 records). [2025-09-23T17:39:40.774211] [DEBUG] [VALIDATOR ] BLND: Validating primary data. [2025-09-23T17:39:41.012421] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-02. [2025-09-23T17:39:41.171499] [DEBUG] [VALIDATOR ] BLND: All expected trading days are present. [2025-09-23T17:39:41.171622] [DEBUG] [VALIDATOR ] BLND: Primary data validation passed. [2025-09-23T17:39:41.180168] [INFO ] [MAIN ] BLND: Fetched primary data is valid. [2025-09-23T17:39:41.180322] [DEBUG] [LOCAL ] BLND: Saving primary data. [2025-09-23T17:39:41.181568] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-23T17:39:41.185227] [INFO ] [REMOTE ] BLW: Full fetch complete (18836 records). [2025-09-23T17:39:41.185539] [DEBUG] [VALIDATOR ] BLW: Validating primary data. [2025-09-23T17:39:41.185801] [DEBUG] [LOCAL ] BLND: Trimmed 72321 records to 49485 (keeping 200 days of data) [2025-09-23T17:39:41.682947] [DEBUG] [VALIDATOR ] BLW: All expected trading days are present. [2025-09-23T17:39:41.683380] [DEBUG] [VALIDATOR ] BLW: Primary data validation passed. [2025-09-23T17:39:41.685270] [INFO ] [MAIN ] BLW: Fetched primary data is valid. [2025-09-23T17:39:41.685350] [DEBUG] [LOCAL ] BLW: Saving primary data. [2025-09-23T17:39:41.690190] [DEBUG] [LOCAL ] BLW: Trimmed 18836 records to 12741 (keeping 200 days of data) [2025-09-23T17:39:41.817947] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-02. [2025-09-23T17:39:41.874203] [DEBUG] [LOCAL ] BLW: Primary data saved (12741 records). [2025-09-23T17:39:41.875448] [INFO ] [MAIN ] BLW: Full history saved. [2025-09-23T17:39:41.875584] [INFO ] [MAIN ] Update Progress: 303/2372 symbols completed. BLW took 33.9s. Estimated remaining: 4h 30m 42s. Rate: 7.6 symbols/min [2025-09-23T17:39:42.064777] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:39:42.100007] [DEBUG] [LOCAL ] BMEZ: Loaded 26103 existing records from primary storage. [2025-09-23T17:39:42.102737] [INFO ] [MAIN ] BMEZ: Loaded 26103 existing records. [2025-09-23T17:39:42.331270] [WARN ] [MAIN ] BMEZ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:39:42.332475] [INFO ] [MAIN ] BMEZ: Wiping existing primary data before full refresh. [2025-09-23T17:39:42.334205] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-09-23T17:39:42.336206] [DEBUG] [LOCAL ] BMEZ: Deleted primary data file. [2025-09-23T17:39:42.336518] [INFO ] [MAIN ] BMEZ: Starting full primary refresh. [2025-09-23T17:39:42.474204] [DEBUG] [LOCAL ] BLND: Primary data saved (49485 records). [2025-09-23T17:39:42.479850] [INFO ] [MAIN ] BLND: Full history saved. [2025-09-23T17:39:42.498820] [INFO ] [MAIN ] Update Progress: 304/2372 symbols completed. BLND took 43.6s. Estimated remaining: 4h 29m 45s. Rate: 7.7 symbols/min [2025-09-23T17:39:42.659214] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-23T17:39:42.723370] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-23T17:39:42.770470] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-03. [2025-09-23T17:39:42.932537] [INFO ] [REMOTE ] BMEZ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:39:42.950713] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:39:42.976032] [DEBUG] [LOCAL ] BMI: Loaded 24070 existing records from primary storage. [2025-09-23T17:39:42.976197] [INFO ] [MAIN ] BMI: Loaded 24070 existing records. [2025-09-23T17:39:43.151498] [WARN ] [MAIN ] BMI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:39:43.151755] [INFO ] [MAIN ] BMI: Wiping existing primary data before full refresh. [2025-09-23T17:39:43.151838] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-09-23T17:39:43.152736] [DEBUG] [LOCAL ] BMI: Deleted primary data file. [2025-09-23T17:39:43.152800] [INFO ] [MAIN ] BMI: Starting full primary refresh. [2025-09-23T17:39:43.404012] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-03. [2025-09-23T17:39:43.510150] [INFO ] [REMOTE ] BMI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:39:43.625529] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-23T17:39:44.202195] [INFO ] [REMOTE ] BMI: Fetching primary data for 2024-12. [2025-09-23T17:39:44.404861] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-23T17:39:45.002197] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-04. [2025-09-23T17:39:45.186722] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-23T17:39:45.802203] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-04. [2025-09-23T17:39:46.271818] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-23T17:39:46.599962] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-23T17:39:46.602498] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2024-12. [2025-09-23T17:39:47.402196] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-05. [2025-09-23T17:39:47.732473] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-23T17:39:48.202198] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-01. [2025-09-23T17:39:48.736568] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-23T17:39:49.002224] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-05. [2025-09-23T17:39:49.504550] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-23T17:39:49.673767] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-23T17:39:49.802225] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-06. [2025-09-23T17:39:50.262454] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-23T17:39:50.602186] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-07. [2025-09-23T17:39:51.183213] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-23T17:39:51.402196] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-01. [2025-09-23T17:39:52.202165] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-06. [2025-09-23T17:39:52.440673] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-23T17:39:53.002194] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-02. [2025-09-23T17:39:53.189286] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-23T17:39:53.802178] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-02. [2025-09-23T17:39:54.136386] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-23T17:39:54.540797] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-23T17:39:54.602190] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-08. [2025-09-23T17:39:55.195847] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-23T17:39:55.402249] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-03. [2025-09-23T17:39:56.202281] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-07. [2025-09-23T17:39:56.257065] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-23T17:39:57.002249] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-04. [2025-09-23T17:39:57.671083] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-23T17:39:57.802217] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-08. [2025-09-23T17:39:57.942544] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-23T17:39:58.602218] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-03. [2025-09-23T17:39:58.788544] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-23T17:39:59.402214] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-05. [2025-09-23T17:39:59.529525] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-23T17:40:00.202259] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-09. [2025-09-23T17:40:00.559110] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-23T17:40:01.002249] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-06. [2025-09-23T17:40:01.802245] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-04. [2025-09-23T17:40:01.908103] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-23T17:40:02.063553] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-23T17:40:02.071784] [INFO ] [REMOTE ] BMA: Full fetch complete (51060 records). [2025-09-23T17:40:02.071928] [DEBUG] [VALIDATOR ] BMA: Validating primary data. [2025-09-23T17:40:02.483927] [DEBUG] [VALIDATOR ] BMA: All expected trading days are present. [2025-09-23T17:40:02.484024] [DEBUG] [VALIDATOR ] BMA: Primary data validation passed. [2025-09-23T17:40:02.484612] [INFO ] [MAIN ] BMA: Fetched primary data is valid. [2025-09-23T17:40:02.484683] [DEBUG] [LOCAL ] BMA: Saving primary data. [2025-09-23T17:40:02.485952] [DEBUG] [LOCAL ] BMA: Trimmed 51060 records to 34895 (keeping 200 days of data) [2025-09-23T17:40:02.604271] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-07. [2025-09-23T17:40:02.712032] [DEBUG] [LOCAL ] BMA: Primary data saved (34895 records). [2025-09-23T17:40:02.712201] [INFO ] [MAIN ] BMA: Full history saved. [2025-09-23T17:40:02.712319] [INFO ] [MAIN ] Update Progress: 305/2372 symbols completed. BMA took 31.0s. Estimated remaining: 4h 31m 1s. Rate: 7.6 symbols/min [2025-09-23T17:40:02.915776] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:40:02.921576] [DEBUG] [LOCAL ] BMN: Loaded 2561 existing records from primary storage. [2025-09-23T17:40:02.921762] [INFO ] [MAIN ] BMN: Loaded 2561 existing records. [2025-09-23T17:40:03.122753] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-23T17:40:03.167282] [WARN ] [MAIN ] BMN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:40:03.168373] [INFO ] [MAIN ] BMN: Wiping existing primary data before full refresh. [2025-09-23T17:40:03.168459] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-09-23T17:40:03.168754] [DEBUG] [LOCAL ] BMN: Deleted primary data file. [2025-09-23T17:40:03.168826] [INFO ] [MAIN ] BMN: Starting full primary refresh. [2025-09-23T17:40:03.408324] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-09. [2025-09-23T17:40:03.585855] [INFO ] [REMOTE ] BMN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:40:03.603567] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-23T17:40:04.202243] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-05. [2025-09-23T17:40:04.333313] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-23T17:40:04.336790] [INFO ] [REMOTE ] BME: Full fetch complete (16083 records). [2025-09-23T17:40:04.336885] [DEBUG] [VALIDATOR ] BME: Validating primary data. [2025-09-23T17:40:04.699193] [DEBUG] [VALIDATOR ] BME: All expected trading days are present. [2025-09-23T17:40:04.699273] [DEBUG] [VALIDATOR ] BME: Primary data validation passed. [2025-09-23T17:40:04.699576] [INFO ] [MAIN ] BME: Fetched primary data is valid. [2025-09-23T17:40:04.699628] [DEBUG] [LOCAL ] BME: Saving primary data. [2025-09-23T17:40:04.700393] [DEBUG] [LOCAL ] BME: Trimmed 16083 records to 10811 (keeping 200 days of data) [2025-09-23T17:40:04.770764] [DEBUG] [LOCAL ] BME: Primary data saved (10811 records). [2025-09-23T17:40:04.770912] [INFO ] [MAIN ] BME: Full history saved. [2025-09-23T17:40:04.771016] [INFO ] [MAIN ] Update Progress: 306/2372 symbols completed. BME took 30.6s. Estimated remaining: 4h 30m 14s. Rate: 7.6 symbols/min [2025-09-23T17:40:04.951113] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:40:05.005894] [INFO ] [REMOTE ] BMN: Fetching primary data for 2024-12. [2025-09-23T17:40:05.072097] [DEBUG] [LOCAL ] BMO: Loaded 41319 existing records from primary storage. [2025-09-23T17:40:05.072552] [INFO ] [MAIN ] BMO: Loaded 41319 existing records. [2025-09-23T17:40:05.089512] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-23T17:40:05.267688] [WARN ] [MAIN ] BMO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:40:05.267952] [INFO ] [MAIN ] BMO: Wiping existing primary data before full refresh. [2025-09-23T17:40:05.268000] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-09-23T17:40:05.269197] [DEBUG] [LOCAL ] BMO: Deleted primary data file. [2025-09-23T17:40:05.269258] [INFO ] [MAIN ] BMO: Starting full primary refresh. [2025-09-23T17:40:05.552213] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-23T17:40:05.627680] [INFO ] [REMOTE ] BMO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:40:05.802175] [INFO ] [REMOTE ] BMO: Fetching primary data for 2024-12. [2025-09-23T17:40:06.602251] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-08. [2025-09-23T17:40:07.169558] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-23T17:40:07.402169] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-06. [2025-09-23T17:40:07.763035] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-23T17:40:08.108463] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-23T17:40:08.202165] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-07. [2025-09-23T17:40:09.002207] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-01. [2025-09-23T17:40:09.201072] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-23T17:40:09.802220] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-09. [2025-09-23T17:40:10.075163] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-23T17:40:10.602235] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-02. [2025-09-23T17:40:10.796967] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-23T17:40:10.801969] [INFO ] [REMOTE ] BMEZ: Full fetch complete (41054 records). [2025-09-23T17:40:10.802072] [DEBUG] [VALIDATOR ] BMEZ: Validating primary data. [2025-09-23T17:40:11.240756] [DEBUG] [VALIDATOR ] BMEZ: All expected trading days are present. [2025-09-23T17:40:11.240881] [DEBUG] [VALIDATOR ] BMEZ: Primary data validation passed. [2025-09-23T17:40:11.241438] [INFO ] [MAIN ] BMEZ: Fetched primary data is valid. [2025-09-23T17:40:11.241485] [DEBUG] [LOCAL ] BMEZ: Saving primary data. [2025-09-23T17:40:11.243304] [DEBUG] [LOCAL ] BMEZ: Trimmed 41054 records to 26034 (keeping 200 days of data) [2025-09-23T17:40:11.413362] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-01. [2025-09-23T17:40:11.439329] [DEBUG] [LOCAL ] BMEZ: Primary data saved (26034 records). [2025-09-23T17:40:11.439512] [INFO ] [MAIN ] BMEZ: Full history saved. [2025-09-23T17:40:11.439714] [INFO ] [MAIN ] Update Progress: 307/2372 symbols completed. BMEZ took 29.6s. Estimated remaining: 4h 29m 59s. Rate: 7.6 symbols/min [2025-09-23T17:40:11.648439] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:40:11.715261] [DEBUG] [LOCAL ] BMY: Loaded 53757 existing records from primary storage. [2025-09-23T17:40:11.715434] [INFO ] [MAIN ] BMY: Loaded 53757 existing records. [2025-09-23T17:40:11.843509] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-23T17:40:11.929792] [WARN ] [MAIN ] BMY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:40:11.930089] [INFO ] [MAIN ] BMY: Wiping existing primary data before full refresh. [2025-09-23T17:40:11.930146] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-09-23T17:40:11.931406] [DEBUG] [LOCAL ] BMY: Deleted primary data file. [2025-09-23T17:40:11.931489] [INFO ] [MAIN ] BMY: Starting full primary refresh. [2025-09-23T17:40:12.204185] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-02. [2025-09-23T17:40:12.352081] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-23T17:40:12.357798] [INFO ] [REMOTE ] BMY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:40:12.653480] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-23T17:40:13.002216] [INFO ] [REMOTE ] BMY: Fetching primary data for 2024-12. [2025-09-23T17:40:13.802225] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-08. [2025-09-23T17:40:14.602184] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-03. [2025-09-23T17:40:14.645367] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-23T17:40:14.706128] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-23T17:40:15.217716] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-23T17:40:15.402236] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-03. [2025-09-23T17:40:16.202202] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-09. [2025-09-23T17:40:17.002191] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-01. [2025-09-23T17:40:17.091493] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-23T17:40:17.802249] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-04. [2025-09-23T17:40:18.261211] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-23T17:40:18.582287] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-23T17:40:18.602183] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-02. [2025-09-23T17:40:19.402242] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-04. [2025-09-23T17:40:19.836857] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-09 (3.63 seconds). [2025-09-23T17:40:19.842071] [INFO ] [REMOTE ] BMI: Full fetch complete (32775 records). [2025-09-23T17:40:19.842248] [DEBUG] [VALIDATOR ] BMI: Validating primary data. [2025-09-23T17:40:20.220271] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-05. [2025-09-23T17:40:20.263778] [DEBUG] [VALIDATOR ] BMI: All expected trading days are present. [2025-09-23T17:40:20.264015] [DEBUG] [VALIDATOR ] BMI: Primary data validation passed. [2025-09-23T17:40:20.264485] [INFO ] [MAIN ] BMI: Fetched primary data is valid. [2025-09-23T17:40:20.264562] [DEBUG] [LOCAL ] BMI: Saving primary data. [2025-09-23T17:40:20.267293] [DEBUG] [LOCAL ] BMI: Trimmed 32775 records to 24187 (keeping 200 days of data) [2025-09-23T17:40:20.417312] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-23T17:40:20.480245] [DEBUG] [LOCAL ] BMI: Primary data saved (24187 records). [2025-09-23T17:40:20.480389] [INFO ] [MAIN ] BMI: Full history saved. [2025-09-23T17:40:20.480502] [INFO ] [MAIN ] Update Progress: 308/2372 symbols completed. BMI took 38.0s. Estimated remaining: 4h 29m 59s. Rate: 7.6 symbols/min [2025-09-23T17:40:20.666661] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:40:20.670418] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-23T17:40:20.731106] [DEBUG] [LOCAL ] BN: Loaded 52995 existing records from primary storage. [2025-09-23T17:40:20.731309] [INFO ] [MAIN ] BN: Loaded 52995 existing records. [2025-09-23T17:40:20.965541] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-23T17:40:20.971164] [WARN ] [MAIN ] BN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:40:20.981206] [INFO ] [MAIN ] BN: Wiping existing primary data before full refresh. [2025-09-23T17:40:20.981280] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-09-23T17:40:20.982537] [DEBUG] [LOCAL ] BN: Deleted primary data file. [2025-09-23T17:40:20.982598] [INFO ] [MAIN ] BN: Starting full primary refresh. [2025-09-23T17:40:21.011313] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-05. [2025-09-23T17:40:21.355993] [INFO ] [REMOTE ] BN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:40:21.802234] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-03. [2025-09-23T17:40:22.284895] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-23T17:40:22.602237] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-06. [2025-09-23T17:40:22.895929] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-09-23T17:40:23.385374] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-23T17:40:23.402161] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-04. [2025-09-23T17:40:24.202191] [INFO ] [REMOTE ] BN: Fetching primary data for 2024-12. [2025-09-23T17:40:25.002244] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-06. [2025-09-23T17:40:25.242362] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-23T17:40:25.802199] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-05. [2025-09-23T17:40:26.078774] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-23T17:40:26.512367] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-23T17:40:26.602195] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-07. [2025-09-23T17:40:27.414089] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-01. [2025-09-23T17:40:27.421721] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-23T17:40:27.835343] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-23T17:40:28.202198] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-06. [2025-09-23T17:40:28.752017] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-23T17:40:29.002250] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-02. [2025-09-23T17:40:29.802266] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-08. [2025-09-23T17:40:29.927445] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-23T17:40:30.390553] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-23T17:40:30.602221] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-03. [2025-09-23T17:40:31.077773] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-23T17:40:31.402235] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-07. [2025-09-23T17:40:31.968155] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-23T17:40:32.027206] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-23T17:40:32.202179] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-08. [2025-09-23T17:40:32.565879] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-23T17:40:33.002191] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-07. [2025-09-23T17:40:33.802199] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-04. [2025-09-23T17:40:34.602161] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-09. [2025-09-23T17:40:34.737139] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-23T17:40:35.402244] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-08. [2025-09-23T17:40:35.710922] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-23T17:40:35.811054] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-23T17:40:35.818456] [INFO ] [REMOTE ] BMO: Full fetch complete (59910 records). [2025-09-23T17:40:35.818597] [DEBUG] [VALIDATOR ] BMO: Validating primary data. [2025-09-23T17:40:36.216437] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-09. [2025-09-23T17:40:36.237914] [DEBUG] [VALIDATOR ] BMO: All expected trading days are present. [2025-09-23T17:40:36.238032] [DEBUG] [VALIDATOR ] BMO: Primary data validation passed. [2025-09-23T17:40:36.238801] [INFO ] [MAIN ] BMO: Fetched primary data is valid. [2025-09-23T17:40:36.238868] [DEBUG] [LOCAL ] BMO: Saving primary data. [2025-09-23T17:40:36.240489] [DEBUG] [LOCAL ] BMO: Trimmed 59910 records to 41304 (keeping 200 days of data) [2025-09-23T17:40:36.501778] [DEBUG] [LOCAL ] BMO: Primary data saved (41304 records). [2025-09-23T17:40:36.501916] [INFO ] [MAIN ] BMO: Full history saved. [2025-09-23T17:40:36.502002] [INFO ] [MAIN ] Update Progress: 309/2372 symbols completed. BMO took 31.7s. Estimated remaining: 4h 30m 45s. Rate: 7.6 symbols/min [2025-09-23T17:40:36.671816] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:40:36.701855] [DEBUG] [LOCAL ] BNED: Loaded 30016 existing records from primary storage. [2025-09-23T17:40:36.701990] [INFO ] [MAIN ] BNED: Loaded 30016 existing records. [2025-09-23T17:40:36.806491] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-23T17:40:36.813563] [INFO ] [REMOTE ] BMN: Full fetch complete (3709 records). [2025-09-23T17:40:36.818719] [DEBUG] [VALIDATOR ] BMN: Validating primary data. [2025-09-23T17:40:37.007139] [WARN ] [MAIN ] BNED: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:40:37.002534] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-05. [2025-09-23T17:40:37.009174] [INFO ] [MAIN ] BNED: Wiping existing primary data before full refresh. [2025-09-23T17:40:37.020019] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-09-23T17:40:37.035763] [DEBUG] [LOCAL ] BNED: Deleted primary data file. [2025-09-23T17:40:37.041215] [INFO ] [MAIN ] BNED: Starting full primary refresh. [2025-09-23T17:40:37.492425] [DEBUG] [VALIDATOR ] BMN: All expected trading days are present. [2025-09-23T17:40:37.492566] [DEBUG] [VALIDATOR ] BMN: Primary data validation passed. [2025-09-23T17:40:37.531720] [INFO ] [MAIN ] BMN: Fetched primary data is valid. [2025-09-23T17:40:37.543564] [DEBUG] [LOCAL ] BMN: Saving primary data. [2025-09-23T17:40:37.596778] [DEBUG] [LOCAL ] BMN: Trimmed 3709 records to 2537 (keeping 200 days of data) [2025-09-23T17:40:37.655535] [DEBUG] [LOCAL ] BMN: Primary data saved (2537 records). [2025-09-23T17:40:37.698349] [INFO ] [REMOTE ] BNED: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:40:37.692807] [INFO ] [MAIN ] BMN: Full history saved. [2025-09-23T17:40:37.699032] [INFO ] [MAIN ] Update Progress: 310/2372 symbols completed. BMN took 35.0s. Estimated remaining: 4h 29m 53s. Rate: 7.6 symbols/min [2025-09-23T17:40:37.807553] [INFO ] [REMOTE ] BNED: Fetching primary data for 2024-12. [2025-09-23T17:40:37.837435] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-09-23T17:40:37.921358] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:40:37.934481] [DEBUG] [LOCAL ] BNH: Loaded 4822 existing records from primary storage. [2025-09-23T17:40:37.934606] [INFO ] [MAIN ] BNH: Loaded 4822 existing records. [2025-09-23T17:40:38.115807] [WARN ] [MAIN ] BNH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:40:38.116084] [INFO ] [MAIN ] BNH: Wiping existing primary data before full refresh. [2025-09-23T17:40:38.116134] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-09-23T17:40:38.116470] [DEBUG] [LOCAL ] BNH: Deleted primary data file. [2025-09-23T17:40:38.116542] [INFO ] [MAIN ] BNH: Starting full primary refresh. [2025-09-23T17:40:38.477418] [INFO ] [REMOTE ] BNH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:40:38.602186] [INFO ] [REMOTE ] BNH: Fetching primary data for 2024-12. [2025-09-23T17:40:38.653324] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-23T17:40:39.079945] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-23T17:40:39.093397] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-23T17:40:39.402196] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-01. [2025-09-23T17:40:39.737966] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-23T17:40:40.202234] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-06. [2025-09-23T17:40:41.002243] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-09. [2025-09-23T17:40:41.570985] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-23T17:40:41.655765] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-23T17:40:41.664980] [INFO ] [REMOTE ] BMY: Full fetch complete (77795 records). [2025-09-23T17:40:41.665183] [DEBUG] [VALIDATOR ] BMY: Validating primary data. [2025-09-23T17:40:41.807688] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-01. [2025-09-23T17:40:42.072692] [DEBUG] [VALIDATOR ] BMY: All expected trading days are present. [2025-09-23T17:40:42.072796] [DEBUG] [VALIDATOR ] BMY: Primary data validation passed. [2025-09-23T17:40:42.073732] [INFO ] [MAIN ] BMY: Fetched primary data is valid. [2025-09-23T17:40:42.073800] [DEBUG] [LOCAL ] BMY: Saving primary data. [2025-09-23T17:40:42.078011] [DEBUG] [LOCAL ] BMY: Trimmed 77795 records to 53757 (keeping 200 days of data) [2025-09-23T17:40:42.402067] [DEBUG] [LOCAL ] BMY: Primary data saved (53757 records). [2025-09-23T17:40:42.402212] [INFO ] [MAIN ] BMY: Full history saved. [2025-09-23T17:40:42.402298] [INFO ] [MAIN ] Update Progress: 311/2372 symbols completed. BMY took 31.0s. Estimated remaining: 4h 29m 24s. Rate: 7.7 symbols/min [2025-09-23T17:40:42.568374] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:40:42.572454] [DEBUG] [LOCAL ] BNJ: Loaded 2577 existing records from primary storage. [2025-09-23T17:40:42.572525] [INFO ] [MAIN ] BNJ: Loaded 2577 existing records. [2025-09-23T17:40:42.607498] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-07. [2025-09-23T17:40:42.754283] [WARN ] [MAIN ] BNJ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:40:42.754530] [INFO ] [MAIN ] BNJ: Wiping existing primary data before full refresh. [2025-09-23T17:40:42.754584] [INFO ] [LOCAL ] BNJ: Starting deletion of primary data. [2025-09-23T17:40:42.754851] [DEBUG] [LOCAL ] BNJ: Deleted primary data file. [2025-09-23T17:40:42.754911] [INFO ] [MAIN ] BNJ: Starting full primary refresh. [2025-09-23T17:40:43.118633] [INFO ] [REMOTE ] BNJ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:40:43.137488] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-23T17:40:43.402213] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2024-12. [2025-09-23T17:40:43.897984] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-23T17:40:44.128179] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-23T17:40:44.202161] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-08. [2025-09-23T17:40:45.002214] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-02. [2025-09-23T17:40:45.754013] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-23T17:40:45.811285] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-03. [2025-09-23T17:40:45.831899] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-23T17:40:46.602199] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-01. [2025-09-23T17:40:46.917123] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-09-23T17:40:47.157343] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-23T17:40:47.402195] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-04. [2025-09-23T17:40:48.202245] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-02. [2025-09-23T17:40:48.288050] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-23T17:40:48.517215] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-09-23T17:40:49.002192] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-05. [2025-09-23T17:40:49.802202] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-02. [2025-09-23T17:40:49.997592] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-23T17:40:50.110335] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-09-23T17:40:50.602197] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-03. [2025-09-23T17:40:51.136520] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-23T17:40:51.402205] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-04. [2025-09-23T17:40:51.868636] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-23T17:40:52.202225] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-06. [2025-09-23T17:40:53.002178] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-09. [2025-09-23T17:40:53.374454] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-23T17:40:53.802229] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-07. [2025-09-23T17:40:54.442574] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-23T17:40:54.451369] [INFO ] [REMOTE ] BN: Full fetch complete (76623 records). [2025-09-23T17:40:54.451538] [DEBUG] [VALIDATOR ] BN: Validating primary data. [2025-09-23T17:40:54.627406] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-03. [2025-09-23T17:40:54.859823] [DEBUG] [VALIDATOR ] BN: All expected trading days are present. [2025-09-23T17:40:54.859953] [DEBUG] [VALIDATOR ] BN: Primary data validation passed. [2025-09-23T17:40:54.860877] [INFO ] [MAIN ] BN: Fetched primary data is valid. [2025-09-23T17:40:54.861118] [DEBUG] [LOCAL ] BN: Saving primary data. [2025-09-23T17:40:54.882993] [DEBUG] [LOCAL ] BN: Trimmed 76623 records to 52994 (keeping 200 days of data) [2025-09-23T17:40:54.884226] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-23T17:40:55.207443] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-23T17:40:55.228860] [DEBUG] [LOCAL ] BN: Primary data saved (52994 records). [2025-09-23T17:40:55.228953] [INFO ] [MAIN ] BN: Full history saved. [2025-09-23T17:40:55.229028] [INFO ] [MAIN ] Update Progress: 312/2372 symbols completed. BN took 34.7s. Estimated remaining: 4h 29m 50s. Rate: 7.6 symbols/min [2025-09-23T17:40:55.398702] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:40:55.402196] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-08. [2025-09-23T17:40:55.447213] [DEBUG] [LOCAL ] BNL: Loaded 46906 existing records from primary storage. [2025-09-23T17:40:55.447350] [INFO ] [MAIN ] BNL: Loaded 46906 existing records. [2025-09-23T17:40:55.627693] [WARN ] [MAIN ] BNL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:40:55.627965] [INFO ] [MAIN ] BNL: Wiping existing primary data before full refresh. [2025-09-23T17:40:55.628030] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-09-23T17:40:55.629018] [DEBUG] [LOCAL ] BNL: Deleted primary data file. [2025-09-23T17:40:55.629080] [INFO ] [MAIN ] BNL: Starting full primary refresh. [2025-09-23T17:40:55.984696] [INFO ] [REMOTE ] BNL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:40:56.202261] [INFO ] [REMOTE ] BNL: Fetching primary data for 2024-12. [2025-09-23T17:40:56.354319] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-23T17:40:57.002195] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-04. [2025-09-23T17:40:57.401984] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-23T17:40:57.785818] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-23T17:40:57.802157] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-01. [2025-09-23T17:40:58.602250] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-05. [2025-09-23T17:40:58.921334] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-23T17:40:58.975437] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-23T17:40:59.402291] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-05. [2025-09-23T17:40:59.749083] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-23T17:41:00.202234] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-06. [2025-09-23T17:41:00.531623] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-23T17:41:01.002212] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-06. [2025-09-23T17:41:01.523148] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-23T17:41:01.802254] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-07. [2025-09-23T17:41:02.133895] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-23T17:41:02.602220] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-07. [2025-09-23T17:41:02.918898] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-23T17:41:03.402227] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-08. [2025-09-23T17:41:03.729725] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-23T17:41:04.202214] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-09. [2025-09-23T17:41:04.649204] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-23T17:41:04.650400] [INFO ] [REMOTE ] BNJ: Full fetch complete (4435 records). [2025-09-23T17:41:04.650468] [DEBUG] [VALIDATOR ] BNJ: Validating primary data. [2025-09-23T17:41:05.009010] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-08. [2025-09-23T17:41:05.043561] [DEBUG] [VALIDATOR ] BNJ: All expected trading days are present. [2025-09-23T17:41:05.043661] [DEBUG] [VALIDATOR ] BNJ: Primary data validation passed. [2025-09-23T17:41:05.043830] [INFO ] [MAIN ] BNJ: Fetched primary data is valid. [2025-09-23T17:41:05.043871] [DEBUG] [LOCAL ] BNJ: Saving primary data. [2025-09-23T17:41:05.044253] [DEBUG] [LOCAL ] BNJ: Trimmed 4435 records to 2584 (keeping 200 days of data) [2025-09-23T17:41:05.060179] [DEBUG] [LOCAL ] BNJ: Primary data saved (2584 records). [2025-09-23T17:41:05.060338] [INFO ] [MAIN ] BNJ: Full history saved. [2025-09-23T17:41:05.060442] [INFO ] [MAIN ] Update Progress: 313/2372 symbols completed. BNJ took 22.7s. Estimated remaining: 4h 29m 55s. Rate: 7.6 symbols/min [2025-09-23T17:41:05.237123] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:41:05.289607] [DEBUG] [LOCAL ] BNS: Loaded 51466 existing records from primary storage. [2025-09-23T17:41:05.289779] [INFO ] [MAIN ] BNS: Loaded 51466 existing records. [2025-09-23T17:41:05.473806] [WARN ] [MAIN ] BNS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:41:05.474133] [INFO ] [MAIN ] BNS: Wiping existing primary data before full refresh. [2025-09-23T17:41:05.474186] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-09-23T17:41:05.475907] [DEBUG] [LOCAL ] BNS: Deleted primary data file. [2025-09-23T17:41:05.475970] [INFO ] [MAIN ] BNS: Starting full primary refresh. [2025-09-23T17:41:05.605500] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-23T17:41:05.807384] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-09. [2025-09-23T17:41:05.845981] [INFO ] [REMOTE ] BNS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:41:06.398548] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-23T17:41:06.399888] [INFO ] [REMOTE ] BNH: Full fetch complete (6811 records). [2025-09-23T17:41:06.399967] [DEBUG] [VALIDATOR ] BNH: Validating primary data. [2025-09-23T17:41:06.607349] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-09. [2025-09-23T17:41:06.766060] [DEBUG] [VALIDATOR ] BNH: All expected trading days are present. [2025-09-23T17:41:06.766186] [DEBUG] [VALIDATOR ] BNH: Primary data validation passed. [2025-09-23T17:41:06.766386] [INFO ] [MAIN ] BNH: Fetched primary data is valid. [2025-09-23T17:41:06.766428] [DEBUG] [LOCAL ] BNH: Saving primary data. [2025-09-23T17:41:06.766877] [DEBUG] [LOCAL ] BNH: Trimmed 6811 records to 4838 (keeping 200 days of data) [2025-09-23T17:41:06.799467] [DEBUG] [LOCAL ] BNH: Primary data saved (4838 records). [2025-09-23T17:41:06.799602] [INFO ] [MAIN ] BNH: Full history saved. [2025-09-23T17:41:06.799712] [INFO ] [MAIN ] Update Progress: 314/2372 symbols completed. BNH took 29.1s. Estimated remaining: 4h 29m 7s. Rate: 7.6 symbols/min [2025-09-23T17:41:06.970514] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:41:06.976022] [DEBUG] [LOCAL ] BNT: Loaded 3407 existing records from primary storage. [2025-09-23T17:41:06.976153] [INFO ] [MAIN ] BNT: Loaded 3407 existing records. [2025-09-23T17:41:07.157786] [WARN ] [MAIN ] BNT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:41:07.158127] [INFO ] [MAIN ] BNT: Wiping existing primary data before full refresh. [2025-09-23T17:41:07.158186] [INFO ] [LOCAL ] BNT: Starting deletion of primary data. [2025-09-23T17:41:07.158473] [DEBUG] [LOCAL ] BNT: Deleted primary data file. [2025-09-23T17:41:07.158535] [INFO ] [MAIN ] BNT: Starting full primary refresh. [2025-09-23T17:41:07.410249] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-02. [2025-09-23T17:41:07.562775] [INFO ] [REMOTE ] BNT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:41:07.777938] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-23T17:41:07.783383] [INFO ] [REMOTE ] BNED: Full fetch complete (44350 records). [2025-09-23T17:41:07.783521] [DEBUG] [VALIDATOR ] BNED: Validating primary data. [2025-09-23T17:41:08.200637] [DEBUG] [VALIDATOR ] BNED: All expected trading days are present. [2025-09-23T17:41:08.200921] [DEBUG] [VALIDATOR ] BNED: Primary data validation passed. [2025-09-23T17:41:08.201519] [INFO ] [MAIN ] BNED: Fetched primary data is valid. [2025-09-23T17:41:08.201569] [DEBUG] [LOCAL ] BNED: Saving primary data. [2025-09-23T17:41:08.202322] [INFO ] [REMOTE ] BNS: Fetching primary data for 2024-12. [2025-09-23T17:41:08.204008] [DEBUG] [LOCAL ] BNED: Trimmed 44350 records to 29989 (keeping 200 days of data) [2025-09-23T17:41:08.386575] [DEBUG] [LOCAL ] BNED: Primary data saved (29989 records). [2025-09-23T17:41:08.386757] [INFO ] [MAIN ] BNED: Full history saved. [2025-09-23T17:41:08.386880] [INFO ] [MAIN ] Update Progress: 315/2372 symbols completed. BNED took 31.9s. Estimated remaining: 4h 28m 18s. Rate: 7.7 symbols/min [2025-09-23T17:41:08.575346] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:41:08.585005] [DEBUG] [LOCAL ] BNY: Loaded 7446 existing records from primary storage. [2025-09-23T17:41:08.585148] [INFO ] [MAIN ] BNY: Loaded 7446 existing records. [2025-09-23T17:41:08.763538] [WARN ] [MAIN ] BNY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:41:08.763902] [INFO ] [MAIN ] BNY: Wiping existing primary data before full refresh. [2025-09-23T17:41:08.763958] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-09-23T17:41:08.764303] [DEBUG] [LOCAL ] BNY: Deleted primary data file. [2025-09-23T17:41:08.764362] [INFO ] [MAIN ] BNY: Starting full primary refresh. [2025-09-23T17:41:09.035453] [INFO ] [REMOTE ] BNT: Fetching primary data for 2024-12. [2025-09-23T17:41:09.052961] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-23T17:41:09.192942] [INFO ] [REMOTE ] BNY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:41:09.595230] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-23T17:41:09.597322] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-23T17:41:09.802261] [INFO ] [REMOTE ] BNY: Fetching primary data for 2024-12. [2025-09-23T17:41:10.602169] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-01. [2025-09-23T17:41:10.653093] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-23T17:41:11.016851] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-23T17:41:11.402250] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-01. [2025-09-23T17:41:11.817576] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-23T17:41:12.202194] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-02. [2025-09-23T17:41:12.684012] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-23T17:41:13.002281] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-02. [2025-09-23T17:41:13.405000] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-23T17:41:13.802202] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-03. [2025-09-23T17:41:14.602218] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-03. [2025-09-23T17:41:15.299873] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-23T17:41:15.337326] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-23T17:41:15.402196] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-04. [2025-09-23T17:41:16.202239] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-04. [2025-09-23T17:41:16.608909] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-23T17:41:16.997500] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-23T17:41:17.007256] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-01. [2025-09-23T17:41:17.802192] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-05. [2025-09-23T17:41:18.292557] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-23T17:41:18.602200] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-03. [2025-09-23T17:41:19.015176] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-23T17:41:19.402237] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-02. [2025-09-23T17:41:19.538008] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-23T17:41:20.202290] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-06. [2025-09-23T17:41:20.684287] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-23T17:41:21.002216] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-05. [2025-09-23T17:41:21.605717] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-23T17:41:21.802172] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-06. [2025-09-23T17:41:21.856358] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-23T17:41:22.233154] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-23T17:41:22.602212] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-07. [2025-09-23T17:41:23.067547] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-23T17:41:23.402211] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-03. [2025-09-23T17:41:24.202199] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-07. [2025-09-23T17:41:25.002190] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-08. [2025-09-23T17:41:25.141483] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-23T17:41:25.402024] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-23T17:41:25.463609] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-23T17:41:25.802201] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-04. [2025-09-23T17:41:26.316739] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-23T17:41:26.602197] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-08. [2025-09-23T17:41:27.402209] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-04. [2025-09-23T17:41:28.174817] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-23T17:41:28.202147] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-09. [2025-09-23T17:41:28.829832] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-23T17:41:29.002193] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-09. [2025-09-23T17:41:29.531552] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-23T17:41:29.531373] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-23T17:41:29.540993] [INFO ] [REMOTE ] BNY: Full fetch complete (10504 records). [2025-09-23T17:41:29.541069] [DEBUG] [VALIDATOR ] BNY: Validating primary data. [2025-09-23T17:41:29.605613] [INFO ] [REMOTE ] BNL: Full fetch complete (66591 records). [2025-09-23T17:41:29.617080] [DEBUG] [VALIDATOR ] BNL: Validating primary data. [2025-09-23T17:41:29.818160] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-05. [2025-09-23T17:41:30.381443] [DEBUG] [VALIDATOR ] BNY: All expected trading days are present. [2025-09-23T17:41:30.413409] [DEBUG] [VALIDATOR ] BNL: All expected trading days are present. [2025-09-23T17:41:30.413589] [DEBUG] [VALIDATOR ] BNY: Primary data validation passed. [2025-09-23T17:41:30.414124] [INFO ] [MAIN ] BNY: Fetched primary data is valid. [2025-09-23T17:41:30.417550] [DEBUG] [VALIDATOR ] BNL: Primary data validation passed. [2025-09-23T17:41:30.419251] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-23T17:41:30.418971] [INFO ] [MAIN ] BNL: Fetched primary data is valid. [2025-09-23T17:41:30.421313] [DEBUG] [LOCAL ] BNY: Saving primary data. [2025-09-23T17:41:30.421422] [DEBUG] [LOCAL ] BNL: Saving primary data. [2025-09-23T17:41:30.422506] [DEBUG] [LOCAL ] BNY: Trimmed 10504 records to 7423 (keeping 200 days of data) [2025-09-23T17:41:30.441385] [DEBUG] [LOCAL ] BNL: Trimmed 66591 records to 46871 (keeping 200 days of data) [2025-09-23T17:41:30.556928] [DEBUG] [LOCAL ] BNY: Primary data saved (7423 records). [2025-09-23T17:41:30.559702] [INFO ] [MAIN ] BNY: Full history saved. [2025-09-23T17:41:30.560060] [INFO ] [MAIN ] Update Progress: 316/2372 symbols completed. BNY took 22.2s. Estimated remaining: 4h 29m 43s. Rate: 7.6 symbols/min [2025-09-23T17:41:30.604084] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-05. [2025-09-23T17:41:30.835439] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:41:30.898511] [DEBUG] [LOCAL ] BOC: Loaded 18367 existing records from primary storage. [2025-09-23T17:41:30.900233] [INFO ] [MAIN ] BOC: Loaded 18367 existing records. [2025-09-23T17:41:31.100188] [WARN ] [MAIN ] BOC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:41:31.103506] [INFO ] [MAIN ] BOC: Wiping existing primary data before full refresh. [2025-09-23T17:41:31.103569] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-09-23T17:41:31.104094] [DEBUG] [LOCAL ] BOC: Deleted primary data file. [2025-09-23T17:41:31.104156] [INFO ] [MAIN ] BOC: Starting full primary refresh. [2025-09-23T17:41:31.406073] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-06. [2025-09-23T17:41:31.406005] [DEBUG] [LOCAL ] BNL: Primary data saved (46871 records). [2025-09-23T17:41:31.412791] [INFO ] [MAIN ] BNL: Full history saved. [2025-09-23T17:41:31.419158] [INFO ] [MAIN ] Update Progress: 317/2372 symbols completed. BNL took 36.2s. Estimated remaining: 4h 28m 50s. Rate: 7.6 symbols/min [2025-09-23T17:41:31.523436] [INFO ] [REMOTE ] BOC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:41:31.749619] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-23T17:41:32.010776] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-23T17:41:32.202181] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-07. [2025-09-23T17:41:32.573180] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-23T17:41:33.002224] [INFO ] [REMOTE ] BOC: Fetching primary data for 2024-12. [2025-09-23T17:41:33.780185] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-23T17:41:33.802145] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-01. [2025-09-23T17:41:34.392327] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-23T17:41:34.602236] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-02. [2025-09-23T17:41:35.233688] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-23T17:41:35.402259] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-06. [2025-09-23T17:41:36.202197] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-03. [2025-09-23T17:41:36.739681] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-23T17:41:36.804392] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-23T17:41:37.002263] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-08. [2025-09-23T17:41:37.440283] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-23T17:41:37.802214] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-04. [2025-09-23T17:41:38.521437] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-23T17:41:38.602190] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-05. [2025-09-23T17:41:39.402173] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-09. [2025-09-23T17:41:39.568624] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-23T17:41:39.855525] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-23T17:41:39.857069] [INFO ] [REMOTE ] BNT: Full fetch complete (4444 records). [2025-09-23T17:41:39.857139] [DEBUG] [VALIDATOR ] BNT: Validating primary data. [2025-09-23T17:41:40.209098] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-06. [2025-09-23T17:41:40.209390] [DEBUG] [VALIDATOR ] BNT: All expected trading days are present. [2025-09-23T17:41:40.209490] [DEBUG] [VALIDATOR ] BNT: Primary data validation passed. [2025-09-23T17:41:40.210530] [INFO ] [MAIN ] BNT: Fetched primary data is valid. [2025-09-23T17:41:40.210611] [DEBUG] [LOCAL ] BNT: Saving primary data. [2025-09-23T17:41:40.211257] [DEBUG] [LOCAL ] BNT: Trimmed 4444 records to 3417 (keeping 200 days of data) [2025-09-23T17:41:40.232014] [DEBUG] [LOCAL ] BNT: Primary data saved (3417 records). [2025-09-23T17:41:40.232082] [INFO ] [MAIN ] BNT: Full history saved. [2025-09-23T17:41:40.232156] [INFO ] [MAIN ] Update Progress: 318/2372 symbols completed. BNT took 33.4s. Estimated remaining: 4h 28m 48s. Rate: 7.6 symbols/min [2025-09-23T17:41:40.918605] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-23T17:41:41.002141] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-07. [2025-09-23T17:41:41.685455] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-23T17:41:41.802231] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-08. [2025-09-23T17:41:42.495861] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-23T17:41:42.602239] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-09. [2025-09-23T17:41:43.321307] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-23T17:41:43.325226] [INFO ] [REMOTE ] BOC: Full fetch complete (25819 records). [2025-09-23T17:41:43.325342] [DEBUG] [VALIDATOR ] BOC: Validating primary data. [2025-09-23T17:41:43.411440] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-07. [2025-09-23T17:41:43.700878] [DEBUG] [VALIDATOR ] BOC: All expected trading days are present. [2025-09-23T17:41:43.700955] [DEBUG] [VALIDATOR ] BOC: Primary data validation passed. [2025-09-23T17:41:43.701330] [INFO ] [MAIN ] BOC: Fetched primary data is valid. [2025-09-23T17:41:43.701368] [DEBUG] [LOCAL ] BOC: Saving primary data. [2025-09-23T17:41:43.702057] [DEBUG] [LOCAL ] BOC: Trimmed 25819 records to 18394 (keeping 200 days of data) [2025-09-23T17:41:43.804604] [DEBUG] [LOCAL ] BOC: Primary data saved (18394 records). [2025-09-23T17:41:43.804763] [INFO ] [MAIN ] BOC: Full history saved. [2025-09-23T17:41:43.804852] [INFO ] [MAIN ] Update Progress: 319/2372 symbols completed. BOC took 13.2s. Estimated remaining: 4h 28m 13s. Rate: 7.7 symbols/min [2025-09-23T17:41:45.085956] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-23T17:41:45.098130] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-08. [2025-09-23T17:41:46.333872] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-23T17:41:46.344633] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-09. [2025-09-23T17:41:48.035513] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-23T17:41:48.044849] [INFO ] [REMOTE ] BNS: Full fetch complete (74200 records). [2025-09-23T17:41:48.045004] [DEBUG] [VALIDATOR ] BNS: Validating primary data. [2025-09-23T17:41:48.459007] [DEBUG] [VALIDATOR ] BNS: All expected trading days are present. [2025-09-23T17:41:48.459116] [DEBUG] [VALIDATOR ] BNS: Primary data validation passed. [2025-09-23T17:41:48.460001] [INFO ] [MAIN ] BNS: Fetched primary data is valid. [2025-09-23T17:41:48.460086] [DEBUG] [LOCAL ] BNS: Saving primary data. [2025-09-23T17:41:48.461851] [DEBUG] [LOCAL ] BNS: Trimmed 74200 records to 51460 (keeping 200 days of data) [2025-09-23T17:41:48.788850] [DEBUG] [LOCAL ] BNS: Primary data saved (51460 records). [2025-09-23T17:41:48.789002] [INFO ] [MAIN ] BNS: Full history saved. [2025-09-23T17:41:48.789094] [INFO ] [MAIN ] Update Progress: 320/2372 symbols completed. BNS took 43.7s. Estimated remaining: 4h 27m 47s. Rate: 7.7 symbols/min [2025-09-23T17:41:49.451955] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:41:49.466742] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:41:49.495971] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:41:49.517220] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:41:49.539241] [DEBUG] [LOCAL ] BOE: Loaded 17665 existing records from primary storage. [2025-09-23T17:41:49.539424] [INFO ] [MAIN ] BOE: Loaded 17665 existing records. [2025-09-23T17:41:49.749249] [DEBUG] [LOCAL ] BOH: Loaded 31418 existing records from primary storage. [2025-09-23T17:41:49.782065] [WARN ] [MAIN ] BOE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:41:49.794589] [INFO ] [MAIN ] BOH: Loaded 31418 existing records. [2025-09-23T17:41:49.825885] [DEBUG] [LOCAL ] BOOT: Loaded 41054 existing records from primary storage. [2025-09-23T17:41:49.825273] [INFO ] [MAIN ] BOE: Wiping existing primary data before full refresh. [2025-09-23T17:41:49.851430] [INFO ] [MAIN ] BOOT: Loaded 41054 existing records. [2025-09-23T17:41:49.836760] [DEBUG] [LOCAL ] BOND: Loaded 32096 existing records from primary storage. [2025-09-23T17:41:49.865766] [INFO ] [MAIN ] BOND: Loaded 32096 existing records. [2025-09-23T17:41:49.860419] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-09-23T17:41:49.939676] [DEBUG] [LOCAL ] BOE: Deleted primary data file. [2025-09-23T17:41:49.953738] [INFO ] [MAIN ] BOE: Starting full primary refresh. [2025-09-23T17:41:50.249708] [WARN ] [MAIN ] BOH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:41:50.472340] [WARN ] [MAIN ] BOOT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:41:50.453639] [INFO ] [MAIN ] BOH: Wiping existing primary data before full refresh. [2025-09-23T17:41:50.525376] [INFO ] [MAIN ] BOOT: Wiping existing primary data before full refresh. [2025-09-23T17:41:50.539736] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-09-23T17:41:50.558732] [WARN ] [MAIN ] BOND: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:41:50.558872] [INFO ] [LOCAL ] BOOT: Starting deletion of primary data. [2025-09-23T17:41:50.600458] [INFO ] [MAIN ] BOND: Wiping existing primary data before full refresh. [2025-09-23T17:41:50.621824] [DEBUG] [LOCAL ] BOH: Deleted primary data file. [2025-09-23T17:41:50.622022] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-09-23T17:41:50.621742] [DEBUG] [LOCAL ] BOOT: Deleted primary data file. [2025-09-23T17:41:50.627465] [INFO ] [MAIN ] BOH: Starting full primary refresh. [2025-09-23T17:41:50.643361] [INFO ] [MAIN ] BOOT: Starting full primary refresh. [2025-09-23T17:41:50.658688] [DEBUG] [LOCAL ] BOND: Deleted primary data file. [2025-09-23T17:41:50.696558] [INFO ] [MAIN ] BOND: Starting full primary refresh. [2025-09-23T17:41:51.230739] [INFO ] [REMOTE ] BOE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:41:51.383174] [INFO ] [REMOTE ] BOE: Fetching primary data for 2024-12. [2025-09-23T17:41:51.738122] [INFO ] [REMOTE ] BOH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:41:51.798735] [INFO ] [REMOTE ] BOH: Fetching primary data for 2024-12. [2025-09-23T17:41:51.845233] [INFO ] [REMOTE ] BOND: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:41:51.895999] [INFO ] [REMOTE ] BOND: Fetching primary data for 2024-12. [2025-09-23T17:41:51.901153] [INFO ] [REMOTE ] BOOT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:41:51.901602] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2024-12. [2025-09-23T17:41:52.244014] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-23T17:41:52.248948] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-01. [2025-09-23T17:41:52.880466] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-23T17:41:52.900502] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-01. [2025-09-23T17:41:52.902272] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-23T17:41:52.908133] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-01. [2025-09-23T17:41:52.977986] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-23T17:41:52.982456] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-02. [2025-09-23T17:41:53.124394] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-23T17:41:53.132518] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-01. [2025-09-23T17:41:53.729174] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-23T17:41:53.733324] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-03. [2025-09-23T17:41:53.976826] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-23T17:41:53.985798] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-02. [2025-09-23T17:41:54.175679] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-23T17:41:54.444792] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-23T17:41:54.602200] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-02. [2025-09-23T17:41:54.666871] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-23T17:41:54.863476] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-23T17:41:55.402194] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-03. [2025-09-23T17:41:55.445489] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-23T17:41:56.202243] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-04. [2025-09-23T17:41:56.514413] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-23T17:41:57.002174] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-04. [2025-09-23T17:41:57.030270] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-23T17:41:57.802198] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-02. [2025-09-23T17:41:58.096310] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-23T17:41:58.602184] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-05. [2025-09-23T17:41:58.989873] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-23T17:41:59.236130] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-23T17:41:59.402225] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-03. [2025-09-23T17:42:00.202191] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-03. [2025-09-23T17:42:00.801686] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-23T17:42:01.002214] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-05. [2025-09-23T17:42:01.796923] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-23T17:42:01.806770] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-04. [2025-09-23T17:42:02.200549] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-23T17:42:02.602258] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-06. [2025-09-23T17:42:03.402217] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-04. [2025-09-23T17:42:04.194165] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-23T17:42:04.202145] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-07. [2025-09-23T17:42:04.335431] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-04 (2.53 seconds). [2025-09-23T17:42:04.904714] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-23T17:42:04.980123] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-23T17:42:05.002240] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-05. [2025-09-23T17:42:05.802264] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-08. [2025-09-23T17:42:06.407770] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-23T17:42:06.602219] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-09. [2025-09-23T17:42:06.799114] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-23T17:42:07.402244] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-06. [2025-09-23T17:42:07.473158] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-23T17:42:07.477106] [INFO ] [REMOTE ] BOE: Full fetch complete (26674 records). [2025-09-23T17:42:07.477197] [DEBUG] [VALIDATOR ] BOE: Validating primary data. [2025-09-23T17:42:07.898276] [DEBUG] [VALIDATOR ] BOE: All expected trading days are present. [2025-09-23T17:42:07.898371] [DEBUG] [VALIDATOR ] BOE: Primary data validation passed. [2025-09-23T17:42:07.898776] [INFO ] [MAIN ] BOE: Fetched primary data is valid. [2025-09-23T17:42:07.898839] [DEBUG] [LOCAL ] BOE: Saving primary data. [2025-09-23T17:42:07.899538] [DEBUG] [LOCAL ] BOE: Trimmed 26674 records to 17606 (keeping 200 days of data) [2025-09-23T17:42:08.011395] [DEBUG] [LOCAL ] BOE: Primary data saved (17606 records). [2025-09-23T17:42:08.011548] [INFO ] [MAIN ] BOE: Full history saved. [2025-09-23T17:42:08.011667] [INFO ] [MAIN ] Update Progress: 321/2372 symbols completed. BOE took 19.2s. Estimated remaining: 4h 28m 52s. Rate: 7.6 symbols/min [2025-09-23T17:42:08.200248] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:42:08.202270] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-05. [2025-09-23T17:42:08.266559] [DEBUG] [LOCAL ] BORR: Loaded 51168 existing records from primary storage. [2025-09-23T17:42:08.266739] [INFO ] [MAIN ] BORR: Loaded 51168 existing records. [2025-09-23T17:42:08.453002] [WARN ] [MAIN ] BORR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:42:08.453325] [INFO ] [MAIN ] BORR: Wiping existing primary data before full refresh. [2025-09-23T17:42:08.453403] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-09-23T17:42:08.454800] [DEBUG] [LOCAL ] BORR: Deleted primary data file. [2025-09-23T17:42:08.454864] [INFO ] [MAIN ] BORR: Starting full primary refresh. [2025-09-23T17:42:08.838996] [INFO ] [REMOTE ] BORR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:42:08.865758] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-23T17:42:09.002239] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-07. [2025-09-23T17:42:09.131336] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-23T17:42:09.802205] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-06. [2025-09-23T17:42:10.159681] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-23T17:42:10.602212] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-06. [2025-09-23T17:42:11.375268] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-23T17:42:11.402156] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-07. [2025-09-23T17:42:11.862814] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-23T17:42:12.202210] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-07. [2025-09-23T17:42:12.329197] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-23T17:42:13.002204] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-08. [2025-09-23T17:42:13.297037] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-23T17:42:13.802227] [INFO ] [REMOTE ] BORR: Fetching primary data for 2024-12. [2025-09-23T17:42:14.478008] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-23T17:42:14.602189] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-09. [2025-09-23T17:42:15.402199] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-08. [2025-09-23T17:42:15.848690] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-23T17:42:16.204286] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-08. [2025-09-23T17:42:16.206044] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-23T17:42:16.218898] [INFO ] [REMOTE ] BOND: Full fetch complete (46291 records). [2025-09-23T17:42:16.219107] [DEBUG] [VALIDATOR ] BOND: Validating primary data. [2025-09-23T17:42:16.614317] [DEBUG] [VALIDATOR ] BOND: All expected trading days are present. [2025-09-23T17:42:16.614417] [DEBUG] [VALIDATOR ] BOND: Primary data validation passed. [2025-09-23T17:42:16.615041] [INFO ] [MAIN ] BOND: Fetched primary data is valid. [2025-09-23T17:42:16.615181] [DEBUG] [LOCAL ] BOND: Saving primary data. [2025-09-23T17:42:16.616314] [DEBUG] [LOCAL ] BOND: Trimmed 46291 records to 32076 (keeping 200 days of data) [2025-09-23T17:42:16.832777] [DEBUG] [LOCAL ] BOND: Primary data saved (32076 records). [2025-09-23T17:42:16.833063] [INFO ] [MAIN ] BOND: Full history saved. [2025-09-23T17:42:16.833356] [INFO ] [MAIN ] Update Progress: 322/2372 symbols completed. BOND took 28.0s. Estimated remaining: 4h 28m 50s. Rate: 7.6 symbols/min [2025-09-23T17:42:16.970732] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-23T17:42:17.005245] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-01. [2025-09-23T17:42:17.060358] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:42:17.094121] [DEBUG] [LOCAL ] BOW: Loaded 23622 existing records from primary storage. [2025-09-23T17:42:17.094385] [INFO ] [MAIN ] BOW: Loaded 23622 existing records. [2025-09-23T17:42:17.299727] [WARN ] [MAIN ] BOW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:42:17.300457] [INFO ] [MAIN ] BOW: Wiping existing primary data before full refresh. [2025-09-23T17:42:17.300676] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-09-23T17:42:17.301586] [DEBUG] [LOCAL ] BOW: Deleted primary data file. [2025-09-23T17:42:17.301749] [INFO ] [MAIN ] BOW: Starting full primary refresh. [2025-09-23T17:42:17.435177] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-23T17:42:17.701775] [INFO ] [REMOTE ] BOW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:42:17.802195] [INFO ] [REMOTE ] BOW: Fetching primary data for 2024-12. [2025-09-23T17:42:18.497895] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-23T17:42:18.560154] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-23T17:42:18.602170] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-02. [2025-09-23T17:42:19.402189] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-09. [2025-09-23T17:42:19.917624] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-23T17:42:20.202193] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-09. [2025-09-23T17:42:20.474167] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-23T17:42:20.480544] [INFO ] [REMOTE ] BOH: Full fetch complete (44846 records). [2025-09-23T17:42:20.480669] [DEBUG] [VALIDATOR ] BOH: Validating primary data. [2025-09-23T17:42:20.852686] [DEBUG] [VALIDATOR ] BOH: All expected trading days are present. [2025-09-23T17:42:20.852774] [DEBUG] [VALIDATOR ] BOH: Primary data validation passed. [2025-09-23T17:42:20.853279] [INFO ] [MAIN ] BOH: Fetched primary data is valid. [2025-09-23T17:42:20.853319] [DEBUG] [LOCAL ] BOH: Saving primary data. [2025-09-23T17:42:20.854300] [DEBUG] [LOCAL ] BOH: Trimmed 44846 records to 31414 (keeping 200 days of data) [2025-09-23T17:42:21.028368] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-03. [2025-09-23T17:42:21.068914] [DEBUG] [LOCAL ] BOH: Primary data saved (31414 records). [2025-09-23T17:42:21.069052] [INFO ] [MAIN ] BOH: Full history saved. [2025-09-23T17:42:21.069174] [INFO ] [MAIN ] Update Progress: 323/2372 symbols completed. BOH took 32.3s. Estimated remaining: 4h 28m 19s. Rate: 7.6 symbols/min [2025-09-23T17:42:21.248175] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:42:21.300350] [DEBUG] [LOCAL ] BOX: Loaded 50341 existing records from primary storage. [2025-09-23T17:42:21.300491] [INFO ] [MAIN ] BOX: Loaded 50341 existing records. [2025-09-23T17:42:21.484267] [WARN ] [MAIN ] BOX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:42:21.484599] [INFO ] [MAIN ] BOX: Wiping existing primary data before full refresh. [2025-09-23T17:42:21.484705] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-09-23T17:42:21.486618] [DEBUG] [LOCAL ] BOX: Deleted primary data file. [2025-09-23T17:42:21.486721] [INFO ] [MAIN ] BOX: Starting full primary refresh. [2025-09-23T17:42:21.816220] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-01. [2025-09-23T17:42:21.830792] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-23T17:42:21.880836] [INFO ] [REMOTE ] BOX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:42:21.884693] [INFO ] [REMOTE ] BOOT: Full fetch complete (60345 records). [2025-09-23T17:42:21.884827] [DEBUG] [VALIDATOR ] BOOT: Validating primary data. [2025-09-23T17:42:22.282160] [DEBUG] [VALIDATOR ] BOOT: All expected trading days are present. [2025-09-23T17:42:22.282329] [DEBUG] [VALIDATOR ] BOOT: Primary data validation passed. [2025-09-23T17:42:22.283002] [INFO ] [MAIN ] BOOT: Fetched primary data is valid. [2025-09-23T17:42:22.283812] [DEBUG] [LOCAL ] BOOT: Saving primary data. [2025-09-23T17:42:22.285371] [DEBUG] [LOCAL ] BOOT: Trimmed 60345 records to 40931 (keeping 200 days of data) [2025-09-23T17:42:22.431600] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-23T17:42:22.563265] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-23T17:42:22.604681] [INFO ] [REMOTE ] BOX: Fetching primary data for 2024-12. [2025-09-23T17:42:22.607373] [DEBUG] [LOCAL ] BOOT: Primary data saved (40931 records). [2025-09-23T17:42:22.607488] [INFO ] [MAIN ] BOOT: Full history saved. [2025-09-23T17:42:22.607614] [INFO ] [MAIN ] Update Progress: 324/2372 symbols completed. BOOT took 33.8s. Estimated remaining: 4h 27m 31s. Rate: 7.7 symbols/min [2025-09-23T17:42:22.778119] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:42:22.835137] [DEBUG] [LOCAL ] BP: Loaded 53711 existing records from primary storage. [2025-09-23T17:42:22.835311] [INFO ] [MAIN ] BP: Loaded 53711 existing records. [2025-09-23T17:42:23.082888] [WARN ] [MAIN ] BP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:42:23.083150] [INFO ] [MAIN ] BP: Wiping existing primary data before full refresh. [2025-09-23T17:42:23.083198] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-09-23T17:42:23.084860] [DEBUG] [LOCAL ] BP: Deleted primary data file. [2025-09-23T17:42:23.084923] [INFO ] [MAIN ] BP: Starting full primary refresh. [2025-09-23T17:42:23.407393] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-02. [2025-09-23T17:42:23.472365] [INFO ] [REMOTE ] BP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:42:24.018991] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-23T17:42:24.202205] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-03. [2025-09-23T17:42:24.379704] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-23T17:42:25.002210] [INFO ] [REMOTE ] BP: Fetching primary data for 2024-12. [2025-09-23T17:42:25.168824] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-23T17:42:25.802269] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-04. [2025-09-23T17:42:26.602272] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-01. [2025-09-23T17:42:26.770850] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-23T17:42:27.187915] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-23T17:42:27.402203] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-01. [2025-09-23T17:42:28.003999] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-23T17:42:28.202203] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-02. [2025-09-23T17:42:29.002215] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-05. [2025-09-23T17:42:29.178540] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-23T17:42:29.340045] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-23T17:42:29.802213] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-04. [2025-09-23T17:42:30.502047] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-23T17:42:30.602219] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-03. [2025-09-23T17:42:30.789482] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-23T17:42:31.402226] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-05. [2025-09-23T17:42:32.197427] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-23T17:42:32.207694] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-06. [2025-09-23T17:42:32.226245] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-23T17:42:33.002205] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-06. [2025-09-23T17:42:33.714882] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-23T17:42:33.802161] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-07. [2025-09-23T17:42:33.914246] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-23T17:42:34.429776] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-23T17:42:34.602213] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-02. [2025-09-23T17:42:35.402204] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-07. [2025-09-23T17:42:36.146155] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-23T17:42:36.202190] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-03. [2025-09-23T17:42:37.002202] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-08. [2025-09-23T17:42:37.213395] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-23T17:42:37.802208] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-08. [2025-09-23T17:42:37.860097] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-23T17:42:38.003496] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-23T17:42:38.602196] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-09. [2025-09-23T17:42:39.314227] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-23T17:42:39.391058] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-23T17:42:39.395176] [INFO ] [REMOTE ] BOW: Full fetch complete (31126 records). [2025-09-23T17:42:39.395262] [DEBUG] [VALIDATOR ] BOW: Validating primary data. [2025-09-23T17:42:39.407292] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-04. [2025-09-23T17:42:39.766385] [DEBUG] [VALIDATOR ] BOW: All expected trading days are present. [2025-09-23T17:42:39.766463] [DEBUG] [VALIDATOR ] BOW: Primary data validation passed. [2025-09-23T17:42:39.766901] [INFO ] [MAIN ] BOW: Fetched primary data is valid. [2025-09-23T17:42:39.766964] [DEBUG] [LOCAL ] BOW: Saving primary data. [2025-09-23T17:42:39.767743] [DEBUG] [LOCAL ] BOW: Trimmed 31126 records to 23640 (keeping 200 days of data) [2025-09-23T17:42:39.903140] [DEBUG] [LOCAL ] BOW: Primary data saved (23640 records). [2025-09-23T17:42:39.903268] [INFO ] [MAIN ] BOW: Full history saved. [2025-09-23T17:42:39.903353] [INFO ] [MAIN ] Update Progress: 325/2372 symbols completed. BOW took 23.1s. Estimated remaining: 4h 28m 23s. Rate: 7.6 symbols/min [2025-09-23T17:42:40.070106] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:42:40.115007] [DEBUG] [LOCAL ] BR: Loaded 34832 existing records from primary storage. [2025-09-23T17:42:40.115165] [INFO ] [MAIN ] BR: Loaded 34832 existing records. [2025-09-23T17:42:40.210395] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-09. [2025-09-23T17:42:40.291182] [WARN ] [MAIN ] BR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:42:40.291457] [INFO ] [MAIN ] BR: Wiping existing primary data before full refresh. [2025-09-23T17:42:40.291505] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-09-23T17:42:40.292671] [DEBUG] [LOCAL ] BR: Deleted primary data file. [2025-09-23T17:42:40.292734] [INFO ] [MAIN ] BR: Starting full primary refresh. [2025-09-23T17:42:40.644587] [INFO ] [REMOTE ] BR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:42:41.002187] [INFO ] [REMOTE ] BR: Fetching primary data for 2024-12. [2025-09-23T17:42:41.349696] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-23T17:42:41.664905] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-23T17:42:41.673605] [INFO ] [REMOTE ] BORR: Full fetch complete (74772 records). [2025-09-23T17:42:41.673805] [DEBUG] [VALIDATOR ] BORR: Validating primary data. [2025-09-23T17:42:41.807319] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-04. [2025-09-23T17:42:42.105439] [DEBUG] [VALIDATOR ] BORR: All expected trading days are present. [2025-09-23T17:42:42.105595] [DEBUG] [VALIDATOR ] BORR: Primary data validation passed. [2025-09-23T17:42:42.106836] [INFO ] [MAIN ] BORR: Fetched primary data is valid. [2025-09-23T17:42:42.106989] [DEBUG] [LOCAL ] BORR: Saving primary data. [2025-09-23T17:42:42.108909] [DEBUG] [LOCAL ] BORR: Trimmed 74772 records to 51182 (keeping 200 days of data) [2025-09-23T17:42:42.221294] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-23T17:42:42.435197] [DEBUG] [LOCAL ] BORR: Primary data saved (51182 records). [2025-09-23T17:42:42.435362] [INFO ] [MAIN ] BORR: Full history saved. [2025-09-23T17:42:42.435459] [INFO ] [MAIN ] Update Progress: 326/2372 symbols completed. BORR took 34.4s. Estimated remaining: 4h 27m 42s. Rate: 7.6 symbols/min [2025-09-23T17:42:42.605267] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:42:42.605398] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-05. [2025-09-23T17:42:42.657450] [DEBUG] [LOCAL ] BRBR: Loaded 51236 existing records from primary storage. [2025-09-23T17:42:42.657605] [INFO ] [MAIN ] BRBR: Loaded 51236 existing records. [2025-09-23T17:42:42.839478] [WARN ] [MAIN ] BRBR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:42:42.839796] [INFO ] [MAIN ] BRBR: Wiping existing primary data before full refresh. [2025-09-23T17:42:42.839849] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-09-23T17:42:42.841434] [DEBUG] [LOCAL ] BRBR: Deleted primary data file. [2025-09-23T17:42:42.841498] [INFO ] [MAIN ] BRBR: Starting full primary refresh. [2025-09-23T17:42:43.193531] [INFO ] [REMOTE ] BRBR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:42:43.294269] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-23T17:42:43.402166] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-05. [2025-09-23T17:42:44.202255] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2024-12. [2025-09-23T17:42:44.502735] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-23T17:42:45.002209] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-01. [2025-09-23T17:42:45.063234] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-23T17:42:45.537033] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-23T17:42:45.802203] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-01. [2025-09-23T17:42:46.123554] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-23T17:42:46.602194] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-02. [2025-09-23T17:42:47.055160] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-23T17:42:47.402204] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-06. [2025-09-23T17:42:47.526800] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-23T17:42:48.202199] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-03. [2025-09-23T17:42:48.640310] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-23T17:42:49.002242] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-02. [2025-09-23T17:42:49.800583] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-23T17:42:49.809402] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-07. [2025-09-23T17:42:50.408881] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-23T17:42:50.602237] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-03. [2025-09-23T17:42:51.132764] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-23T17:42:51.402208] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-04. [2025-09-23T17:42:52.202160] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-06. [2025-09-23T17:42:52.204873] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-23T17:42:52.720045] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-23T17:42:53.002207] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-08. [2025-09-23T17:42:53.802237] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-04. [2025-09-23T17:42:54.212556] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-23T17:42:54.346848] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-23T17:42:54.602152] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-09. [2025-09-23T17:42:55.059377] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-23T17:42:55.402214] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-05. [2025-09-23T17:42:56.004900] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-23T17:42:56.013582] [INFO ] [REMOTE ] BOX: Full fetch complete (72163 records). [2025-09-23T17:42:56.013742] [DEBUG] [VALIDATOR ] BOX: Validating primary data. [2025-09-23T17:42:56.204716] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-05. [2025-09-23T17:42:56.427532] [DEBUG] [VALIDATOR ] BOX: All expected trading days are present. [2025-09-23T17:42:56.427618] [DEBUG] [VALIDATOR ] BOX: Primary data validation passed. [2025-09-23T17:42:56.428440] [INFO ] [MAIN ] BOX: Fetched primary data is valid. [2025-09-23T17:42:56.428506] [DEBUG] [LOCAL ] BOX: Saving primary data. [2025-09-23T17:42:56.429963] [DEBUG] [LOCAL ] BOX: Trimmed 72163 records to 50321 (keeping 200 days of data) [2025-09-23T17:42:56.666882] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-23T17:42:56.759380] [DEBUG] [LOCAL ] BOX: Primary data saved (50321 records). [2025-09-23T17:42:56.759520] [INFO ] [MAIN ] BOX: Full history saved. [2025-09-23T17:42:56.759604] [INFO ] [MAIN ] Update Progress: 327/2372 symbols completed. BOX took 35.7s. Estimated remaining: 4h 28m 14s. Rate: 7.6 symbols/min [2025-09-23T17:42:56.936941] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:42:56.956331] [DEBUG] [LOCAL ] BRC: Loaded 19492 existing records from primary storage. [2025-09-23T17:42:56.956457] [INFO ] [MAIN ] BRC: Loaded 19492 existing records. [2025-09-23T17:42:57.009950] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-07. [2025-09-23T17:42:57.136921] [WARN ] [MAIN ] BRC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:42:57.137141] [INFO ] [MAIN ] BRC: Wiping existing primary data before full refresh. [2025-09-23T17:42:57.137189] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-09-23T17:42:57.137847] [DEBUG] [LOCAL ] BRC: Deleted primary data file. [2025-09-23T17:42:57.137909] [INFO ] [MAIN ] BRC: Starting full primary refresh. [2025-09-23T17:42:57.545814] [INFO ] [REMOTE ] BRC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:42:57.775633] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-23T17:42:57.802246] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-06. [2025-09-23T17:42:58.602314] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-06. [2025-09-23T17:42:58.945991] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-23T17:42:59.065081] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-23T17:42:59.402236] [INFO ] [REMOTE ] BRC: Fetching primary data for 2024-12. [2025-09-23T17:42:59.906378] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-23T17:43:00.202199] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-07. [2025-09-23T17:43:01.002274] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-23T17:43:01.002439] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-07. [2025-09-23T17:43:01.591409] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-23T17:43:01.802196] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-08. [2025-09-23T17:43:02.379868] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-23T17:43:02.602209] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-08. [2025-09-23T17:43:03.242326] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-23T17:43:03.402158] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-09. [2025-09-23T17:43:04.202252] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-08. [2025-09-23T17:43:04.939326] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-09-23T17:43:04.976806] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-23T17:43:04.985814] [INFO ] [REMOTE ] BRBR: Full fetch complete (71740 records). [2025-09-23T17:43:04.985981] [DEBUG] [VALIDATOR ] BRBR: Validating primary data. [2025-09-23T17:43:05.007564] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-01. [2025-09-23T17:43:05.403828] [DEBUG] [VALIDATOR ] BRBR: All expected trading days are present. [2025-09-23T17:43:05.403951] [DEBUG] [VALIDATOR ] BRBR: Primary data validation passed. [2025-09-23T17:43:05.404802] [INFO ] [MAIN ] BRBR: Fetched primary data is valid. [2025-09-23T17:43:05.404885] [DEBUG] [LOCAL ] BRBR: Saving primary data. [2025-09-23T17:43:05.406434] [DEBUG] [LOCAL ] BRBR: Trimmed 71740 records to 51231 (keeping 200 days of data) [2025-09-23T17:43:05.522193] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-23T17:43:05.731369] [DEBUG] [LOCAL ] BRBR: Primary data saved (51231 records). [2025-09-23T17:43:05.731524] [INFO ] [MAIN ] BRBR: Full history saved. [2025-09-23T17:43:05.731610] [INFO ] [MAIN ] Update Progress: 328/2372 symbols completed. BRBR took 23.3s. Estimated remaining: 4h 28m 13s. Rate: 7.6 symbols/min [2025-09-23T17:43:05.807319] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-09. [2025-09-23T17:43:05.923975] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:43:05.964736] [DEBUG] [LOCAL ] BRCC: Loaded 40430 existing records from primary storage. [2025-09-23T17:43:05.964901] [INFO ] [MAIN ] BRCC: Loaded 40430 existing records. [2025-09-23T17:43:06.166496] [WARN ] [MAIN ] BRCC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:43:06.166836] [INFO ] [MAIN ] BRCC: Wiping existing primary data before full refresh. [2025-09-23T17:43:06.166891] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-09-23T17:43:06.167936] [DEBUG] [LOCAL ] BRCC: Deleted primary data file. [2025-09-23T17:43:06.167999] [INFO ] [MAIN ] BRCC: Starting full primary refresh. [2025-09-23T17:43:06.312196] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-23T17:43:06.550706] [INFO ] [REMOTE ] BRCC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:43:06.602155] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2024-12. [2025-09-23T17:43:07.028968] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-23T17:43:07.035412] [INFO ] [REMOTE ] BR: Full fetch complete (48985 records). [2025-09-23T17:43:07.035543] [DEBUG] [VALIDATOR ] BR: Validating primary data. [2025-09-23T17:43:07.414296] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-09. [2025-09-23T17:43:07.467761] [DEBUG] [VALIDATOR ] BR: All expected trading days are present. [2025-09-23T17:43:07.467845] [DEBUG] [VALIDATOR ] BR: Primary data validation passed. [2025-09-23T17:43:07.468469] [INFO ] [MAIN ] BR: Fetched primary data is valid. [2025-09-23T17:43:07.468532] [DEBUG] [LOCAL ] BR: Saving primary data. [2025-09-23T17:43:07.469599] [DEBUG] [LOCAL ] BR: Trimmed 48985 records to 34778 (keeping 200 days of data) [2025-09-23T17:43:07.700343] [DEBUG] [LOCAL ] BR: Primary data saved (34778 records). [2025-09-23T17:43:07.700498] [INFO ] [MAIN ] BR: Full history saved. [2025-09-23T17:43:07.701843] [INFO ] [MAIN ] Update Progress: 329/2372 symbols completed. BR took 27.8s. Estimated remaining: 4h 27m 29s. Rate: 7.6 symbols/min [2025-09-23T17:43:07.889359] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:43:07.962371] [DEBUG] [LOCAL ] BRO: Loaded 51919 existing records from primary storage. [2025-09-23T17:43:07.962733] [INFO ] [MAIN ] BRO: Loaded 51919 existing records. [2025-09-23T17:43:08.146187] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-23T17:43:08.185950] [WARN ] [MAIN ] BRO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:43:08.186573] [INFO ] [MAIN ] BRO: Wiping existing primary data before full refresh. [2025-09-23T17:43:08.186623] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-09-23T17:43:08.188064] [DEBUG] [LOCAL ] BRO: Deleted primary data file. [2025-09-23T17:43:08.188125] [INFO ] [MAIN ] BRO: Starting full primary refresh. [2025-09-23T17:43:08.208772] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-01. [2025-09-23T17:43:08.552241] [INFO ] [REMOTE ] BRO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:43:09.002229] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-02. [2025-09-23T17:43:09.231045] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-23T17:43:09.240270] [INFO ] [REMOTE ] BP: Full fetch complete (77763 records). [2025-09-23T17:43:09.240415] [DEBUG] [VALIDATOR ] BP: Validating primary data. [2025-09-23T17:43:09.658278] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-23T17:43:09.689948] [DEBUG] [VALIDATOR ] BP: All expected trading days are present. [2025-09-23T17:43:09.690315] [DEBUG] [VALIDATOR ] BP: Primary data validation passed. [2025-09-23T17:43:09.691157] [INFO ] [MAIN ] BP: Fetched primary data is valid. [2025-09-23T17:43:09.691228] [DEBUG] [LOCAL ] BP: Saving primary data. [2025-09-23T17:43:09.693348] [DEBUG] [LOCAL ] BP: Trimmed 77763 records to 53711 (keeping 200 days of data) [2025-09-23T17:43:09.802359] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-02. [2025-09-23T17:43:09.822418] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-23T17:43:10.050105] [DEBUG] [LOCAL ] BP: Primary data saved (53711 records). [2025-09-23T17:43:10.050313] [INFO ] [MAIN ] BP: Full history saved. [2025-09-23T17:43:10.050415] [INFO ] [MAIN ] Update Progress: 330/2372 symbols completed. BP took 47.4s. Estimated remaining: 4h 26m 47s. Rate: 7.7 symbols/min [2025-09-23T17:43:10.234152] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:43:10.287582] [DEBUG] [LOCAL ] BROS: Loaded 53287 existing records from primary storage. [2025-09-23T17:43:10.287783] [INFO ] [MAIN ] BROS: Loaded 53287 existing records. [2025-09-23T17:43:10.480391] [WARN ] [MAIN ] BROS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:43:10.480709] [INFO ] [MAIN ] BROS: Wiping existing primary data before full refresh. [2025-09-23T17:43:10.480765] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-09-23T17:43:10.481842] [DEBUG] [LOCAL ] BROS: Deleted primary data file. [2025-09-23T17:43:10.481902] [INFO ] [MAIN ] BROS: Starting full primary refresh. [2025-09-23T17:43:10.607369] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-03. [2025-09-23T17:43:10.853632] [INFO ] [REMOTE ] BROS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:43:10.873853] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-23T17:43:11.402301] [INFO ] [REMOTE ] BRO: Fetching primary data for 2024-12. [2025-09-23T17:43:11.733789] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-23T17:43:12.202200] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-04. [2025-09-23T17:43:13.002207] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-03. [2025-09-23T17:43:13.079248] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-23T17:43:13.176932] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-23T17:43:13.802210] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-01. [2025-09-23T17:43:14.184148] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-23T17:43:14.602230] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-04. [2025-09-23T17:43:15.203568] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-23T17:43:15.402214] [INFO ] [REMOTE ] BROS: Fetching primary data for 2024-12. [2025-09-23T17:43:15.639709] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-23T17:43:16.202254] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-05. [2025-09-23T17:43:16.957949] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-23T17:43:17.002211] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-01. [2025-09-23T17:43:17.370815] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-23T17:43:17.802224] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-06. [2025-09-23T17:43:18.512877] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-23T17:43:18.602263] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-02. [2025-09-23T17:43:18.975609] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-23T17:43:19.402272] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-02. [2025-09-23T17:43:19.827131] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-23T17:43:20.202217] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-03. [2025-09-23T17:43:20.914396] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-23T17:43:21.002224] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-05. [2025-09-23T17:43:21.714065] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-23T17:43:21.802237] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-04. [2025-09-23T17:43:22.248458] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-23T17:43:22.602201] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-03. [2025-09-23T17:43:23.402188] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-06. [2025-09-23T17:43:23.472251] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-23T17:43:24.041159] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-23T17:43:24.202763] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-07. [2025-09-23T17:43:24.348900] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-23T17:43:24.834470] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-23T17:43:25.002213] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-05. [2025-09-23T17:43:25.802201] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-07. [2025-09-23T17:43:26.427383] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-23T17:43:26.602232] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-08. [2025-09-23T17:43:26.945901] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-23T17:43:27.216788] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-23T17:43:27.402203] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-04. [2025-09-23T17:43:28.202229] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-08. [2025-09-23T17:43:29.002193] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-09. [2025-09-23T17:43:29.059489] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-23T17:43:29.475483] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-23T17:43:29.802352] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-06. [2025-09-23T17:43:29.824057] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-23T17:43:29.827783] [INFO ] [REMOTE ] BRC: Full fetch complete (29147 records). [2025-09-23T17:43:29.827887] [DEBUG] [VALIDATOR ] BRC: Validating primary data. [2025-09-23T17:43:30.215431] [DEBUG] [VALIDATOR ] BRC: All expected trading days are present. [2025-09-23T17:43:30.215534] [DEBUG] [VALIDATOR ] BRC: Primary data validation passed. [2025-09-23T17:43:30.216125] [INFO ] [MAIN ] BRC: Fetched primary data is valid. [2025-09-23T17:43:30.216191] [DEBUG] [LOCAL ] BRC: Saving primary data. [2025-09-23T17:43:30.217282] [DEBUG] [LOCAL ] BRC: Trimmed 29147 records to 19365 (keeping 200 days of data) [2025-09-23T17:43:30.345224] [DEBUG] [LOCAL ] BRC: Primary data saved (19365 records). [2025-09-23T17:43:30.345460] [INFO ] [MAIN ] BRC: Full history saved. [2025-09-23T17:43:30.345585] [INFO ] [MAIN ] Update Progress: 331/2372 symbols completed. BRC took 33.6s. Estimated remaining: 4h 27m 56s. Rate: 7.6 symbols/min [2025-09-23T17:43:30.520926] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:43:30.521214] [DEBUG] [LOCAL ] BRSL: No existing data file found in primary storage. [2025-09-23T17:43:30.521252] [WARN ] [MAIN ] BRSL: No existing data found, performing full refresh instead. [2025-09-23T17:43:30.521441] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-09-23T17:43:30.521486] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-09-23T17:43:30.521530] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-09-23T17:43:30.521629] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-09-23T17:43:30.607397] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-05. [2025-09-23T17:43:30.928108] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:43:31.187470] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-23T17:43:31.402239] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-09. [2025-09-23T17:43:32.202253] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-07. [2025-09-23T17:43:32.809557] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-23T17:43:33.002205] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-06. [2025-09-23T17:43:33.028425] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-23T17:43:33.036263] [INFO ] [REMOTE ] BRCC: Full fetch complete (58038 records). [2025-09-23T17:43:33.036436] [DEBUG] [VALIDATOR ] BRCC: Validating primary data. [2025-09-23T17:43:33.441139] [DEBUG] [VALIDATOR ] BRCC: All expected trading days are present. [2025-09-23T17:43:33.441219] [DEBUG] [VALIDATOR ] BRCC: Primary data validation passed. [2025-09-23T17:43:33.441864] [INFO ] [MAIN ] BRCC: Fetched primary data is valid. [2025-09-23T17:43:33.441928] [DEBUG] [LOCAL ] BRCC: Saving primary data. [2025-09-23T17:43:33.443142] [DEBUG] [LOCAL ] BRCC: Trimmed 58038 records to 40441 (keeping 200 days of data) [2025-09-23T17:43:33.669618] [DEBUG] [LOCAL ] BRCC: Primary data saved (40441 records). [2025-09-23T17:43:33.669808] [INFO ] [MAIN ] BRCC: Full history saved. [2025-09-23T17:43:33.669902] [INFO ] [MAIN ] Update Progress: 332/2372 symbols completed. BRCC took 27.9s. Estimated remaining: 4h 27m 20s. Rate: 7.6 symbols/min [2025-09-23T17:43:33.816012] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2024-12. [2025-09-23T17:43:33.841418] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:43:33.879425] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-23T17:43:33.920491] [DEBUG] [LOCAL ] BRSP: Loaded 36916 existing records from primary storage. [2025-09-23T17:43:33.920670] [INFO ] [MAIN ] BRSP: Loaded 36916 existing records. [2025-09-23T17:43:34.063737] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:43:34.106189] [WARN ] [REMOTE ] BRSL: No data returned for month 2024-12 [2025-09-23T17:43:34.106400] [WARN ] [MAIN ] BRSP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:43:34.107514] [INFO ] [MAIN ] BRSP: Wiping existing primary data before full refresh. [2025-09-23T17:43:34.107581] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-09-23T17:43:34.108694] [DEBUG] [LOCAL ] BRSP: Deleted primary data file. [2025-09-23T17:43:34.108757] [INFO ] [MAIN ] BRSP: Starting full primary refresh. [2025-09-23T17:43:34.490765] [INFO ] [REMOTE ] BRSP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:43:34.602150] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2024-12. [2025-09-23T17:43:34.658782] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-23T17:43:35.402205] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-01. [2025-09-23T17:43:35.608242] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:43:35.608574] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-01 [2025-09-23T17:43:35.705295] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-23T17:43:36.202233] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-01. [2025-09-23T17:43:37.002180] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-08. [2025-09-23T17:43:37.164932] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-23T17:43:37.802247] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-02. [2025-09-23T17:43:38.602182] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-07. [2025-09-23T17:43:38.769419] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-23T17:43:38.855694] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-23T17:43:39.402191] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-03. [2025-09-23T17:43:40.202206] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-09. [2025-09-23T17:43:40.460190] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-23T17:43:40.552192] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-23T17:43:41.002189] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-04. [2025-09-23T17:43:41.630962] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-23T17:43:41.639767] [INFO ] [REMOTE ] BRO: Full fetch complete (74146 records). [2025-09-23T17:43:41.639913] [DEBUG] [VALIDATOR ] BRO: Validating primary data. [2025-09-23T17:43:41.810486] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-02. [2025-09-23T17:43:42.071102] [DEBUG] [VALIDATOR ] BRO: All expected trading days are present. [2025-09-23T17:43:42.071195] [DEBUG] [VALIDATOR ] BRO: Primary data validation passed. [2025-09-23T17:43:42.071992] [INFO ] [MAIN ] BRO: Fetched primary data is valid. [2025-09-23T17:43:42.072065] [DEBUG] [LOCAL ] BRO: Saving primary data. [2025-09-23T17:43:42.073771] [DEBUG] [LOCAL ] BRO: Trimmed 74146 records to 51916 (keeping 200 days of data) [2025-09-23T17:43:42.130453] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:43:42.166429] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-02 [2025-09-23T17:43:42.411916] [DEBUG] [LOCAL ] BRO: Primary data saved (51916 records). [2025-09-23T17:43:42.412054] [INFO ] [MAIN ] BRO: Full history saved. [2025-09-23T17:43:42.412592] [INFO ] [MAIN ] Update Progress: 333/2372 symbols completed. BRO took 34.7s. Estimated remaining: 4h 27m 18s. Rate: 7.6 symbols/min [2025-09-23T17:43:42.583961] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:43:42.606187] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-03. [2025-09-23T17:43:42.613147] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-23T17:43:42.626008] [DEBUG] [LOCAL ] BRT: Loaded 4876 existing records from primary storage. [2025-09-23T17:43:42.626426] [INFO ] [MAIN ] BRT: Loaded 4876 existing records. [2025-09-23T17:43:42.811400] [WARN ] [MAIN ] BRT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:43:42.811727] [INFO ] [MAIN ] BRT: Wiping existing primary data before full refresh. [2025-09-23T17:43:42.811784] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-09-23T17:43:42.812125] [DEBUG] [LOCAL ] BRT: Deleted primary data file. [2025-09-23T17:43:42.812187] [INFO ] [MAIN ] BRT: Starting full primary refresh. [2025-09-23T17:43:42.880851] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:43:42.903047] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-03 [2025-09-23T17:43:43.192598] [INFO ] [REMOTE ] BRT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:43:43.402208] [INFO ] [REMOTE ] BRT: Fetching primary data for 2024-12. [2025-09-23T17:43:43.963420] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-23T17:43:44.202218] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-05. [2025-09-23T17:43:45.002203] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-01. [2025-09-23T17:43:45.106529] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-23T17:43:45.406990] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-23T17:43:45.802230] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-06. [2025-09-23T17:43:46.602226] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-08. [2025-09-23T17:43:46.822587] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-23T17:43:47.402243] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-07. [2025-09-23T17:43:48.205835] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-02. [2025-09-23T17:43:48.211607] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-23T17:43:48.426863] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-23T17:43:48.545786] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-23T17:43:49.002217] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-04. [2025-09-23T17:43:49.206242] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:43:49.206546] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-04 [2025-09-23T17:43:49.802248] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-08. [2025-09-23T17:43:50.602235] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-05. [2025-09-23T17:43:50.800778] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:43:50.801276] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-05 [2025-09-23T17:43:50.968634] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-23T17:43:51.402218] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-09. [2025-09-23T17:43:52.202281] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-09. [2025-09-23T17:43:53.002218] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-03. [2025-09-23T17:43:53.163294] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-23T17:43:53.169282] [INFO ] [REMOTE ] BRSP: Full fetch complete (53642 records). [2025-09-23T17:43:53.169411] [DEBUG] [VALIDATOR ] BRSP: Validating primary data. [2025-09-23T17:43:53.170156] [FATAL] [VALIDATOR ] BRSP: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:43:53.170245] [FATAL] [MAIN ] BRSP: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:43:53.170303] [WARN ] [MAIN ] BRSP: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:43:53.170394] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-09-23T17:43:53.170474] [DEBUG] [LOCAL ] BRSP: No primary data file found to delete. [2025-09-23T17:43:53.170537] [INFO ] [LOCAL ] BRSP: Starting deletion of derivative data. [2025-09-23T17:43:53.171174] [DEBUG] [LOCAL ] BRSP: Deleted derivative data file. [2025-09-23T17:43:53.171288] [INFO ] [MAIN ] Update Progress: 334/2372 symbols completed. BRSP took 19.5s. Estimated remaining: 4h 27m 27s. Rate: 7.6 symbols/min [2025-09-23T17:43:53.354174] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:43:53.374677] [DEBUG] [LOCAL ] BRW: Loaded 19139 existing records from primary storage. [2025-09-23T17:43:53.374820] [INFO ] [MAIN ] BRW: Loaded 19139 existing records. [2025-09-23T17:43:53.491892] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-23T17:43:53.580888] [WARN ] [MAIN ] BRW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:43:53.581505] [INFO ] [MAIN ] BRW: Wiping existing primary data before full refresh. [2025-09-23T17:43:53.581639] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-09-23T17:43:53.591666] [DEBUG] [LOCAL ] BRW: Deleted primary data file. [2025-09-23T17:43:53.606727] [INFO ] [MAIN ] BRW: Starting full primary refresh. [2025-09-23T17:43:53.682095] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-09-23T17:43:53.733734] [INFO ] [REMOTE ] BROS: Full fetch complete (76572 records). [2025-09-23T17:43:53.749404] [DEBUG] [VALIDATOR ] BROS: Validating primary data. [2025-09-23T17:43:53.777899] [FATAL] [VALIDATOR ] BROS: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:43:53.793896] [FATAL] [MAIN ] BROS: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:43:53.795960] [WARN ] [MAIN ] BROS: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:43:53.810862] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-06. [2025-09-23T17:43:53.820988] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-09-23T17:43:53.862900] [DEBUG] [LOCAL ] BROS: No primary data file found to delete. [2025-09-23T17:43:53.875764] [INFO ] [LOCAL ] BROS: Starting deletion of derivative data. [2025-09-23T17:43:53.902819] [DEBUG] [LOCAL ] BROS: Deleted derivative data file. [2025-09-23T17:43:53.924726] [INFO ] [MAIN ] Update Progress: 335/2372 symbols completed. BROS took 43.9s. Estimated remaining: 4h 26m 36s. Rate: 7.6 symbols/min [2025-09-23T17:43:54.128523] [INFO ] [REMOTE ] BRW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:43:54.145942] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:43:54.186673] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-06 [2025-09-23T17:43:54.190331] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:43:54.240832] [DEBUG] [LOCAL ] BRX: Loaded 51826 existing records from primary storage. [2025-09-23T17:43:54.241048] [INFO ] [MAIN ] BRX: Loaded 51826 existing records. [2025-09-23T17:43:54.430350] [WARN ] [MAIN ] BRX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:43:54.430630] [INFO ] [MAIN ] BRX: Wiping existing primary data before full refresh. [2025-09-23T17:43:54.430715] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-09-23T17:43:54.432215] [DEBUG] [LOCAL ] BRX: Deleted primary data file. [2025-09-23T17:43:54.432281] [INFO ] [MAIN ] BRX: Starting full primary refresh. [2025-09-23T17:43:54.612749] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-07. [2025-09-23T17:43:54.808297] [INFO ] [REMOTE ] BRX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:43:55.402207] [INFO ] [REMOTE ] BRX: Fetching primary data for 2024-12. [2025-09-23T17:43:56.054863] [INFO ] [REMOTE ] BRSL: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-23T17:43:56.202202] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-08. [2025-09-23T17:43:56.789803] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-23T17:43:57.002208] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-01. [2025-09-23T17:43:57.395785] [INFO ] [REMOTE ] BRSL: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-23T17:43:57.802268] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-09. [2025-09-23T17:43:58.602265] [INFO ] [REMOTE ] BRW: Fetching primary data for 2024-12. [2025-09-23T17:43:58.654829] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-23T17:43:59.061113] [INFO ] [REMOTE ] BRSL: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-23T17:43:59.069001] [INFO ] [REMOTE ] BRSL: Full fetch complete (21252 records). [2025-09-23T17:43:59.069076] [DEBUG] [VALIDATOR ] BRSL: Validating primary data. [2025-09-23T17:43:59.249396] [WARN ] [VALIDATOR ] BRSL: Validation failed - insufficient historical data. Have 58 unique days, need 200 days [2025-09-23T17:43:59.249752] [FATAL] [MAIN ] BRSL: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:43:59.249823] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:43:59.249893] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-09-23T17:43:59.250018] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-09-23T17:43:59.250073] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-09-23T17:43:59.250117] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-09-23T17:43:59.250174] [INFO ] [MAIN ] Update Progress: 336/2372 symbols completed. BRSL took 28.9s. Estimated remaining: 4h 26m 13s. Rate: 7.6 symbols/min [2025-09-23T17:43:59.417111] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:43:59.417324] [DEBUG] [LOCAL ] BSAC: No existing data file found in primary storage. [2025-09-23T17:43:59.417453] [WARN ] [MAIN ] BSAC: No existing data found, performing full refresh instead. [2025-09-23T17:43:59.413124] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-04. [2025-09-23T17:43:59.418802] [INFO ] [MAIN ] BSAC: Wiping existing primary data before full refresh. [2025-09-23T17:43:59.418964] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-09-23T17:43:59.419087] [DEBUG] [LOCAL ] BSAC: No primary data file found to delete. [2025-09-23T17:43:59.419190] [INFO ] [MAIN ] BSAC: Starting full primary refresh. [2025-09-23T17:43:59.585231] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-23T17:43:59.790746] [INFO ] [REMOTE ] BSAC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:44:00.014593] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-23T17:44:00.202225] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-05. [2025-09-23T17:44:00.627945] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-23T17:44:01.002248] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-06. [2025-09-23T17:44:01.580291] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-23T17:44:01.802347] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2024-12. [2025-09-23T17:44:02.597324] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-23T17:44:02.602138] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-01. [2025-09-23T17:44:03.398952] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-23T17:44:03.403827] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-02. [2025-09-23T17:44:04.202162] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-01. [2025-09-23T17:44:04.606456] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-23T17:44:04.969277] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-23T17:44:05.002142] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-02. [2025-09-23T17:44:05.802303] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-03. [2025-09-23T17:44:06.602168] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-02. [2025-09-23T17:44:06.649607] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-23T17:44:07.128101] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-23T17:44:07.402159] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-03. [2025-09-23T17:44:07.797120] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-23T17:44:08.202235] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-07. [2025-09-23T17:44:08.810515] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-23T17:44:08.869391] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-23T17:44:09.002233] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-03. [2025-09-23T17:44:09.802175] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-08. [2025-09-23T17:44:10.024871] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-23T17:44:10.299927] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-23T17:44:10.602194] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-04. [2025-09-23T17:44:11.402227] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-09. [2025-09-23T17:44:11.905716] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-23T17:44:11.907610] [INFO ] [REMOTE ] BRT: Full fetch complete (6816 records). [2025-09-23T17:44:11.907761] [DEBUG] [VALIDATOR ] BRT: Validating primary data. [2025-09-23T17:44:12.207343] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-04. [2025-09-23T17:44:12.317686] [DEBUG] [VALIDATOR ] BRT: All expected trading days are present. [2025-09-23T17:44:12.317953] [DEBUG] [VALIDATOR ] BRT: Primary data validation passed. [2025-09-23T17:44:12.318338] [INFO ] [MAIN ] BRT: Fetched primary data is valid. [2025-09-23T17:44:12.318423] [DEBUG] [LOCAL ] BRT: Saving primary data. [2025-09-23T17:44:12.319380] [DEBUG] [LOCAL ] BRT: Trimmed 6816 records to 4949 (keeping 200 days of data) [2025-09-23T17:44:12.396313] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-23T17:44:12.418364] [DEBUG] [LOCAL ] BRT: Primary data saved (4949 records). [2025-09-23T17:44:12.418676] [INFO ] [MAIN ] BRT: Full history saved. [2025-09-23T17:44:12.418875] [INFO ] [MAIN ] Update Progress: 337/2372 symbols completed. BRT took 30.0s. Estimated remaining: 4h 26m 37s. Rate: 7.6 symbols/min [2025-09-23T17:44:12.619428] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:44:12.619770] [DEBUG] [LOCAL ] BSBR: No existing data file found in primary storage. [2025-09-23T17:44:12.619831] [WARN ] [MAIN ] BSBR: No existing data found, performing full refresh instead. [2025-09-23T17:44:12.620006] [INFO ] [MAIN ] BSBR: Wiping existing primary data before full refresh. [2025-09-23T17:44:12.620066] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-09-23T17:44:12.620137] [DEBUG] [LOCAL ] BSBR: No primary data file found to delete. [2025-09-23T17:44:12.620176] [INFO ] [MAIN ] BSBR: Starting full primary refresh. [2025-09-23T17:44:13.007421] [INFO ] [REMOTE ] BSBR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:44:13.002464] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-04. [2025-09-23T17:44:13.135033] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-23T17:44:13.802277] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2024-12. [2025-09-23T17:44:14.194018] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-23T17:44:14.602206] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-05. [2025-09-23T17:44:14.758626] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-23T17:44:15.402200] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-01. [2025-09-23T17:44:15.558894] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-23T17:44:16.202212] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-05. [2025-09-23T17:44:16.389355] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-23T17:44:17.002200] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-05. [2025-09-23T17:44:17.117016] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-23T17:44:17.802195] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-02. [2025-09-23T17:44:18.607316] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-06. [2025-09-23T17:44:18.617584] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-23T17:44:18.872890] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-23T17:44:19.219836] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-23T17:44:19.402193] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-06. [2025-09-23T17:44:20.202199] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-07. [2025-09-23T17:44:20.730441] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-23T17:44:21.002197] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-03. [2025-09-23T17:44:21.489725] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-23T17:44:21.802205] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-07. [2025-09-23T17:44:21.841837] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-23T17:44:22.602233] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-08. [2025-09-23T17:44:23.168702] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-23T17:44:23.342965] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-23T17:44:23.402155] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-09. [2025-09-23T17:44:24.186261] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-23T17:44:24.190538] [INFO ] [REMOTE ] BRW: Full fetch complete (29316 records). [2025-09-23T17:44:24.190636] [DEBUG] [VALIDATOR ] BRW: Validating primary data. [2025-09-23T17:44:24.207344] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-04. [2025-09-23T17:44:24.581996] [DEBUG] [VALIDATOR ] BRW: All expected trading days are present. [2025-09-23T17:44:24.582094] [DEBUG] [VALIDATOR ] BRW: Primary data validation passed. [2025-09-23T17:44:24.582613] [INFO ] [MAIN ] BRW: Fetched primary data is valid. [2025-09-23T17:44:24.582754] [DEBUG] [LOCAL ] BRW: Saving primary data. [2025-09-23T17:44:24.583597] [DEBUG] [LOCAL ] BRW: Trimmed 29316 records to 18999 (keeping 200 days of data) [2025-09-23T17:44:24.708795] [DEBUG] [LOCAL ] BRW: Primary data saved (18999 records). [2025-09-23T17:44:24.708945] [INFO ] [MAIN ] BRW: Full history saved. [2025-09-23T17:44:24.709107] [INFO ] [MAIN ] Update Progress: 338/2372 symbols completed. BRW took 31.5s. Estimated remaining: 4h 26m 56s. Rate: 7.6 symbols/min [2025-09-23T17:44:24.883760] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:44:24.897571] [DEBUG] [LOCAL ] BSL: Loaded 7898 existing records from primary storage. [2025-09-23T17:44:24.897743] [INFO ] [MAIN ] BSL: Loaded 7898 existing records. [2025-09-23T17:44:25.007445] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-06. [2025-09-23T17:44:25.086156] [WARN ] [MAIN ] BSL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:44:25.086417] [INFO ] [MAIN ] BSL: Wiping existing primary data before full refresh. [2025-09-23T17:44:25.086470] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-09-23T17:44:25.086959] [DEBUG] [LOCAL ] BSL: Deleted primary data file. [2025-09-23T17:44:25.087054] [INFO ] [MAIN ] BSL: Starting full primary refresh. [2025-09-23T17:44:25.476430] [INFO ] [REMOTE ] BSL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:44:25.501636] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-23T17:44:25.802210] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-05. [2025-09-23T17:44:26.095693] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-23T17:44:26.602214] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-08. [2025-09-23T17:44:27.133861] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-23T17:44:27.402209] [INFO ] [REMOTE ] BSL: Fetching primary data for 2024-12. [2025-09-23T17:44:27.865422] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-23T17:44:28.034048] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-23T17:44:28.202248] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-07. [2025-09-23T17:44:29.002227] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-09. [2025-09-23T17:44:29.163411] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-23T17:44:29.802238] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-08. [2025-09-23T17:44:30.293154] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-23T17:44:30.304110] [INFO ] [REMOTE ] BRX: Full fetch complete (74950 records). [2025-09-23T17:44:30.304305] [DEBUG] [VALIDATOR ] BRX: Validating primary data. [2025-09-23T17:44:30.605520] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-06. [2025-09-23T17:44:30.741585] [DEBUG] [VALIDATOR ] BRX: All expected trading days are present. [2025-09-23T17:44:30.743874] [DEBUG] [VALIDATOR ] BRX: Primary data validation passed. [2025-09-23T17:44:30.744973] [INFO ] [MAIN ] BRX: Fetched primary data is valid. [2025-09-23T17:44:30.745539] [DEBUG] [LOCAL ] BRX: Saving primary data. [2025-09-23T17:44:30.746626] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-23T17:44:30.754904] [DEBUG] [LOCAL ] BRX: Trimmed 74950 records to 51807 (keeping 200 days of data) [2025-09-23T17:44:31.091356] [DEBUG] [LOCAL ] BRX: Primary data saved (51807 records). [2025-09-23T17:44:31.091630] [INFO ] [MAIN ] BRX: Full history saved. [2025-09-23T17:44:31.091803] [INFO ] [MAIN ] Update Progress: 339/2372 symbols completed. BRX took 37.2s. Estimated remaining: 4h 26m 39s. Rate: 7.6 symbols/min [2025-09-23T17:44:31.279578] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:44:31.314842] [DEBUG] [LOCAL ] BSM: Loaded 32330 existing records from primary storage. [2025-09-23T17:44:31.314992] [INFO ] [MAIN ] BSM: Loaded 32330 existing records. [2025-09-23T17:44:31.410793] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-01. [2025-09-23T17:44:31.495398] [WARN ] [MAIN ] BSM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:44:31.495868] [INFO ] [MAIN ] BSM: Wiping existing primary data before full refresh. [2025-09-23T17:44:31.496056] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-09-23T17:44:31.497534] [DEBUG] [LOCAL ] BSM: Deleted primary data file. [2025-09-23T17:44:31.497599] [INFO ] [MAIN ] BSM: Starting full primary refresh. [2025-09-23T17:44:31.759119] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-23T17:44:31.911725] [INFO ] [REMOTE ] BSM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:44:31.945269] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-23T17:44:32.202206] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-02. [2025-09-23T17:44:32.739601] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-23T17:44:33.002218] [INFO ] [REMOTE ] BSM: Fetching primary data for 2024-12. [2025-09-23T17:44:33.802206] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-07. [2025-09-23T17:44:34.131293] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-23T17:44:34.602213] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-01. [2025-09-23T17:44:34.888870] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-23T17:44:35.402207] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-09. [2025-09-23T17:44:35.466849] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-23T17:44:36.202215] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-08. [2025-09-23T17:44:36.694032] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-23T17:44:36.700487] [INFO ] [REMOTE ] BSAC: Full fetch complete (43532 records). [2025-09-23T17:44:36.700584] [DEBUG] [VALIDATOR ] BSAC: Validating primary data. [2025-09-23T17:44:37.003801] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-03. [2025-09-23T17:44:37.097787] [DEBUG] [VALIDATOR ] BSAC: All expected trading days are present. [2025-09-23T17:44:37.097882] [DEBUG] [VALIDATOR ] BSAC: Primary data validation passed. [2025-09-23T17:44:37.098425] [INFO ] [MAIN ] BSAC: Fetched primary data is valid. [2025-09-23T17:44:37.098466] [DEBUG] [LOCAL ] BSAC: Saving primary data. [2025-09-23T17:44:37.101352] [DEBUG] [LOCAL ] BSAC: Trimmed 43532 records to 32985 (keeping 200 days of data) [2025-09-23T17:44:37.309557] [DEBUG] [LOCAL ] BSAC: Primary data saved (32985 records). [2025-09-23T17:44:37.309860] [INFO ] [MAIN ] BSAC: Full history saved. [2025-09-23T17:44:37.310227] [INFO ] [MAIN ] Update Progress: 340/2372 symbols completed. BSAC took 38.1s. Estimated remaining: 4h 26m 22s. Rate: 7.6 symbols/min [2025-09-23T17:44:37.491160] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-23T17:44:37.527628] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:44:37.553577] [DEBUG] [LOCAL ] BST: Loaded 19306 existing records from primary storage. [2025-09-23T17:44:37.553772] [INFO ] [MAIN ] BST: Loaded 19306 existing records. [2025-09-23T17:44:37.716442] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-23T17:44:37.757549] [WARN ] [MAIN ] BST: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:44:37.757875] [INFO ] [MAIN ] BST: Wiping existing primary data before full refresh. [2025-09-23T17:44:37.757936] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-09-23T17:44:37.758872] [DEBUG] [LOCAL ] BST: Deleted primary data file. [2025-09-23T17:44:37.758940] [INFO ] [MAIN ] BST: Starting full primary refresh. [2025-09-23T17:44:37.807399] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-04. [2025-09-23T17:44:38.126488] [INFO ] [REMOTE ] BST: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:44:38.535376] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-23T17:44:38.602195] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-02. [2025-09-23T17:44:39.402212] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-09. [2025-09-23T17:44:39.554856] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-23T17:44:40.202204] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-05. [2025-09-23T17:44:40.622548] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-23T17:44:40.902537] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-23T17:44:40.909148] [INFO ] [REMOTE ] BSBR: Full fetch complete (50517 records). [2025-09-23T17:44:40.909244] [DEBUG] [VALIDATOR ] BSBR: Validating primary data. [2025-09-23T17:44:41.007313] [INFO ] [REMOTE ] BST: Fetching primary data for 2024-12. [2025-09-23T17:44:41.295711] [DEBUG] [VALIDATOR ] BSBR: All expected trading days are present. [2025-09-23T17:44:41.295801] [DEBUG] [VALIDATOR ] BSBR: Primary data validation passed. [2025-09-23T17:44:41.296388] [INFO ] [MAIN ] BSBR: Fetched primary data is valid. [2025-09-23T17:44:41.296431] [DEBUG] [LOCAL ] BSBR: Saving primary data. [2025-09-23T17:44:41.297467] [DEBUG] [LOCAL ] BSBR: Trimmed 50517 records to 35113 (keeping 200 days of data) [2025-09-23T17:44:41.503838] [DEBUG] [LOCAL ] BSBR: Primary data saved (35113 records). [2025-09-23T17:44:41.503983] [INFO ] [MAIN ] BSBR: Full history saved. [2025-09-23T17:44:41.504061] [INFO ] [MAIN ] Update Progress: 341/2372 symbols completed. BSBR took 29.1s. Estimated remaining: 4h 25m 52s. Rate: 7.6 symbols/min [2025-09-23T17:44:41.676284] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:44:41.701395] [DEBUG] [LOCAL ] BSTZ: Loaded 24927 existing records from primary storage. [2025-09-23T17:44:41.701575] [INFO ] [MAIN ] BSTZ: Loaded 24927 existing records. [2025-09-23T17:44:41.807349] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-06. [2025-09-23T17:44:41.912820] [WARN ] [MAIN ] BSTZ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:44:41.913076] [INFO ] [MAIN ] BSTZ: Wiping existing primary data before full refresh. [2025-09-23T17:44:41.913127] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-09-23T17:44:41.914228] [DEBUG] [LOCAL ] BSTZ: Deleted primary data file. [2025-09-23T17:44:41.914291] [INFO ] [MAIN ] BSTZ: Starting full primary refresh. [2025-09-23T17:44:42.222114] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-23T17:44:42.366957] [INFO ] [REMOTE ] BSTZ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:44:42.372989] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-23T17:44:42.602194] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-03. [2025-09-23T17:44:43.402206] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-01. [2025-09-23T17:44:43.493867] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-23T17:44:44.202220] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2024-12. [2025-09-23T17:44:44.420137] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-23T17:44:45.002198] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-07. [2025-09-23T17:44:45.160006] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-23T17:44:45.763837] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-23T17:44:45.802167] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-08. [2025-09-23T17:44:46.346115] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-23T17:44:46.602194] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-09. [2025-09-23T17:44:47.402166] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-01. [2025-09-23T17:44:47.483277] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-23T17:44:47.485357] [INFO ] [REMOTE ] BSL: Full fetch complete (12525 records). [2025-09-23T17:44:47.485435] [DEBUG] [VALIDATOR ] BSL: Validating primary data. [2025-09-23T17:44:47.854881] [DEBUG] [VALIDATOR ] BSL: All expected trading days are present. [2025-09-23T17:44:47.855030] [DEBUG] [VALIDATOR ] BSL: Primary data validation passed. [2025-09-23T17:44:47.855358] [INFO ] [MAIN ] BSL: Fetched primary data is valid. [2025-09-23T17:44:47.855433] [DEBUG] [LOCAL ] BSL: Saving primary data. [2025-09-23T17:44:47.856206] [DEBUG] [LOCAL ] BSL: Trimmed 12525 records to 7936 (keeping 200 days of data) [2025-09-23T17:44:47.910674] [DEBUG] [LOCAL ] BSL: Primary data saved (7936 records). [2025-09-23T17:44:47.910791] [INFO ] [MAIN ] BSL: Full history saved. [2025-09-23T17:44:47.910882] [INFO ] [MAIN ] Update Progress: 342/2372 symbols completed. BSL took 23.2s. Estimated remaining: 4h 25m 35s. Rate: 7.6 symbols/min [2025-09-23T17:44:48.085026] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:44:48.145385] [DEBUG] [LOCAL ] BSX: Loaded 53688 existing records from primary storage. [2025-09-23T17:44:48.145525] [INFO ] [MAIN ] BSX: Loaded 53688 existing records. [2025-09-23T17:44:48.207782] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-04. [2025-09-23T17:44:48.342801] [WARN ] [MAIN ] BSX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:44:48.343158] [INFO ] [MAIN ] BSX: Wiping existing primary data before full refresh. [2025-09-23T17:44:48.343296] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-09-23T17:44:48.351219] [DEBUG] [LOCAL ] BSX: Deleted primary data file. [2025-09-23T17:44:48.363423] [INFO ] [MAIN ] BSX: Starting full primary refresh. [2025-09-23T17:44:48.423169] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-23T17:44:48.731778] [INFO ] [REMOTE ] BSX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:44:49.002277] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-02. [2025-09-23T17:44:49.430069] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-23T17:44:49.808544] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-05. [2025-09-23T17:44:49.815744] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-23T17:44:50.602196] [INFO ] [REMOTE ] BSX: Fetching primary data for 2024-12. [2025-09-23T17:44:50.737540] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-23T17:44:51.402232] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-02. [2025-09-23T17:44:52.127002] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-23T17:44:52.161637] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-23T17:44:52.202225] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-01. [2025-09-23T17:44:53.002275] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-06. [2025-09-23T17:44:53.717576] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-23T17:44:53.802265] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-03. [2025-09-23T17:44:54.383466] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-23T17:44:54.602237] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-03. [2025-09-23T17:44:54.720561] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-23T17:44:55.402303] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-02. [2025-09-23T17:44:55.608058] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-23T17:44:56.202197] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-04. [2025-09-23T17:44:56.849410] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-23T17:44:57.005750] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-04. [2025-09-23T17:44:57.010201] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-23T17:44:57.802220] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-07. [2025-09-23T17:44:57.825667] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-23T17:44:58.602229] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-03. [2025-09-23T17:44:59.242478] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-23T17:44:59.402284] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-05. [2025-09-23T17:45:00.092953] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-23T17:45:00.135554] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-23T17:45:00.202226] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-05. [2025-09-23T17:45:01.002331] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-08. [2025-09-23T17:45:01.407901] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-23T17:45:01.802361] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-06. [2025-09-23T17:45:02.602305] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-06. [2025-09-23T17:45:02.904063] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-23T17:45:03.402270] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-04. [2025-09-23T17:45:04.202311] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-09. [2025-09-23T17:45:04.916167] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-06 (3.11 seconds). [2025-09-23T17:45:05.002296] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-07. [2025-09-23T17:45:05.812676] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-06 (3.21 seconds). [2025-09-23T17:45:05.817312] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-07. [2025-09-23T17:45:06.684355] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-23T17:45:06.689119] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-08. [2025-09-23T17:45:07.129349] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-23T17:45:07.402446] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-08. [2025-09-23T17:45:07.430303] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-23T17:45:07.464866] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-09 (3.26 seconds). [2025-09-23T17:45:07.473024] [INFO ] [REMOTE ] BSM: Full fetch complete (47649 records). [2025-09-23T17:45:07.473510] [DEBUG] [VALIDATOR ] BSM: Validating primary data. [2025-09-23T17:45:07.940392] [DEBUG] [VALIDATOR ] BSM: All expected trading days are present. [2025-09-23T17:45:07.940718] [DEBUG] [VALIDATOR ] BSM: Primary data validation passed. [2025-09-23T17:45:07.941982] [INFO ] [MAIN ] BSM: Fetched primary data is valid. [2025-09-23T17:45:07.942095] [DEBUG] [LOCAL ] BSM: Saving primary data. [2025-09-23T17:45:07.944762] [DEBUG] [LOCAL ] BSM: Trimmed 47649 records to 32342 (keeping 200 days of data) [2025-09-23T17:45:08.088330] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-04 (4.69 seconds). [2025-09-23T17:45:08.202220] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-09. [2025-09-23T17:45:08.223547] [DEBUG] [LOCAL ] BSM: Primary data saved (32342 records). [2025-09-23T17:45:08.223816] [INFO ] [MAIN ] BSM: Full history saved. [2025-09-23T17:45:08.223952] [INFO ] [MAIN ] Update Progress: 343/2372 symbols completed. BSM took 37.1s. Estimated remaining: 4h 26m 41s. Rate: 7.6 symbols/min [2025-09-23T17:45:08.437135] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:45:08.446322] [DEBUG] [LOCAL ] BTA: Loaded 5290 existing records from primary storage. [2025-09-23T17:45:08.446507] [INFO ] [MAIN ] BTA: Loaded 5290 existing records. [2025-09-23T17:45:08.675679] [WARN ] [MAIN ] BTA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:45:08.676431] [INFO ] [MAIN ] BTA: Wiping existing primary data before full refresh. [2025-09-23T17:45:08.676500] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-09-23T17:45:08.676907] [DEBUG] [LOCAL ] BTA: Deleted primary data file. [2025-09-23T17:45:08.676970] [INFO ] [MAIN ] BTA: Starting full primary refresh. [2025-09-23T17:45:08.941507] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-23T17:45:09.007517] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-05. [2025-09-23T17:45:09.180615] [INFO ] [REMOTE ] BTA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:45:09.195412] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-23T17:45:09.199901] [INFO ] [REMOTE ] BST: Full fetch complete (28774 records). [2025-09-23T17:45:09.200028] [DEBUG] [VALIDATOR ] BST: Validating primary data. [2025-09-23T17:45:09.675728] [DEBUG] [VALIDATOR ] BST: All expected trading days are present. [2025-09-23T17:45:09.675856] [DEBUG] [VALIDATOR ] BST: Primary data validation passed. [2025-09-23T17:45:09.676390] [INFO ] [MAIN ] BST: Fetched primary data is valid. [2025-09-23T17:45:09.676435] [DEBUG] [LOCAL ] BST: Saving primary data. [2025-09-23T17:45:09.677372] [DEBUG] [LOCAL ] BST: Trimmed 28774 records to 19205 (keeping 200 days of data) [2025-09-23T17:45:09.804197] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-09. [2025-09-23T17:45:09.804045] [DEBUG] [LOCAL ] BST: Primary data saved (19205 records). [2025-09-23T17:45:09.804687] [INFO ] [MAIN ] BST: Full history saved. [2025-09-23T17:45:09.806120] [INFO ] [MAIN ] Update Progress: 344/2372 symbols completed. BST took 32.5s. Estimated remaining: 4h 25m 56s. Rate: 7.6 symbols/min [2025-09-23T17:45:10.003611] [INFO ] [MAIN ] BTCM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:45:10.023117] [DEBUG] [LOCAL ] BTCM: Loaded 14601 existing records from primary storage. [2025-09-23T17:45:10.023317] [INFO ] [MAIN ] BTCM: Loaded 14601 existing records. [2025-09-23T17:45:10.226968] [WARN ] [MAIN ] BTCM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:45:10.227337] [INFO ] [MAIN ] BTCM: Wiping existing primary data before full refresh. [2025-09-23T17:45:10.227390] [INFO ] [LOCAL ] BTCM: Starting deletion of primary data. [2025-09-23T17:45:10.228177] [DEBUG] [LOCAL ] BTCM: Deleted primary data file. [2025-09-23T17:45:10.228254] [INFO ] [MAIN ] BTCM: Starting full primary refresh. [2025-09-23T17:45:10.604297] [INFO ] [REMOTE ] BTA: Fetching primary data for 2024-12. [2025-09-23T17:45:10.705573] [INFO ] [REMOTE ] BTCM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:45:10.722401] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-23T17:45:10.727004] [INFO ] [REMOTE ] BSTZ: Full fetch complete (36679 records). [2025-09-23T17:45:10.727094] [DEBUG] [VALIDATOR ] BSTZ: Validating primary data. [2025-09-23T17:45:11.117988] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-23T17:45:11.176236] [DEBUG] [VALIDATOR ] BSTZ: All expected trading days are present. [2025-09-23T17:45:11.176314] [DEBUG] [VALIDATOR ] BSTZ: Primary data validation passed. [2025-09-23T17:45:11.176851] [INFO ] [MAIN ] BSTZ: Fetched primary data is valid. [2025-09-23T17:45:11.176942] [DEBUG] [LOCAL ] BSTZ: Saving primary data. [2025-09-23T17:45:11.177778] [DEBUG] [LOCAL ] BSTZ: Trimmed 36679 records to 24871 (keeping 200 days of data) [2025-09-23T17:45:11.333045] [DEBUG] [LOCAL ] BSTZ: Primary data saved (24871 records). [2025-09-23T17:45:11.333190] [INFO ] [MAIN ] BSTZ: Full history saved. [2025-09-23T17:45:11.333287] [INFO ] [MAIN ] Update Progress: 345/2372 symbols completed. BSTZ took 29.8s. Estimated remaining: 4h 25m 11s. Rate: 7.6 symbols/min [2025-09-23T17:45:11.411004] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2024-12. [2025-09-23T17:45:11.524289] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:45:11.523068] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-23T17:45:11.591561] [DEBUG] [LOCAL ] BTE: Loaded 52748 existing records from primary storage. [2025-09-23T17:45:11.591732] [INFO ] [MAIN ] BTE: Loaded 52748 existing records. [2025-09-23T17:45:11.767064] [WARN ] [MAIN ] BTE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:45:11.767338] [INFO ] [MAIN ] BTE: Wiping existing primary data before full refresh. [2025-09-23T17:45:11.767385] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-09-23T17:45:11.768955] [DEBUG] [LOCAL ] BTE: Deleted primary data file. [2025-09-23T17:45:11.769017] [INFO ] [MAIN ] BTE: Starting full primary refresh. [2025-09-23T17:45:12.120423] [INFO ] [REMOTE ] BTE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:45:12.202168] [INFO ] [REMOTE ] BTE: Fetching primary data for 2024-12. [2025-09-23T17:45:12.333925] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-23T17:45:13.002250] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-01. [2025-09-23T17:45:13.524258] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-23T17:45:13.770079] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-23T17:45:13.802143] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-02. [2025-09-23T17:45:14.310737] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-23T17:45:14.602185] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-03. [2025-09-23T17:45:15.119517] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-23T17:45:15.402202] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-06. [2025-09-23T17:45:16.202189] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-01. [2025-09-23T17:45:17.002191] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-01. [2025-09-23T17:45:17.802194] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-04. [2025-09-23T17:45:17.957441] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-23T17:45:18.092091] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-06 (2.69 seconds). [2025-09-23T17:45:18.296757] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-23T17:45:18.365885] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-09-23T17:45:18.602225] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-07. [2025-09-23T17:45:19.402196] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-02. [2025-09-23T17:45:20.172047] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-23T17:45:20.206606] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-02. [2025-09-23T17:45:20.212175] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-23T17:45:21.002196] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-05. [2025-09-23T17:45:21.452686] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-23T17:45:21.802174] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-03. [2025-09-23T17:45:21.868518] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-23T17:45:22.370838] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-23T17:45:22.602199] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-03. [2025-09-23T17:45:23.402267] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-04. [2025-09-23T17:45:23.890912] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-23T17:45:24.003301] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-23T17:45:24.202193] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-05. [2025-09-23T17:45:24.655577] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-23T17:45:25.002221] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-06. [2025-09-23T17:45:25.395786] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-23T17:45:25.802199] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-08. [2025-09-23T17:45:26.602230] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-06. [2025-09-23T17:45:27.337305] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-23T17:45:27.402195] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-04. [2025-09-23T17:45:27.674871] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-23T17:45:28.202190] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-09. [2025-09-23T17:45:29.002256] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-07. [2025-09-23T17:45:29.198682] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-23T17:45:29.466322] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-23T17:45:29.802243] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-08. [2025-09-23T17:45:29.935182] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-23T17:45:29.945991] [INFO ] [REMOTE ] BSX: Full fetch complete (77684 records). [2025-09-23T17:45:29.946130] [DEBUG] [VALIDATOR ] BSX: Validating primary data. [2025-09-23T17:45:30.302103] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-23T17:45:30.393579] [DEBUG] [VALIDATOR ] BSX: All expected trading days are present. [2025-09-23T17:45:30.393700] [DEBUG] [VALIDATOR ] BSX: Primary data validation passed. [2025-09-23T17:45:30.394616] [INFO ] [MAIN ] BSX: Fetched primary data is valid. [2025-09-23T17:45:30.394708] [DEBUG] [LOCAL ] BSX: Saving primary data. [2025-09-23T17:45:30.396361] [DEBUG] [LOCAL ] BSX: Trimmed 77684 records to 53688 (keeping 200 days of data) [2025-09-23T17:45:30.619325] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-09. [2025-09-23T17:45:30.743144] [DEBUG] [LOCAL ] BSX: Primary data saved (53688 records). [2025-09-23T17:45:30.743272] [INFO ] [MAIN ] BSX: Full history saved. [2025-09-23T17:45:30.743351] [INFO ] [MAIN ] Update Progress: 346/2372 symbols completed. BSX took 42.8s. Estimated remaining: 4h 26m 11s. Rate: 7.6 symbols/min [2025-09-23T17:45:30.926999] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:45:30.927178] [DEBUG] [LOCAL ] BTI: No existing data file found in primary storage. [2025-09-23T17:45:30.927217] [WARN ] [MAIN ] BTI: No existing data found, performing full refresh instead. [2025-09-23T17:45:30.927366] [INFO ] [MAIN ] BTI: Wiping existing primary data before full refresh. [2025-09-23T17:45:30.927411] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-09-23T17:45:30.927453] [DEBUG] [LOCAL ] BTI: No primary data file found to delete. [2025-09-23T17:45:30.927487] [INFO ] [MAIN ] BTI: Starting full primary refresh. [2025-09-23T17:45:31.219975] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-23T17:45:31.232948] [INFO ] [REMOTE ] BTA: Full fetch complete (9494 records). [2025-09-23T17:45:31.243332] [DEBUG] [VALIDATOR ] BTA: Validating primary data. [2025-09-23T17:45:31.407313] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-07. [2025-09-23T17:45:31.411364] [INFO ] [REMOTE ] BTI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:45:31.698157] [DEBUG] [VALIDATOR ] BTA: All expected trading days are present. [2025-09-23T17:45:31.698235] [DEBUG] [VALIDATOR ] BTA: Primary data validation passed. [2025-09-23T17:45:31.698472] [INFO ] [MAIN ] BTA: Fetched primary data is valid. [2025-09-23T17:45:31.698510] [DEBUG] [LOCAL ] BTA: Saving primary data. [2025-09-23T17:45:31.698951] [DEBUG] [LOCAL ] BTA: Trimmed 9494 records to 5282 (keeping 200 days of data) [2025-09-23T17:45:31.729991] [DEBUG] [LOCAL ] BTA: Primary data saved (5282 records). [2025-09-23T17:45:31.730091] [INFO ] [MAIN ] BTA: Full history saved. [2025-09-23T17:45:31.730199] [INFO ] [MAIN ] Update Progress: 347/2372 symbols completed. BTA took 23.5s. Estimated remaining: 4h 25m 23s. Rate: 7.6 symbols/min [2025-09-23T17:45:31.895744] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:45:31.906075] [DEBUG] [LOCAL ] BTO: Loaded 8965 existing records from primary storage. [2025-09-23T17:45:31.906180] [INFO ] [MAIN ] BTO: Loaded 8965 existing records. [2025-09-23T17:45:32.079245] [WARN ] [MAIN ] BTO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:45:32.079496] [INFO ] [MAIN ] BTO: Wiping existing primary data before full refresh. [2025-09-23T17:45:32.079551] [INFO ] [LOCAL ] BTO: Starting deletion of primary data. [2025-09-23T17:45:32.079933] [DEBUG] [LOCAL ] BTO: Deleted primary data file. [2025-09-23T17:45:32.080007] [INFO ] [MAIN ] BTO: Starting full primary refresh. [2025-09-23T17:45:32.219063] [INFO ] [REMOTE ] BTI: Fetching primary data for 2024-12. [2025-09-23T17:45:32.432863] [INFO ] [REMOTE ] BTO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:45:32.801191] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-23T17:45:33.002199] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-08. [2025-09-23T17:45:33.802150] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-05. [2025-09-23T17:45:34.352436] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-23T17:45:34.385212] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-23T17:45:34.602237] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-01. [2025-09-23T17:45:35.239457] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-23T17:45:35.402179] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-06. [2025-09-23T17:45:36.202175] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-09. [2025-09-23T17:45:36.248820] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-23T17:45:36.755728] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-23T17:45:37.002199] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-02. [2025-09-23T17:45:37.257259] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-23T17:45:37.262466] [INFO ] [REMOTE ] BTCM: Full fetch complete (19663 records). [2025-09-23T17:45:37.262713] [DEBUG] [VALIDATOR ] BTCM: Validating primary data. [2025-09-23T17:45:37.660967] [DEBUG] [VALIDATOR ] BTCM: All expected trading days are present. [2025-09-23T17:45:37.661046] [DEBUG] [VALIDATOR ] BTCM: Primary data validation passed. [2025-09-23T17:45:37.661427] [INFO ] [MAIN ] BTCM: Fetched primary data is valid. [2025-09-23T17:45:37.661467] [DEBUG] [LOCAL ] BTCM: Saving primary data. [2025-09-23T17:45:37.662058] [DEBUG] [LOCAL ] BTCM: Trimmed 19663 records to 14757 (keeping 200 days of data) [2025-09-23T17:45:37.749261] [DEBUG] [LOCAL ] BTCM: Primary data saved (14757 records). [2025-09-23T17:45:37.749391] [INFO ] [MAIN ] BTCM: Full history saved. [2025-09-23T17:45:37.749473] [INFO ] [MAIN ] Update Progress: 348/2372 symbols completed. BTCM took 27.9s. Estimated remaining: 4h 25m 4s. Rate: 7.6 symbols/min [2025-09-23T17:45:37.812152] [INFO ] [REMOTE ] BTO: Fetching primary data for 2024-12. [2025-09-23T17:45:37.921168] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:45:37.941000] [DEBUG] [LOCAL ] BTT: Loaded 16021 existing records from primary storage. [2025-09-23T17:45:37.941130] [INFO ] [MAIN ] BTT: Loaded 16021 existing records. [2025-09-23T17:45:38.118334] [WARN ] [MAIN ] BTT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:45:38.118603] [INFO ] [MAIN ] BTT: Wiping existing primary data before full refresh. [2025-09-23T17:45:38.118680] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-09-23T17:45:38.119336] [DEBUG] [LOCAL ] BTT: Deleted primary data file. [2025-09-23T17:45:38.119397] [INFO ] [MAIN ] BTT: Starting full primary refresh. [2025-09-23T17:45:38.470912] [INFO ] [REMOTE ] BTT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:45:38.533014] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-23T17:45:38.586920] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-23T17:45:38.602175] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-03. [2025-09-23T17:45:39.402190] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-07. [2025-09-23T17:45:40.197748] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-23T17:45:40.208249] [INFO ] [REMOTE ] BTT: Fetching primary data for 2024-12. [2025-09-23T17:45:40.804153] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-23T17:45:41.002166] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-08. [2025-09-23T17:45:41.123697] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-23T17:45:41.802214] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-01. [2025-09-23T17:45:42.286048] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-23T17:45:42.602211] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-01. [2025-09-23T17:45:42.768460] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-23T17:45:43.221091] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-23T17:45:43.402196] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-09. [2025-09-23T17:45:44.202218] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-04. [2025-09-23T17:45:44.797571] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-23T17:45:44.806314] [INFO ] [REMOTE ] BTE: Full fetch complete (75992 records). [2025-09-23T17:45:44.806444] [DEBUG] [VALIDATOR ] BTE: Validating primary data. [2025-09-23T17:45:45.007359] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-02. [2025-09-23T17:45:45.205495] [DEBUG] [VALIDATOR ] BTE: All expected trading days are present. [2025-09-23T17:45:45.205599] [DEBUG] [VALIDATOR ] BTE: Primary data validation passed. [2025-09-23T17:45:45.206406] [INFO ] [MAIN ] BTE: Fetched primary data is valid. [2025-09-23T17:45:45.206468] [DEBUG] [LOCAL ] BTE: Saving primary data. [2025-09-23T17:45:45.208409] [DEBUG] [LOCAL ] BTE: Trimmed 75992 records to 52748 (keeping 200 days of data) [2025-09-23T17:45:45.532488] [DEBUG] [LOCAL ] BTE: Primary data saved (52748 records). [2025-09-23T17:45:45.532637] [INFO ] [MAIN ] BTE: Full history saved. [2025-09-23T17:45:45.532812] [INFO ] [MAIN ] Update Progress: 349/2372 symbols completed. BTE took 34.2s. Estimated remaining: 4h 24m 56s. Rate: 7.6 symbols/min [2025-09-23T17:45:45.740444] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:45:45.751535] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-23T17:45:45.805414] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-03. [2025-09-23T17:45:45.808749] [DEBUG] [LOCAL ] BTU: Loaded 53303 existing records from primary storage. [2025-09-23T17:45:45.808906] [INFO ] [MAIN ] BTU: Loaded 53303 existing records. [2025-09-23T17:45:45.992356] [WARN ] [MAIN ] BTU: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:45:45.992882] [INFO ] [MAIN ] BTU: Wiping existing primary data before full refresh. [2025-09-23T17:45:45.993087] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-09-23T17:45:45.994698] [DEBUG] [LOCAL ] BTU: Deleted primary data file. [2025-09-23T17:45:45.994767] [INFO ] [MAIN ] BTU: Starting full primary refresh. [2025-09-23T17:45:46.370570] [INFO ] [REMOTE ] BTU: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:45:46.393139] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-23T17:45:46.561088] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-23T17:45:46.602146] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-04. [2025-09-23T17:45:47.370881] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-23T17:45:47.402194] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-02. [2025-09-23T17:45:47.879999] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-23T17:45:48.202193] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-05. [2025-09-23T17:45:49.002196] [INFO ] [REMOTE ] BTU: Fetching primary data for 2024-12. [2025-09-23T17:45:49.802171] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-03. [2025-09-23T17:45:49.905677] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-23T17:45:50.420898] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-23T17:45:50.453575] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-23T17:45:50.602196] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-06. [2025-09-23T17:45:51.402244] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-04. [2025-09-23T17:45:51.904469] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-23T17:45:52.144554] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-23T17:45:52.202206] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-05. [2025-09-23T17:45:53.002232] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-07. [2025-09-23T17:45:53.031089] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-23T17:45:53.802233] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-06. [2025-09-23T17:45:54.287551] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-23T17:45:54.602247] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-01. [2025-09-23T17:45:54.781118] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-23T17:45:55.402194] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-05. [2025-09-23T17:45:56.069103] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-23T17:45:56.137458] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-23T17:45:56.202276] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-08. [2025-09-23T17:45:57.002242] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-07. [2025-09-23T17:45:57.519364] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-23T17:45:57.802169] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-08. [2025-09-23T17:45:57.939447] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-23T17:45:58.336104] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-23T17:45:58.602192] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-09. [2025-09-23T17:45:59.402209] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-09. [2025-09-23T17:46:00.202190] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-06. [2025-09-23T17:46:00.295950] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-23T17:46:00.308243] [INFO ] [REMOTE ] BTI: Full fetch complete (77426 records). [2025-09-23T17:46:00.308432] [DEBUG] [VALIDATOR ] BTI: Validating primary data. [2025-09-23T17:46:00.440274] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-23T17:46:00.472966] [INFO ] [REMOTE ] BTO: Full fetch complete (13360 records). [2025-09-23T17:46:00.484177] [DEBUG] [VALIDATOR ] BTO: Validating primary data. [2025-09-23T17:46:01.020278] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-02. [2025-09-23T17:46:01.043032] [DEBUG] [VALIDATOR ] BTI: All expected trading days are present. [2025-09-23T17:46:01.047376] [DEBUG] [VALIDATOR ] BTI: Primary data validation passed. [2025-09-23T17:46:01.048462] [INFO ] [MAIN ] BTI: Fetched primary data is valid. [2025-09-23T17:46:01.059359] [DEBUG] [LOCAL ] BTI: Saving primary data. [2025-09-23T17:46:01.133859] [DEBUG] [VALIDATOR ] BTO: All expected trading days are present. [2025-09-23T17:46:01.134054] [DEBUG] [VALIDATOR ] BTO: Primary data validation passed. [2025-09-23T17:46:01.134407] [INFO ] [MAIN ] BTO: Fetched primary data is valid. [2025-09-23T17:46:01.134854] [DEBUG] [LOCAL ] BTO: Saving primary data. [2025-09-23T17:46:01.135700] [DEBUG] [LOCAL ] BTI: Trimmed 77426 records to 53557 (keeping 200 days of data) [2025-09-23T17:46:01.136038] [DEBUG] [LOCAL ] BTO: Trimmed 13360 records to 8939 (keeping 200 days of data) [2025-09-23T17:46:01.301497] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-23T17:46:01.326953] [DEBUG] [LOCAL ] BTO: Primary data saved (8939 records). [2025-09-23T17:46:01.327579] [INFO ] [MAIN ] BTO: Full history saved. [2025-09-23T17:46:01.327721] [INFO ] [MAIN ] Update Progress: 350/2372 symbols completed. BTO took 29.6s. Estimated remaining: 4h 25m 34s. Rate: 7.6 symbols/min [2025-09-23T17:46:01.513101] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:46:01.513801] [DEBUG] [LOCAL ] BTX: No existing data file found in primary storage. [2025-09-23T17:46:01.514549] [WARN ] [MAIN ] BTX: No existing data found, performing full refresh instead. [2025-09-23T17:46:01.516586] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-09-23T17:46:01.517425] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-09-23T17:46:01.518022] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-09-23T17:46:01.518562] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-09-23T17:46:01.805215] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-07. [2025-09-23T17:46:02.011239] [INFO ] [REMOTE ] BTX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:46:02.130099] [DEBUG] [LOCAL ] BTI: Primary data saved (53557 records). [2025-09-23T17:46:02.130243] [INFO ] [MAIN ] BTI: Full history saved. [2025-09-23T17:46:02.130320] [INFO ] [MAIN ] Update Progress: 351/2372 symbols completed. BTI took 31.4s. Estimated remaining: 4h 24m 45s. Rate: 7.6 symbols/min [2025-09-23T17:46:02.306780] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:46:02.338041] [DEBUG] [LOCAL ] BTZ: Loaded 22906 existing records from primary storage. [2025-09-23T17:46:02.338218] [INFO ] [MAIN ] BTZ: Loaded 22906 existing records. [2025-09-23T17:46:02.536189] [WARN ] [MAIN ] BTZ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:46:02.537338] [INFO ] [MAIN ] BTZ: Wiping existing primary data before full refresh. [2025-09-23T17:46:02.537541] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-09-23T17:46:02.543176] [DEBUG] [LOCAL ] BTZ: Deleted primary data file. [2025-09-23T17:46:02.549335] [INFO ] [MAIN ] BTZ: Starting full primary refresh. [2025-09-23T17:46:02.584530] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-23T17:46:02.610103] [INFO ] [REMOTE ] BTX: Fetching primary data for 2024-12. [2025-09-23T17:46:02.893268] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:46:02.894963] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-23T17:46:02.895261] [WARN ] [REMOTE ] BTX: No data returned for month 2024-12 [2025-09-23T17:46:02.984235] [INFO ] [REMOTE ] BTZ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:46:03.402189] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-03. [2025-09-23T17:46:04.202196] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-01. [2025-09-23T17:46:04.422271] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:46:04.422584] [WARN ] [REMOTE ] BTX: No data returned for month 2025-01 [2025-09-23T17:46:04.964537] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-23T17:46:05.002206] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-08. [2025-09-23T17:46:05.580546] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-23T17:46:05.802210] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-04. [2025-09-23T17:46:06.602235] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-09. [2025-09-23T17:46:07.402251] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2024-12. [2025-09-23T17:46:07.831459] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-23T17:46:07.850384] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-23T17:46:07.854383] [INFO ] [REMOTE ] BTT: Full fetch complete (24320 records). [2025-09-23T17:46:07.854487] [DEBUG] [VALIDATOR ] BTT: Validating primary data. [2025-09-23T17:46:07.855170] [FATAL] [VALIDATOR ] BTT: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:46:07.855271] [FATAL] [MAIN ] BTT: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:46:07.855330] [WARN ] [MAIN ] BTT: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:46:07.855408] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-09-23T17:46:07.855509] [DEBUG] [LOCAL ] BTT: No primary data file found to delete. [2025-09-23T17:46:07.855565] [INFO ] [LOCAL ] BTT: Starting deletion of derivative data. [2025-09-23T17:46:07.856141] [DEBUG] [LOCAL ] BTT: Deleted derivative data file. [2025-09-23T17:46:07.856317] [INFO ] [MAIN ] Update Progress: 352/2372 symbols completed. BTT took 30.1s. Estimated remaining: 4h 24m 25s. Rate: 7.6 symbols/min [2025-09-23T17:46:08.026921] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:46:08.096220] [DEBUG] [LOCAL ] BUD: Loaded 52752 existing records from primary storage. [2025-09-23T17:46:08.096548] [INFO ] [MAIN ] BUD: Loaded 52752 existing records. [2025-09-23T17:46:08.207448] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-05. [2025-09-23T17:46:08.284494] [WARN ] [MAIN ] BUD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:46:08.285275] [INFO ] [MAIN ] BUD: Wiping existing primary data before full refresh. [2025-09-23T17:46:08.285421] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-09-23T17:46:08.286839] [DEBUG] [LOCAL ] BUD: Deleted primary data file. [2025-09-23T17:46:08.286908] [INFO ] [MAIN ] BUD: Starting full primary refresh. [2025-09-23T17:46:08.407218] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-23T17:46:08.667390] [INFO ] [REMOTE ] BUD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:46:09.002201] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-01. [2025-09-23T17:46:09.793836] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-23T17:46:09.804848] [INFO ] [REMOTE ] BUD: Fetching primary data for 2024-12. [2025-09-23T17:46:09.820663] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-23T17:46:10.602205] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-02. [2025-09-23T17:46:11.402277] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-06. [2025-09-23T17:46:11.435249] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-23T17:46:11.980878] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-09-23T17:46:12.202199] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-03. [2025-09-23T17:46:12.897949] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-23T17:46:12.956223] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-23T17:46:13.002227] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-07. [2025-09-23T17:46:13.802223] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-04. [2025-09-23T17:46:14.602178] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-02. [2025-09-23T17:46:14.744112] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-23T17:46:14.745081] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-23T17:46:15.202548] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-23T17:46:15.402204] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-05. [2025-09-23T17:46:16.202153] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-03. [2025-09-23T17:46:16.219122] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-23T17:46:17.002207] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-01. [2025-09-23T17:46:17.664803] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-23T17:46:17.802205] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-04. [2025-09-23T17:46:18.583700] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-23T17:46:18.602159] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-02. [2025-09-23T17:46:18.726483] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-23T17:46:19.402210] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-08. [2025-09-23T17:46:20.123024] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-23T17:46:20.202152] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-03. [2025-09-23T17:46:20.883481] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-23T17:46:21.002191] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-09. [2025-09-23T17:46:21.812550] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-05. [2025-09-23T17:46:21.839059] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-23T17:46:22.602198] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-04. [2025-09-23T17:46:22.761050] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-23T17:46:22.823084] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-23T17:46:22.832365] [INFO ] [REMOTE ] BTU: Full fetch complete (76826 records). [2025-09-23T17:46:22.832512] [DEBUG] [VALIDATOR ] BTU: Validating primary data. [2025-09-23T17:46:23.256138] [DEBUG] [VALIDATOR ] BTU: All expected trading days are present. [2025-09-23T17:46:23.256267] [DEBUG] [VALIDATOR ] BTU: Primary data validation passed. [2025-09-23T17:46:23.257637] [INFO ] [MAIN ] BTU: Fetched primary data is valid. [2025-09-23T17:46:23.257782] [DEBUG] [LOCAL ] BTU: Saving primary data. [2025-09-23T17:46:23.259464] [DEBUG] [LOCAL ] BTU: Trimmed 76826 records to 53303 (keeping 200 days of data) [2025-09-23T17:46:23.451335] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-06. [2025-09-23T17:46:23.608673] [DEBUG] [LOCAL ] BTU: Primary data saved (53303 records). [2025-09-23T17:46:23.608850] [INFO ] [MAIN ] BTU: Full history saved. [2025-09-23T17:46:23.608983] [INFO ] [MAIN ] Update Progress: 353/2372 symbols completed. BTU took 38.1s. Estimated remaining: 4h 25m 3s. Rate: 7.6 symbols/min [2025-09-23T17:46:23.782196] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:46:23.796005] [DEBUG] [LOCAL ] BUI: Loaded 11478 existing records from primary storage. [2025-09-23T17:46:23.796150] [INFO ] [MAIN ] BUI: Loaded 11478 existing records. [2025-09-23T17:46:23.986530] [WARN ] [MAIN ] BUI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:46:23.986934] [INFO ] [MAIN ] BUI: Wiping existing primary data before full refresh. [2025-09-23T17:46:23.987018] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-09-23T17:46:23.987452] [DEBUG] [LOCAL ] BUI: Deleted primary data file. [2025-09-23T17:46:23.987531] [INFO ] [MAIN ] BUI: Starting full primary refresh. [2025-09-23T17:46:24.203543] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-06. [2025-09-23T17:46:24.369726] [INFO ] [REMOTE ] BUI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:46:24.460354] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-23T17:46:24.852315] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-23T17:46:25.002237] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-05. [2025-09-23T17:46:25.426196] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-23T17:46:25.802201] [INFO ] [REMOTE ] BUI: Fetching primary data for 2024-12. [2025-09-23T17:46:26.436056] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-23T17:46:26.578358] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-23T17:46:26.602185] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-07. [2025-09-23T17:46:27.402217] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-07. [2025-09-23T17:46:27.637719] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-23T17:46:28.202215] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-08. [2025-09-23T17:46:28.711585] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-23T17:46:29.002210] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-06. [2025-09-23T17:46:29.409220] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-23T17:46:29.802189] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-08. [2025-09-23T17:46:30.333341] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-23T17:46:30.602210] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-01. [2025-09-23T17:46:30.680461] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-23T17:46:31.402159] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-09. [2025-09-23T17:46:31.490099] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-23T17:46:32.202190] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-09. [2025-09-23T17:46:32.504103] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-23T17:46:32.509274] [INFO ] [REMOTE ] BTX: Full fetch complete (35518 records). [2025-09-23T17:46:32.509370] [DEBUG] [VALIDATOR ] BTX: Validating primary data. [2025-09-23T17:46:32.710493] [WARN ] [VALIDATOR ] BTX: Validation failed - insufficient historical data. Have 149 unique days, need 200 days [2025-09-23T17:46:32.710936] [FATAL] [MAIN ] BTX: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:46:32.711017] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:46:32.711092] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-09-23T17:46:32.711157] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-09-23T17:46:32.711206] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-09-23T17:46:32.711274] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-09-23T17:46:32.711368] [INFO ] [MAIN ] Update Progress: 354/2372 symbols completed. BTX took 31.4s. Estimated remaining: 4h 25m 2s. Rate: 7.6 symbols/min [2025-09-23T17:46:32.888636] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:46:32.957307] [DEBUG] [LOCAL ] BUR: Loaded 45095 existing records from primary storage. [2025-09-23T17:46:32.957483] [INFO ] [MAIN ] BUR: Loaded 45095 existing records. [2025-09-23T17:46:33.011281] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-07. [2025-09-23T17:46:33.143173] [WARN ] [MAIN ] BUR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:46:33.143558] [INFO ] [MAIN ] BUR: Wiping existing primary data before full refresh. [2025-09-23T17:46:33.143682] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-09-23T17:46:33.152409] [DEBUG] [LOCAL ] BUR: Deleted primary data file. [2025-09-23T17:46:33.154020] [INFO ] [MAIN ] BUR: Starting full primary refresh. [2025-09-23T17:46:33.212597] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-23T17:46:33.254021] [INFO ] [REMOTE ] BTZ: Full fetch complete (33843 records). [2025-09-23T17:46:33.264358] [DEBUG] [VALIDATOR ] BTZ: Validating primary data. [2025-09-23T17:46:33.825891] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-02. [2025-09-23T17:46:33.834027] [INFO ] [REMOTE ] BUR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:46:33.923231] [DEBUG] [VALIDATOR ] BTZ: All expected trading days are present. [2025-09-23T17:46:33.923306] [DEBUG] [VALIDATOR ] BTZ: Primary data validation passed. [2025-09-23T17:46:33.923771] [INFO ] [MAIN ] BTZ: Fetched primary data is valid. [2025-09-23T17:46:33.923835] [DEBUG] [LOCAL ] BTZ: Saving primary data. [2025-09-23T17:46:33.924754] [DEBUG] [LOCAL ] BTZ: Trimmed 33843 records to 22844 (keeping 200 days of data) [2025-09-23T17:46:34.076076] [DEBUG] [LOCAL ] BTZ: Primary data saved (22844 records). [2025-09-23T17:46:34.076240] [INFO ] [MAIN ] BTZ: Full history saved. [2025-09-23T17:46:34.076351] [INFO ] [MAIN ] Update Progress: 355/2372 symbols completed. BTZ took 31.9s. Estimated remaining: 4h 24m 17s. Rate: 7.6 symbols/min [2025-09-23T17:46:34.245769] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:46:34.298057] [DEBUG] [LOCAL ] BURL: Loaded 46416 existing records from primary storage. [2025-09-23T17:46:34.298221] [INFO ] [MAIN ] BURL: Loaded 46416 existing records. [2025-09-23T17:46:34.478824] [WARN ] [MAIN ] BURL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:46:34.479104] [INFO ] [MAIN ] BURL: Wiping existing primary data before full refresh. [2025-09-23T17:46:34.479152] [INFO ] [LOCAL ] BURL: Starting deletion of primary data. [2025-09-23T17:46:34.480230] [DEBUG] [LOCAL ] BURL: Deleted primary data file. [2025-09-23T17:46:34.480292] [INFO ] [MAIN ] BURL: Starting full primary refresh. [2025-09-23T17:46:34.607036] [INFO ] [REMOTE ] BUR: Fetching primary data for 2024-12. [2025-09-23T17:46:34.752414] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-23T17:46:34.864527] [INFO ] [REMOTE ] BURL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:46:34.925978] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-23T17:46:35.402192] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-08. [2025-09-23T17:46:35.738488] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-23T17:46:36.202208] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-01. [2025-09-23T17:46:36.799358] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-23T17:46:37.002208] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-03. [2025-09-23T17:46:37.256893] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-23T17:46:37.802169] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-02. [2025-09-23T17:46:37.867866] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-23T17:46:38.602187] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-09. [2025-09-23T17:46:39.285015] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-23T17:46:39.402226] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-04. [2025-09-23T17:46:40.151033] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-23T17:46:40.160821] [INFO ] [REMOTE ] BUD: Full fetch complete (76487 records). [2025-09-23T17:46:40.160962] [DEBUG] [VALIDATOR ] BUD: Validating primary data. [2025-09-23T17:46:40.207474] [INFO ] [REMOTE ] BURL: Fetching primary data for 2024-12. [2025-09-23T17:46:40.358470] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-23T17:46:40.596971] [DEBUG] [VALIDATOR ] BUD: All expected trading days are present. [2025-09-23T17:46:40.597101] [DEBUG] [VALIDATOR ] BUD: Primary data validation passed. [2025-09-23T17:46:40.597990] [INFO ] [MAIN ] BUD: Fetched primary data is valid. [2025-09-23T17:46:40.598063] [DEBUG] [LOCAL ] BUD: Saving primary data. [2025-09-23T17:46:40.602597] [DEBUG] [LOCAL ] BUD: Trimmed 76487 records to 52743 (keeping 200 days of data) [2025-09-23T17:46:40.941916] [DEBUG] [LOCAL ] BUD: Primary data saved (52743 records). [2025-09-23T17:46:40.942070] [INFO ] [MAIN ] BUD: Full history saved. [2025-09-23T17:46:40.942226] [INFO ] [MAIN ] Update Progress: 356/2372 symbols completed. BUD took 33.1s. Estimated remaining: 4h 24m 3s. Rate: 7.6 symbols/min [2025-09-23T17:46:41.011685] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-05. [2025-09-23T17:46:41.128064] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:46:41.147846] [DEBUG] [LOCAL ] BUXX: Loaded 15166 existing records from primary storage. [2025-09-23T17:46:41.148007] [INFO ] [MAIN ] BUXX: Loaded 15166 existing records. [2025-09-23T17:46:41.359275] [WARN ] [MAIN ] BUXX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:46:41.359575] [INFO ] [MAIN ] BUXX: Wiping existing primary data before full refresh. [2025-09-23T17:46:41.359626] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-09-23T17:46:41.360332] [DEBUG] [LOCAL ] BUXX: Deleted primary data file. [2025-09-23T17:46:41.360398] [INFO ] [MAIN ] BUXX: Starting full primary refresh. [2025-09-23T17:46:41.718787] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-23T17:46:41.810237] [INFO ] [REMOTE ] BUXX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:46:41.803407] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-06. [2025-09-23T17:46:41.838039] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-23T17:46:42.385354] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-23T17:46:42.602182] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-03. [2025-09-23T17:46:43.402210] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2024-12. [2025-09-23T17:46:44.183503] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-23T17:46:44.202151] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-04. [2025-09-23T17:46:44.219868] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-23T17:46:45.002218] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-07. [2025-09-23T17:46:45.432518] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-23T17:46:45.802214] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-05. [2025-09-23T17:46:45.986215] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-23T17:46:46.602269] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-08. [2025-09-23T17:46:47.159153] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-23T17:46:47.396268] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-23T17:46:47.405141] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-09. [2025-09-23T17:46:48.202262] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-06. [2025-09-23T17:46:48.576954] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-23T17:46:48.579673] [INFO ] [REMOTE ] BUI: Full fetch complete (16139 records). [2025-09-23T17:46:48.579761] [DEBUG] [VALIDATOR ] BUI: Validating primary data. [2025-09-23T17:46:48.947859] [DEBUG] [VALIDATOR ] BUI: All expected trading days are present. [2025-09-23T17:46:48.947938] [DEBUG] [VALIDATOR ] BUI: Primary data validation passed. [2025-09-23T17:46:48.948252] [INFO ] [MAIN ] BUI: Fetched primary data is valid. [2025-09-23T17:46:48.948293] [DEBUG] [LOCAL ] BUI: Saving primary data. [2025-09-23T17:46:48.948883] [DEBUG] [LOCAL ] BUI: Trimmed 16139 records to 11464 (keeping 200 days of data) [2025-09-23T17:46:49.003292] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-01. [2025-09-23T17:46:49.020926] [DEBUG] [LOCAL ] BUI: Primary data saved (11464 records). [2025-09-23T17:46:49.021047] [INFO ] [MAIN ] BUI: Full history saved. [2025-09-23T17:46:49.021131] [INFO ] [MAIN ] Update Progress: 357/2372 symbols completed. BUI took 25.4s. Estimated remaining: 4h 23m 57s. Rate: 7.6 symbols/min [2025-09-23T17:46:49.385027] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-23T17:46:49.484750] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-23T17:46:49.802207] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-01. [2025-09-23T17:46:50.602212] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-02. [2025-09-23T17:46:51.078723] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-23T17:46:51.403109] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-23T17:46:51.403215] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-03. [2025-09-23T17:46:52.013217] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-23T17:46:52.202214] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-07. [2025-09-23T17:46:53.002209] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-04. [2025-09-23T17:46:53.547201] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-23T17:46:53.656434] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-23T17:46:53.802238] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-08. [2025-09-23T17:46:54.602288] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-05. [2025-09-23T17:46:54.926699] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-23T17:46:55.402221] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-09. [2025-09-23T17:46:55.613833] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-23T17:46:56.202221] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-06. [2025-09-23T17:46:56.906701] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-23T17:46:56.914419] [INFO ] [REMOTE ] BUR: Full fetch complete (62927 records). [2025-09-23T17:46:56.925217] [DEBUG] [VALIDATOR ] BUR: Validating primary data. [2025-09-23T17:46:56.926563] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-23T17:46:56.927228] [FATAL] [VALIDATOR ] BUR: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:46:56.927496] [FATAL] [MAIN ] BUR: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:46:56.931771] [WARN ] [MAIN ] BUR: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:46:56.931857] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-09-23T17:46:56.931931] [DEBUG] [LOCAL ] BUR: No primary data file found to delete. [2025-09-23T17:46:56.931992] [INFO ] [LOCAL ] BUR: Starting deletion of derivative data. [2025-09-23T17:46:56.932596] [DEBUG] [LOCAL ] BUR: Deleted derivative data file. [2025-09-23T17:46:56.932743] [INFO ] [MAIN ] Update Progress: 358/2372 symbols completed. BUR took 24.2s. Estimated remaining: 4h 23m 49s. Rate: 7.6 symbols/min [2025-09-23T17:46:57.002161] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-07. [2025-09-23T17:46:57.710302] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-23T17:46:57.802254] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-08. [2025-09-23T17:46:58.316843] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-23T17:46:58.602258] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-09. [2025-09-23T17:46:59.295611] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-23T17:46:59.298550] [INFO ] [REMOTE ] BUXX: Full fetch complete (20255 records). [2025-09-23T17:46:59.298704] [DEBUG] [VALIDATOR ] BUXX: Validating primary data. [2025-09-23T17:46:59.407074] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-02. [2025-09-23T17:46:59.681130] [DEBUG] [VALIDATOR ] BUXX: All expected trading days are present. [2025-09-23T17:46:59.681250] [DEBUG] [VALIDATOR ] BUXX: Primary data validation passed. [2025-09-23T17:46:59.681786] [INFO ] [MAIN ] BUXX: Fetched primary data is valid. [2025-09-23T17:46:59.681853] [DEBUG] [LOCAL ] BUXX: Saving primary data. [2025-09-23T17:46:59.682594] [DEBUG] [LOCAL ] BUXX: Trimmed 20255 records to 15142 (keeping 200 days of data) [2025-09-23T17:46:59.776867] [DEBUG] [LOCAL ] BUXX: Primary data saved (15142 records). [2025-09-23T17:46:59.777024] [INFO ] [MAIN ] BUXX: Full history saved. [2025-09-23T17:46:59.777113] [INFO ] [MAIN ] Update Progress: 359/2372 symbols completed. BUXX took 18.8s. Estimated remaining: 4h 23m 13s. Rate: 7.6 symbols/min [2025-09-23T17:47:00.819361] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-23T17:47:00.828334] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-03. [2025-09-23T17:47:02.291554] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-23T17:47:02.302272] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-04. [2025-09-23T17:47:03.801420] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-23T17:47:03.812904] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-05. [2025-09-23T17:47:05.593229] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-23T17:47:05.603375] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-06. [2025-09-23T17:47:06.815300] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-23T17:47:06.824758] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-07. [2025-09-23T17:47:08.519434] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-23T17:47:08.529447] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-08. [2025-09-23T17:47:09.818798] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-23T17:47:09.829037] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-09. [2025-09-23T17:47:11.854926] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-23T17:47:11.864171] [INFO ] [REMOTE ] BURL: Full fetch complete (65664 records). [2025-09-23T17:47:11.864449] [DEBUG] [VALIDATOR ] BURL: Validating primary data. [2025-09-23T17:47:12.258166] [DEBUG] [VALIDATOR ] BURL: All expected trading days are present. [2025-09-23T17:47:12.258254] [DEBUG] [VALIDATOR ] BURL: Primary data validation passed. [2025-09-23T17:47:12.258976] [INFO ] [MAIN ] BURL: Fetched primary data is valid. [2025-09-23T17:47:12.259043] [DEBUG] [LOCAL ] BURL: Saving primary data. [2025-09-23T17:47:12.260396] [DEBUG] [LOCAL ] BURL: Trimmed 65664 records to 46328 (keeping 200 days of data) [2025-09-23T17:47:12.544445] [DEBUG] [LOCAL ] BURL: Primary data saved (46328 records). [2025-09-23T17:47:12.544605] [INFO ] [MAIN ] BURL: Full history saved. [2025-09-23T17:47:12.544758] [INFO ] [MAIN ] Update Progress: 360/2372 symbols completed. BURL took 38.5s. Estimated remaining: 4h 23m 33s. Rate: 7.6 symbols/min [2025-09-23T17:47:13.163355] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:47:13.267148] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:47:13.298561] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:47:13.322406] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:47:13.384049] [DEBUG] [LOCAL ] BW: Loaded 39509 existing records from primary storage. [2025-09-23T17:47:13.384336] [INFO ] [MAIN ] BW: Loaded 39509 existing records. [2025-09-23T17:47:13.553178] [DEBUG] [LOCAL ] BV: Loaded 38631 existing records from primary storage. [2025-09-23T17:47:13.575731] [INFO ] [MAIN ] BV: Loaded 38631 existing records. [2025-09-23T17:47:13.654910] [DEBUG] [LOCAL ] BVN: Loaded 43798 existing records from primary storage. [2025-09-23T17:47:13.743446] [INFO ] [MAIN ] BVN: Loaded 43798 existing records. [2025-09-23T17:47:13.744315] [DEBUG] [LOCAL ] BWA: Loaded 52257 existing records from primary storage. [2025-09-23T17:47:13.755008] [INFO ] [MAIN ] BWA: Loaded 52257 existing records. [2025-09-23T17:47:13.743255] [WARN ] [MAIN ] BW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:47:13.946215] [INFO ] [MAIN ] BW: Wiping existing primary data before full refresh. [2025-09-23T17:47:14.010782] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-09-23T17:47:14.129743] [WARN ] [MAIN ] BV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:47:14.203800] [DEBUG] [LOCAL ] BW: Deleted primary data file. [2025-09-23T17:47:14.230267] [INFO ] [MAIN ] BW: Starting full primary refresh. [2025-09-23T17:47:14.230187] [INFO ] [MAIN ] BV: Wiping existing primary data before full refresh. [2025-09-23T17:47:14.243478] [WARN ] [MAIN ] BVN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:47:14.243595] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-09-23T17:47:14.302755] [WARN ] [MAIN ] BWA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:47:14.320964] [DEBUG] [LOCAL ] BV: Deleted primary data file. [2025-09-23T17:47:14.347337] [INFO ] [MAIN ] BWA: Wiping existing primary data before full refresh. [2025-09-23T17:47:14.347487] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-09-23T17:47:14.331571] [INFO ] [MAIN ] BVN: Wiping existing primary data before full refresh. [2025-09-23T17:47:14.362123] [INFO ] [MAIN ] BV: Starting full primary refresh. [2025-09-23T17:47:14.362325] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-09-23T17:47:14.398461] [DEBUG] [LOCAL ] BVN: Deleted primary data file. [2025-09-23T17:47:14.389584] [DEBUG] [LOCAL ] BWA: Deleted primary data file. [2025-09-23T17:47:14.424594] [INFO ] [MAIN ] BWA: Starting full primary refresh. [2025-09-23T17:47:14.424477] [INFO ] [MAIN ] BVN: Starting full primary refresh. [2025-09-23T17:47:15.443936] [INFO ] [REMOTE ] BW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:47:15.517020] [INFO ] [REMOTE ] BW: Fetching primary data for 2024-12. [2025-09-23T17:47:15.641923] [INFO ] [REMOTE ] BV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:47:15.643149] [INFO ] [REMOTE ] BV: Fetching primary data for 2024-12. [2025-09-23T17:47:15.769142] [INFO ] [REMOTE ] BVN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:47:15.814097] [INFO ] [REMOTE ] BVN: Fetching primary data for 2024-12. [2025-09-23T17:47:15.820500] [INFO ] [REMOTE ] BWA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:47:15.821595] [INFO ] [REMOTE ] BWA: Fetching primary data for 2024-12. [2025-09-23T17:47:17.019484] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-23T17:47:17.028789] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-01. [2025-09-23T17:47:17.178462] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-23T17:47:17.199672] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-01. [2025-09-23T17:47:17.202221] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-23T17:47:17.209892] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-01. [2025-09-23T17:47:17.299725] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-23T17:47:17.310519] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-01. [2025-09-23T17:47:18.075428] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-23T17:47:18.081523] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-02. [2025-09-23T17:47:18.185230] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-23T17:47:18.194319] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-02. [2025-09-23T17:47:18.351052] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-23T17:47:18.359361] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-02. [2025-09-23T17:47:18.640968] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-23T17:47:18.651608] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-02. [2025-09-23T17:47:19.034175] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-23T17:47:19.042050] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-03. [2025-09-23T17:47:19.141242] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-23T17:47:19.149606] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-03. [2025-09-23T17:47:19.474252] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-23T17:47:19.482887] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-03. [2025-09-23T17:47:19.983094] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-23T17:47:19.993353] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-03. [2025-09-23T17:47:20.075997] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-23T17:47:20.084377] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-04. [2025-09-23T17:47:20.255157] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-23T17:47:20.264296] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-04. [2025-09-23T17:47:20.718207] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-23T17:47:20.727482] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-04. [2025-09-23T17:47:21.140268] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-23T17:47:21.148602] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-05. [2025-09-23T17:47:21.332150] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-23T17:47:21.501465] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-23T17:47:21.802202] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-05. [2025-09-23T17:47:22.233538] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-23T17:47:22.271332] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-23T17:47:22.602201] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-05. [2025-09-23T17:47:23.312856] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-23T17:47:23.402184] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-04. [2025-09-23T17:47:24.105937] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-23T17:47:24.202200] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-06. [2025-09-23T17:47:24.800581] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-23T17:47:25.002212] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-06. [2025-09-23T17:47:25.454611] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-23T17:47:25.802187] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-07. [2025-09-23T17:47:26.093885] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-23T17:47:26.602214] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-07. [2025-09-23T17:47:27.061183] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-23T17:47:27.402256] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-05. [2025-09-23T17:47:28.131378] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-23T17:47:28.202164] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-08. [2025-09-23T17:47:28.981690] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-23T17:47:29.002208] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-08. [2025-09-23T17:47:29.383989] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-23T17:47:29.802250] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-06. [2025-09-23T17:47:30.398577] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-23T17:47:30.602212] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-09. [2025-09-23T17:47:31.104174] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-23T17:47:31.402224] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-06. [2025-09-23T17:47:31.979032] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-23T17:47:31.987393] [INFO ] [REMOTE ] BW: Full fetch complete (58711 records). [2025-09-23T17:47:31.987564] [DEBUG] [VALIDATOR ] BW: Validating primary data. [2025-09-23T17:47:32.207291] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-09. [2025-09-23T17:47:32.382008] [DEBUG] [VALIDATOR ] BW: All expected trading days are present. [2025-09-23T17:47:32.382097] [DEBUG] [VALIDATOR ] BW: Primary data validation passed. [2025-09-23T17:47:32.382754] [INFO ] [MAIN ] BW: Fetched primary data is valid. [2025-09-23T17:47:32.382818] [DEBUG] [LOCAL ] BW: Saving primary data. [2025-09-23T17:47:32.384078] [DEBUG] [LOCAL ] BW: Trimmed 58711 records to 39536 (keeping 200 days of data) [2025-09-23T17:47:32.610472] [DEBUG] [LOCAL ] BW: Primary data saved (39536 records). [2025-09-23T17:47:32.610660] [INFO ] [MAIN ] BW: Full history saved. [2025-09-23T17:47:32.610768] [INFO ] [MAIN ] Update Progress: 361/2372 symbols completed. BW took 20.1s. Estimated remaining: 4h 24m 33s. Rate: 7.6 symbols/min [2025-09-23T17:47:32.794604] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:47:32.811345] [DEBUG] [LOCAL ] BWG: Loaded 12327 existing records from primary storage. [2025-09-23T17:47:32.811494] [INFO ] [MAIN ] BWG: Loaded 12327 existing records. [2025-09-23T17:47:33.003522] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-07. [2025-09-23T17:47:33.009726] [WARN ] [MAIN ] BWG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:47:33.011273] [INFO ] [MAIN ] BWG: Wiping existing primary data before full refresh. [2025-09-23T17:47:33.011528] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-09-23T17:47:33.012170] [DEBUG] [LOCAL ] BWG: Deleted primary data file. [2025-09-23T17:47:33.012234] [INFO ] [MAIN ] BWG: Starting full primary refresh. [2025-09-23T17:47:33.344395] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-23T17:47:33.432930] [INFO ] [REMOTE ] BWG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:47:33.483005] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-23T17:47:33.490212] [INFO ] [REMOTE ] BV: Full fetch complete (53803 records). [2025-09-23T17:47:33.490391] [DEBUG] [VALIDATOR ] BV: Validating primary data. [2025-09-23T17:47:33.807329] [INFO ] [REMOTE ] BWG: Fetching primary data for 2024-12. [2025-09-23T17:47:33.881848] [DEBUG] [VALIDATOR ] BV: All expected trading days are present. [2025-09-23T17:47:33.881968] [DEBUG] [VALIDATOR ] BV: Primary data validation passed. [2025-09-23T17:47:33.882799] [INFO ] [MAIN ] BV: Fetched primary data is valid. [2025-09-23T17:47:33.882878] [DEBUG] [LOCAL ] BV: Saving primary data. [2025-09-23T17:47:33.884156] [DEBUG] [LOCAL ] BV: Trimmed 53803 records to 38602 (keeping 200 days of data) [2025-09-23T17:47:34.104529] [DEBUG] [LOCAL ] BV: Primary data saved (38602 records). [2025-09-23T17:47:34.104713] [INFO ] [MAIN ] BV: Full history saved. [2025-09-23T17:47:34.104814] [INFO ] [MAIN ] Update Progress: 362/2372 symbols completed. BV took 21.6s. Estimated remaining: 4h 23m 49s. Rate: 7.6 symbols/min [2025-09-23T17:47:34.299505] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:47:34.337461] [DEBUG] [LOCAL ] BWLP: Loaded 32842 existing records from primary storage. [2025-09-23T17:47:34.337824] [INFO ] [MAIN ] BWLP: Loaded 32842 existing records. [2025-09-23T17:47:34.530954] [WARN ] [MAIN ] BWLP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:47:34.531552] [INFO ] [MAIN ] BWLP: Wiping existing primary data before full refresh. [2025-09-23T17:47:34.531620] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-09-23T17:47:34.532915] [DEBUG] [LOCAL ] BWLP: Deleted primary data file. [2025-09-23T17:47:34.532979] [INFO ] [MAIN ] BWLP: Starting full primary refresh. [2025-09-23T17:47:34.604308] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-07. [2025-09-23T17:47:34.758911] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-23T17:47:34.881565] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-23T17:47:34.978126] [INFO ] [REMOTE ] BWLP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:47:35.402195] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-08. [2025-09-23T17:47:35.746225] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-23T17:47:36.202204] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-01. [2025-09-23T17:47:36.819301] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-23T17:47:36.884508] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-23T17:47:37.002216] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2024-12. [2025-09-23T17:47:37.802199] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-09. [2025-09-23T17:47:38.557556] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-23T17:47:38.602249] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-01. [2025-09-23T17:47:39.348255] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-23T17:47:39.364664] [INFO ] [REMOTE ] BWA: Full fetch complete (75763 records). [2025-09-23T17:47:39.364908] [DEBUG] [VALIDATOR ] BWA: Validating primary data. [2025-09-23T17:47:39.402306] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-08. [2025-09-23T17:47:39.890872] [DEBUG] [VALIDATOR ] BWA: All expected trading days are present. [2025-09-23T17:47:39.891053] [DEBUG] [VALIDATOR ] BWA: Primary data validation passed. [2025-09-23T17:47:39.892096] [INFO ] [MAIN ] BWA: Fetched primary data is valid. [2025-09-23T17:47:39.892257] [DEBUG] [LOCAL ] BWA: Saving primary data. [2025-09-23T17:47:39.894360] [DEBUG] [LOCAL ] BWA: Trimmed 75763 records to 52250 (keeping 200 days of data) [2025-09-23T17:47:40.203271] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-02. [2025-09-23T17:47:40.252435] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-23T17:47:40.287291] [DEBUG] [LOCAL ] BWA: Primary data saved (52250 records). [2025-09-23T17:47:40.287474] [INFO ] [MAIN ] BWA: Full history saved. [2025-09-23T17:47:40.287606] [INFO ] [MAIN ] Update Progress: 363/2372 symbols completed. BWA took 27.7s. Estimated remaining: 4h 23m 32s. Rate: 7.6 symbols/min [2025-09-23T17:47:40.480537] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:47:40.490843] [DEBUG] [LOCAL ] BWMX: Loaded 7613 existing records from primary storage. [2025-09-23T17:47:40.490982] [INFO ] [MAIN ] BWMX: Loaded 7613 existing records. [2025-09-23T17:47:40.693602] [WARN ] [MAIN ] BWMX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:47:40.693957] [INFO ] [MAIN ] BWMX: Wiping existing primary data before full refresh. [2025-09-23T17:47:40.694105] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-09-23T17:47:40.694628] [DEBUG] [LOCAL ] BWMX: Deleted primary data file. [2025-09-23T17:47:40.694725] [INFO ] [MAIN ] BWMX: Starting full primary refresh. [2025-09-23T17:47:40.865944] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-23T17:47:40.872730] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-23T17:47:41.010298] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-03. [2025-09-23T17:47:41.132227] [INFO ] [REMOTE ] BWMX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:47:41.509498] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-23T17:47:41.802190] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-09. [2025-09-23T17:47:42.602214] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-04. [2025-09-23T17:47:43.191431] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-23T17:47:43.199925] [INFO ] [REMOTE ] BVN: Full fetch complete (62621 records). [2025-09-23T17:47:43.200098] [DEBUG] [VALIDATOR ] BVN: Validating primary data. [2025-09-23T17:47:43.402293] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2024-12. [2025-09-23T17:47:43.447887] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-23T17:47:43.612766] [DEBUG] [VALIDATOR ] BVN: All expected trading days are present. [2025-09-23T17:47:43.612915] [DEBUG] [VALIDATOR ] BVN: Primary data validation passed. [2025-09-23T17:47:43.613720] [INFO ] [MAIN ] BVN: Fetched primary data is valid. [2025-09-23T17:47:43.613787] [DEBUG] [LOCAL ] BVN: Saving primary data. [2025-09-23T17:47:43.615820] [DEBUG] [LOCAL ] BVN: Trimmed 62621 records to 43805 (keeping 200 days of data) [2025-09-23T17:47:43.880271] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-23T17:47:43.893943] [DEBUG] [LOCAL ] BVN: Primary data saved (43805 records). [2025-09-23T17:47:43.894089] [INFO ] [MAIN ] BVN: Full history saved. [2025-09-23T17:47:43.894179] [INFO ] [MAIN ] Update Progress: 364/2372 symbols completed. BVN took 31.3s. Estimated remaining: 4h 23m 1s. Rate: 7.6 symbols/min [2025-09-23T17:47:44.061192] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:47:44.067633] [DEBUG] [LOCAL ] BWNB: Loaded 4485 existing records from primary storage. [2025-09-23T17:47:44.067764] [INFO ] [MAIN ] BWNB: Loaded 4485 existing records. [2025-09-23T17:47:44.209090] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-02. [2025-09-23T17:47:44.251604] [WARN ] [MAIN ] BWNB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:47:44.251884] [INFO ] [MAIN ] BWNB: Wiping existing primary data before full refresh. [2025-09-23T17:47:44.251965] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-09-23T17:47:44.252265] [DEBUG] [LOCAL ] BWNB: Deleted primary data file. [2025-09-23T17:47:44.252338] [INFO ] [MAIN ] BWNB: Starting full primary refresh. [2025-09-23T17:47:44.607586] [INFO ] [REMOTE ] BWNB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:47:45.002203] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2024-12. [2025-09-23T17:47:45.261137] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-23T17:47:45.426797] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-23T17:47:45.802281] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-05. [2025-09-23T17:47:46.495975] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-23T17:47:46.602245] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-03. [2025-09-23T17:47:47.402212] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-06. [2025-09-23T17:47:47.758505] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-23T17:47:48.078690] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-23T17:47:48.202203] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-04. [2025-09-23T17:47:49.002229] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-01. [2025-09-23T17:47:49.256284] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-23T17:47:49.454873] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-23T17:47:49.802229] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-01. [2025-09-23T17:47:50.241871] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-23T17:47:50.602222] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-02. [2025-09-23T17:47:51.132844] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-23T17:47:51.402214] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-02. [2025-09-23T17:47:51.842957] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-23T17:47:52.202195] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-03. [2025-09-23T17:47:52.921308] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-23T17:47:53.002196] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-03. [2025-09-23T17:47:53.553071] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-23T17:47:53.802222] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-04. [2025-09-23T17:47:54.244534] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-23T17:47:54.602237] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-05. [2025-09-23T17:47:55.402207] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-04. [2025-09-23T17:47:55.767062] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-23T17:47:55.861040] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-23T17:47:56.202210] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-06. [2025-09-23T17:47:57.002235] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-05. [2025-09-23T17:47:57.154428] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-23T17:47:57.458170] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-23T17:47:57.802230] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-06. [2025-09-23T17:47:58.255217] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-23T17:47:58.602240] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-05. [2025-09-23T17:47:59.074226] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-23T17:47:59.402242] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-06. [2025-09-23T17:47:59.814561] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-23T17:48:00.202198] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-07. [2025-09-23T17:48:01.002195] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-07. [2025-09-23T17:48:01.534980] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-23T17:48:01.703095] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-23T17:48:01.802256] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-08. [2025-09-23T17:48:02.602200] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-07. [2025-09-23T17:48:03.402199] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-08. [2025-09-23T17:48:03.549452] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-23T17:48:03.832669] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-23T17:48:03.949423] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-23T17:48:04.202205] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-08. [2025-09-23T17:48:05.002177] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-09. [2025-09-23T17:48:05.241304] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-23T17:48:05.511372] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-23T17:48:05.512763] [INFO ] [REMOTE ] BWNB: Full fetch complete (5734 records). [2025-09-23T17:48:05.512836] [DEBUG] [VALIDATOR ] BWNB: Validating primary data. [2025-09-23T17:48:05.513255] [FATAL] [VALIDATOR ] BWNB: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:48:05.513366] [FATAL] [MAIN ] BWNB: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:48:05.513450] [WARN ] [MAIN ] BWNB: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:48:05.513541] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-09-23T17:48:05.513637] [DEBUG] [LOCAL ] BWNB: No primary data file found to delete. [2025-09-23T17:48:05.513731] [INFO ] [LOCAL ] BWNB: Starting deletion of derivative data. [2025-09-23T17:48:05.514330] [DEBUG] [LOCAL ] BWNB: Deleted derivative data file. [2025-09-23T17:48:05.514431] [INFO ] [MAIN ] Update Progress: 365/2372 symbols completed. BWNB took 21.6s. Estimated remaining: 4h 24m 9s. Rate: 7.6 symbols/min [2025-09-23T17:48:05.689753] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:48:05.690063] [DEBUG] [LOCAL ] BWSN: No existing data file found in primary storage. [2025-09-23T17:48:05.690118] [WARN ] [MAIN ] BWSN: No existing data found, performing full refresh instead. [2025-09-23T17:48:05.690360] [INFO ] [MAIN ] BWSN: Wiping existing primary data before full refresh. [2025-09-23T17:48:05.690416] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-09-23T17:48:05.690460] [DEBUG] [LOCAL ] BWSN: No primary data file found to delete. [2025-09-23T17:48:05.690493] [INFO ] [MAIN ] BWSN: Starting full primary refresh. [2025-09-23T17:48:05.807258] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-09. [2025-09-23T17:48:06.072248] [INFO ] [REMOTE ] BWSN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:48:06.602154] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-09. [2025-09-23T17:48:06.737705] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-23T17:48:06.740825] [INFO ] [REMOTE ] BWG: Full fetch complete (17689 records). [2025-09-23T17:48:06.741092] [DEBUG] [VALIDATOR ] BWG: Validating primary data. [2025-09-23T17:48:07.136864] [DEBUG] [VALIDATOR ] BWG: All expected trading days are present. [2025-09-23T17:48:07.136995] [DEBUG] [VALIDATOR ] BWG: Primary data validation passed. [2025-09-23T17:48:07.137442] [INFO ] [MAIN ] BWG: Fetched primary data is valid. [2025-09-23T17:48:07.137517] [DEBUG] [LOCAL ] BWG: Saving primary data. [2025-09-23T17:48:07.138310] [DEBUG] [LOCAL ] BWG: Trimmed 17689 records to 12317 (keeping 200 days of data) [2025-09-23T17:48:07.226689] [DEBUG] [LOCAL ] BWG: Primary data saved (12317 records). [2025-09-23T17:48:07.226854] [INFO ] [MAIN ] BWG: Full history saved. [2025-09-23T17:48:07.226976] [INFO ] [MAIN ] Update Progress: 366/2372 symbols completed. BWG took 34.6s. Estimated remaining: 4h 23m 27s. Rate: 7.6 symbols/min [2025-09-23T17:48:07.400683] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:48:07.401023] [DEBUG] [LOCAL ] BWXT: No existing data file found in primary storage. [2025-09-23T17:48:07.401079] [WARN ] [MAIN ] BWXT: No existing data found, performing full refresh instead. [2025-09-23T17:48:07.401253] [INFO ] [MAIN ] BWXT: Wiping existing primary data before full refresh. [2025-09-23T17:48:07.401306] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-09-23T17:48:07.401352] [DEBUG] [LOCAL ] BWXT: No primary data file found to delete. [2025-09-23T17:48:07.401386] [INFO ] [MAIN ] BWXT: Starting full primary refresh. [2025-09-23T17:48:07.412491] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2024-12. [2025-09-23T17:48:07.764664] [INFO ] [REMOTE ] BWXT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:48:08.067583] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-23T17:48:08.073089] [INFO ] [REMOTE ] BWLP: Full fetch complete (48651 records). [2025-09-23T17:48:08.073190] [DEBUG] [VALIDATOR ] BWLP: Validating primary data. [2025-09-23T17:48:08.156927] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-23T17:48:08.217552] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-07. [2025-09-23T17:48:08.456052] [DEBUG] [VALIDATOR ] BWLP: All expected trading days are present. [2025-09-23T17:48:08.456142] [DEBUG] [VALIDATOR ] BWLP: Primary data validation passed. [2025-09-23T17:48:08.456754] [INFO ] [MAIN ] BWLP: Fetched primary data is valid. [2025-09-23T17:48:08.456819] [DEBUG] [LOCAL ] BWLP: Saving primary data. [2025-09-23T17:48:08.457978] [DEBUG] [LOCAL ] BWLP: Trimmed 48651 records to 32847 (keeping 200 days of data) [2025-09-23T17:48:08.665077] [DEBUG] [LOCAL ] BWLP: Primary data saved (32847 records). [2025-09-23T17:48:08.665257] [INFO ] [MAIN ] BWLP: Full history saved. [2025-09-23T17:48:08.665351] [INFO ] [MAIN ] Update Progress: 367/2372 symbols completed. BWLP took 34.6s. Estimated remaining: 4h 22m 44s. Rate: 7.6 symbols/min [2025-09-23T17:48:08.832762] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:48:08.889231] [DEBUG] [LOCAL ] BX: Loaded 53501 existing records from primary storage. [2025-09-23T17:48:08.889378] [INFO ] [MAIN ] BX: Loaded 53501 existing records. [2025-09-23T17:48:09.004861] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-01. [2025-09-23T17:48:09.054044] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-23T17:48:09.091143] [WARN ] [MAIN ] BX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:48:09.091392] [INFO ] [MAIN ] BX: Wiping existing primary data before full refresh. [2025-09-23T17:48:09.091458] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-09-23T17:48:09.093158] [DEBUG] [LOCAL ] BX: Deleted primary data file. [2025-09-23T17:48:09.093222] [INFO ] [MAIN ] BX: Starting full primary refresh. [2025-09-23T17:48:09.448840] [INFO ] [REMOTE ] BX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:48:09.481449] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-23T17:48:09.802276] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-08. [2025-09-23T17:48:10.577891] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-23T17:48:10.602168] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2024-12. [2025-09-23T17:48:11.402209] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-02. [2025-09-23T17:48:11.711960] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-09-23T17:48:12.202217] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-09. [2025-09-23T17:48:12.367151] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-23T17:48:12.734849] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-23T17:48:12.737434] [INFO ] [REMOTE ] BWMX: Full fetch complete (10057 records). [2025-09-23T17:48:12.737542] [DEBUG] [VALIDATOR ] BWMX: Validating primary data. [2025-09-23T17:48:13.007386] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-03. [2025-09-23T17:48:13.103400] [DEBUG] [VALIDATOR ] BWMX: All expected trading days are present. [2025-09-23T17:48:13.103478] [DEBUG] [VALIDATOR ] BWMX: Primary data validation passed. [2025-09-23T17:48:13.103731] [INFO ] [MAIN ] BWMX: Fetched primary data is valid. [2025-09-23T17:48:13.103791] [DEBUG] [LOCAL ] BWMX: Saving primary data. [2025-09-23T17:48:13.104223] [DEBUG] [LOCAL ] BWMX: Trimmed 10057 records to 7621 (keeping 200 days of data) [2025-09-23T17:48:13.155340] [DEBUG] [LOCAL ] BWMX: Primary data saved (7621 records). [2025-09-23T17:48:13.155483] [INFO ] [MAIN ] BWMX: Full history saved. [2025-09-23T17:48:13.155568] [INFO ] [MAIN ] Update Progress: 368/2372 symbols completed. BWMX took 32.9s. Estimated remaining: 4h 22m 18s. Rate: 7.6 symbols/min [2025-09-23T17:48:13.324609] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:48:13.324891] [DEBUG] [LOCAL ] BXC: No existing data file found in primary storage. [2025-09-23T17:48:13.324934] [WARN ] [MAIN ] BXC: No existing data found, performing full refresh instead. [2025-09-23T17:48:13.325041] [INFO ] [MAIN ] BXC: Wiping existing primary data before full refresh. [2025-09-23T17:48:13.325079] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-09-23T17:48:13.325152] [DEBUG] [LOCAL ] BXC: No primary data file found to delete. [2025-09-23T17:48:13.325213] [INFO ] [MAIN ] BXC: Starting full primary refresh. [2025-09-23T17:48:13.459110] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-23T17:48:13.693923] [INFO ] [REMOTE ] BXC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:48:13.802195] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-04. [2025-09-23T17:48:14.263948] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-23T17:48:14.602199] [INFO ] [REMOTE ] BXC: Fetching primary data for 2024-12. [2025-09-23T17:48:15.193226] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-23T17:48:15.402219] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-01. [2025-09-23T17:48:16.202224] [INFO ] [REMOTE ] BX: Fetching primary data for 2024-12. [2025-09-23T17:48:17.002220] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-01. [2025-09-23T17:48:17.353818] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-23T17:48:17.802238] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-05. [2025-09-23T17:48:18.048718] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-23T17:48:18.602223] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-02. [2025-09-23T17:48:18.905337] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2024-12 (2.70 seconds). [2025-09-23T17:48:18.922809] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-23T17:48:19.187822] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-23T17:48:19.402198] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-01. [2025-09-23T17:48:20.202199] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-03. [2025-09-23T17:48:20.830254] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-23T17:48:21.003261] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-06. [2025-09-23T17:48:21.003142] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-23T17:48:21.460759] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-23T17:48:21.802254] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-02. [2025-09-23T17:48:22.602224] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-07. [2025-09-23T17:48:22.927896] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-23T17:48:23.323820] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-23T17:48:23.402233] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-03. [2025-09-23T17:48:24.202215] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-02. [2025-09-23T17:48:25.002198] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-08. [2025-09-23T17:48:25.422482] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-23T17:48:25.547380] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-23T17:48:25.625964] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-23T17:48:25.802210] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-04. [2025-09-23T17:48:26.591809] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-23T17:48:26.602136] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-05. [2025-09-23T17:48:27.237981] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-23T17:48:27.402188] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-06. [2025-09-23T17:48:28.202271] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-03. [2025-09-23T17:48:28.295428] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-23T17:48:29.002195] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-04. [2025-09-23T17:48:29.633123] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-23T17:48:29.802178] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-04. [2025-09-23T17:48:30.602197] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-07. [2025-09-23T17:48:30.862852] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-23T17:48:31.280672] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-23T17:48:31.402188] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-08. [2025-09-23T17:48:31.582576] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-23T17:48:32.000767] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-23T17:48:32.202220] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-05. [2025-09-23T17:48:33.002209] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-05. [2025-09-23T17:48:33.802217] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-09. [2025-09-23T17:48:33.923660] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-23T17:48:34.355601] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-23T17:48:34.356927] [INFO ] [REMOTE ] BWSN: Full fetch complete (6143 records). [2025-09-23T17:48:34.357032] [DEBUG] [VALIDATOR ] BWSN: Validating primary data. [2025-09-23T17:48:34.607310] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-09. [2025-09-23T17:48:34.753128] [DEBUG] [VALIDATOR ] BWSN: All expected trading days are present. [2025-09-23T17:48:34.753208] [DEBUG] [VALIDATOR ] BWSN: Primary data validation passed. [2025-09-23T17:48:34.753380] [INFO ] [MAIN ] BWSN: Fetched primary data is valid. [2025-09-23T17:48:34.753453] [DEBUG] [LOCAL ] BWSN: Saving primary data. [2025-09-23T17:48:34.753966] [DEBUG] [LOCAL ] BWSN: Trimmed 6143 records to 5091 (keeping 200 days of data) [2025-09-23T17:48:34.815821] [DEBUG] [LOCAL ] BWSN: Primary data saved (5091 records). [2025-09-23T17:48:34.817244] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-23T17:48:34.817342] [INFO ] [MAIN ] BWSN: Full history saved. [2025-09-23T17:48:34.826588] [INFO ] [MAIN ] Update Progress: 369/2372 symbols completed. BWSN took 29.3s. Estimated remaining: 4h 23m 25s. Rate: 7.6 symbols/min [2025-09-23T17:48:34.996877] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:48:35.054800] [DEBUG] [LOCAL ] BXMT: Loaded 47231 existing records from primary storage. [2025-09-23T17:48:35.054970] [INFO ] [MAIN ] BXMT: Loaded 47231 existing records. [2025-09-23T17:48:35.232241] [WARN ] [MAIN ] BXMT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:48:35.232537] [INFO ] [MAIN ] BXMT: Wiping existing primary data before full refresh. [2025-09-23T17:48:35.232601] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-09-23T17:48:35.234070] [DEBUG] [LOCAL ] BXMT: Deleted primary data file. [2025-09-23T17:48:35.234136] [INFO ] [MAIN ] BXMT: Starting full primary refresh. [2025-09-23T17:48:35.417976] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-06. [2025-09-23T17:48:35.539115] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-23T17:48:35.581476] [INFO ] [REMOTE ] BXC: Full fetch complete (17723 records). [2025-09-23T17:48:35.592418] [DEBUG] [VALIDATOR ] BXC: Validating primary data. [2025-09-23T17:48:35.622988] [INFO ] [REMOTE ] BXMT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:48:35.983223] [DEBUG] [VALIDATOR ] BXC: All expected trading days are present. [2025-09-23T17:48:35.983297] [DEBUG] [VALIDATOR ] BXC: Primary data validation passed. [2025-09-23T17:48:35.983616] [INFO ] [MAIN ] BXC: Fetched primary data is valid. [2025-09-23T17:48:35.983731] [DEBUG] [LOCAL ] BXC: Saving primary data. [2025-09-23T17:48:35.985063] [DEBUG] [LOCAL ] BXC: Trimmed 17723 records to 13767 (keeping 200 days of data) [2025-09-23T17:48:36.073842] [DEBUG] [LOCAL ] BXC: Primary data saved (13767 records). [2025-09-23T17:48:36.073977] [INFO ] [MAIN ] BXC: Full history saved. [2025-09-23T17:48:36.074070] [INFO ] [MAIN ] Update Progress: 370/2372 symbols completed. BXC took 22.9s. Estimated remaining: 4h 22m 41s. Rate: 7.6 symbols/min [2025-09-23T17:48:36.212815] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2024-12. [2025-09-23T17:48:36.245705] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:48:36.245870] [DEBUG] [LOCAL ] BXMX: No existing data file found in primary storage. [2025-09-23T17:48:36.245914] [WARN ] [MAIN ] BXMX: No existing data found, performing full refresh instead. [2025-09-23T17:48:36.246059] [INFO ] [MAIN ] BXMX: Wiping existing primary data before full refresh. [2025-09-23T17:48:36.246101] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-09-23T17:48:36.246142] [DEBUG] [LOCAL ] BXMX: No primary data file found to delete. [2025-09-23T17:48:36.246173] [INFO ] [MAIN ] BXMX: Starting full primary refresh. [2025-09-23T17:48:36.600219] [INFO ] [REMOTE ] BXMX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:48:37.002166] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2024-12. [2025-09-23T17:48:37.441377] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-23T17:48:37.594111] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-23T17:48:37.804216] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-06. [2025-09-23T17:48:37.806817] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-23T17:48:38.602221] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-01. [2025-09-23T17:48:39.338195] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-23T17:48:39.402213] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-02. [2025-09-23T17:48:39.750222] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-23T17:48:40.052026] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-23T17:48:40.202181] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-01. [2025-09-23T17:48:41.002206] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-07. [2025-09-23T17:48:41.478818] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-23T17:48:41.802207] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-07. [2025-09-23T17:48:42.602317] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-03. [2025-09-23T17:48:42.891777] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-23T17:48:43.324216] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-23T17:48:43.402152] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-04. [2025-09-23T17:48:43.958710] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-23T17:48:44.202167] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-02. [2025-09-23T17:48:44.226265] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-23T17:48:45.002195] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-08. [2025-09-23T17:48:45.525955] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-23T17:48:45.802179] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-03. [2025-09-23T17:48:46.602210] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-05. [2025-09-23T17:48:46.669250] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-23T17:48:47.214448] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-23T17:48:47.369586] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-23T17:48:47.402145] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-06. [2025-09-23T17:48:48.202222] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-08. [2025-09-23T17:48:48.524352] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-23T17:48:49.002298] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-07. [2025-09-23T17:48:49.771536] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-23T17:48:49.802250] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-09. [2025-09-23T17:48:50.037575] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-23T17:48:50.602222] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-09. [2025-09-23T17:48:51.341427] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-23T17:48:51.350503] [INFO ] [REMOTE ] BX: Full fetch complete (77399 records). [2025-09-23T17:48:51.350716] [DEBUG] [VALIDATOR ] BX: Validating primary data. [2025-09-23T17:48:51.408765] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-08. [2025-09-23T17:48:51.799019] [DEBUG] [VALIDATOR ] BX: All expected trading days are present. [2025-09-23T17:48:51.799108] [DEBUG] [VALIDATOR ] BX: Primary data validation passed. [2025-09-23T17:48:51.799947] [INFO ] [MAIN ] BX: Fetched primary data is valid. [2025-09-23T17:48:51.800021] [DEBUG] [LOCAL ] BX: Saving primary data. [2025-09-23T17:48:51.801529] [DEBUG] [LOCAL ] BX: Trimmed 77399 records to 53497 (keeping 200 days of data) [2025-09-23T17:48:52.142163] [DEBUG] [LOCAL ] BX: Primary data saved (53497 records). [2025-09-23T17:48:52.142301] [INFO ] [MAIN ] BX: Full history saved. [2025-09-23T17:48:52.144100] [INFO ] [MAIN ] Update Progress: 371/2372 symbols completed. BX took 43.5s. Estimated remaining: 4h 23m 17s. Rate: 7.6 symbols/min [2025-09-23T17:48:52.236116] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-04. [2025-09-23T17:48:52.344293] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-23T17:48:52.342607] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:48:52.399900] [DEBUG] [LOCAL ] BXP: Loaded 49824 existing records from primary storage. [2025-09-23T17:48:52.400157] [INFO ] [MAIN ] BXP: Loaded 49824 existing records. [2025-09-23T17:48:52.589898] [WARN ] [MAIN ] BXP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:48:52.590332] [INFO ] [MAIN ] BXP: Wiping existing primary data before full refresh. [2025-09-23T17:48:52.590402] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-09-23T17:48:52.597959] [DEBUG] [LOCAL ] BXP: Deleted primary data file. [2025-09-23T17:48:52.611554] [INFO ] [MAIN ] BXP: Starting full primary refresh. [2025-09-23T17:48:52.618693] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-23T17:48:52.724596] [INFO ] [REMOTE ] BWXT: Full fetch complete (67272 records). [2025-09-23T17:48:52.727734] [DEBUG] [VALIDATOR ] BWXT: Validating primary data. [2025-09-23T17:48:53.003758] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-09. [2025-09-23T17:48:53.357278] [INFO ] [REMOTE ] BXP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:48:53.432604] [DEBUG] [VALIDATOR ] BWXT: All expected trading days are present. [2025-09-23T17:48:53.432726] [DEBUG] [VALIDATOR ] BWXT: Primary data validation passed. [2025-09-23T17:48:53.433566] [INFO ] [MAIN ] BWXT: Fetched primary data is valid. [2025-09-23T17:48:53.433685] [DEBUG] [LOCAL ] BWXT: Saving primary data. [2025-09-23T17:48:53.441288] [DEBUG] [LOCAL ] BWXT: Trimmed 67272 records to 46764 (keeping 200 days of data) [2025-09-23T17:48:53.754071] [DEBUG] [LOCAL ] BWXT: Primary data saved (46764 records). [2025-09-23T17:48:53.754213] [INFO ] [MAIN ] BWXT: Full history saved. [2025-09-23T17:48:53.754312] [INFO ] [MAIN ] Update Progress: 372/2372 symbols completed. BWXT took 46.5s. Estimated remaining: 4h 22m 36s. Rate: 7.6 symbols/min [2025-09-23T17:48:53.823524] [INFO ] [REMOTE ] BXP: Fetching primary data for 2024-12. [2025-09-23T17:48:53.931988] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:48:53.943293] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-23T17:48:53.979140] [INFO ] [REMOTE ] BXMX: Full fetch complete (28719 records). [2025-09-23T17:48:53.980092] [DEBUG] [VALIDATOR ] BXMX: Validating primary data. [2025-09-23T17:48:53.981250] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-23T17:48:54.265790] [DEBUG] [LOCAL ] BXSL: Loaded 47462 existing records from primary storage. [2025-09-23T17:48:54.315449] [INFO ] [MAIN ] BXSL: Loaded 47462 existing records. [2025-09-23T17:48:54.606523] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-05. [2025-09-23T17:48:54.629272] [DEBUG] [VALIDATOR ] BXMX: All expected trading days are present. [2025-09-23T17:48:54.631076] [DEBUG] [VALIDATOR ] BXMX: Primary data validation passed. [2025-09-23T17:48:54.631676] [INFO ] [MAIN ] BXMX: Fetched primary data is valid. [2025-09-23T17:48:54.631749] [DEBUG] [LOCAL ] BXMX: Saving primary data. [2025-09-23T17:48:54.631002] [WARN ] [MAIN ] BXSL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:48:54.632424] [INFO ] [MAIN ] BXSL: Wiping existing primary data before full refresh. [2025-09-23T17:48:54.632819] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-09-23T17:48:54.633610] [DEBUG] [LOCAL ] BXMX: Trimmed 28719 records to 19572 (keeping 200 days of data) [2025-09-23T17:48:54.634488] [DEBUG] [LOCAL ] BXSL: Deleted primary data file. [2025-09-23T17:48:54.634575] [INFO ] [MAIN ] BXSL: Starting full primary refresh. [2025-09-23T17:48:55.070942] [DEBUG] [LOCAL ] BXMX: Primary data saved (19572 records). [2025-09-23T17:48:55.104633] [INFO ] [MAIN ] BXMX: Full history saved. [2025-09-23T17:48:55.135333] [INFO ] [MAIN ] Update Progress: 373/2372 symbols completed. BXMX took 19.1s. Estimated remaining: 4h 21m 53s. Rate: 7.6 symbols/min [2025-09-23T17:48:55.135210] [INFO ] [REMOTE ] BXSL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:48:55.326325] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:48:55.359855] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-23T17:48:55.384686] [DEBUG] [LOCAL ] BY: Loaded 21511 existing records from primary storage. [2025-09-23T17:48:55.384849] [INFO ] [MAIN ] BY: Loaded 21511 existing records. [2025-09-23T17:48:55.407281] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2024-12. [2025-09-23T17:48:55.571616] [WARN ] [MAIN ] BY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:48:55.571914] [INFO ] [MAIN ] BY: Wiping existing primary data before full refresh. [2025-09-23T17:48:55.572005] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-09-23T17:48:55.572852] [DEBUG] [LOCAL ] BY: Deleted primary data file. [2025-09-23T17:48:55.572914] [INFO ] [MAIN ] BY: Starting full primary refresh. [2025-09-23T17:48:55.933890] [INFO ] [REMOTE ] BY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:48:55.990817] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-23T17:48:56.202232] [INFO ] [REMOTE ] BY: Fetching primary data for 2024-12. [2025-09-23T17:48:56.959004] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-23T17:48:57.002177] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-01. [2025-09-23T17:48:57.296690] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-23T17:48:57.802232] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-01. [2025-09-23T17:48:58.223295] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-23T17:48:58.471859] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-23T17:48:58.602260] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-06. [2025-09-23T17:48:59.402197] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-01. [2025-09-23T17:48:59.877148] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-23T17:49:00.202210] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-02. [2025-09-23T17:49:00.996045] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-23T17:49:01.005700] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-02. [2025-09-23T17:49:01.465520] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-23T17:49:01.802166] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-02. [2025-09-23T17:49:01.839046] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-23T17:49:02.602253] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-03. [2025-09-23T17:49:03.090792] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-23T17:49:03.325918] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-23T17:49:03.402146] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-04. [2025-09-23T17:49:04.202259] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-03. [2025-09-23T17:49:04.624543] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-23T17:49:05.002244] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-03. [2025-09-23T17:49:05.542433] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-23T17:49:05.802204] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-05. [2025-09-23T17:49:06.444476] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-23T17:49:06.602156] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-04. [2025-09-23T17:49:06.808192] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-23T17:49:07.402200] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-06. [2025-09-23T17:49:08.202206] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-04. [2025-09-23T17:49:09.002221] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-07. [2025-09-23T17:49:10.033066] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-04 (3.43 seconds). [2025-09-23T17:49:10.044997] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-05. [2025-09-23T17:49:10.441759] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-06 (3.04 seconds). [2025-09-23T17:49:10.481696] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-23T17:49:10.602200] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-08. [2025-09-23T17:49:10.925776] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-04 (2.72 seconds). [2025-09-23T17:49:11.402272] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-07. [2025-09-23T17:49:11.471845] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-23T17:49:11.915088] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-23T17:49:12.148833] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-23T17:49:12.202184] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-08. [2025-09-23T17:49:13.002244] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-06. [2025-09-23T17:49:13.189357] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-23T17:49:13.802240] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-09. [2025-09-23T17:49:14.295393] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-23T17:49:14.602293] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-09. [2025-09-23T17:49:14.979381] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-23T17:49:14.983715] [INFO ] [REMOTE ] BY: Full fetch complete (29077 records). [2025-09-23T17:49:14.983838] [DEBUG] [VALIDATOR ] BY: Validating primary data. [2025-09-23T17:49:15.372960] [DEBUG] [VALIDATOR ] BY: All expected trading days are present. [2025-09-23T17:49:15.373078] [DEBUG] [VALIDATOR ] BY: Primary data validation passed. [2025-09-23T17:49:15.373805] [INFO ] [MAIN ] BY: Fetched primary data is valid. [2025-09-23T17:49:15.373871] [DEBUG] [LOCAL ] BY: Saving primary data. [2025-09-23T17:49:15.374973] [DEBUG] [LOCAL ] BY: Trimmed 29077 records to 21542 (keeping 200 days of data) [2025-09-23T17:49:15.431634] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-07. [2025-09-23T17:49:15.522940] [DEBUG] [LOCAL ] BY: Primary data saved (21542 records). [2025-09-23T17:49:15.523153] [INFO ] [MAIN ] BY: Full history saved. [2025-09-23T17:49:15.523294] [INFO ] [MAIN ] Update Progress: 374/2372 symbols completed. BY took 20.4s. Estimated remaining: 4h 22m 52s. Rate: 7.6 symbols/min [2025-09-23T17:49:15.702322] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:49:15.760075] [DEBUG] [LOCAL ] BYD: Loaded 45355 existing records from primary storage. [2025-09-23T17:49:15.760298] [INFO ] [MAIN ] BYD: Loaded 45355 existing records. [2025-09-23T17:49:15.949125] [WARN ] [MAIN ] BYD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:49:15.949796] [INFO ] [MAIN ] BYD: Wiping existing primary data before full refresh. [2025-09-23T17:49:15.949880] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-09-23T17:49:15.951808] [DEBUG] [LOCAL ] BYD: Deleted primary data file. [2025-09-23T17:49:15.951889] [INFO ] [MAIN ] BYD: Starting full primary refresh. [2025-09-23T17:49:16.095945] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-23T17:49:16.150028] [INFO ] [REMOTE ] BXMT: Full fetch complete (69367 records). [2025-09-23T17:49:16.161878] [DEBUG] [VALIDATOR ] BXMT: Validating primary data. [2025-09-23T17:49:16.222021] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-05. [2025-09-23T17:49:16.620573] [INFO ] [REMOTE ] BYD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:49:16.825413] [DEBUG] [VALIDATOR ] BXMT: All expected trading days are present. [2025-09-23T17:49:16.825570] [DEBUG] [VALIDATOR ] BXMT: Primary data validation passed. [2025-09-23T17:49:16.826305] [INFO ] [MAIN ] BXMT: Fetched primary data is valid. [2025-09-23T17:49:16.826534] [DEBUG] [LOCAL ] BXMT: Saving primary data. [2025-09-23T17:49:16.828444] [DEBUG] [LOCAL ] BXMT: Trimmed 69367 records to 47250 (keeping 200 days of data) [2025-09-23T17:49:16.957418] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-23T17:49:17.002403] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-08. [2025-09-23T17:49:17.168742] [DEBUG] [LOCAL ] BXMT: Primary data saved (47250 records). [2025-09-23T17:49:17.168882] [INFO ] [MAIN ] BXMT: Full history saved. [2025-09-23T17:49:17.168968] [INFO ] [MAIN ] Update Progress: 375/2372 symbols completed. BXMT took 42.3s. Estimated remaining: 4h 22m 11s. Rate: 7.6 symbols/min [2025-09-23T17:49:17.342556] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:49:17.358150] [DEBUG] [LOCAL ] BYM: Loaded 12167 existing records from primary storage. [2025-09-23T17:49:17.358302] [INFO ] [MAIN ] BYM: Loaded 12167 existing records. [2025-09-23T17:49:17.540038] [WARN ] [MAIN ] BYM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:49:17.540295] [INFO ] [MAIN ] BYM: Wiping existing primary data before full refresh. [2025-09-23T17:49:17.540344] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-09-23T17:49:17.541068] [DEBUG] [LOCAL ] BYM: Deleted primary data file. [2025-09-23T17:49:17.541131] [INFO ] [MAIN ] BYM: Starting full primary refresh. [2025-09-23T17:49:17.804794] [INFO ] [REMOTE ] BYD: Fetching primary data for 2024-12. [2025-09-23T17:49:17.914304] [INFO ] [REMOTE ] BYM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:49:18.058475] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-23T17:49:18.328960] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-23T17:49:18.602190] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-09. [2025-09-23T17:49:19.156268] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-23T17:49:19.402180] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-01. [2025-09-23T17:49:19.942210] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-23T17:49:19.950720] [INFO ] [REMOTE ] BXP: Full fetch complete (71165 records). [2025-09-23T17:49:19.950894] [DEBUG] [VALIDATOR ] BXP: Validating primary data. [2025-09-23T17:49:20.213509] [INFO ] [REMOTE ] BYM: Fetching primary data for 2024-12. [2025-09-23T17:49:20.359940] [DEBUG] [VALIDATOR ] BXP: All expected trading days are present. [2025-09-23T17:49:20.360079] [DEBUG] [VALIDATOR ] BXP: Primary data validation passed. [2025-09-23T17:49:20.360887] [INFO ] [MAIN ] BXP: Fetched primary data is valid. [2025-09-23T17:49:20.360959] [DEBUG] [LOCAL ] BXP: Saving primary data. [2025-09-23T17:49:20.362561] [DEBUG] [LOCAL ] BXP: Trimmed 71165 records to 49802 (keeping 200 days of data) [2025-09-23T17:49:20.687143] [DEBUG] [LOCAL ] BXP: Primary data saved (49802 records). [2025-09-23T17:49:20.687293] [INFO ] [MAIN ] BXP: Full history saved. [2025-09-23T17:49:20.687381] [INFO ] [MAIN ] Update Progress: 376/2372 symbols completed. BXP took 28.5s. Estimated remaining: 4h 21m 40s. Rate: 7.6 symbols/min [2025-09-23T17:49:20.866877] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:49:20.904567] [DEBUG] [LOCAL ] BZH: Loaded 32788 existing records from primary storage. [2025-09-23T17:49:20.904769] [INFO ] [MAIN ] BZH: Loaded 32788 existing records. [2025-09-23T17:49:21.009837] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-06. [2025-09-23T17:49:21.100402] [WARN ] [MAIN ] BZH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:49:21.101116] [INFO ] [MAIN ] BZH: Wiping existing primary data before full refresh. [2025-09-23T17:49:21.101424] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-09-23T17:49:21.111755] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-23T17:49:21.110736] [DEBUG] [LOCAL ] BZH: Deleted primary data file. [2025-09-23T17:49:21.115765] [INFO ] [MAIN ] BZH: Starting full primary refresh. [2025-09-23T17:49:21.232271] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-23T17:49:21.531228] [INFO ] [REMOTE ] BZH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:49:21.802181] [INFO ] [REMOTE ] BZH: Fetching primary data for 2024-12. [2025-09-23T17:49:22.340276] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-23T17:49:22.602179] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-07. [2025-09-23T17:49:23.078030] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-23T17:49:23.402196] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-01. [2025-09-23T17:49:23.938814] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-23T17:49:24.202207] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-01. [2025-09-23T17:49:24.301555] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-23T17:49:24.734952] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-23T17:49:25.002201] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-02. [2025-09-23T17:49:25.802231] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-08. [2025-09-23T17:49:26.203064] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-23T17:49:26.602417] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-02. [2025-09-23T17:49:27.106963] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-23T17:49:27.402191] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-09. [2025-09-23T17:49:27.677765] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-23T17:49:28.202247] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-03. [2025-09-23T17:49:29.002196] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-02. [2025-09-23T17:49:29.108753] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-23T17:49:29.117498] [INFO ] [REMOTE ] BXSL: Full fetch complete (69188 records). [2025-09-23T17:49:29.117706] [DEBUG] [VALIDATOR ] BXSL: Validating primary data. [2025-09-23T17:49:29.537119] [DEBUG] [VALIDATOR ] BXSL: All expected trading days are present. [2025-09-23T17:49:29.538094] [DEBUG] [VALIDATOR ] BXSL: Primary data validation passed. [2025-09-23T17:49:29.538782] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-23T17:49:29.540748] [INFO ] [MAIN ] BXSL: Fetched primary data is valid. [2025-09-23T17:49:29.540855] [DEBUG] [LOCAL ] BXSL: Saving primary data. [2025-09-23T17:49:29.565950] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-23T17:49:29.575232] [DEBUG] [LOCAL ] BXSL: Trimmed 69188 records to 47457 (keeping 200 days of data) [2025-09-23T17:49:29.802265] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-03. [2025-09-23T17:49:29.878731] [DEBUG] [LOCAL ] BXSL: Primary data saved (47457 records). [2025-09-23T17:49:29.878869] [INFO ] [MAIN ] BXSL: Full history saved. [2025-09-23T17:49:29.878978] [INFO ] [MAIN ] Update Progress: 377/2372 symbols completed. BXSL took 36.1s. Estimated remaining: 4h 21m 39s. Rate: 7.6 symbols/min [2025-09-23T17:49:30.051313] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:49:30.103208] [DEBUG] [LOCAL ] C: Loaded 53741 existing records from primary storage. [2025-09-23T17:49:30.103354] [INFO ] [MAIN ] C: Loaded 53741 existing records. [2025-09-23T17:49:30.282508] [WARN ] [MAIN ] C: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:49:30.282802] [INFO ] [MAIN ] C: Wiping existing primary data before full refresh. [2025-09-23T17:49:30.282861] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-09-23T17:49:30.284394] [DEBUG] [LOCAL ] C: Deleted primary data file. [2025-09-23T17:49:30.284458] [INFO ] [MAIN ] C: Starting full primary refresh. [2025-09-23T17:49:30.476203] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-23T17:49:30.607371] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-04. [2025-09-23T17:49:30.675690] [INFO ] [REMOTE ] C: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:49:31.402204] [INFO ] [REMOTE ] C: Fetching primary data for 2024-12. [2025-09-23T17:49:31.680495] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-23T17:49:32.202285] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-03. [2025-09-23T17:49:33.002213] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-04. [2025-09-23T17:49:33.181731] [INFO ] [REMOTE ] C: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-23T17:49:33.590438] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-23T17:49:33.802186] [INFO ] [REMOTE ] C: Fetching primary data for 2025-01. [2025-09-23T17:49:34.072608] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-23T17:49:34.602207] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-05. [2025-09-23T17:49:35.278122] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-23T17:49:35.402164] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-04. [2025-09-23T17:49:35.499145] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-23T17:49:36.202222] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-05. [2025-09-23T17:49:36.886329] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-23T17:49:37.002151] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-05. [2025-09-23T17:49:37.216775] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-23T17:49:37.802206] [INFO ] [REMOTE ] C: Fetching primary data for 2025-02. [2025-09-23T17:49:38.433633] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-23T17:49:38.602244] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-06. [2025-09-23T17:49:39.324566] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-23T17:49:39.402155] [INFO ] [REMOTE ] C: Fetching primary data for 2025-03. [2025-09-23T17:49:40.131979] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-23T17:49:40.202256] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-07. [2025-09-23T17:49:41.002258] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-06. [2025-09-23T17:49:41.166394] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-23T17:49:41.600506] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-23T17:49:41.802303] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-08. [2025-09-23T17:49:42.222277] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-23T17:49:42.602255] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-06. [2025-09-23T17:49:42.985598] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-23T17:49:43.187716] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-23T17:49:43.402225] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-07. [2025-09-23T17:49:44.202194] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-07. [2025-09-23T17:49:44.217976] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-23T17:49:45.002237] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-08. [2025-09-23T17:49:45.638277] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-23T17:49:45.719967] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-23T17:49:45.802204] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-08. [2025-09-23T17:49:46.602199] [INFO ] [REMOTE ] C: Fetching primary data for 2025-04. [2025-09-23T17:49:47.008614] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-23T17:49:47.402195] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-09. [2025-09-23T17:49:48.202202] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-09. [2025-09-23T17:49:48.634547] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-23T17:49:48.800204] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-23T17:49:48.807389] [INFO ] [REMOTE ] BYD: Full fetch complete (64921 records). [2025-09-23T17:49:48.807514] [DEBUG] [VALIDATOR ] BYD: Validating primary data. [2025-09-23T17:49:49.007332] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-09. [2025-09-23T17:49:49.199578] [DEBUG] [VALIDATOR ] BYD: All expected trading days are present. [2025-09-23T17:49:49.199690] [DEBUG] [VALIDATOR ] BYD: Primary data validation passed. [2025-09-23T17:49:49.200443] [INFO ] [MAIN ] BYD: Fetched primary data is valid. [2025-09-23T17:49:49.200554] [DEBUG] [LOCAL ] BYD: Saving primary data. [2025-09-23T17:49:49.201982] [DEBUG] [LOCAL ] BYD: Trimmed 64921 records to 45300 (keeping 200 days of data) [2025-09-23T17:49:49.483336] [DEBUG] [LOCAL ] BYD: Primary data saved (45300 records). [2025-09-23T17:49:49.483477] [INFO ] [MAIN ] BYD: Full history saved. [2025-09-23T17:49:49.483562] [INFO ] [MAIN ] Update Progress: 378/2372 symbols completed. BYD took 34.0s. Estimated remaining: 4h 22m 33s. Rate: 7.6 symbols/min [2025-09-23T17:49:49.668355] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:49:49.670814] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-23T17:49:49.677145] [INFO ] [REMOTE ] BZH: Full fetch complete (47039 records). [2025-09-23T17:49:49.677369] [DEBUG] [VALIDATOR ] BZH: Validating primary data. [2025-09-23T17:49:49.748604] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-23T17:49:49.799063] [DEBUG] [LOCAL ] CAAP: Loaded 19303 existing records from primary storage. [2025-09-23T17:49:49.799265] [INFO ] [REMOTE ] BYM: Full fetch complete (17976 records). [2025-09-23T17:49:49.805729] [INFO ] [MAIN ] CAAP: Loaded 19303 existing records. [2025-09-23T17:49:49.813814] [INFO ] [REMOTE ] C: Fetching primary data for 2025-05. [2025-09-23T17:49:49.824013] [DEBUG] [VALIDATOR ] BYM: Validating primary data. [2025-09-23T17:49:50.388614] [WARN ] [MAIN ] CAAP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:49:50.483269] [INFO ] [MAIN ] CAAP: Wiping existing primary data before full refresh. [2025-09-23T17:49:50.483690] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-09-23T17:49:50.532425] [DEBUG] [LOCAL ] CAAP: Deleted primary data file. [2025-09-23T17:49:50.542825] [INFO ] [MAIN ] CAAP: Starting full primary refresh. [2025-09-23T17:49:50.756750] [DEBUG] [VALIDATOR ] BZH: All expected trading days are present. [2025-09-23T17:49:50.762149] [DEBUG] [VALIDATOR ] BZH: Primary data validation passed. [2025-09-23T17:49:50.773472] [INFO ] [MAIN ] BZH: Fetched primary data is valid. [2025-09-23T17:49:50.797290] [DEBUG] [LOCAL ] BZH: Saving primary data. [2025-09-23T17:49:50.893672] [DEBUG] [VALIDATOR ] BYM: All expected trading days are present. [2025-09-23T17:49:50.941805] [DEBUG] [VALIDATOR ] BYM: Primary data validation passed. [2025-09-23T17:49:50.978772] [INFO ] [MAIN ] BYM: Fetched primary data is valid. [2025-09-23T17:49:50.980731] [DEBUG] [LOCAL ] BYM: Saving primary data. [2025-09-23T17:49:50.957958] [DEBUG] [LOCAL ] BZH: Trimmed 47039 records to 32727 (keeping 200 days of data) [2025-09-23T17:49:51.065866] [DEBUG] [LOCAL ] BYM: Trimmed 17976 records to 12057 (keeping 200 days of data) [2025-09-23T17:49:51.264442] [INFO ] [REMOTE ] CAAP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:49:51.282498] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2024-12. [2025-09-23T17:49:51.375502] [DEBUG] [LOCAL ] BYM: Primary data saved (12057 records). [2025-09-23T17:49:51.378730] [INFO ] [MAIN ] BYM: Full history saved. [2025-09-23T17:49:51.379703] [INFO ] [MAIN ] Update Progress: 379/2372 symbols completed. BYM took 34.2s. Estimated remaining: 4h 21m 53s. Rate: 7.6 symbols/min [2025-09-23T17:49:51.505666] [DEBUG] [LOCAL ] BZH: Primary data saved (32727 records). [2025-09-23T17:49:51.521126] [INFO ] [MAIN ] BZH: Full history saved. [2025-09-23T17:49:51.526364] [INFO ] [MAIN ] Update Progress: 380/2372 symbols completed. BZH took 30.8s. Estimated remaining: 4h 21m 5s. Rate: 7.6 symbols/min [2025-09-23T17:49:51.639989] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:49:51.758877] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:49:51.759228] [DEBUG] [LOCAL ] CACI: No existing data file found in primary storage. [2025-09-23T17:49:51.759302] [WARN ] [MAIN ] CACI: No existing data found, performing full refresh instead. [2025-09-23T17:49:51.759604] [INFO ] [MAIN ] CACI: Wiping existing primary data before full refresh. [2025-09-23T17:49:51.759777] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-09-23T17:49:51.759851] [DEBUG] [LOCAL ] CACI: No primary data file found to delete. [2025-09-23T17:49:51.759915] [INFO ] [MAIN ] CACI: Starting full primary refresh. [2025-09-23T17:49:51.820053] [DEBUG] [LOCAL ] CABO: Loaded 17506 existing records from primary storage. [2025-09-23T17:49:51.841736] [INFO ] [MAIN ] CABO: Loaded 17506 existing records. [2025-09-23T17:49:52.264743] [WARN ] [MAIN ] CABO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:49:52.275731] [INFO ] [MAIN ] CABO: Wiping existing primary data before full refresh. [2025-09-23T17:49:52.335277] [INFO ] [REMOTE ] CACI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:49:52.301901] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-09-23T17:49:52.336018] [INFO ] [REMOTE ] CACI: Fetching primary data for 2024-12. [2025-09-23T17:49:52.337607] [DEBUG] [LOCAL ] CABO: Deleted primary data file. [2025-09-23T17:49:52.337780] [INFO ] [MAIN ] CABO: Starting full primary refresh. [2025-09-23T17:49:52.448192] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-05 (2.63 seconds). [2025-09-23T17:49:52.499812] [INFO ] [REMOTE ] C: Fetching primary data for 2025-06. [2025-09-23T17:49:52.708853] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-23T17:49:52.776887] [INFO ] [REMOTE ] CABO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:49:53.002195] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-01. [2025-09-23T17:49:53.636881] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-23T17:49:53.739700] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-23T17:49:53.802172] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-02. [2025-09-23T17:49:54.182738] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-23T17:49:54.357205] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-23T17:49:54.602190] [INFO ] [REMOTE ] CABO: Fetching primary data for 2024-12. [2025-09-23T17:49:55.402209] [INFO ] [REMOTE ] C: Fetching primary data for 2025-07. [2025-09-23T17:49:55.651947] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-23T17:49:56.202222] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-03. [2025-09-23T17:49:57.002236] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-01. [2025-09-23T17:49:57.382466] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-23T17:49:57.478893] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-23T17:49:57.802224] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-01. [2025-09-23T17:49:57.973048] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-23T17:49:58.394287] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-23T17:49:58.602242] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-02. [2025-09-23T17:49:59.402256] [INFO ] [REMOTE ] C: Fetching primary data for 2025-08. [2025-09-23T17:49:59.962856] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-23T17:50:00.202195] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-02. [2025-09-23T17:50:00.932521] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-23T17:50:01.002193] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-03. [2025-09-23T17:50:01.498987] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-23T17:50:01.802252] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-04. [2025-09-23T17:50:02.339717] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-23T17:50:02.602250] [INFO ] [REMOTE ] C: Fetching primary data for 2025-09. [2025-09-23T17:50:02.722150] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-23T17:50:03.402211] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-05. [2025-09-23T17:50:04.102440] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-23T17:50:04.202233] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-06. [2025-09-23T17:50:04.499047] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-23T17:50:04.508504] [INFO ] [REMOTE ] C: Full fetch complete (77784 records). [2025-09-23T17:50:04.508704] [DEBUG] [VALIDATOR ] C: Validating primary data. [2025-09-23T17:50:04.906070] [DEBUG] [VALIDATOR ] C: All expected trading days are present. [2025-09-23T17:50:04.906275] [DEBUG] [VALIDATOR ] C: Primary data validation passed. [2025-09-23T17:50:04.907147] [INFO ] [MAIN ] C: Fetched primary data is valid. [2025-09-23T17:50:04.907286] [DEBUG] [LOCAL ] C: Saving primary data. [2025-09-23T17:50:04.920048] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-23T17:50:04.924187] [DEBUG] [LOCAL ] C: Trimmed 77784 records to 53741 (keeping 200 days of data) [2025-09-23T17:50:05.016344] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-03. [2025-09-23T17:50:05.260581] [DEBUG] [LOCAL ] C: Primary data saved (53741 records). [2025-09-23T17:50:05.260762] [INFO ] [MAIN ] C: Full history saved. [2025-09-23T17:50:05.260861] [INFO ] [MAIN ] Update Progress: 381/2372 symbols completed. C took 35.4s. Estimated remaining: 4h 21m 28s. Rate: 7.6 symbols/min [2025-09-23T17:50:05.430740] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:50:05.483013] [DEBUG] [LOCAL ] CADE: Loaded 48797 existing records from primary storage. [2025-09-23T17:50:05.483167] [INFO ] [MAIN ] CADE: Loaded 48797 existing records. [2025-09-23T17:50:05.664222] [WARN ] [MAIN ] CADE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:50:05.664527] [INFO ] [MAIN ] CADE: Wiping existing primary data before full refresh. [2025-09-23T17:50:05.664577] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-09-23T17:50:05.666086] [DEBUG] [LOCAL ] CADE: Deleted primary data file. [2025-09-23T17:50:05.666150] [INFO ] [MAIN ] CADE: Starting full primary refresh. [2025-09-23T17:50:05.807387] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-04. [2025-09-23T17:50:06.022319] [INFO ] [REMOTE ] CADE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:50:06.248536] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-23T17:50:06.602204] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-07. [2025-09-23T17:50:06.639896] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-23T17:50:07.402338] [INFO ] [REMOTE ] CADE: Fetching primary data for 2024-12. [2025-09-23T17:50:07.612914] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-23T17:50:08.202218] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-08. [2025-09-23T17:50:09.002198] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-05. [2025-09-23T17:50:09.219574] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-23T17:50:09.273015] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-23T17:50:09.802233] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-01. [2025-09-23T17:50:10.336273] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-23T17:50:10.602213] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-06. [2025-09-23T17:50:11.073318] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-23T17:50:11.341102] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-23T17:50:11.402217] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-04. [2025-09-23T17:50:12.202251] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-09. [2025-09-23T17:50:12.662050] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-23T17:50:13.002198] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-07. [2025-09-23T17:50:13.168295] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-23T17:50:13.172903] [INFO ] [REMOTE ] CAAP: Full fetch complete (27591 records). [2025-09-23T17:50:13.173030] [DEBUG] [VALIDATOR ] CAAP: Validating primary data. [2025-09-23T17:50:13.552322] [DEBUG] [VALIDATOR ] CAAP: All expected trading days are present. [2025-09-23T17:50:13.552408] [DEBUG] [VALIDATOR ] CAAP: Primary data validation passed. [2025-09-23T17:50:13.552873] [INFO ] [MAIN ] CAAP: Fetched primary data is valid. [2025-09-23T17:50:13.552938] [DEBUG] [LOCAL ] CAAP: Saving primary data. [2025-09-23T17:50:13.553818] [DEBUG] [LOCAL ] CAAP: Trimmed 27591 records to 19410 (keeping 200 days of data) [2025-09-23T17:50:13.666486] [DEBUG] [LOCAL ] CAAP: Primary data saved (19410 records). [2025-09-23T17:50:13.666635] [INFO ] [MAIN ] CAAP: Full history saved. [2025-09-23T17:50:13.666764] [INFO ] [MAIN ] Update Progress: 382/2372 symbols completed. CAAP took 24.2s. Estimated remaining: 4h 21m 23s. Rate: 7.6 symbols/min [2025-09-23T17:50:13.817292] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-02. [2025-09-23T17:50:13.852799] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:50:13.891028] [DEBUG] [LOCAL ] CAE: Loaded 38913 existing records from primary storage. [2025-09-23T17:50:13.891287] [INFO ] [MAIN ] CAE: Loaded 38913 existing records. [2025-09-23T17:50:13.988958] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-23T17:50:14.106744] [WARN ] [MAIN ] CAE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:50:14.107009] [INFO ] [MAIN ] CAE: Wiping existing primary data before full refresh. [2025-09-23T17:50:14.107068] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-09-23T17:50:14.108243] [DEBUG] [LOCAL ] CAE: Deleted primary data file. [2025-09-23T17:50:14.108306] [INFO ] [MAIN ] CAE: Starting full primary refresh. [2025-09-23T17:50:14.496272] [INFO ] [REMOTE ] CAE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:50:14.602161] [INFO ] [REMOTE ] CAE: Fetching primary data for 2024-12. [2025-09-23T17:50:15.031691] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-23T17:50:15.402243] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-05. [2025-09-23T17:50:16.194220] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-23T17:50:16.202140] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-01. [2025-09-23T17:50:16.404166] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-23T17:50:17.002205] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-06. [2025-09-23T17:50:17.564020] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-23T17:50:17.802240] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-08. [2025-09-23T17:50:18.402249] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-23T17:50:18.550313] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-23T17:50:18.602191] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-09. [2025-09-23T17:50:19.336812] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-23T17:50:19.339346] [INFO ] [REMOTE ] CABO: Full fetch complete (22984 records). [2025-09-23T17:50:19.339424] [DEBUG] [VALIDATOR ] CABO: Validating primary data. [2025-09-23T17:50:19.407304] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-02. [2025-09-23T17:50:19.711705] [DEBUG] [VALIDATOR ] CABO: All expected trading days are present. [2025-09-23T17:50:19.711807] [DEBUG] [VALIDATOR ] CABO: Primary data validation passed. [2025-09-23T17:50:19.712209] [INFO ] [MAIN ] CABO: Fetched primary data is valid. [2025-09-23T17:50:19.712251] [DEBUG] [LOCAL ] CABO: Saving primary data. [2025-09-23T17:50:19.712926] [DEBUG] [LOCAL ] CABO: Trimmed 22984 records to 17449 (keeping 200 days of data) [2025-09-23T17:50:19.818745] [DEBUG] [LOCAL ] CABO: Primary data saved (17449 records). [2025-09-23T17:50:19.818892] [INFO ] [MAIN ] CABO: Full history saved. [2025-09-23T17:50:19.818989] [INFO ] [MAIN ] Update Progress: 383/2372 symbols completed. CABO took 28.4s. Estimated remaining: 4h 21m 6s. Rate: 7.6 symbols/min [2025-09-23T17:50:19.986469] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:50:19.991720] [DEBUG] [LOCAL ] CAF: Loaded 3423 existing records from primary storage. [2025-09-23T17:50:19.991810] [INFO ] [MAIN ] CAF: Loaded 3423 existing records. [2025-09-23T17:50:20.170948] [WARN ] [MAIN ] CAF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:50:20.171168] [INFO ] [MAIN ] CAF: Wiping existing primary data before full refresh. [2025-09-23T17:50:20.171221] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-09-23T17:50:20.171465] [DEBUG] [LOCAL ] CAF: Deleted primary data file. [2025-09-23T17:50:20.171526] [INFO ] [MAIN ] CAF: Starting full primary refresh. [2025-09-23T17:50:20.207371] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-07. [2025-09-23T17:50:20.532408] [INFO ] [REMOTE ] CAF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:50:20.994936] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-23T17:50:21.002182] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-03. [2025-09-23T17:50:21.048111] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-23T17:50:21.802183] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-03. [2025-09-23T17:50:22.367454] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-23T17:50:22.602199] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-04. [2025-09-23T17:50:23.286507] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-23T17:50:23.402192] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-04. [2025-09-23T17:50:23.923616] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-23T17:50:24.202229] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-05. [2025-09-23T17:50:24.488283] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-23T17:50:25.002197] [INFO ] [REMOTE ] CAF: Fetching primary data for 2024-12. [2025-09-23T17:50:25.386800] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-23T17:50:25.504788] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-23T17:50:25.802195] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-01. [2025-09-23T17:50:26.198244] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-23T17:50:26.602214] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-05. [2025-09-23T17:50:27.402209] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-08. [2025-09-23T17:50:28.204053] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-06. [2025-09-23T17:50:28.206838] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-23T17:50:28.639524] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-23T17:50:29.002194] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-09. [2025-09-23T17:50:29.411920] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-23T17:50:29.802155] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-02. [2025-09-23T17:50:29.803283] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-23T17:50:29.808461] [INFO ] [REMOTE ] CACI: Full fetch complete (39150 records). [2025-09-23T17:50:29.808584] [DEBUG] [VALIDATOR ] CACI: Validating primary data. [2025-09-23T17:50:30.208069] [DEBUG] [VALIDATOR ] CACI: All expected trading days are present. [2025-09-23T17:50:30.208178] [DEBUG] [VALIDATOR ] CACI: Primary data validation passed. [2025-09-23T17:50:30.208792] [INFO ] [MAIN ] CACI: Fetched primary data is valid. [2025-09-23T17:50:30.208859] [DEBUG] [LOCAL ] CACI: Saving primary data. [2025-09-23T17:50:30.209822] [DEBUG] [LOCAL ] CACI: Trimmed 39150 records to 25266 (keeping 200 days of data) [2025-09-23T17:50:30.369460] [DEBUG] [LOCAL ] CACI: Primary data saved (25266 records). [2025-09-23T17:50:30.369614] [INFO ] [MAIN ] CACI: Full history saved. [2025-09-23T17:50:30.369743] [INFO ] [MAIN ] Update Progress: 384/2372 symbols completed. CACI took 38.8s. Estimated remaining: 4h 21m 12s. Rate: 7.6 symbols/min [2025-09-23T17:50:30.557263] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:50:30.609074] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-07. [2025-09-23T17:50:30.612605] [DEBUG] [LOCAL ] CAG: Loaded 53659 existing records from primary storage. [2025-09-23T17:50:30.612867] [INFO ] [MAIN ] CAG: Loaded 53659 existing records. [2025-09-23T17:50:30.799332] [WARN ] [MAIN ] CAG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:50:30.799637] [INFO ] [MAIN ] CAG: Wiping existing primary data before full refresh. [2025-09-23T17:50:30.799723] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-09-23T17:50:30.801183] [DEBUG] [LOCAL ] CAG: Deleted primary data file. [2025-09-23T17:50:30.801248] [INFO ] [MAIN ] CAG: Starting full primary refresh. [2025-09-23T17:50:30.924604] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-23T17:50:31.204016] [INFO ] [REMOTE ] CAG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:50:31.402193] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-03. [2025-09-23T17:50:32.104120] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-23T17:50:32.202156] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-06. [2025-09-23T17:50:32.450735] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-23T17:50:33.002217] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-08. [2025-09-23T17:50:33.216865] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-23T17:50:33.802191] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-07. [2025-09-23T17:50:34.421846] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-23T17:50:34.602237] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-09. [2025-09-23T17:50:35.025031] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-23T17:50:35.402242] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-08. [2025-09-23T17:50:36.202271] [INFO ] [REMOTE ] CAG: Fetching primary data for 2024-12. [2025-09-23T17:50:36.328908] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-23T17:50:36.338302] [INFO ] [REMOTE ] CADE: Full fetch complete (69659 records). [2025-09-23T17:50:36.338482] [DEBUG] [VALIDATOR ] CADE: Validating primary data. [2025-09-23T17:50:36.783239] [DEBUG] [VALIDATOR ] CADE: All expected trading days are present. [2025-09-23T17:50:36.783446] [DEBUG] [VALIDATOR ] CADE: Primary data validation passed. [2025-09-23T17:50:36.784232] [INFO ] [MAIN ] CADE: Fetched primary data is valid. [2025-09-23T17:50:36.784369] [DEBUG] [LOCAL ] CADE: Saving primary data. [2025-09-23T17:50:36.785915] [DEBUG] [LOCAL ] CADE: Trimmed 69659 records to 48801 (keeping 200 days of data) [2025-09-23T17:50:36.899538] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-23T17:50:37.005212] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-09. [2025-09-23T17:50:37.125881] [DEBUG] [LOCAL ] CADE: Primary data saved (48801 records). [2025-09-23T17:50:37.126061] [INFO ] [MAIN ] CADE: Full history saved. [2025-09-23T17:50:37.126160] [INFO ] [MAIN ] Update Progress: 385/2372 symbols completed. CADE took 31.9s. Estimated remaining: 4h 20m 58s. Rate: 7.6 symbols/min [2025-09-23T17:50:37.299724] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:50:37.354541] [DEBUG] [LOCAL ] CAH: Loaded 51466 existing records from primary storage. [2025-09-23T17:50:37.354772] [INFO ] [MAIN ] CAH: Loaded 51466 existing records. [2025-09-23T17:50:37.534192] [WARN ] [MAIN ] CAH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:50:37.534785] [INFO ] [MAIN ] CAH: Wiping existing primary data before full refresh. [2025-09-23T17:50:37.534883] [INFO ] [LOCAL ] CAH: Starting deletion of primary data. [2025-09-23T17:50:37.536637] [DEBUG] [LOCAL ] CAH: Deleted primary data file. [2025-09-23T17:50:37.536724] [INFO ] [MAIN ] CAH: Starting full primary refresh. [2025-09-23T17:50:37.807702] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-04. [2025-09-23T17:50:37.932540] [INFO ] [REMOTE ] CAH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:50:37.928579] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-23T17:50:38.242328] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-23T17:50:38.248616] [INFO ] [REMOTE ] CAE: Full fetch complete (55695 records). [2025-09-23T17:50:38.248737] [DEBUG] [VALIDATOR ] CAE: Validating primary data. [2025-09-23T17:50:38.358235] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-23T17:50:38.606962] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-01. [2025-09-23T17:50:38.641370] [DEBUG] [VALIDATOR ] CAE: All expected trading days are present. [2025-09-23T17:50:38.641455] [DEBUG] [VALIDATOR ] CAE: Primary data validation passed. [2025-09-23T17:50:38.642176] [INFO ] [MAIN ] CAE: Fetched primary data is valid. [2025-09-23T17:50:38.642243] [DEBUG] [LOCAL ] CAE: Saving primary data. [2025-09-23T17:50:38.643710] [DEBUG] [LOCAL ] CAE: Trimmed 55695 records to 38961 (keeping 200 days of data) [2025-09-23T17:50:38.867438] [DEBUG] [LOCAL ] CAE: Primary data saved (38961 records). [2025-09-23T17:50:38.867621] [INFO ] [MAIN ] CAE: Full history saved. [2025-09-23T17:50:38.867749] [INFO ] [MAIN ] Update Progress: 386/2372 symbols completed. CAE took 25.2s. Estimated remaining: 4h 20m 19s. Rate: 7.6 symbols/min [2025-09-23T17:50:39.036773] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:50:39.079478] [DEBUG] [LOCAL ] CAL: Loaded 43280 existing records from primary storage. [2025-09-23T17:50:39.079630] [INFO ] [MAIN ] CAL: Loaded 43280 existing records. [2025-09-23T17:50:39.298987] [WARN ] [MAIN ] CAL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:50:39.299296] [INFO ] [MAIN ] CAL: Wiping existing primary data before full refresh. [2025-09-23T17:50:39.299346] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-09-23T17:50:39.300413] [DEBUG] [LOCAL ] CAL: Deleted primary data file. [2025-09-23T17:50:39.300475] [INFO ] [MAIN ] CAL: Starting full primary refresh. [2025-09-23T17:50:39.407254] [INFO ] [REMOTE ] CAH: Fetching primary data for 2024-12. [2025-09-23T17:50:39.660350] [INFO ] [REMOTE ] CAL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:50:40.202176] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-05. [2025-09-23T17:50:40.644422] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-23T17:50:40.671560] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-23T17:50:40.993367] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-23T17:50:41.004564] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-06. [2025-09-23T17:50:41.335779] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-23T17:50:41.802185] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-01. [2025-09-23T17:50:42.602247] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-02. [2025-09-23T17:50:43.106614] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-23T17:50:43.402211] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-07. [2025-09-23T17:50:43.870303] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-23T17:50:43.936907] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-23T17:50:44.202225] [INFO ] [REMOTE ] CAL: Fetching primary data for 2024-12. [2025-09-23T17:50:45.002213] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-02. [2025-09-23T17:50:45.571178] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-23T17:50:45.802197] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-01. [2025-09-23T17:50:46.402064] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-23T17:50:46.602213] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-03. [2025-09-23T17:50:46.788288] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-23T17:50:47.402268] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-08. [2025-09-23T17:50:47.825276] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-23T17:50:48.001865] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-23T17:50:48.202248] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-04. [2025-09-23T17:50:49.002194] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-02. [2025-09-23T17:50:49.725405] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-23T17:50:49.802152] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-05. [2025-09-23T17:50:50.098770] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-23T17:50:50.602224] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-03. [2025-09-23T17:50:51.402192] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-03. [2025-09-23T17:50:51.903619] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-23T17:50:52.115482] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-23T17:50:52.202176] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-04. [2025-09-23T17:50:52.881068] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-23T17:50:53.002245] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-06. [2025-09-23T17:50:53.467430] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-23T17:50:53.802217] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-04. [2025-09-23T17:50:54.602236] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-09. [2025-09-23T17:50:54.810762] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-23T17:50:55.192738] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-23T17:50:55.194411] [INFO ] [REMOTE ] CAF: Full fetch complete (5823 records). [2025-09-23T17:50:55.194493] [DEBUG] [VALIDATOR ] CAF: Validating primary data. [2025-09-23T17:50:55.407845] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-05. [2025-09-23T17:50:55.544571] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-23T17:50:55.630111] [DEBUG] [VALIDATOR ] CAF: All expected trading days are present. [2025-09-23T17:50:55.630197] [DEBUG] [VALIDATOR ] CAF: Primary data validation passed. [2025-09-23T17:50:55.630351] [INFO ] [MAIN ] CAF: Fetched primary data is valid. [2025-09-23T17:50:55.630412] [DEBUG] [LOCAL ] CAF: Saving primary data. [2025-09-23T17:50:55.630975] [DEBUG] [LOCAL ] CAF: Trimmed 5823 records to 3440 (keeping 200 days of data) [2025-09-23T17:50:55.651742] [DEBUG] [LOCAL ] CAF: Primary data saved (3440 records). [2025-09-23T17:50:55.651812] [INFO ] [MAIN ] CAF: Full history saved. [2025-09-23T17:50:55.651893] [INFO ] [MAIN ] Update Progress: 387/2372 symbols completed. CAF took 35.8s. Estimated remaining: 4h 20m 57s. Rate: 7.6 symbols/min [2025-09-23T17:50:55.859343] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:50:55.909283] [DEBUG] [LOCAL ] CALX: Loaded 38657 existing records from primary storage. [2025-09-23T17:50:55.909423] [INFO ] [MAIN ] CALX: Loaded 38657 existing records. [2025-09-23T17:50:56.093239] [WARN ] [MAIN ] CALX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:50:56.093600] [INFO ] [MAIN ] CALX: Wiping existing primary data before full refresh. [2025-09-23T17:50:56.093689] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-09-23T17:50:56.094638] [DEBUG] [LOCAL ] CALX: Deleted primary data file. [2025-09-23T17:50:56.094749] [INFO ] [MAIN ] CALX: Starting full primary refresh. [2025-09-23T17:50:56.207351] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-05. [2025-09-23T17:50:56.457074] [INFO ] [REMOTE ] CALX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:50:56.810898] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-23T17:50:57.002216] [INFO ] [REMOTE ] CALX: Fetching primary data for 2024-12. [2025-09-23T17:50:57.803692] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-07. [2025-09-23T17:50:57.820746] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-23T17:50:58.384481] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-23T17:50:58.602244] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-01. [2025-09-23T17:50:59.251673] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-23T17:50:59.402283] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-08. [2025-09-23T17:51:00.096349] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-23T17:51:00.202152] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-02. [2025-09-23T17:51:01.007249] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-06. [2025-09-23T17:51:01.024784] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-23T17:51:01.229279] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-23T17:51:01.802249] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-03. [2025-09-23T17:51:02.602191] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-06. [2025-09-23T17:51:03.402203] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-09. [2025-09-23T17:51:03.554923] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-06 (2.55 seconds). [2025-09-23T17:51:04.202227] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-07. [2025-09-23T17:51:04.663307] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-23T17:51:04.699084] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-03 (2.90 seconds). [2025-09-23T17:51:05.002220] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-07. [2025-09-23T17:51:05.802210] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-04. [2025-09-23T17:51:06.007528] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-09 (2.61 seconds). [2025-09-23T17:51:06.017767] [INFO ] [REMOTE ] CAH: Full fetch complete (74206 records). [2025-09-23T17:51:06.017941] [DEBUG] [VALIDATOR ] CAH: Validating primary data. [2025-09-23T17:51:06.018946] [FATAL] [VALIDATOR ] CAH: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:51:06.019051] [FATAL] [MAIN ] CAH: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:51:06.019096] [WARN ] [MAIN ] CAH: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:51:06.019138] [INFO ] [LOCAL ] CAH: Starting deletion of primary data. [2025-09-23T17:51:06.019200] [DEBUG] [LOCAL ] CAH: No primary data file found to delete. [2025-09-23T17:51:06.019237] [INFO ] [LOCAL ] CAH: Starting deletion of derivative data. [2025-09-23T17:51:06.019802] [DEBUG] [LOCAL ] CAH: Deleted derivative data file. [2025-09-23T17:51:06.019937] [INFO ] [MAIN ] Update Progress: 388/2372 symbols completed. CAH took 28.9s. Estimated remaining: 4h 21m 1s. Rate: 7.6 symbols/min [2025-09-23T17:51:06.198226] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:51:06.224944] [DEBUG] [LOCAL ] CANG: Loaded 26659 existing records from primary storage. [2025-09-23T17:51:06.225200] [INFO ] [MAIN ] CANG: Loaded 26659 existing records. [2025-09-23T17:51:06.364385] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-23T17:51:06.457684] [WARN ] [MAIN ] CANG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:51:06.458510] [INFO ] [MAIN ] CANG: Wiping existing primary data before full refresh. [2025-09-23T17:51:06.458638] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-09-23T17:51:06.459888] [DEBUG] [LOCAL ] CANG: Deleted primary data file. [2025-09-23T17:51:06.459951] [INFO ] [MAIN ] CANG: Starting full primary refresh. [2025-09-23T17:51:06.599161] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-09-23T17:51:06.605085] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-08. [2025-09-23T17:51:06.866798] [INFO ] [REMOTE ] CANG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:51:06.993782] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-23T17:51:07.402196] [INFO ] [REMOTE ] CANG: Fetching primary data for 2024-12. [2025-09-23T17:51:08.202238] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-08. [2025-09-23T17:51:08.474113] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-23T17:51:08.504587] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-23T17:51:09.002248] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-09. [2025-09-23T17:51:09.807284] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-01. [2025-09-23T17:51:09.826049] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-23T17:51:10.602207] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-09. [2025-09-23T17:51:10.685766] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-23T17:51:10.734093] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-23T17:51:10.741673] [INFO ] [REMOTE ] CAL: Full fetch complete (61964 records). [2025-09-23T17:51:10.741808] [DEBUG] [VALIDATOR ] CAL: Validating primary data. [2025-09-23T17:51:11.120324] [DEBUG] [VALIDATOR ] CAL: All expected trading days are present. [2025-09-23T17:51:11.120409] [DEBUG] [VALIDATOR ] CAL: Primary data validation passed. [2025-09-23T17:51:11.121154] [INFO ] [MAIN ] CAL: Fetched primary data is valid. [2025-09-23T17:51:11.121257] [DEBUG] [LOCAL ] CAL: Saving primary data. [2025-09-23T17:51:11.123521] [DEBUG] [LOCAL ] CAL: Trimmed 61964 records to 43299 (keeping 200 days of data) [2025-09-23T17:51:11.399845] [DEBUG] [LOCAL ] CAL: Primary data saved (43299 records). [2025-09-23T17:51:11.400096] [INFO ] [MAIN ] CAL: Full history saved. [2025-09-23T17:51:11.400315] [INFO ] [MAIN ] Update Progress: 389/2372 symbols completed. CAL took 32.5s. Estimated remaining: 4h 20m 41s. Rate: 7.6 symbols/min [2025-09-23T17:51:11.413947] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-02. [2025-09-23T17:51:11.579399] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:51:11.590023] [DEBUG] [LOCAL ] CAPL: Loaded 5880 existing records from primary storage. [2025-09-23T17:51:11.590145] [INFO ] [MAIN ] CAPL: Loaded 5880 existing records. [2025-09-23T17:51:11.764436] [WARN ] [MAIN ] CAPL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:51:11.764730] [INFO ] [MAIN ] CAPL: Wiping existing primary data before full refresh. [2025-09-23T17:51:11.764786] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-09-23T17:51:11.765168] [DEBUG] [LOCAL ] CAPL: Deleted primary data file. [2025-09-23T17:51:11.765248] [INFO ] [MAIN ] CAPL: Starting full primary refresh. [2025-09-23T17:51:12.126944] [INFO ] [REMOTE ] CAPL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:51:12.205228] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-05. [2025-09-23T17:51:12.210899] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-23T17:51:12.221051] [INFO ] [REMOTE ] CAG: Full fetch complete (77648 records). [2025-09-23T17:51:12.221209] [DEBUG] [VALIDATOR ] CAG: Validating primary data. [2025-09-23T17:51:12.516722] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-23T17:51:12.642281] [DEBUG] [VALIDATOR ] CAG: All expected trading days are present. [2025-09-23T17:51:12.642352] [DEBUG] [VALIDATOR ] CAG: Primary data validation passed. [2025-09-23T17:51:12.643159] [INFO ] [MAIN ] CAG: Fetched primary data is valid. [2025-09-23T17:51:12.643223] [DEBUG] [LOCAL ] CAG: Saving primary data. [2025-09-23T17:51:12.644778] [DEBUG] [LOCAL ] CAG: Trimmed 77648 records to 53659 (keeping 200 days of data) [2025-09-23T17:51:12.988519] [DEBUG] [LOCAL ] CAG: Primary data saved (53659 records). [2025-09-23T17:51:12.988738] [INFO ] [MAIN ] CAG: Full history saved. [2025-09-23T17:51:12.988900] [INFO ] [MAIN ] Update Progress: 390/2372 symbols completed. CAG took 42.6s. Estimated remaining: 4h 20m 1s. Rate: 7.6 symbols/min [2025-09-23T17:51:13.010630] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2024-12. [2025-09-23T17:51:13.163389] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:51:13.218862] [DEBUG] [LOCAL ] CARR: Loaded 53596 existing records from primary storage. [2025-09-23T17:51:13.219072] [INFO ] [MAIN ] CARR: Loaded 53596 existing records. [2025-09-23T17:51:13.406784] [WARN ] [MAIN ] CARR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:51:13.407185] [INFO ] [MAIN ] CARR: Wiping existing primary data before full refresh. [2025-09-23T17:51:13.407380] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-09-23T17:51:13.430493] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-23T17:51:13.430553] [DEBUG] [LOCAL ] CARR: Deleted primary data file. [2025-09-23T17:51:13.438383] [INFO ] [MAIN ] CARR: Starting full primary refresh. [2025-09-23T17:51:13.802723] [INFO ] [REMOTE ] CARR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:51:13.802790] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-06. [2025-09-23T17:51:13.890691] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-23T17:51:14.602206] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-03. [2025-09-23T17:51:14.743016] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-23T17:51:15.402183] [INFO ] [REMOTE ] CARR: Fetching primary data for 2024-12. [2025-09-23T17:51:15.429049] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-23T17:51:16.202213] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-04. [2025-09-23T17:51:16.974866] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-23T17:51:17.002162] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-01. [2025-09-23T17:51:17.295068] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-23T17:51:17.424473] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-23T17:51:17.802187] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-05. [2025-09-23T17:51:18.602210] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-01. [2025-09-23T17:51:18.724691] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-23T17:51:19.402219] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-02. [2025-09-23T17:51:19.798859] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-23T17:51:19.892506] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-23T17:51:20.202200] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-03. [2025-09-23T17:51:20.657616] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-23T17:51:21.002208] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-07. [2025-09-23T17:51:21.802203] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-04. [2025-09-23T17:51:22.267300] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-23T17:51:22.306126] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-23T17:51:22.602210] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-05. [2025-09-23T17:51:23.034123] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-23T17:51:23.402210] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-06. [2025-09-23T17:51:24.202209] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-06. [2025-09-23T17:51:24.267807] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-23T17:51:25.002213] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-07. [2025-09-23T17:51:25.114785] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-23T17:51:25.802236] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-02. [2025-09-23T17:51:25.963898] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-23T17:51:26.602197] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-07. [2025-09-23T17:51:27.028055] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-23T17:51:27.354560] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-23T17:51:27.402230] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-08. [2025-09-23T17:51:28.059443] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-23T17:51:28.202243] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-08. [2025-09-23T17:51:29.002297] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-03. [2025-09-23T17:51:29.122568] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-23T17:51:29.802186] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-09. [2025-09-23T17:51:30.602208] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-09. [2025-09-23T17:51:30.850501] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-23T17:51:30.880557] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-23T17:51:30.886685] [INFO ] [REMOTE ] CANG: Full fetch complete (40525 records). [2025-09-23T17:51:30.886813] [DEBUG] [VALIDATOR ] CANG: Validating primary data. [2025-09-23T17:51:31.128697] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-23T17:51:31.181017] [INFO ] [REMOTE ] CAPL: Full fetch complete (8933 records). [2025-09-23T17:51:31.195556] [DEBUG] [VALIDATOR ] CAPL: Validating primary data. [2025-09-23T17:51:31.420336] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-04. [2025-09-23T17:51:31.542546] [DEBUG] [VALIDATOR ] CANG: All expected trading days are present. [2025-09-23T17:51:31.549366] [DEBUG] [VALIDATOR ] CANG: Primary data validation passed. [2025-09-23T17:51:31.578845] [INFO ] [MAIN ] CANG: Fetched primary data is valid. [2025-09-23T17:51:31.591780] [DEBUG] [LOCAL ] CANG: Saving primary data. [2025-09-23T17:51:31.670271] [DEBUG] [LOCAL ] CANG: Trimmed 40525 records to 26721 (keeping 200 days of data) [2025-09-23T17:51:31.743661] [DEBUG] [VALIDATOR ] CAPL: All expected trading days are present. [2025-09-23T17:51:31.743756] [DEBUG] [VALIDATOR ] CAPL: Primary data validation passed. [2025-09-23T17:51:31.744107] [INFO ] [MAIN ] CAPL: Fetched primary data is valid. [2025-09-23T17:51:31.744153] [DEBUG] [LOCAL ] CAPL: Saving primary data. [2025-09-23T17:51:31.744595] [DEBUG] [LOCAL ] CAPL: Trimmed 8933 records to 5866 (keeping 200 days of data) [2025-09-23T17:51:31.866031] [DEBUG] [LOCAL ] CAPL: Primary data saved (5866 records). [2025-09-23T17:51:31.878916] [INFO ] [MAIN ] CAPL: Full history saved. [2025-09-23T17:51:31.884935] [INFO ] [MAIN ] Update Progress: 391/2372 symbols completed. CAPL took 20.5s. Estimated remaining: 4h 20m 49s. Rate: 7.6 symbols/min [2025-09-23T17:51:32.091217] [DEBUG] [LOCAL ] CANG: Primary data saved (26721 records). [2025-09-23T17:51:32.112109] [INFO ] [MAIN ] CANG: Full history saved. [2025-09-23T17:51:32.114382] [INFO ] [MAIN ] Update Progress: 392/2372 symbols completed. CANG took 26.1s. Estimated remaining: 4h 20m 2s. Rate: 7.6 symbols/min [2025-09-23T17:51:32.114199] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:51:32.205023] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-08. [2025-09-23T17:51:32.334394] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:51:32.349473] [DEBUG] [LOCAL ] CARS: Loaded 40297 existing records from primary storage. [2025-09-23T17:51:32.349765] [INFO ] [MAIN ] CARS: Loaded 40297 existing records. [2025-09-23T17:51:32.536170] [WARN ] [MAIN ] CARS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:51:32.536455] [INFO ] [MAIN ] CARS: Wiping existing primary data before full refresh. [2025-09-23T17:51:32.536504] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-09-23T17:51:32.537687] [DEBUG] [LOCAL ] CARS: Deleted primary data file. [2025-09-23T17:51:32.537752] [INFO ] [MAIN ] CARS: Starting full primary refresh. [2025-09-23T17:51:32.722772] [DEBUG] [LOCAL ] CAT: Loaded 52926 existing records from primary storage. [2025-09-23T17:51:32.734508] [INFO ] [MAIN ] CAT: Loaded 52926 existing records. [2025-09-23T17:51:33.151539] [INFO ] [REMOTE ] CARS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:51:33.173385] [INFO ] [REMOTE ] CARS: Fetching primary data for 2024-12. [2025-09-23T17:51:33.204177] [WARN ] [MAIN ] CAT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:51:33.205512] [INFO ] [MAIN ] CAT: Wiping existing primary data before full refresh. [2025-09-23T17:51:33.205667] [INFO ] [LOCAL ] CAT: Starting deletion of primary data. [2025-09-23T17:51:33.207833] [DEBUG] [LOCAL ] CAT: Deleted primary data file. [2025-09-23T17:51:33.207955] [INFO ] [MAIN ] CAT: Starting full primary refresh. [2025-09-23T17:51:33.585364] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-23T17:51:33.628347] [INFO ] [REMOTE ] CAT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:51:33.697931] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-23T17:51:33.802199] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-05. [2025-09-23T17:51:34.602317] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-09. [2025-09-23T17:51:34.674357] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-23T17:51:35.207578] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-23T17:51:35.402228] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-01. [2025-09-23T17:51:35.576933] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-23T17:51:35.583098] [INFO ] [REMOTE ] CALX: Full fetch complete (54193 records). [2025-09-23T17:51:35.583207] [DEBUG] [VALIDATOR ] CALX: Validating primary data. [2025-09-23T17:51:35.963594] [DEBUG] [VALIDATOR ] CALX: All expected trading days are present. [2025-09-23T17:51:35.963716] [DEBUG] [VALIDATOR ] CALX: Primary data validation passed. [2025-09-23T17:51:35.964349] [INFO ] [MAIN ] CALX: Fetched primary data is valid. [2025-09-23T17:51:35.964391] [DEBUG] [LOCAL ] CALX: Saving primary data. [2025-09-23T17:51:35.966701] [DEBUG] [LOCAL ] CALX: Trimmed 54193 records to 38586 (keeping 200 days of data) [2025-09-23T17:51:36.196918] [DEBUG] [LOCAL ] CALX: Primary data saved (38586 records). [2025-09-23T17:51:36.197062] [INFO ] [MAIN ] CALX: Full history saved. [2025-09-23T17:51:36.197190] [INFO ] [MAIN ] Update Progress: 393/2372 symbols completed. CALX took 40.5s. Estimated remaining: 4h 19m 35s. Rate: 7.6 symbols/min [2025-09-23T17:51:36.208244] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-06. [2025-09-23T17:51:36.381879] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:51:36.408033] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-23T17:51:36.419098] [DEBUG] [LOCAL ] CATO: Loaded 7350 existing records from primary storage. [2025-09-23T17:51:36.419240] [INFO ] [MAIN ] CATO: Loaded 7350 existing records. [2025-09-23T17:51:36.596058] [WARN ] [MAIN ] CATO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:51:36.596304] [INFO ] [MAIN ] CATO: Wiping existing primary data before full refresh. [2025-09-23T17:51:36.596352] [INFO ] [LOCAL ] CATO: Starting deletion of primary data. [2025-09-23T17:51:36.596691] [DEBUG] [LOCAL ] CATO: Deleted primary data file. [2025-09-23T17:51:36.596753] [INFO ] [MAIN ] CATO: Starting full primary refresh. [2025-09-23T17:51:36.953080] [INFO ] [REMOTE ] CATO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:51:37.002184] [INFO ] [REMOTE ] CATO: Fetching primary data for 2024-12. [2025-09-23T17:51:37.798217] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-23T17:51:37.802164] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-01. [2025-09-23T17:51:38.168856] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-23T17:51:38.257895] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-23T17:51:38.602229] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-02. [2025-09-23T17:51:39.043405] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-23T17:51:39.402268] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-02. [2025-09-23T17:51:40.202239] [INFO ] [REMOTE ] CAT: Fetching primary data for 2024-12. [2025-09-23T17:51:40.296228] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-23T17:51:41.002207] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-03. [2025-09-23T17:51:41.802177] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-07. [2025-09-23T17:51:42.173971] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-23T17:51:42.251002] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-23T17:51:42.602269] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-01. [2025-09-23T17:51:43.210393] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-23T17:51:43.402211] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-08. [2025-09-23T17:51:44.202197] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-04. [2025-09-23T17:51:44.742849] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-09-23T17:51:44.868444] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-23T17:51:45.002283] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-02. [2025-09-23T17:51:45.566817] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-23T17:51:45.802207] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-05. [2025-09-23T17:51:46.602181] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-03. [2025-09-23T17:51:46.696282] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-23T17:51:46.948054] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-23T17:51:47.402219] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-03. [2025-09-23T17:51:47.569203] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-23T17:51:48.202213] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-09. [2025-09-23T17:51:49.002209] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-04. [2025-09-23T17:51:49.100826] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-23T17:51:49.792496] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-23T17:51:49.802174] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-04. [2025-09-23T17:51:49.995799] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-23T17:51:50.005623] [INFO ] [REMOTE ] CARR: Full fetch complete (77599 records). [2025-09-23T17:51:50.005821] [DEBUG] [VALIDATOR ] CARR: Validating primary data. [2025-09-23T17:51:50.404582] [DEBUG] [VALIDATOR ] CARR: All expected trading days are present. [2025-09-23T17:51:50.404699] [DEBUG] [VALIDATOR ] CARR: Primary data validation passed. [2025-09-23T17:51:50.405571] [INFO ] [MAIN ] CARR: Fetched primary data is valid. [2025-09-23T17:51:50.405636] [DEBUG] [LOCAL ] CARR: Saving primary data. [2025-09-23T17:51:50.407225] [DEBUG] [LOCAL ] CARR: Trimmed 77599 records to 53596 (keeping 200 days of data) [2025-09-23T17:51:50.618624] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-06. [2025-09-23T17:51:50.749240] [DEBUG] [LOCAL ] CARR: Primary data saved (53596 records). [2025-09-23T17:51:50.749392] [INFO ] [MAIN ] CARR: Full history saved. [2025-09-23T17:51:50.749486] [INFO ] [MAIN ] Update Progress: 394/2372 symbols completed. CARR took 37.8s. Estimated remaining: 4h 20m 1s. Rate: 7.6 symbols/min [2025-09-23T17:51:50.980947] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:51:51.032823] [DEBUG] [LOCAL ] CAVA: Loaded 53552 existing records from primary storage. [2025-09-23T17:51:51.032967] [INFO ] [MAIN ] CAVA: Loaded 53552 existing records. [2025-09-23T17:51:51.209715] [WARN ] [MAIN ] CAVA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:51:51.209974] [INFO ] [MAIN ] CAVA: Wiping existing primary data before full refresh. [2025-09-23T17:51:51.210022] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-09-23T17:51:51.211109] [DEBUG] [LOCAL ] CAVA: Deleted primary data file. [2025-09-23T17:51:51.211171] [INFO ] [MAIN ] CAVA: Starting full primary refresh. [2025-09-23T17:51:51.418071] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-05. [2025-09-23T17:51:51.575404] [INFO ] [REMOTE ] CAVA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:51:51.713000] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-23T17:51:51.740200] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-23T17:51:52.113992] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-23T17:51:52.202160] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2024-12. [2025-09-23T17:51:53.002241] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-06. [2025-09-23T17:51:53.491717] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-23T17:51:53.802188] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-07. [2025-09-23T17:51:54.354983] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-23T17:51:54.602197] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-01. [2025-09-23T17:51:54.860163] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-23T17:51:55.402247] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-05. [2025-09-23T17:51:56.202196] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-07. [2025-09-23T17:51:56.284330] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-23T17:51:56.626901] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-23T17:51:57.002219] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-08. [2025-09-23T17:51:57.145968] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-23T17:51:57.502792] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-23T17:51:57.802177] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-09. [2025-09-23T17:51:58.349039] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-23T17:51:58.351279] [INFO ] [REMOTE ] CATO: Full fetch complete (12086 records). [2025-09-23T17:51:58.351377] [DEBUG] [VALIDATOR ] CATO: Validating primary data. [2025-09-23T17:51:58.607311] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-06. [2025-09-23T17:51:58.727361] [DEBUG] [VALIDATOR ] CATO: All expected trading days are present. [2025-09-23T17:51:58.727446] [DEBUG] [VALIDATOR ] CATO: Primary data validation passed. [2025-09-23T17:51:58.727790] [INFO ] [MAIN ] CATO: Fetched primary data is valid. [2025-09-23T17:51:58.727854] [DEBUG] [LOCAL ] CATO: Saving primary data. [2025-09-23T17:51:58.728362] [DEBUG] [LOCAL ] CATO: Trimmed 12086 records to 7317 (keeping 200 days of data) [2025-09-23T17:51:58.771514] [DEBUG] [LOCAL ] CATO: Primary data saved (7317 records). [2025-09-23T17:51:58.771639] [INFO ] [MAIN ] CATO: Full history saved. [2025-09-23T17:51:58.771763] [INFO ] [MAIN ] Update Progress: 395/2372 symbols completed. CATO took 22.6s. Estimated remaining: 4h 19m 54s. Rate: 7.6 symbols/min [2025-09-23T17:51:58.957698] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:51:59.014187] [DEBUG] [LOCAL ] CB: Loaded 50103 existing records from primary storage. [2025-09-23T17:51:59.014368] [INFO ] [MAIN ] CB: Loaded 50103 existing records. [2025-09-23T17:51:59.209569] [WARN ] [MAIN ] CB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:51:59.210033] [INFO ] [MAIN ] CB: Wiping existing primary data before full refresh. [2025-09-23T17:51:59.210105] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-09-23T17:51:59.211422] [DEBUG] [LOCAL ] CB: Deleted primary data file. [2025-09-23T17:51:59.211490] [INFO ] [MAIN ] CB: Starting full primary refresh. [2025-09-23T17:51:59.408392] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-08. [2025-09-23T17:51:59.591130] [INFO ] [REMOTE ] CB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:52:00.202209] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-02. [2025-09-23T17:52:00.251986] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-23T17:52:00.749573] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-23T17:52:01.002219] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-07. [2025-09-23T17:52:01.802197] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-09. [2025-09-23T17:52:01.860563] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-23T17:52:02.602232] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-03. [2025-09-23T17:52:02.780663] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-23T17:52:02.974532] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-23T17:52:02.980918] [INFO ] [REMOTE ] CARS: Full fetch complete (55402 records). [2025-09-23T17:52:02.981021] [DEBUG] [VALIDATOR ] CARS: Validating primary data. [2025-09-23T17:52:03.397408] [DEBUG] [VALIDATOR ] CARS: All expected trading days are present. [2025-09-23T17:52:03.397542] [DEBUG] [VALIDATOR ] CARS: Primary data validation passed. [2025-09-23T17:52:03.398399] [INFO ] [MAIN ] CARS: Fetched primary data is valid. [2025-09-23T17:52:03.398468] [DEBUG] [LOCAL ] CARS: Saving primary data. [2025-09-23T17:52:03.399885] [DEBUG] [LOCAL ] CARS: Trimmed 55402 records to 40251 (keeping 200 days of data) [2025-09-23T17:52:03.402229] [INFO ] [REMOTE ] CB: Fetching primary data for 2024-12. [2025-09-23T17:52:03.648967] [DEBUG] [LOCAL ] CARS: Primary data saved (40251 records). [2025-09-23T17:52:03.649100] [INFO ] [MAIN ] CARS: Full history saved. [2025-09-23T17:52:03.649184] [INFO ] [MAIN ] Update Progress: 396/2372 symbols completed. CARS took 31.8s. Estimated remaining: 4h 19m 31s. Rate: 7.6 symbols/min [2025-09-23T17:52:03.835549] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:52:03.848915] [DEBUG] [LOCAL ] CBAN: Loaded 11144 existing records from primary storage. [2025-09-23T17:52:03.849089] [INFO ] [MAIN ] CBAN: Loaded 11144 existing records. [2025-09-23T17:52:04.041188] [WARN ] [MAIN ] CBAN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:52:04.041481] [INFO ] [MAIN ] CBAN: Wiping existing primary data before full refresh. [2025-09-23T17:52:04.041536] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-09-23T17:52:04.042116] [DEBUG] [LOCAL ] CBAN: Deleted primary data file. [2025-09-23T17:52:04.042178] [INFO ] [MAIN ] CBAN: Starting full primary refresh. [2025-09-23T17:52:04.207450] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-08. [2025-09-23T17:52:04.436505] [INFO ] [REMOTE ] CBAN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:52:04.521132] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-23T17:52:05.002170] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2024-12. [2025-09-23T17:52:05.032629] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-23T17:52:05.578716] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-23T17:52:05.802179] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-01. [2025-09-23T17:52:06.012881] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-23T17:52:06.602194] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-09. [2025-09-23T17:52:07.402254] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-01. [2025-09-23T17:52:08.202222] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-04. [2025-09-23T17:52:08.652553] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-01 (2.85 seconds). [2025-09-23T17:52:09.002195] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-02. [2025-09-23T17:52:09.625560] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-09 (3.02 seconds). [2025-09-23T17:52:09.634160] [INFO ] [REMOTE ] CAT: Full fetch complete (76608 records). [2025-09-23T17:52:09.634283] [DEBUG] [VALIDATOR ] CAT: Validating primary data. [2025-09-23T17:52:10.047504] [DEBUG] [VALIDATOR ] CAT: All expected trading days are present. [2025-09-23T17:52:10.048181] [DEBUG] [VALIDATOR ] CAT: Primary data validation passed. [2025-09-23T17:52:10.049575] [INFO ] [MAIN ] CAT: Fetched primary data is valid. [2025-09-23T17:52:10.048546] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-01 (2.65 seconds). [2025-09-23T17:52:10.049802] [DEBUG] [LOCAL ] CAT: Saving primary data. [2025-09-23T17:52:10.053298] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-02. [2025-09-23T17:52:10.055542] [DEBUG] [LOCAL ] CAT: Trimmed 76608 records to 52925 (keeping 200 days of data) [2025-09-23T17:52:10.328507] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-23T17:52:10.454301] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-23T17:52:10.484779] [DEBUG] [LOCAL ] CAT: Primary data saved (52925 records). [2025-09-23T17:52:10.484924] [INFO ] [MAIN ] CAT: Full history saved. [2025-09-23T17:52:10.485013] [INFO ] [MAIN ] Update Progress: 397/2372 symbols completed. CAT took 38.4s. Estimated remaining: 4h 19m 18s. Rate: 7.6 symbols/min [2025-09-23T17:52:10.603396] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-05. [2025-09-23T17:52:10.606386] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-23T17:52:11.402267] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-03. [2025-09-23T17:52:12.202278] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-03. [2025-09-23T17:52:12.414934] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-23T17:52:12.840518] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-23T17:52:12.912274] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-23T17:52:13.002218] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-06. [2025-09-23T17:52:13.802182] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-04. [2025-09-23T17:52:14.602297] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-04. [2025-09-23T17:52:14.752799] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-23T17:52:15.301483] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-23T17:52:15.402149] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-07. [2025-09-23T17:52:15.540340] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-23T17:52:16.202209] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-05. [2025-09-23T17:52:17.002173] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-05. [2025-09-23T17:52:17.055566] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-23T17:52:17.148798] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-23T17:52:17.802246] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-06. [2025-09-23T17:52:18.400057] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-23T17:52:18.602202] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-08. [2025-09-23T17:52:18.610516] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-23T17:52:19.402248] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-07. [2025-09-23T17:52:19.992310] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-23T17:52:20.202202] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-08. [2025-09-23T17:52:20.436624] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-23T17:52:20.706549] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-23T17:52:21.002204] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-06. [2025-09-23T17:52:21.802200] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-09. [2025-09-23T17:52:22.406182] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-23T17:52:22.602210] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-07. [2025-09-23T17:52:23.402255] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-09. [2025-09-23T17:52:23.838142] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-23T17:52:23.848982] [INFO ] [REMOTE ] CAVA: Full fetch complete (77275 records). [2025-09-23T17:52:23.849185] [DEBUG] [VALIDATOR ] CAVA: Validating primary data. [2025-09-23T17:52:24.158196] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-23T17:52:24.191037] [INFO ] [REMOTE ] CBAN: Full fetch complete (16060 records). [2025-09-23T17:52:24.207460] [DEBUG] [VALIDATOR ] CBAN: Validating primary data. [2025-09-23T17:52:24.312953] [DEBUG] [VALIDATOR ] CAVA: All expected trading days are present. [2025-09-23T17:52:24.319041] [DEBUG] [VALIDATOR ] CAVA: Primary data validation passed. [2025-09-23T17:52:24.345529] [INFO ] [MAIN ] CAVA: Fetched primary data is valid. [2025-09-23T17:52:24.393246] [DEBUG] [LOCAL ] CAVA: Saving primary data. [2025-09-23T17:52:24.467414] [DEBUG] [LOCAL ] CAVA: Trimmed 77275 records to 53550 (keeping 200 days of data) [2025-09-23T17:52:24.835775] [DEBUG] [VALIDATOR ] CBAN: All expected trading days are present. [2025-09-23T17:52:24.836879] [DEBUG] [VALIDATOR ] CBAN: Primary data validation passed. [2025-09-23T17:52:24.838027] [INFO ] [MAIN ] CBAN: Fetched primary data is valid. [2025-09-23T17:52:24.838989] [DEBUG] [LOCAL ] CBAN: Saving primary data. [2025-09-23T17:52:24.841632] [DEBUG] [LOCAL ] CBAN: Trimmed 16060 records to 11122 (keeping 200 days of data) [2025-09-23T17:52:24.932679] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-09-23T17:52:24.956284] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-08. [2025-09-23T17:52:24.982074] [DEBUG] [LOCAL ] CBAN: Primary data saved (11122 records). [2025-09-23T17:52:24.984733] [INFO ] [MAIN ] CBAN: Full history saved. [2025-09-23T17:52:24.984878] [INFO ] [MAIN ] Update Progress: 398/2372 symbols completed. CBAN took 21.3s. Estimated remaining: 4h 19m 43s. Rate: 7.6 symbols/min [2025-09-23T17:52:25.188063] [DEBUG] [LOCAL ] CAVA: Primary data saved (53550 records). [2025-09-23T17:52:25.188221] [INFO ] [MAIN ] CAVA: Full history saved. [2025-09-23T17:52:25.188311] [INFO ] [MAIN ] Update Progress: 399/2372 symbols completed. CAVA took 34.4s. Estimated remaining: 4h 18m 57s. Rate: 7.6 symbols/min [2025-09-23T17:52:26.474379] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-23T17:52:26.485705] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-09. [2025-09-23T17:52:27.944212] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-23T17:52:27.952536] [INFO ] [REMOTE ] CB: Full fetch complete (72693 records). [2025-09-23T17:52:27.952704] [DEBUG] [VALIDATOR ] CB: Validating primary data. [2025-09-23T17:52:28.344392] [DEBUG] [VALIDATOR ] CB: All expected trading days are present. [2025-09-23T17:52:28.344491] [DEBUG] [VALIDATOR ] CB: Primary data validation passed. [2025-09-23T17:52:28.345306] [INFO ] [MAIN ] CB: Fetched primary data is valid. [2025-09-23T17:52:28.345372] [DEBUG] [LOCAL ] CB: Saving primary data. [2025-09-23T17:52:28.346885] [DEBUG] [LOCAL ] CB: Trimmed 72693 records to 50089 (keeping 200 days of data) [2025-09-23T17:52:28.663758] [DEBUG] [LOCAL ] CB: Primary data saved (50089 records). [2025-09-23T17:52:28.663897] [INFO ] [MAIN ] CB: Full history saved. [2025-09-23T17:52:28.663979] [INFO ] [MAIN ] Update Progress: 400/2372 symbols completed. CB took 29.9s. Estimated remaining: 4h 18m 27s. Rate: 7.6 symbols/min [2025-09-23T17:52:29.237885] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:52:29.325203] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:52:29.369581] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-09-23T17:52:29.383328] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-09-23T17:52:29.340575] [DEBUG] [LOCAL ] CBNA: Loaded 2901 existing records from primary storage. [2025-09-23T17:52:29.389734] [INFO ] [MAIN ] CBNA: Loaded 2901 existing records. [2025-09-23T17:52:29.369480] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:52:29.427834] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:52:29.459177] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-09-23T17:52:29.484738] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-09-23T17:52:29.507535] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-09-23T17:52:29.529425] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-09-23T17:52:29.715442] [DEBUG] [LOCAL ] CBL: Loaded 16762 existing records from primary storage. [2025-09-23T17:52:29.736552] [INFO ] [MAIN ] CBL: Loaded 16762 existing records. [2025-09-23T17:52:29.789850] [WARN ] [MAIN ] CBNA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:52:29.925554] [INFO ] [MAIN ] CBNA: Wiping existing primary data before full refresh. [2025-09-23T17:52:29.933230] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-09-23T17:52:29.990887] [DEBUG] [LOCAL ] CBNA: Deleted primary data file. [2025-09-23T17:52:30.003111] [INFO ] [MAIN ] CBNA: Starting full primary refresh. [2025-09-23T17:52:30.030210] [DEBUG] [LOCAL ] CBRE: Loaded 50664 existing records from primary storage. [2025-09-23T17:52:30.065131] [INFO ] [MAIN ] CBRE: Loaded 50664 existing records. [2025-09-23T17:52:30.395395] [WARN ] [MAIN ] CBL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:52:30.448948] [INFO ] [MAIN ] CBL: Wiping existing primary data before full refresh. [2025-09-23T17:52:30.455179] [INFO ] [LOCAL ] CBL: Starting deletion of primary data. [2025-09-23T17:52:30.567692] [DEBUG] [LOCAL ] CBL: Deleted primary data file. [2025-09-23T17:52:30.579516] [INFO ] [REMOTE ] CBO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:52:30.582828] [INFO ] [MAIN ] CBL: Starting full primary refresh. [2025-09-23T17:52:30.585095] [INFO ] [REMOTE ] CBO: Fetching primary data for 2024-12. [2025-09-23T17:52:30.694347] [WARN ] [MAIN ] CBRE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:52:30.780233] [INFO ] [MAIN ] CBRE: Wiping existing primary data before full refresh. [2025-09-23T17:52:30.786138] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-09-23T17:52:30.913234] [DEBUG] [LOCAL ] CBRE: Deleted primary data file. [2025-09-23T17:52:30.940396] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:52:30.958570] [INFO ] [MAIN ] CBRE: Starting full primary refresh. [2025-09-23T17:52:30.994835] [WARN ] [REMOTE ] CBO: No data returned for month 2024-12 [2025-09-23T17:52:31.143443] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-01. [2025-09-23T17:52:31.200515] [INFO ] [REMOTE ] CBNA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:52:31.220384] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2024-12. [2025-09-23T17:52:31.433553] [INFO ] [REMOTE ] CBL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:52:31.460484] [INFO ] [REMOTE ] CBL: Fetching primary data for 2024-12. [2025-09-23T17:52:31.511234] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:52:31.539313] [WARN ] [REMOTE ] CBO: No data returned for month 2025-01 [2025-09-23T17:52:31.576369] [INFO ] [REMOTE ] CBRE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:52:31.576602] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-02. [2025-09-23T17:52:31.576938] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2024-12. [2025-09-23T17:52:31.762755] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-23T17:52:31.764539] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-01. [2025-09-23T17:52:31.790268] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:52:31.790505] [WARN ] [REMOTE ] CBO: No data returned for month 2025-02 [2025-09-23T17:52:31.790897] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-03. [2025-09-23T17:52:32.123347] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-23T17:52:32.183589] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-23T17:52:32.202139] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-02. [2025-09-23T17:52:32.532718] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-23T17:52:32.612886] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-23T17:52:33.002162] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-03. [2025-09-23T17:52:33.104740] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-23T17:52:33.297788] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-09-23T17:52:33.802221] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-01. [2025-09-23T17:52:34.602199] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-01. [2025-09-23T17:52:35.402198] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-04. [2025-09-23T17:52:35.989103] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-23T17:52:36.154438] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-09-23T17:52:36.202151] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-02. [2025-09-23T17:52:36.318994] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-23T17:52:37.002242] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-02. [2025-09-23T17:52:37.604297] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-23T17:52:37.802234] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-04. [2025-09-23T17:52:37.988776] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-23T17:52:38.101322] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-09-23T17:52:38.602270] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-03. [2025-09-23T17:52:39.402238] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-05. [2025-09-23T17:52:39.726673] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-23T17:52:40.203914] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-03. [2025-09-23T17:52:40.207499] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-23T17:52:41.002215] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-05. [2025-09-23T17:52:41.347573] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-23T17:52:41.808587] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-04. [2025-09-23T17:52:41.828203] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-23T17:52:42.602256] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-04. [2025-09-23T17:52:42.675211] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-23T17:52:43.402217] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-06. [2025-09-23T17:52:43.867327] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-23T17:52:44.071872] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-23T17:52:44.202221] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-05. [2025-09-23T17:52:45.002203] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-07. [2025-09-23T17:52:45.567108] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-23T17:52:45.569892] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-23T17:52:45.802229] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-08. [2025-09-23T17:52:46.126401] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-23T17:52:46.602215] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-05. [2025-09-23T17:52:47.186673] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-23T17:52:47.402221] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-06. [2025-09-23T17:52:48.007012] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-23T17:52:48.202230] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-06. [2025-09-23T17:52:48.546257] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-23T17:52:49.002193] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-07. [2025-09-23T17:52:49.406982] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-23T17:52:49.802191] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-08. [2025-09-23T17:52:50.011846] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:52:50.012167] [WARN ] [REMOTE ] CBO: No data returned for month 2025-08 [2025-09-23T17:52:50.602256] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-07. [2025-09-23T17:52:51.225770] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-23T17:52:51.402206] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-06. [2025-09-23T17:52:52.202180] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-08. [2025-09-23T17:52:52.919160] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-23T17:52:53.002177] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-09. [2025-09-23T17:52:53.173419] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-23T17:52:53.674825] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:52:53.675198] [WARN ] [REMOTE ] CBO: No data returned for month 2025-09 [2025-09-23T17:52:53.675307] [INFO ] [REMOTE ] CBO: Full fetch complete (1016 records). [2025-09-23T17:52:53.675387] [DEBUG] [VALIDATOR ] CBO: Validating primary data. [2025-09-23T17:52:53.676098] [FATAL] [VALIDATOR ] CBO: Data is stale - most recent date (2025-07-10) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:52:53.676182] [FATAL] [MAIN ] CBO: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:52:53.676276] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:52:53.676389] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-09-23T17:52:53.676513] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-09-23T17:52:53.676582] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-09-23T17:52:53.676665] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-09-23T17:52:53.676751] [INFO ] [MAIN ] Update Progress: 401/2372 symbols completed. CBO took 25.0s. Estimated remaining: 4h 19m 43s. Rate: 7.6 symbols/min [2025-09-23T17:52:53.807307] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-09. [2025-09-23T17:52:53.861153] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:52:53.895446] [DEBUG] [LOCAL ] CBT: Loaded 31131 existing records from primary storage. [2025-09-23T17:52:53.895627] [INFO ] [MAIN ] CBT: Loaded 31131 existing records. [2025-09-23T17:52:54.087383] [WARN ] [MAIN ] CBT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:52:54.087808] [INFO ] [MAIN ] CBT: Wiping existing primary data before full refresh. [2025-09-23T17:52:54.087865] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-09-23T17:52:54.089552] [DEBUG] [LOCAL ] CBT: Deleted primary data file. [2025-09-23T17:52:54.089612] [INFO ] [MAIN ] CBT: Starting full primary refresh. [2025-09-23T17:52:54.440789] [INFO ] [REMOTE ] CBT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:52:54.520826] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-23T17:52:54.523886] [INFO ] [REMOTE ] CBL: Full fetch complete (25661 records). [2025-09-23T17:52:54.523985] [DEBUG] [VALIDATOR ] CBL: Validating primary data. [2025-09-23T17:52:54.607359] [INFO ] [REMOTE ] CBT: Fetching primary data for 2024-12. [2025-09-23T17:52:54.919699] [DEBUG] [VALIDATOR ] CBL: All expected trading days are present. [2025-09-23T17:52:54.919790] [DEBUG] [VALIDATOR ] CBL: Primary data validation passed. [2025-09-23T17:52:54.920189] [INFO ] [MAIN ] CBL: Fetched primary data is valid. [2025-09-23T17:52:54.920230] [DEBUG] [LOCAL ] CBL: Saving primary data. [2025-09-23T17:52:54.920933] [DEBUG] [LOCAL ] CBL: Trimmed 25661 records to 16744 (keeping 200 days of data) [2025-09-23T17:52:55.023074] [DEBUG] [LOCAL ] CBL: Primary data saved (16744 records). [2025-09-23T17:52:55.023222] [INFO ] [MAIN ] CBL: Full history saved. [2025-09-23T17:52:55.023324] [INFO ] [MAIN ] Update Progress: 402/2372 symbols completed. CBL took 26.4s. Estimated remaining: 4h 19m 3s. Rate: 7.6 symbols/min [2025-09-23T17:52:55.197712] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:52:55.220370] [DEBUG] [LOCAL ] CBU: Loaded 22859 existing records from primary storage. [2025-09-23T17:52:55.220513] [INFO ] [MAIN ] CBU: Loaded 22859 existing records. [2025-09-23T17:52:55.411262] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-07. [2025-09-23T17:52:55.418180] [WARN ] [MAIN ] CBU: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:52:55.419363] [INFO ] [MAIN ] CBU: Wiping existing primary data before full refresh. [2025-09-23T17:52:55.419417] [INFO ] [LOCAL ] CBU: Starting deletion of primary data. [2025-09-23T17:52:55.420254] [DEBUG] [LOCAL ] CBU: Deleted primary data file. [2025-09-23T17:52:55.420318] [INFO ] [MAIN ] CBU: Starting full primary refresh. [2025-09-23T17:52:55.797403] [INFO ] [REMOTE ] CBU: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:52:56.194336] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-23T17:52:56.202133] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-01. [2025-09-23T17:52:56.866285] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-23T17:52:57.002244] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-09. [2025-09-23T17:52:57.133242] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-23T17:52:57.487249] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-23T17:52:57.488332] [INFO ] [REMOTE ] CBNA: Full fetch complete (4690 records). [2025-09-23T17:52:57.488401] [DEBUG] [VALIDATOR ] CBNA: Validating primary data. [2025-09-23T17:52:57.811810] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-08. [2025-09-23T17:52:57.844424] [DEBUG] [VALIDATOR ] CBNA: All expected trading days are present. [2025-09-23T17:52:57.844481] [DEBUG] [VALIDATOR ] CBNA: Primary data validation passed. [2025-09-23T17:52:57.844626] [INFO ] [MAIN ] CBNA: Fetched primary data is valid. [2025-09-23T17:52:57.844699] [DEBUG] [LOCAL ] CBNA: Saving primary data. [2025-09-23T17:52:57.845143] [DEBUG] [LOCAL ] CBNA: Trimmed 4690 records to 2892 (keeping 200 days of data) [2025-09-23T17:52:57.862279] [DEBUG] [LOCAL ] CBNA: Primary data saved (2892 records). [2025-09-23T17:52:57.862374] [INFO ] [MAIN ] CBNA: Full history saved. [2025-09-23T17:52:57.862456] [INFO ] [MAIN ] Update Progress: 403/2372 symbols completed. CBNA took 29.2s. Estimated remaining: 4h 18m 31s. Rate: 7.6 symbols/min [2025-09-23T17:52:58.043268] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:52:58.043465] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-09-23T17:52:58.043522] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-09-23T17:52:58.043711] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-09-23T17:52:58.043763] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-09-23T17:52:58.043807] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-09-23T17:52:58.043840] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-09-23T17:52:58.412062] [INFO ] [REMOTE ] CBX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:52:58.602179] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-02. [2025-09-23T17:52:59.106751] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-23T17:52:59.402211] [INFO ] [REMOTE ] CBU: Fetching primary data for 2024-12. [2025-09-23T17:52:59.972931] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-23T17:53:00.205679] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-03. [2025-09-23T17:53:00.213851] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-23T17:53:01.002216] [INFO ] [REMOTE ] CBX: Fetching primary data for 2024-12. [2025-09-23T17:53:01.244450] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:53:01.244848] [WARN ] [REMOTE ] CBX: No data returned for month 2024-12 [2025-09-23T17:53:01.711088] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-23T17:53:01.802407] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-09. [2025-09-23T17:53:02.602258] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-01. [2025-09-23T17:53:02.797286] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:53:02.797631] [WARN ] [REMOTE ] CBX: No data returned for month 2025-01 [2025-09-23T17:53:03.151010] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-23T17:53:03.159749] [INFO ] [REMOTE ] CBRE: Full fetch complete (73949 records). [2025-09-23T17:53:03.159922] [DEBUG] [VALIDATOR ] CBRE: Validating primary data. [2025-09-23T17:53:03.407339] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-02. [2025-09-23T17:53:03.583972] [DEBUG] [VALIDATOR ] CBRE: All expected trading days are present. [2025-09-23T17:53:03.584087] [DEBUG] [VALIDATOR ] CBRE: Primary data validation passed. [2025-09-23T17:53:03.585072] [INFO ] [MAIN ] CBRE: Fetched primary data is valid. [2025-09-23T17:53:03.585182] [DEBUG] [LOCAL ] CBRE: Saving primary data. [2025-09-23T17:53:03.586926] [DEBUG] [LOCAL ] CBRE: Trimmed 73949 records to 50658 (keeping 200 days of data) [2025-09-23T17:53:03.686875] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:53:03.688417] [WARN ] [REMOTE ] CBX: No data returned for month 2025-02 [2025-09-23T17:53:03.908176] [DEBUG] [LOCAL ] CBRE: Primary data saved (50658 records). [2025-09-23T17:53:03.908316] [INFO ] [MAIN ] CBRE: Full history saved. [2025-09-23T17:53:03.908401] [INFO ] [MAIN ] Update Progress: 404/2372 symbols completed. CBRE took 35.2s. Estimated remaining: 4h 18m 14s. Rate: 7.6 symbols/min [2025-09-23T17:53:04.075755] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:53:04.109705] [DEBUG] [LOCAL ] CBZ: Loaded 33453 existing records from primary storage. [2025-09-23T17:53:04.109874] [INFO ] [MAIN ] CBZ: Loaded 33453 existing records. [2025-09-23T17:53:04.207361] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-01. [2025-09-23T17:53:04.290817] [WARN ] [MAIN ] CBZ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:53:04.291082] [INFO ] [MAIN ] CBZ: Wiping existing primary data before full refresh. [2025-09-23T17:53:04.291128] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-09-23T17:53:04.292066] [DEBUG] [LOCAL ] CBZ: Deleted primary data file. [2025-09-23T17:53:04.292127] [INFO ] [MAIN ] CBZ: Starting full primary refresh. [2025-09-23T17:53:04.643208] [INFO ] [REMOTE ] CBZ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:53:05.002221] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2024-12. [2025-09-23T17:53:05.300903] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-23T17:53:05.802233] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-04. [2025-09-23T17:53:06.033680] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-23T17:53:06.602237] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-03. [2025-09-23T17:53:06.808403] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:53:06.808763] [WARN ] [REMOTE ] CBX: No data returned for month 2025-03 [2025-09-23T17:53:06.940581] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-23T17:53:07.402221] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-02. [2025-09-23T17:53:08.072469] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-23T17:53:08.202191] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-03. [2025-09-23T17:53:09.003795] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-04. [2025-09-23T17:53:09.007864] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-23T17:53:09.212952] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:53:09.213272] [WARN ] [REMOTE ] CBX: No data returned for month 2025-04 [2025-09-23T17:53:09.802213] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-05. [2025-09-23T17:53:10.602200] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-01. [2025-09-23T17:53:10.774244] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-23T17:53:11.392532] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-23T17:53:11.402156] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-02. [2025-09-23T17:53:12.160723] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-23T17:53:12.202142] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-03. [2025-09-23T17:53:13.002201] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-05. [2025-09-23T17:53:13.141533] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-23T17:53:13.671257] [INFO ] [REMOTE ] CBX: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-23T17:53:13.802164] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-06. [2025-09-23T17:53:14.057189] [INFO ] [REMOTE ] CBX: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-09-23T17:53:14.602269] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-04. [2025-09-23T17:53:15.402212] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-04. [2025-09-23T17:53:16.160781] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-23T17:53:16.202202] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-06. [2025-09-23T17:53:16.455783] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-23T17:53:17.002227] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-05. [2025-09-23T17:53:17.320866] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-23T17:53:17.756851] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-23T17:53:17.802154] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-06. [2025-09-23T17:53:18.602244] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-05. [2025-09-23T17:53:18.887388] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-23T17:53:19.402251] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-07. [2025-09-23T17:53:19.601036] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-23T17:53:20.202206] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-06. [2025-09-23T17:53:20.373945] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-23T17:53:21.002420] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-08. [2025-09-23T17:53:21.124605] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-23T17:53:21.802257] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-07. [2025-09-23T17:53:21.865515] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-23T17:53:22.602219] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-07. [2025-09-23T17:53:22.728268] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-23T17:53:23.402219] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-08. [2025-09-23T17:53:23.939737] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-23T17:53:24.202210] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-09. [2025-09-23T17:53:24.365484] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-23T17:53:25.002212] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-09. [2025-09-23T17:53:25.046511] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-23T17:53:25.050968] [INFO ] [REMOTE ] CBU: Full fetch complete (32183 records). [2025-09-23T17:53:25.051100] [DEBUG] [VALIDATOR ] CBU: Validating primary data. [2025-09-23T17:53:25.442415] [DEBUG] [VALIDATOR ] CBU: All expected trading days are present. [2025-09-23T17:53:25.442548] [DEBUG] [VALIDATOR ] CBU: Primary data validation passed. [2025-09-23T17:53:25.443048] [INFO ] [MAIN ] CBU: Fetched primary data is valid. [2025-09-23T17:53:25.443122] [DEBUG] [LOCAL ] CBU: Saving primary data. [2025-09-23T17:53:25.444067] [DEBUG] [LOCAL ] CBU: Trimmed 32183 records to 22875 (keeping 200 days of data) [2025-09-23T17:53:25.590226] [DEBUG] [LOCAL ] CBU: Primary data saved (22875 records). [2025-09-23T17:53:25.590358] [INFO ] [MAIN ] CBU: Full history saved. [2025-09-23T17:53:25.590531] [INFO ] [MAIN ] Update Progress: 405/2372 symbols completed. CBU took 30.6s. Estimated remaining: 4h 19m 13s. Rate: 7.6 symbols/min [2025-09-23T17:53:25.757732] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:53:25.811568] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-07. [2025-09-23T17:53:25.815164] [DEBUG] [LOCAL ] CC: Loaded 53028 existing records from primary storage. [2025-09-23T17:53:25.815357] [INFO ] [MAIN ] CC: Loaded 53028 existing records. [2025-09-23T17:53:26.005930] [WARN ] [MAIN ] CC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:53:26.006450] [INFO ] [MAIN ] CC: Wiping existing primary data before full refresh. [2025-09-23T17:53:26.006530] [INFO ] [LOCAL ] CC: Starting deletion of primary data. [2025-09-23T17:53:26.007968] [DEBUG] [LOCAL ] CC: Deleted primary data file. [2025-09-23T17:53:26.008029] [INFO ] [MAIN ] CC: Starting full primary refresh. [2025-09-23T17:53:26.259503] [INFO ] [REMOTE ] CBX: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-23T17:53:26.371938] [INFO ] [REMOTE ] CC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:53:26.538328] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-23T17:53:26.547361] [INFO ] [REMOTE ] CBT: Full fetch complete (45924 records). [2025-09-23T17:53:26.547542] [DEBUG] [VALIDATOR ] CBT: Validating primary data. [2025-09-23T17:53:26.611703] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-08. [2025-09-23T17:53:26.937127] [DEBUG] [VALIDATOR ] CBT: All expected trading days are present. [2025-09-23T17:53:26.937205] [DEBUG] [VALIDATOR ] CBT: Primary data validation passed. [2025-09-23T17:53:26.937792] [INFO ] [MAIN ] CBT: Fetched primary data is valid. [2025-09-23T17:53:26.937872] [DEBUG] [LOCAL ] CBT: Saving primary data. [2025-09-23T17:53:26.940994] [DEBUG] [LOCAL ] CBT: Trimmed 45924 records to 31140 (keeping 200 days of data) [2025-09-23T17:53:27.149950] [DEBUG] [LOCAL ] CBT: Primary data saved (31140 records). [2025-09-23T17:53:27.150167] [INFO ] [MAIN ] CBT: Full history saved. [2025-09-23T17:53:27.150385] [INFO ] [MAIN ] Update Progress: 406/2372 symbols completed. CBT took 33.5s. Estimated remaining: 4h 18m 35s. Rate: 7.6 symbols/min [2025-09-23T17:53:27.324377] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:53:27.384026] [DEBUG] [LOCAL ] CCI: Loaded 53161 existing records from primary storage. [2025-09-23T17:53:27.384200] [INFO ] [MAIN ] CCI: Loaded 53161 existing records. [2025-09-23T17:53:27.407374] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-08. [2025-09-23T17:53:27.571239] [WARN ] [MAIN ] CCI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:53:27.571495] [INFO ] [MAIN ] CCI: Wiping existing primary data before full refresh. [2025-09-23T17:53:27.571558] [INFO ] [LOCAL ] CCI: Starting deletion of primary data. [2025-09-23T17:53:27.573258] [DEBUG] [LOCAL ] CCI: Deleted primary data file. [2025-09-23T17:53:27.573346] [INFO ] [MAIN ] CCI: Starting full primary refresh. [2025-09-23T17:53:27.688819] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:53:27.693455] [WARN ] [REMOTE ] CBX: No data returned for month 2025-08 [2025-09-23T17:53:27.975393] [INFO ] [REMOTE ] CCI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:53:27.999179] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-23T17:53:28.202248] [INFO ] [REMOTE ] CCI: Fetching primary data for 2024-12. [2025-09-23T17:53:29.002223] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-09. [2025-09-23T17:53:29.360804] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:53:29.361117] [WARN ] [REMOTE ] CBX: No data returned for month 2025-09 [2025-09-23T17:53:29.361233] [INFO ] [REMOTE ] CBX: Full fetch complete (1040 records). [2025-09-23T17:53:29.361387] [DEBUG] [VALIDATOR ] CBX: Validating primary data. [2025-09-23T17:53:29.362316] [FATAL] [VALIDATOR ] CBX: Data is stale - most recent date (2025-07-02) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:53:29.362401] [FATAL] [MAIN ] CBX: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:53:29.362500] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:53:29.362597] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-09-23T17:53:29.362760] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-09-23T17:53:29.362859] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-09-23T17:53:29.362953] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-09-23T17:53:29.363045] [INFO ] [MAIN ] Update Progress: 407/2372 symbols completed. CBX took 31.5s. Estimated remaining: 4h 17m 59s. Rate: 7.6 symbols/min [2025-09-23T17:53:29.546210] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:53:29.546471] [DEBUG] [LOCAL ] CCIA: No existing data file found in primary storage. [2025-09-23T17:53:29.546532] [WARN ] [MAIN ] CCIA: No existing data found, performing full refresh instead. [2025-09-23T17:53:29.546787] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-09-23T17:53:29.546880] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-09-23T17:53:29.546970] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-09-23T17:53:29.547038] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-09-23T17:53:29.806570] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-09. [2025-09-23T17:53:29.920491] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:53:30.016205] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-23T17:53:30.602226] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-01. [2025-09-23T17:53:31.118334] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-23T17:53:31.130534] [INFO ] [REMOTE ] CBZ: Full fetch complete (44731 records). [2025-09-23T17:53:31.130824] [DEBUG] [VALIDATOR ] CBZ: Validating primary data. [2025-09-23T17:53:31.409928] [INFO ] [REMOTE ] CC: Fetching primary data for 2024-12. [2025-09-23T17:53:31.760968] [DEBUG] [VALIDATOR ] CBZ: All expected trading days are present. [2025-09-23T17:53:31.761177] [DEBUG] [VALIDATOR ] CBZ: Primary data validation passed. [2025-09-23T17:53:31.762476] [INFO ] [MAIN ] CBZ: Fetched primary data is valid. [2025-09-23T17:53:31.762568] [DEBUG] [LOCAL ] CBZ: Saving primary data. [2025-09-23T17:53:31.766538] [DEBUG] [LOCAL ] CBZ: Trimmed 44731 records to 33481 (keeping 200 days of data) [2025-09-23T17:53:32.009825] [DEBUG] [LOCAL ] CBZ: Primary data saved (33481 records). [2025-09-23T17:53:32.009983] [INFO ] [MAIN ] CBZ: Full history saved. [2025-09-23T17:53:32.010122] [INFO ] [MAIN ] Update Progress: 408/2372 symbols completed. CBZ took 28.1s. Estimated remaining: 4h 17m 26s. Rate: 7.6 symbols/min [2025-09-23T17:53:32.182090] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:53:32.201187] [DEBUG] [LOCAL ] CCIF: Loaded 15367 existing records from primary storage. [2025-09-23T17:53:32.201318] [INFO ] [MAIN ] CCIF: Loaded 15367 existing records. [2025-09-23T17:53:32.231971] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2024-12. [2025-09-23T17:53:32.386897] [WARN ] [MAIN ] CCIF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:53:32.387211] [INFO ] [MAIN ] CCIF: Wiping existing primary data before full refresh. [2025-09-23T17:53:32.387266] [INFO ] [LOCAL ] CCIF: Starting deletion of primary data. [2025-09-23T17:53:32.387930] [DEBUG] [LOCAL ] CCIF: Deleted primary data file. [2025-09-23T17:53:32.387990] [INFO ] [MAIN ] CCIF: Starting full primary refresh. [2025-09-23T17:53:32.729279] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-23T17:53:32.797496] [INFO ] [REMOTE ] CCIF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:53:32.801379] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-23T17:53:32.870808] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-23T17:53:33.002217] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-02. [2025-09-23T17:53:33.802191] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-01. [2025-09-23T17:53:34.281771] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-23T17:53:34.602247] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-01. [2025-09-23T17:53:34.989546] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-23T17:53:35.006874] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-23T17:53:35.402248] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2024-12. [2025-09-23T17:53:36.202227] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-03. [2025-09-23T17:53:36.297884] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-23T17:53:37.002254] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-01. [2025-09-23T17:53:37.547102] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-23T17:53:37.802202] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-09-23T17:53:37.976136] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-23T17:53:38.057943] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-09-23T17:53:38.602272] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-04. [2025-09-23T17:53:39.402267] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-02. [2025-09-23T17:53:39.935320] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-23T17:53:40.202259] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-03. [2025-09-23T17:53:40.711628] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-23T17:53:41.002170] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-05. [2025-09-23T17:53:41.268924] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-23T17:53:41.802259] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-09-23T17:53:42.130579] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-23T17:53:42.487552] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-23T17:53:42.602251] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-09-23T17:53:43.297384] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-23T17:53:43.402232] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-02. [2025-09-23T17:53:44.202207] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-04. [2025-09-23T17:53:44.828138] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-23T17:53:45.002172] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-05. [2025-09-23T17:53:45.029563] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-23T17:53:45.645690] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-23T17:53:45.802255] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-09-23T17:53:46.167606] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-23T17:53:46.602262] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-06. [2025-09-23T17:53:47.402246] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-06. [2025-09-23T17:53:47.585418] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-23T17:53:48.202238] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-03. [2025-09-23T17:53:48.795861] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-23T17:53:49.002287] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-09-23T17:53:49.256324] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-09-23T17:53:49.569576] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-23T17:53:49.802220] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-09-23T17:53:50.231227] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-23T17:53:50.602233] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-09-23T17:53:50.982909] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-23T17:53:51.402211] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-07. [2025-09-23T17:53:52.202198] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-04. [2025-09-23T17:53:53.002189] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-09-23T17:53:53.461863] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-23T17:53:53.511523] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-23T17:53:53.513102] [INFO ] [REMOTE ] CCIA: Full fetch complete (2018 records). [2025-09-23T17:53:53.513345] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-09-23T17:53:53.768127] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-23T17:53:53.768558] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:53:53.768731] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:53:53.768890] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-09-23T17:53:53.769089] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-09-23T17:53:53.769148] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-09-23T17:53:53.773009] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-23T17:53:53.769517] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-09-23T17:53:53.783682] [INFO ] [MAIN ] Update Progress: 409/2372 symbols completed. CCIA took 24.4s. Estimated remaining: 4h 18m 25s. Rate: 7.6 symbols/min [2025-09-23T17:53:53.805630] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-08. [2025-09-23T17:53:53.963181] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:53:54.046065] [DEBUG] [LOCAL ] CCJ: Loaded 53675 existing records from primary storage. [2025-09-23T17:53:54.046254] [INFO ] [MAIN ] CCJ: Loaded 53675 existing records. [2025-09-23T17:53:54.243840] [WARN ] [MAIN ] CCJ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:53:54.244213] [INFO ] [MAIN ] CCJ: Wiping existing primary data before full refresh. [2025-09-23T17:53:54.244300] [INFO ] [LOCAL ] CCJ: Starting deletion of primary data. [2025-09-23T17:53:54.245947] [DEBUG] [LOCAL ] CCJ: Deleted primary data file. [2025-09-23T17:53:54.246022] [INFO ] [MAIN ] CCJ: Starting full primary refresh. [2025-09-23T17:53:54.609397] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-05. [2025-09-23T17:53:54.615181] [INFO ] [REMOTE ] CCJ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:53:55.346604] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-23T17:53:55.402171] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-09. [2025-09-23T17:53:56.202214] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-07. [2025-09-23T17:53:56.615265] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-23T17:53:56.830626] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-23T17:53:56.840314] [INFO ] [REMOTE ] CCI: Full fetch complete (77000 records). [2025-09-23T17:53:56.840487] [DEBUG] [VALIDATOR ] CCI: Validating primary data. [2025-09-23T17:53:57.007296] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2024-12. [2025-09-23T17:53:57.150131] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-23T17:53:57.351877] [DEBUG] [VALIDATOR ] CCI: All expected trading days are present. [2025-09-23T17:53:57.351973] [DEBUG] [VALIDATOR ] CCI: Primary data validation passed. [2025-09-23T17:53:57.352910] [INFO ] [MAIN ] CCI: Fetched primary data is valid. [2025-09-23T17:53:57.352979] [DEBUG] [LOCAL ] CCI: Saving primary data. [2025-09-23T17:53:57.354660] [DEBUG] [LOCAL ] CCI: Trimmed 77000 records to 53153 (keeping 200 days of data) [2025-09-23T17:53:57.692748] [DEBUG] [LOCAL ] CCI: Primary data saved (53153 records). [2025-09-23T17:53:57.692892] [INFO ] [MAIN ] CCI: Full history saved. [2025-09-23T17:53:57.694094] [INFO ] [MAIN ] Update Progress: 410/2372 symbols completed. CCI took 30.5s. Estimated remaining: 4h 17m 58s. Rate: 7.6 symbols/min [2025-09-23T17:53:57.807326] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-06. [2025-09-23T17:53:57.865736] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:53:57.917359] [DEBUG] [LOCAL ] CCK: Loaded 46503 existing records from primary storage. [2025-09-23T17:53:57.917497] [INFO ] [MAIN ] CCK: Loaded 46503 existing records. [2025-09-23T17:53:58.098624] [WARN ] [MAIN ] CCK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:53:58.098948] [INFO ] [MAIN ] CCK: Wiping existing primary data before full refresh. [2025-09-23T17:53:58.099000] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-09-23T17:53:58.100274] [DEBUG] [LOCAL ] CCK: Deleted primary data file. [2025-09-23T17:53:58.100339] [INFO ] [MAIN ] CCK: Starting full primary refresh. [2025-09-23T17:53:58.453548] [INFO ] [REMOTE ] CCK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:53:58.602168] [INFO ] [REMOTE ] CCK: Fetching primary data for 2024-12. [2025-09-23T17:53:58.854428] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-23T17:53:59.191070] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-23T17:53:59.402220] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-07. [2025-09-23T17:53:59.836079] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-23T17:54:00.202198] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-01. [2025-09-23T17:54:01.002273] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-08. [2025-09-23T17:54:01.313370] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-23T17:54:01.802226] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-01. [2025-09-23T17:54:02.109687] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-23T17:54:02.366638] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-09-23T17:54:02.602210] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-08. [2025-09-23T17:54:03.402214] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-09. [2025-09-23T17:54:04.202263] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-02. [2025-09-23T17:54:04.853719] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-23T17:54:04.856797] [INFO ] [REMOTE ] CCIF: Full fetch complete (21492 records). [2025-09-23T17:54:04.856889] [DEBUG] [VALIDATOR ] CCIF: Validating primary data. [2025-09-23T17:54:05.264971] [DEBUG] [VALIDATOR ] CCIF: All expected trading days are present. [2025-09-23T17:54:05.265088] [DEBUG] [VALIDATOR ] CCIF: Primary data validation passed. [2025-09-23T17:54:05.265537] [INFO ] [MAIN ] CCIF: Fetched primary data is valid. [2025-09-23T17:54:05.265601] [DEBUG] [LOCAL ] CCIF: Saving primary data. [2025-09-23T17:54:05.266300] [DEBUG] [LOCAL ] CCIF: Trimmed 21492 records to 15346 (keeping 200 days of data) [2025-09-23T17:54:05.367082] [DEBUG] [LOCAL ] CCIF: Primary data saved (15346 records). [2025-09-23T17:54:05.367227] [INFO ] [MAIN ] CCIF: Full history saved. [2025-09-23T17:54:05.367311] [INFO ] [MAIN ] Update Progress: 411/2372 symbols completed. CCIF took 33.4s. Estimated remaining: 4h 17m 49s. Rate: 7.6 symbols/min [2025-09-23T17:54:05.534701] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:54:05.591886] [DEBUG] [LOCAL ] CCL: Loaded 53800 existing records from primary storage. [2025-09-23T17:54:05.592045] [INFO ] [MAIN ] CCL: Loaded 53800 existing records. [2025-09-23T17:54:05.766943] [WARN ] [MAIN ] CCL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:54:05.767205] [INFO ] [MAIN ] CCL: Wiping existing primary data before full refresh. [2025-09-23T17:54:05.767253] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-09-23T17:54:05.768532] [DEBUG] [LOCAL ] CCL: Deleted primary data file. [2025-09-23T17:54:05.768595] [INFO ] [MAIN ] CCL: Starting full primary refresh. [2025-09-23T17:54:06.138559] [INFO ] [REMOTE ] CCL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:54:06.139182] [INFO ] [REMOTE ] CCL: Fetching primary data for 2024-12. [2025-09-23T17:54:06.190823] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-01 (4.39 seconds). [2025-09-23T17:54:06.201161] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-02. [2025-09-23T17:54:06.302681] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-08 (3.70 seconds). [2025-09-23T17:54:06.409208] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-09-23T17:54:06.602195] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-09. [2025-09-23T17:54:07.397813] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-23T17:54:07.406736] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-03. [2025-09-23T17:54:08.202214] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-03. [2025-09-23T17:54:08.605595] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-23T17:54:08.631902] [INFO ] [REMOTE ] CC: Full fetch complete (75480 records). [2025-09-23T17:54:08.653274] [DEBUG] [VALIDATOR ] CC: Validating primary data. [2025-09-23T17:54:08.687511] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2024-12 (2.55 seconds). [2025-09-23T17:54:09.007996] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-01. [2025-09-23T17:54:09.092870] [DEBUG] [VALIDATOR ] CC: All expected trading days are present. [2025-09-23T17:54:09.093157] [DEBUG] [VALIDATOR ] CC: Primary data validation passed. [2025-09-23T17:54:09.094131] [INFO ] [MAIN ] CC: Fetched primary data is valid. [2025-09-23T17:54:09.094219] [DEBUG] [LOCAL ] CC: Saving primary data. [2025-09-23T17:54:09.096257] [DEBUG] [LOCAL ] CC: Trimmed 75480 records to 53032 (keeping 200 days of data) [2025-09-23T17:54:09.238847] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-23T17:54:09.511317] [DEBUG] [LOCAL ] CC: Primary data saved (53032 records). [2025-09-23T17:54:09.511532] [INFO ] [MAIN ] CC: Full history saved. [2025-09-23T17:54:09.511785] [INFO ] [MAIN ] Update Progress: 412/2372 symbols completed. CC took 43.9s. Estimated remaining: 4h 17m 24s. Rate: 7.6 symbols/min [2025-09-23T17:54:09.545966] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-23T17:54:09.701416] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:54:09.751814] [DEBUG] [LOCAL ] CCO: Loaded 47602 existing records from primary storage. [2025-09-23T17:54:09.751994] [INFO ] [MAIN ] CCO: Loaded 47602 existing records. [2025-09-23T17:54:09.807800] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-04. [2025-09-23T17:54:09.938210] [WARN ] [MAIN ] CCO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:54:09.938474] [INFO ] [MAIN ] CCO: Wiping existing primary data before full refresh. [2025-09-23T17:54:09.938523] [INFO ] [LOCAL ] CCO: Starting deletion of primary data. [2025-09-23T17:54:09.939828] [DEBUG] [LOCAL ] CCO: Deleted primary data file. [2025-09-23T17:54:09.939889] [INFO ] [MAIN ] CCO: Starting full primary refresh. [2025-09-23T17:54:10.308027] [INFO ] [REMOTE ] CCO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:54:10.602195] [INFO ] [REMOTE ] CCO: Fetching primary data for 2024-12. [2025-09-23T17:54:11.371292] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-09-23T17:54:11.402166] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-02. [2025-09-23T17:54:11.562876] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-23T17:54:11.859792] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-23T17:54:12.202193] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-05. [2025-09-23T17:54:13.002289] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-01. [2025-09-23T17:54:13.264530] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-23T17:54:13.802258] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-03. [2025-09-23T17:54:13.983435] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-23T17:54:14.421681] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-23T17:54:14.602205] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-06. [2025-09-23T17:54:15.402226] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-04. [2025-09-23T17:54:15.912344] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-23T17:54:16.202253] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-02. [2025-09-23T17:54:16.530738] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-23T17:54:16.959415] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-23T17:54:17.002189] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-05. [2025-09-23T17:54:17.338338] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-23T17:54:17.802239] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-07. [2025-09-23T17:54:18.417000] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-23T17:54:18.602285] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-06. [2025-09-23T17:54:19.402208] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-04. [2025-09-23T17:54:19.795436] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-23T17:54:19.887138] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-23T17:54:20.202220] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-03. [2025-09-23T17:54:21.002201] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-08. [2025-09-23T17:54:21.402106] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-23T17:54:21.657261] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-23T17:54:21.802199] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-07. [2025-09-23T17:54:22.602233] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-04. [2025-09-23T17:54:22.845393] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-23T17:54:23.081443] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-23T17:54:23.402198] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-08. [2025-09-23T17:54:23.927779] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-23T17:54:24.202245] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-05. [2025-09-23T17:54:24.994190] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-23T17:54:25.003714] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-09. [2025-09-23T17:54:25.802266] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-09. [2025-09-23T17:54:26.278637] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-23T17:54:26.602216] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-06. [2025-09-23T17:54:26.973280] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-23T17:54:26.982430] [INFO ] [REMOTE ] CCJ: Full fetch complete (77684 records). [2025-09-23T17:54:26.982623] [DEBUG] [VALIDATOR ] CCJ: Validating primary data. [2025-09-23T17:54:27.404722] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-05. [2025-09-23T17:54:27.425369] [DEBUG] [VALIDATOR ] CCJ: All expected trading days are present. [2025-09-23T17:54:27.425678] [DEBUG] [VALIDATOR ] CCJ: Primary data validation passed. [2025-09-23T17:54:27.426783] [INFO ] [MAIN ] CCJ: Fetched primary data is valid. [2025-09-23T17:54:27.427857] [DEBUG] [LOCAL ] CCJ: Saving primary data. [2025-09-23T17:54:27.430065] [DEBUG] [LOCAL ] CCJ: Trimmed 77684 records to 53675 (keeping 200 days of data) [2025-09-23T17:54:27.559602] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-23T17:54:27.589753] [INFO ] [REMOTE ] CCK: Full fetch complete (67765 records). [2025-09-23T17:54:27.592956] [DEBUG] [VALIDATOR ] CCK: Validating primary data. [2025-09-23T17:54:28.136485] [DEBUG] [VALIDATOR ] CCK: All expected trading days are present. [2025-09-23T17:54:28.136967] [DEBUG] [VALIDATOR ] CCK: Primary data validation passed. [2025-09-23T17:54:28.138749] [INFO ] [MAIN ] CCK: Fetched primary data is valid. [2025-09-23T17:54:28.139683] [DEBUG] [LOCAL ] CCK: Saving primary data. [2025-09-23T17:54:28.150940] [DEBUG] [LOCAL ] CCK: Trimmed 67765 records to 46406 (keeping 200 days of data) [2025-09-23T17:54:28.368251] [DEBUG] [LOCAL ] CCJ: Primary data saved (53675 records). [2025-09-23T17:54:28.368415] [INFO ] [MAIN ] CCJ: Full history saved. [2025-09-23T17:54:28.368526] [INFO ] [MAIN ] Update Progress: 413/2372 symbols completed. CCJ took 34.6s. Estimated remaining: 4h 18m 8s. Rate: 7.6 symbols/min [2025-09-23T17:54:28.650116] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:54:28.717693] [DEBUG] [LOCAL ] CCRD: Loaded 8988 existing records from primary storage. [2025-09-23T17:54:28.718739] [INFO ] [MAIN ] CCRD: Loaded 8988 existing records. [2025-09-23T17:54:28.816547] [DEBUG] [LOCAL ] CCK: Primary data saved (46406 records). [2025-09-23T17:54:28.824342] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-23T17:54:28.839094] [INFO ] [MAIN ] CCK: Full history saved. [2025-09-23T17:54:28.877034] [INFO ] [MAIN ] Update Progress: 414/2372 symbols completed. CCK took 31.2s. Estimated remaining: 4h 17m 25s. Rate: 7.6 symbols/min [2025-09-23T17:54:28.888279] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-06. [2025-09-23T17:54:29.034901] [WARN ] [MAIN ] CCRD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:54:29.060965] [INFO ] [MAIN ] CCRD: Wiping existing primary data before full refresh. [2025-09-23T17:54:29.072329] [INFO ] [LOCAL ] CCRD: Starting deletion of primary data. [2025-09-23T17:54:29.073056] [DEBUG] [LOCAL ] CCRD: Deleted primary data file. [2025-09-23T17:54:29.118558] [INFO ] [MAIN ] CCRD: Starting full primary refresh. [2025-09-23T17:54:29.171804] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:54:29.492949] [DEBUG] [LOCAL ] CCS: Loaded 30741 existing records from primary storage. [2025-09-23T17:54:29.497333] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-06 (2.90 seconds). [2025-09-23T17:54:29.516132] [INFO ] [MAIN ] CCS: Loaded 30741 existing records. [2025-09-23T17:54:29.695338] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-07. [2025-09-23T17:54:29.757484] [INFO ] [REMOTE ] CCRD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:54:29.804915] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2024-12. [2025-09-23T17:54:29.833763] [WARN ] [MAIN ] CCS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:54:29.834102] [INFO ] [MAIN ] CCS: Wiping existing primary data before full refresh. [2025-09-23T17:54:29.834150] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-09-23T17:54:29.835136] [DEBUG] [LOCAL ] CCS: Deleted primary data file. [2025-09-23T17:54:29.835198] [INFO ] [MAIN ] CCS: Starting full primary refresh. [2025-09-23T17:54:30.216081] [INFO ] [REMOTE ] CCS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:54:30.602254] [INFO ] [REMOTE ] CCS: Fetching primary data for 2024-12. [2025-09-23T17:54:30.604133] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-23T17:54:30.711685] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-23T17:54:31.402284] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-07. [2025-09-23T17:54:31.915255] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-23T17:54:31.941583] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-23T17:54:32.202194] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-01. [2025-09-23T17:54:32.574745] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-23T17:54:33.002200] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-08. [2025-09-23T17:54:33.222444] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-23T17:54:33.802248] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-08. [2025-09-23T17:54:34.602253] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-01. [2025-09-23T17:54:35.317069] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-09-23T17:54:35.382833] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-23T17:54:35.387375] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-23T17:54:35.402143] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-09. [2025-09-23T17:54:36.202197] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-02. [2025-09-23T17:54:36.700414] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-23T17:54:36.708730] [INFO ] [REMOTE ] CCO: Full fetch complete (66067 records). [2025-09-23T17:54:36.708884] [DEBUG] [VALIDATOR ] CCO: Validating primary data. [2025-09-23T17:54:37.007306] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-02. [2025-09-23T17:54:37.108392] [DEBUG] [VALIDATOR ] CCO: All expected trading days are present. [2025-09-23T17:54:37.108469] [DEBUG] [VALIDATOR ] CCO: Primary data validation passed. [2025-09-23T17:54:37.109191] [INFO ] [MAIN ] CCO: Fetched primary data is valid. [2025-09-23T17:54:37.109255] [DEBUG] [LOCAL ] CCO: Saving primary data. [2025-09-23T17:54:37.110501] [DEBUG] [LOCAL ] CCO: Trimmed 66067 records to 47684 (keeping 200 days of data) [2025-09-23T17:54:37.371335] [DEBUG] [LOCAL ] CCO: Primary data saved (47684 records). [2025-09-23T17:54:37.371468] [INFO ] [MAIN ] CCO: Full history saved. [2025-09-23T17:54:37.371550] [INFO ] [MAIN ] Update Progress: 415/2372 symbols completed. CCO took 27.9s. Estimated remaining: 4h 17m 20s. Rate: 7.6 symbols/min [2025-09-23T17:54:37.526491] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-23T17:54:37.514608] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-23T17:54:37.580818] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:54:37.604889] [DEBUG] [LOCAL ] CCU: Loaded 23817 existing records from primary storage. [2025-09-23T17:54:37.605010] [INFO ] [MAIN ] CCU: Loaded 23817 existing records. [2025-09-23T17:54:37.782611] [WARN ] [MAIN ] CCU: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:54:37.782875] [INFO ] [MAIN ] CCU: Wiping existing primary data before full refresh. [2025-09-23T17:54:37.782928] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-09-23T17:54:37.783586] [DEBUG] [LOCAL ] CCU: Deleted primary data file. [2025-09-23T17:54:37.783698] [INFO ] [MAIN ] CCU: Starting full primary refresh. [2025-09-23T17:54:37.811948] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-03. [2025-09-23T17:54:38.134144] [INFO ] [REMOTE ] CCU: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:54:38.602222] [INFO ] [REMOTE ] CCU: Fetching primary data for 2024-12. [2025-09-23T17:54:38.926933] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-23T17:54:39.402225] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-09. [2025-09-23T17:54:39.730370] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-23T17:54:40.202194] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-01. [2025-09-23T17:54:40.815695] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-23T17:54:41.002267] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-03. [2025-09-23T17:54:41.432618] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-23T17:54:41.442176] [INFO ] [REMOTE ] CCL: Full fetch complete (77920 records). [2025-09-23T17:54:41.442350] [DEBUG] [VALIDATOR ] CCL: Validating primary data. [2025-09-23T17:54:41.581922] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-23T17:54:41.808707] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-04. [2025-09-23T17:54:41.873052] [DEBUG] [VALIDATOR ] CCL: All expected trading days are present. [2025-09-23T17:54:41.873178] [DEBUG] [VALIDATOR ] CCL: Primary data validation passed. [2025-09-23T17:54:41.874079] [INFO ] [MAIN ] CCL: Fetched primary data is valid. [2025-09-23T17:54:41.874145] [DEBUG] [LOCAL ] CCL: Saving primary data. [2025-09-23T17:54:41.876010] [DEBUG] [LOCAL ] CCL: Trimmed 77920 records to 53800 (keeping 200 days of data) [2025-09-23T17:54:42.203327] [DEBUG] [LOCAL ] CCL: Primary data saved (53800 records). [2025-09-23T17:54:42.203466] [INFO ] [MAIN ] CCL: Full history saved. [2025-09-23T17:54:42.203551] [INFO ] [MAIN ] Update Progress: 416/2372 symbols completed. CCL took 36.8s. Estimated remaining: 4h 16m 58s. Rate: 7.6 symbols/min [2025-09-23T17:54:42.389776] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:54:42.390002] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-09-23T17:54:42.390059] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-09-23T17:54:42.390256] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-09-23T17:54:42.390322] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-09-23T17:54:42.390380] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-09-23T17:54:42.390421] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-09-23T17:54:42.609791] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-02. [2025-09-23T17:54:42.775591] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:54:43.013795] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-23T17:54:43.402168] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-05. [2025-09-23T17:54:43.615850] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-23T17:54:44.202193] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-03. [2025-09-23T17:54:44.323874] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-23T17:54:45.002196] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-04. [2025-09-23T17:54:45.095426] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-23T17:54:45.400338] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-23T17:54:45.802220] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2024-12. [2025-09-23T17:54:46.164354] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-23T17:54:46.602210] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-01. [2025-09-23T17:54:46.838243] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-01 (0.24 seconds). [2025-09-23T17:54:47.402197] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-09-23T17:54:47.630231] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (0.23 seconds). [2025-09-23T17:54:48.202210] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-06. [2025-09-23T17:54:49.002218] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-05. [2025-09-23T17:54:49.459358] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-23T17:54:49.470884] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-23T17:54:49.802236] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-09-23T17:54:50.043396] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-09-23T17:54:50.602198] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-07. [2025-09-23T17:54:51.402247] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-09-23T17:54:51.537961] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-23T17:54:51.652359] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.25 seconds). [2025-09-23T17:54:52.202238] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-06. [2025-09-23T17:54:53.002225] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-09-23T17:54:53.199567] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-23T17:54:53.250478] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-09-23T17:54:53.802197] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-07. [2025-09-23T17:54:54.602201] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-08. [2025-09-23T17:54:54.652931] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-23T17:54:55.402274] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-04. [2025-09-23T17:54:55.605623] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-23T17:54:56.202205] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-09. [2025-09-23T17:54:56.711236] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-23T17:54:57.002258] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-09-23T17:54:57.172746] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-23T17:54:57.180396] [INFO ] [REMOTE ] CCS: Full fetch complete (44844 records). [2025-09-23T17:54:57.180585] [DEBUG] [VALIDATOR ] CCS: Validating primary data. [2025-09-23T17:54:57.309869] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:54:57.338234] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-09-23T17:54:57.578964] [DEBUG] [VALIDATOR ] CCS: All expected trading days are present. [2025-09-23T17:54:57.579049] [DEBUG] [VALIDATOR ] CCS: Primary data validation passed. [2025-09-23T17:54:57.579601] [INFO ] [MAIN ] CCS: Fetched primary data is valid. [2025-09-23T17:54:57.579716] [DEBUG] [LOCAL ] CCS: Saving primary data. [2025-09-23T17:54:57.580977] [DEBUG] [LOCAL ] CCS: Trimmed 44844 records to 30701 (keeping 200 days of data) [2025-09-23T17:54:57.771226] [DEBUG] [LOCAL ] CCS: Primary data saved (30701 records). [2025-09-23T17:54:57.771373] [INFO ] [MAIN ] CCS: Full history saved. [2025-09-23T17:54:57.771467] [INFO ] [MAIN ] Update Progress: 417/2372 symbols completed. CCS took 28.9s. Estimated remaining: 4h 17m 26s. Rate: 7.6 symbols/min [2025-09-23T17:54:57.804239] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-08. [2025-09-23T17:54:57.950426] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:54:58.007477] [DEBUG] [LOCAL ] CDE: Loaded 53641 existing records from primary storage. [2025-09-23T17:54:58.007714] [INFO ] [MAIN ] CDE: Loaded 53641 existing records. [2025-09-23T17:54:58.191995] [WARN ] [MAIN ] CDE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:54:58.192298] [INFO ] [MAIN ] CDE: Wiping existing primary data before full refresh. [2025-09-23T17:54:58.192349] [INFO ] [LOCAL ] CDE: Starting deletion of primary data. [2025-09-23T17:54:58.193764] [DEBUG] [LOCAL ] CDE: Deleted primary data file. [2025-09-23T17:54:58.193830] [INFO ] [MAIN ] CDE: Starting full primary refresh. [2025-09-23T17:54:58.554757] [INFO ] [REMOTE ] CDE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:54:58.564884] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-23T17:54:58.602149] [INFO ] [REMOTE ] CDE: Fetching primary data for 2024-12. [2025-09-23T17:54:59.402204] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-09. [2025-09-23T17:54:59.994676] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-23T17:54:59.996786] [INFO ] [REMOTE ] CCRD: Full fetch complete (12021 records). [2025-09-23T17:54:59.996857] [DEBUG] [VALIDATOR ] CCRD: Validating primary data. [2025-09-23T17:55:00.219192] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-05. [2025-09-23T17:55:00.445112] [DEBUG] [VALIDATOR ] CCRD: All expected trading days are present. [2025-09-23T17:55:00.445269] [DEBUG] [VALIDATOR ] CCRD: Primary data validation passed. [2025-09-23T17:55:00.445602] [INFO ] [MAIN ] CCRD: Fetched primary data is valid. [2025-09-23T17:55:00.445672] [DEBUG] [LOCAL ] CCRD: Saving primary data. [2025-09-23T17:55:00.446167] [DEBUG] [LOCAL ] CCRD: Trimmed 12021 records to 9000 (keeping 200 days of data) [2025-09-23T17:55:00.523117] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-23T17:55:00.544550] [DEBUG] [LOCAL ] CCRD: Primary data saved (9000 records). [2025-09-23T17:55:00.544738] [INFO ] [MAIN ] CCRD: Full history saved. [2025-09-23T17:55:00.544833] [INFO ] [MAIN ] Update Progress: 418/2372 symbols completed. CCRD took 32.2s. Estimated remaining: 4h 16m 54s. Rate: 7.6 symbols/min [2025-09-23T17:55:00.712468] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:55:00.724790] [DEBUG] [LOCAL ] CDLR: Loaded 9845 existing records from primary storage. [2025-09-23T17:55:00.724919] [INFO ] [MAIN ] CDLR: Loaded 9845 existing records. [2025-09-23T17:55:00.918801] [WARN ] [MAIN ] CDLR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:55:00.919092] [INFO ] [MAIN ] CDLR: Wiping existing primary data before full refresh. [2025-09-23T17:55:00.919142] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-09-23T17:55:00.919561] [DEBUG] [LOCAL ] CDLR: Deleted primary data file. [2025-09-23T17:55:00.919621] [INFO ] [MAIN ] CDLR: Starting full primary refresh. [2025-09-23T17:55:01.010662] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-07. [2025-09-23T17:55:01.280697] [INFO ] [REMOTE ] CDLR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:55:01.295218] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-23T17:55:01.305462] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-09-23T17:55:01.802257] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2024-12. [2025-09-23T17:55:02.391721] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-23T17:55:02.602216] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-01. [2025-09-23T17:55:03.402286] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-01. [2025-09-23T17:55:03.801311] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-23T17:55:04.202167] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-06. [2025-09-23T17:55:04.458399] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-23T17:55:04.946828] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-23T17:55:05.002206] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-07. [2025-09-23T17:55:05.802204] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-02. [2025-09-23T17:55:06.007120] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-23T17:55:06.602235] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-08. [2025-09-23T17:55:07.402455] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-02. [2025-09-23T17:55:08.202264] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-08. [2025-09-23T17:55:08.684357] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-02 (2.88 seconds). [2025-09-23T17:55:08.760032] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-23T17:55:08.875246] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-09-23T17:55:09.002167] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-03. [2025-09-23T17:55:09.136713] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-23T17:55:09.802178] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-03. [2025-09-23T17:55:09.813453] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-23T17:55:10.602187] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-04. [2025-09-23T17:55:11.342885] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-23T17:55:11.402169] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-05. [2025-09-23T17:55:11.516260] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-23T17:55:12.196564] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-23T17:55:12.202144] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-06. [2025-09-23T17:55:13.002172] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-09. [2025-09-23T17:55:13.235331] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-23T17:55:13.435033] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-23T17:55:13.435895] [INFO ] [REMOTE ] CCZ: Full fetch complete (132 records). [2025-09-23T17:55:13.435968] [DEBUG] [VALIDATOR ] CCZ: Validating primary data. [2025-09-23T17:55:13.436342] [FATAL] [VALIDATOR ] CCZ: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:55:13.436440] [FATAL] [MAIN ] CCZ: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:55:13.436485] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:55:13.436550] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-09-23T17:55:13.436679] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-09-23T17:55:13.436783] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-09-23T17:55:13.436858] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-09-23T17:55:13.436937] [INFO ] [MAIN ] Update Progress: 419/2372 symbols completed. CCZ took 31.2s. Estimated remaining: 4h 17m 9s. Rate: 7.6 symbols/min [2025-09-23T17:55:13.614312] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:55:13.659251] [DEBUG] [LOCAL ] CDP: Loaded 42674 existing records from primary storage. [2025-09-23T17:55:13.659393] [INFO ] [MAIN ] CDP: Loaded 42674 existing records. [2025-09-23T17:55:13.808028] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-04. [2025-09-23T17:55:13.855710] [WARN ] [MAIN ] CDP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:55:13.855977] [INFO ] [MAIN ] CDP: Wiping existing primary data before full refresh. [2025-09-23T17:55:13.856033] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-09-23T17:55:13.857293] [DEBUG] [LOCAL ] CDP: Deleted primary data file. [2025-09-23T17:55:13.857357] [INFO ] [MAIN ] CDP: Starting full primary refresh. [2025-09-23T17:55:14.272015] [INFO ] [REMOTE ] CDP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:55:14.602207] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-07. [2025-09-23T17:55:15.402249] [INFO ] [REMOTE ] CDP: Fetching primary data for 2024-12. [2025-09-23T17:55:15.432204] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-23T17:55:15.690342] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-23T17:55:16.202209] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-09. [2025-09-23T17:55:16.968136] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-23T17:55:17.007451] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-08. [2025-09-23T17:55:17.020588] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-23T17:55:17.026299] [INFO ] [REMOTE ] CCU: Full fetch complete (33137 records). [2025-09-23T17:55:17.026474] [DEBUG] [VALIDATOR ] CCU: Validating primary data. [2025-09-23T17:55:17.619165] [DEBUG] [VALIDATOR ] CCU: All expected trading days are present. [2025-09-23T17:55:17.620267] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-23T17:55:17.620427] [DEBUG] [VALIDATOR ] CCU: Primary data validation passed. [2025-09-23T17:55:17.621949] [INFO ] [MAIN ] CCU: Fetched primary data is valid. [2025-09-23T17:55:17.625830] [DEBUG] [LOCAL ] CCU: Saving primary data. [2025-09-23T17:55:17.627965] [DEBUG] [LOCAL ] CCU: Trimmed 33137 records to 23677 (keeping 200 days of data) [2025-09-23T17:55:17.774479] [DEBUG] [LOCAL ] CCU: Primary data saved (23677 records). [2025-09-23T17:55:17.774635] [INFO ] [MAIN ] CCU: Full history saved. [2025-09-23T17:55:17.774796] [INFO ] [MAIN ] Update Progress: 420/2372 symbols completed. CCU took 40.4s. Estimated remaining: 4h 16m 45s. Rate: 7.6 symbols/min [2025-09-23T17:55:17.807300] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-09. [2025-09-23T17:55:17.946947] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:55:17.947150] [DEBUG] [LOCAL ] CDRE: No existing data file found in primary storage. [2025-09-23T17:55:17.947205] [WARN ] [MAIN ] CDRE: No existing data found, performing full refresh instead. [2025-09-23T17:55:17.947348] [INFO ] [MAIN ] CDRE: Wiping existing primary data before full refresh. [2025-09-23T17:55:17.947390] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-09-23T17:55:17.947431] [DEBUG] [LOCAL ] CDRE: No primary data file found to delete. [2025-09-23T17:55:17.947463] [INFO ] [MAIN ] CDRE: Starting full primary refresh. [2025-09-23T17:55:18.303416] [INFO ] [REMOTE ] CDRE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:55:18.578433] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-23T17:55:18.580376] [INFO ] [REMOTE ] CDLR: Full fetch complete (13014 records). [2025-09-23T17:55:18.580451] [DEBUG] [VALIDATOR ] CDLR: Validating primary data. [2025-09-23T17:55:18.580908] [FATAL] [VALIDATOR ] CDLR: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T17:55:18.580994] [FATAL] [MAIN ] CDLR: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:55:18.581037] [WARN ] [MAIN ] CDLR: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:55:18.581075] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-09-23T17:55:18.581129] [DEBUG] [LOCAL ] CDLR: No primary data file found to delete. [2025-09-23T17:55:18.581164] [INFO ] [LOCAL ] CDLR: Starting deletion of derivative data. [2025-09-23T17:55:18.581742] [DEBUG] [LOCAL ] CDLR: Deleted derivative data file. [2025-09-23T17:55:18.581881] [INFO ] [MAIN ] Update Progress: 421/2372 symbols completed. CDLR took 18.0s. Estimated remaining: 4h 16m 4s. Rate: 7.6 symbols/min [2025-09-23T17:55:18.607382] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2024-12. [2025-09-23T17:55:18.765956] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:55:18.827819] [DEBUG] [LOCAL ] CE: Loaded 51561 existing records from primary storage. [2025-09-23T17:55:18.827972] [INFO ] [MAIN ] CE: Loaded 51561 existing records. [2025-09-23T17:55:19.022419] [WARN ] [MAIN ] CE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:55:19.022729] [INFO ] [MAIN ] CE: Wiping existing primary data before full refresh. [2025-09-23T17:55:19.022786] [INFO ] [LOCAL ] CE: Starting deletion of primary data. [2025-09-23T17:55:19.024118] [DEBUG] [LOCAL ] CE: Deleted primary data file. [2025-09-23T17:55:19.024179] [INFO ] [MAIN ] CE: Starting full primary refresh. [2025-09-23T17:55:19.379550] [INFO ] [REMOTE ] CE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:55:19.402148] [INFO ] [REMOTE ] CE: Fetching primary data for 2024-12. [2025-09-23T17:55:19.690031] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-23T17:55:20.202187] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-01. [2025-09-23T17:55:20.972995] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-23T17:55:21.002151] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-01. [2025-09-23T17:55:21.079181] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-23T17:55:21.802160] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-05. [2025-09-23T17:55:22.425857] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-23T17:55:22.602201] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-02. [2025-09-23T17:55:23.402260] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-01. [2025-09-23T17:55:24.011943] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-23T17:55:24.100632] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-09-23T17:55:24.202184] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-06. [2025-09-23T17:55:24.519549] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-23T17:55:25.002193] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-02. [2025-09-23T17:55:25.802167] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-02. [2025-09-23T17:55:25.919609] [DEBUG] [REMOTE ] CDRE: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-09-23T17:55:25.919987] [WARN ] [REMOTE ] CDRE: No data returned for month 2025-02 [2025-09-23T17:55:25.987863] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-23T17:55:26.064003] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-23T17:55:26.602241] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-03. [2025-09-23T17:55:27.402166] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-07. [2025-09-23T17:55:27.577980] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-23T17:55:28.202206] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-04. [2025-09-23T17:55:28.949832] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-23T17:55:29.002224] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-03. [2025-09-23T17:55:29.029338] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-23T17:55:29.802199] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-03. [2025-09-23T17:55:30.602170] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-08. [2025-09-23T17:55:30.777491] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-23T17:55:31.123374] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-23T17:55:31.402207] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-04. [2025-09-23T17:55:32.202260] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-05. [2025-09-23T17:55:32.742598] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-23T17:55:32.940797] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-23T17:55:33.002162] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-05. [2025-09-23T17:55:33.433293] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-23T17:55:33.802211] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-04. [2025-09-23T17:55:34.428691] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-23T17:55:34.602211] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-06. [2025-09-23T17:55:35.049758] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-23T17:55:35.402197] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-06. [2025-09-23T17:55:35.884443] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-23T17:55:36.202158] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-07. [2025-09-23T17:55:36.246806] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-23T17:55:37.002258] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-09. [2025-09-23T17:55:37.531838] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-23T17:55:37.802195] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-07. [2025-09-23T17:55:38.506452] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-23T17:55:38.602246] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-08. [2025-09-23T17:55:38.829526] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-23T17:55:38.843638] [INFO ] [REMOTE ] CDE: Full fetch complete (77574 records). [2025-09-23T17:55:38.843865] [DEBUG] [VALIDATOR ] CDE: Validating primary data. [2025-09-23T17:55:39.300394] [DEBUG] [VALIDATOR ] CDE: All expected trading days are present. [2025-09-23T17:55:39.300479] [DEBUG] [VALIDATOR ] CDE: Primary data validation passed. [2025-09-23T17:55:39.301299] [INFO ] [MAIN ] CDE: Fetched primary data is valid. [2025-09-23T17:55:39.301394] [DEBUG] [LOCAL ] CDE: Saving primary data. [2025-09-23T17:55:39.302992] [DEBUG] [LOCAL ] CDE: Trimmed 77574 records to 53641 (keeping 200 days of data) [2025-09-23T17:55:39.402412] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-05. [2025-09-23T17:55:39.647501] [DEBUG] [LOCAL ] CDE: Primary data saved (53641 records). [2025-09-23T17:55:39.647774] [INFO ] [MAIN ] CDE: Full history saved. [2025-09-23T17:55:39.648006] [INFO ] [MAIN ] Update Progress: 422/2372 symbols completed. CDE took 41.9s. Estimated remaining: 4h 16m 57s. Rate: 7.6 symbols/min [2025-09-23T17:55:39.845498] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:55:39.855302] [DEBUG] [LOCAL ] CEE: Loaded 6839 existing records from primary storage. [2025-09-23T17:55:39.855406] [INFO ] [MAIN ] CEE: Loaded 6839 existing records. [2025-09-23T17:55:40.041054] [WARN ] [MAIN ] CEE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:55:40.041786] [INFO ] [MAIN ] CEE: Wiping existing primary data before full refresh. [2025-09-23T17:55:40.041856] [INFO ] [LOCAL ] CEE: Starting deletion of primary data. [2025-09-23T17:55:40.042578] [DEBUG] [LOCAL ] CEE: Deleted primary data file. [2025-09-23T17:55:40.042755] [INFO ] [MAIN ] CEE: Starting full primary refresh. [2025-09-23T17:55:40.207229] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-08. [2025-09-23T17:55:40.332557] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-23T17:55:40.471122] [INFO ] [REMOTE ] CEE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:55:40.647915] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-23T17:55:41.002204] [INFO ] [REMOTE ] CEE: Fetching primary data for 2024-12. [2025-09-23T17:55:41.205982] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-23T17:55:41.694905] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-23T17:55:41.802217] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-01. [2025-09-23T17:55:42.393165] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-23T17:55:42.602235] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-09. [2025-09-23T17:55:43.402214] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-02. [2025-09-23T17:55:43.550264] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-23T17:55:43.555075] [INFO ] [REMOTE ] CDRE: Full fetch complete (33210 records). [2025-09-23T17:55:43.555217] [DEBUG] [VALIDATOR ] CDRE: Validating primary data. [2025-09-23T17:55:43.740774] [WARN ] [VALIDATOR ] CDRE: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-23T17:55:43.741200] [FATAL] [MAIN ] CDRE: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:55:43.741280] [WARN ] [MAIN ] CDRE: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:55:43.741366] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-09-23T17:55:43.741447] [DEBUG] [LOCAL ] CDRE: No primary data file found to delete. [2025-09-23T17:55:43.741496] [INFO ] [LOCAL ] CDRE: Starting deletion of derivative data. [2025-09-23T17:55:43.741564] [DEBUG] [LOCAL ] CDRE: No derivative data file found to delete. [2025-09-23T17:55:43.741708] [INFO ] [MAIN ] Update Progress: 423/2372 symbols completed. CDRE took 26.0s. Estimated remaining: 4h 16m 32s. Rate: 7.6 symbols/min [2025-09-23T17:55:43.910612] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:55:43.942259] [DEBUG] [LOCAL ] CEPU: Loaded 25921 existing records from primary storage. [2025-09-23T17:55:43.942415] [INFO ] [MAIN ] CEPU: Loaded 25921 existing records. [2025-09-23T17:55:44.139922] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-23T17:55:44.139424] [WARN ] [MAIN ] CEPU: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:55:44.143482] [INFO ] [MAIN ] CEPU: Wiping existing primary data before full refresh. [2025-09-23T17:55:44.143580] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-09-23T17:55:44.144460] [DEBUG] [LOCAL ] CEPU: Deleted primary data file. [2025-09-23T17:55:44.144520] [INFO ] [MAIN ] CEPU: Starting full primary refresh. [2025-09-23T17:55:44.207296] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-09. [2025-09-23T17:55:44.500568] [INFO ] [REMOTE ] CEPU: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:55:45.002241] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-03. [2025-09-23T17:55:45.802222] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2024-12. [2025-09-23T17:55:46.083893] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-23T17:55:46.092698] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-23T17:55:46.097885] [INFO ] [REMOTE ] CE: Full fetch complete (74896 records). [2025-09-23T17:55:46.098005] [DEBUG] [VALIDATOR ] CE: Validating primary data. [2025-09-23T17:55:46.491216] [DEBUG] [VALIDATOR ] CE: All expected trading days are present. [2025-09-23T17:55:46.491308] [DEBUG] [VALIDATOR ] CE: Primary data validation passed. [2025-09-23T17:55:46.492160] [INFO ] [MAIN ] CE: Fetched primary data is valid. [2025-09-23T17:55:46.492225] [DEBUG] [LOCAL ] CE: Saving primary data. [2025-09-23T17:55:46.494788] [DEBUG] [LOCAL ] CE: Trimmed 74896 records to 51554 (keeping 200 days of data) [2025-09-23T17:55:46.602607] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-04. [2025-09-23T17:55:46.824889] [DEBUG] [LOCAL ] CE: Primary data saved (51554 records). [2025-09-23T17:55:46.825528] [INFO ] [MAIN ] CE: Full history saved. [2025-09-23T17:55:46.825883] [INFO ] [MAIN ] Update Progress: 424/2372 symbols completed. CE took 28.2s. Estimated remaining: 4h 16m 2s. Rate: 7.6 symbols/min [2025-09-23T17:55:47.034182] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:55:47.047961] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-23T17:55:47.093963] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-23T17:55:47.116459] [DEBUG] [LOCAL ] CF: Loaded 52233 existing records from primary storage. [2025-09-23T17:55:47.116616] [INFO ] [MAIN ] CF: Loaded 52233 existing records. [2025-09-23T17:55:47.310259] [WARN ] [MAIN ] CF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:55:47.310590] [INFO ] [MAIN ] CF: Wiping existing primary data before full refresh. [2025-09-23T17:55:47.310637] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-09-23T17:55:47.311958] [DEBUG] [LOCAL ] CF: Deleted primary data file. [2025-09-23T17:55:47.312019] [INFO ] [MAIN ] CF: Starting full primary refresh. [2025-09-23T17:55:47.407364] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-01. [2025-09-23T17:55:47.671940] [INFO ] [REMOTE ] CF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:55:48.202199] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-05. [2025-09-23T17:55:48.366424] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-23T17:55:48.715517] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-23T17:55:49.002247] [INFO ] [REMOTE ] CF: Fetching primary data for 2024-12. [2025-09-23T17:55:49.802214] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-06. [2025-09-23T17:55:50.441594] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-23T17:55:50.602208] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-06. [2025-09-23T17:55:50.996451] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-23T17:55:51.072534] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-23T17:55:51.402191] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-07. [2025-09-23T17:55:51.875314] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-23T17:55:52.202200] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-08. [2025-09-23T17:55:52.687662] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-23T17:55:53.002238] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-02. [2025-09-23T17:55:53.809004] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-09. [2025-09-23T17:55:53.812966] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-23T17:55:54.534957] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-23T17:55:54.536378] [INFO ] [REMOTE ] CEE: Full fetch complete (10235 records). [2025-09-23T17:55:54.536449] [DEBUG] [VALIDATOR ] CEE: Validating primary data. [2025-09-23T17:55:54.611948] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-01. [2025-09-23T17:55:54.913721] [DEBUG] [VALIDATOR ] CEE: All expected trading days are present. [2025-09-23T17:55:54.913863] [DEBUG] [VALIDATOR ] CEE: Primary data validation passed. [2025-09-23T17:55:54.914145] [INFO ] [MAIN ] CEE: Fetched primary data is valid. [2025-09-23T17:55:54.914186] [DEBUG] [LOCAL ] CEE: Saving primary data. [2025-09-23T17:55:54.914678] [DEBUG] [LOCAL ] CEE: Trimmed 10235 records to 6777 (keeping 200 days of data) [2025-09-23T17:55:54.954995] [DEBUG] [LOCAL ] CEE: Primary data saved (6777 records). [2025-09-23T17:55:54.955143] [INFO ] [MAIN ] CEE: Full history saved. [2025-09-23T17:55:54.955251] [INFO ] [MAIN ] Update Progress: 425/2372 symbols completed. CEE took 15.3s. Estimated remaining: 4h 15m 55s. Rate: 7.6 symbols/min [2025-09-23T17:55:55.128938] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:55:55.129752] [DEBUG] [LOCAL ] CFG: No existing data file found in primary storage. [2025-09-23T17:55:55.129808] [WARN ] [MAIN ] CFG: No existing data found, performing full refresh instead. [2025-09-23T17:55:55.130057] [INFO ] [MAIN ] CFG: Wiping existing primary data before full refresh. [2025-09-23T17:55:55.130111] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-09-23T17:55:55.130157] [DEBUG] [LOCAL ] CFG: No primary data file found to delete. [2025-09-23T17:55:55.130189] [INFO ] [MAIN ] CFG: Starting full primary refresh. [2025-09-23T17:55:55.404417] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-07. [2025-09-23T17:55:55.482693] [INFO ] [REMOTE ] CFG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:55:56.202168] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-03. [2025-09-23T17:55:56.337625] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-23T17:55:56.605498] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-23T17:55:57.002207] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-08. [2025-09-23T17:55:57.654157] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-23T17:55:57.802242] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-04. [2025-09-23T17:55:58.048732] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-23T17:55:58.582140] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-23T17:55:58.602174] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-05. [2025-09-23T17:55:59.402175] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-09. [2025-09-23T17:55:59.427620] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-23T17:56:00.202204] [INFO ] [REMOTE ] CFG: Fetching primary data for 2024-12. [2025-09-23T17:56:00.721676] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-23T17:56:00.732547] [INFO ] [REMOTE ] CDP: Full fetch complete (61809 records). [2025-09-23T17:56:00.732738] [DEBUG] [VALIDATOR ] CDP: Validating primary data. [2025-09-23T17:56:01.007326] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-06. [2025-09-23T17:56:01.132808] [DEBUG] [VALIDATOR ] CDP: All expected trading days are present. [2025-09-23T17:56:01.132918] [DEBUG] [VALIDATOR ] CDP: Primary data validation passed. [2025-09-23T17:56:01.133697] [INFO ] [MAIN ] CDP: Fetched primary data is valid. [2025-09-23T17:56:01.133764] [DEBUG] [LOCAL ] CDP: Saving primary data. [2025-09-23T17:56:01.135695] [DEBUG] [LOCAL ] CDP: Trimmed 61809 records to 42704 (keeping 200 days of data) [2025-09-23T17:56:01.413699] [DEBUG] [LOCAL ] CDP: Primary data saved (42704 records). [2025-09-23T17:56:01.413833] [INFO ] [MAIN ] CDP: Full history saved. [2025-09-23T17:56:01.413929] [INFO ] [MAIN ] Update Progress: 426/2372 symbols completed. CDP took 48.0s. Estimated remaining: 4h 15m 40s. Rate: 7.6 symbols/min [2025-09-23T17:56:01.582943] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:56:01.583138] [DEBUG] [LOCAL ] CFND: No existing data file found in primary storage. [2025-09-23T17:56:01.583188] [WARN ] [MAIN ] CFND: No existing data found, performing full refresh instead. [2025-09-23T17:56:01.583327] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-09-23T17:56:01.583369] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-09-23T17:56:01.583410] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-09-23T17:56:01.583450] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-09-23T17:56:01.809918] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-02. [2025-09-23T17:56:01.953693] [INFO ] [REMOTE ] CFND: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:56:02.017561] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-23T17:56:02.199029] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-23T17:56:02.602192] [INFO ] [REMOTE ] CFND: Fetching primary data for 2024-12. [2025-09-23T17:56:03.402197] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-07. [2025-09-23T17:56:04.202197] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-01. [2025-09-23T17:56:04.519451] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:56:04.519825] [WARN ] [REMOTE ] CFND: No data returned for month 2024-12 [2025-09-23T17:56:05.002191] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-01. [2025-09-23T17:56:05.208109] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:56:05.208425] [WARN ] [REMOTE ] CFND: No data returned for month 2025-01 [2025-09-23T17:56:05.328086] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-02 (3.52 seconds). [2025-09-23T17:56:05.659109] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-23T17:56:05.802191] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-08. [2025-09-23T17:56:06.503757] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-09-23T17:56:06.528899] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-23T17:56:06.602166] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-09. [2025-09-23T17:56:07.402204] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-02. [2025-09-23T17:56:07.641160] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:56:07.641498] [WARN ] [REMOTE ] CFND: No data returned for month 2025-02 [2025-09-23T17:56:08.202171] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-03. [2025-09-23T17:56:08.294422] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-23T17:56:08.300072] [INFO ] [REMOTE ] CEPU: Full fetch complete (39589 records). [2025-09-23T17:56:08.300162] [DEBUG] [VALIDATOR ] CEPU: Validating primary data. [2025-09-23T17:56:08.695507] [DEBUG] [VALIDATOR ] CEPU: All expected trading days are present. [2025-09-23T17:56:08.695587] [DEBUG] [VALIDATOR ] CEPU: Primary data validation passed. [2025-09-23T17:56:08.696144] [INFO ] [MAIN ] CEPU: Fetched primary data is valid. [2025-09-23T17:56:08.696210] [DEBUG] [LOCAL ] CEPU: Saving primary data. [2025-09-23T17:56:08.697152] [DEBUG] [LOCAL ] CEPU: Trimmed 39589 records to 25995 (keeping 200 days of data) [2025-09-23T17:56:08.869963] [DEBUG] [LOCAL ] CEPU: Primary data saved (25995 records). [2025-09-23T17:56:08.870110] [INFO ] [MAIN ] CEPU: Full history saved. [2025-09-23T17:56:08.870199] [INFO ] [MAIN ] Update Progress: 427/2372 symbols completed. CEPU took 25.1s. Estimated remaining: 4h 15m 31s. Rate: 7.6 symbols/min [2025-09-23T17:56:09.017164] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-02. [2025-09-23T17:56:09.050329] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:56:09.093220] [DEBUG] [LOCAL ] CFR: Loaded 33601 existing records from primary storage. [2025-09-23T17:56:09.093378] [INFO ] [MAIN ] CFR: Loaded 33601 existing records. [2025-09-23T17:56:09.278440] [WARN ] [MAIN ] CFR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:56:09.278726] [INFO ] [MAIN ] CFR: Wiping existing primary data before full refresh. [2025-09-23T17:56:09.278784] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-09-23T17:56:09.279966] [DEBUG] [LOCAL ] CFR: Deleted primary data file. [2025-09-23T17:56:09.280030] [INFO ] [MAIN ] CFR: Starting full primary refresh. [2025-09-23T17:56:09.655666] [INFO ] [REMOTE ] CFR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:56:09.722672] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-23T17:56:09.802170] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-04. [2025-09-23T17:56:10.294683] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-23T17:56:10.602221] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-03. [2025-09-23T17:56:11.317029] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-23T17:56:11.402230] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-05. [2025-09-23T17:56:12.194583] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-23T17:56:12.205513] [INFO ] [REMOTE ] CFR: Fetching primary data for 2024-12. [2025-09-23T17:56:12.847569] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-23T17:56:13.002195] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-04. [2025-09-23T17:56:13.632938] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-23T17:56:13.802201] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-06. [2025-09-23T17:56:14.460614] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-23T17:56:14.602195] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-05. [2025-09-23T17:56:15.252998] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-23T17:56:15.402213] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-03. [2025-09-23T17:56:15.602756] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:56:15.603077] [WARN ] [REMOTE ] CFND: No data returned for month 2025-03 [2025-09-23T17:56:16.017778] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-23T17:56:16.202190] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-06. [2025-09-23T17:56:17.002196] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-01. [2025-09-23T17:56:17.723607] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-23T17:56:17.802151] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-07. [2025-09-23T17:56:18.602199] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-07. [2025-09-23T17:56:18.623868] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-23T17:56:19.402226] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-02. [2025-09-23T17:56:19.827453] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-23T17:56:19.886527] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-23T17:56:20.202208] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-08. [2025-09-23T17:56:20.379220] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-23T17:56:21.002246] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-04. [2025-09-23T17:56:21.201965] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:56:21.202272] [WARN ] [REMOTE ] CFND: No data returned for month 2025-04 [2025-09-23T17:56:21.802212] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-05. [2025-09-23T17:56:21.991116] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-23T17:56:22.012883] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:56:22.013260] [WARN ] [REMOTE ] CFND: No data returned for month 2025-05 [2025-09-23T17:56:22.602229] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-08. [2025-09-23T17:56:23.402243] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-06. [2025-09-23T17:56:23.603599] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:56:23.604370] [WARN ] [REMOTE ] CFND: No data returned for month 2025-06 [2025-09-23T17:56:24.067931] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-23T17:56:24.202215] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-09. [2025-09-23T17:56:25.002266] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-03. [2025-09-23T17:56:25.772543] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-23T17:56:25.781863] [INFO ] [REMOTE ] CFG: Full fetch complete (77575 records). [2025-09-23T17:56:25.782011] [DEBUG] [VALIDATOR ] CFG: Validating primary data. [2025-09-23T17:56:25.814538] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-09. [2025-09-23T17:56:26.193705] [DEBUG] [VALIDATOR ] CFG: All expected trading days are present. [2025-09-23T17:56:26.193849] [DEBUG] [VALIDATOR ] CFG: Primary data validation passed. [2025-09-23T17:56:26.195058] [INFO ] [MAIN ] CFG: Fetched primary data is valid. [2025-09-23T17:56:26.195208] [DEBUG] [LOCAL ] CFG: Saving primary data. [2025-09-23T17:56:26.197562] [DEBUG] [LOCAL ] CFG: Trimmed 77575 records to 53624 (keeping 200 days of data) [2025-09-23T17:56:26.317886] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-23T17:56:26.563121] [DEBUG] [LOCAL ] CFG: Primary data saved (53624 records). [2025-09-23T17:56:26.563263] [INFO ] [MAIN ] CFG: Full history saved. [2025-09-23T17:56:26.563339] [INFO ] [MAIN ] Update Progress: 428/2372 symbols completed. CFG took 31.6s. Estimated remaining: 4h 16m 7s. Rate: 7.6 symbols/min [2025-09-23T17:56:26.607388] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-04. [2025-09-23T17:56:26.740526] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:56:26.779721] [DEBUG] [LOCAL ] CGAU: Loaded 42655 existing records from primary storage. [2025-09-23T17:56:26.779882] [INFO ] [MAIN ] CGAU: Loaded 42655 existing records. [2025-09-23T17:56:26.960238] [WARN ] [MAIN ] CGAU: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:56:26.960477] [INFO ] [MAIN ] CGAU: Wiping existing primary data before full refresh. [2025-09-23T17:56:26.960619] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-09-23T17:56:26.961630] [DEBUG] [LOCAL ] CGAU: Deleted primary data file. [2025-09-23T17:56:26.961729] [INFO ] [MAIN ] CGAU: Starting full primary refresh. [2025-09-23T17:56:27.355396] [INFO ] [REMOTE ] CGAU: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:56:27.407314] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-07. [2025-09-23T17:56:27.422343] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-23T17:56:27.431464] [INFO ] [REMOTE ] CF: Full fetch complete (75134 records). [2025-09-23T17:56:27.431635] [DEBUG] [VALIDATOR ] CF: Validating primary data. [2025-09-23T17:56:27.698598] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:56:27.744053] [WARN ] [REMOTE ] CFND: No data returned for month 2025-07 [2025-09-23T17:56:28.001764] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-23T17:56:28.153925] [DEBUG] [VALIDATOR ] CF: All expected trading days are present. [2025-09-23T17:56:28.154060] [DEBUG] [VALIDATOR ] CF: Primary data validation passed. [2025-09-23T17:56:28.155777] [INFO ] [MAIN ] CF: Fetched primary data is valid. [2025-09-23T17:56:28.155883] [DEBUG] [LOCAL ] CF: Saving primary data. [2025-09-23T17:56:28.158944] [DEBUG] [LOCAL ] CF: Trimmed 75134 records to 52228 (keeping 200 days of data) [2025-09-23T17:56:28.234798] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-08. [2025-09-23T17:56:28.560023] [DEBUG] [LOCAL ] CF: Primary data saved (52228 records). [2025-09-23T17:56:28.560189] [INFO ] [MAIN ] CF: Full history saved. [2025-09-23T17:56:28.560330] [INFO ] [MAIN ] Update Progress: 429/2372 symbols completed. CF took 41.7s. Estimated remaining: 4h 15m 33s. Rate: 7.6 symbols/min [2025-09-23T17:56:28.742028] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:56:28.749335] [DEBUG] [LOCAL ] CGV: Loaded 1425 existing records from primary storage. [2025-09-23T17:56:28.749498] [INFO ] [MAIN ] CGV: Loaded 1425 existing records. [2025-09-23T17:56:28.935609] [WARN ] [MAIN ] CGV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:56:28.935907] [INFO ] [MAIN ] CGV: Wiping existing primary data before full refresh. [2025-09-23T17:56:28.935965] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-09-23T17:56:28.936252] [DEBUG] [LOCAL ] CGV: Deleted primary data file. [2025-09-23T17:56:28.936356] [INFO ] [MAIN ] CGV: Starting full primary refresh. [2025-09-23T17:56:29.006714] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2024-12. [2025-09-23T17:56:29.241916] [INFO ] [REMOTE ] CFND: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-23T17:56:29.323399] [INFO ] [REMOTE ] CGV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:56:29.802205] [INFO ] [REMOTE ] CGV: Fetching primary data for 2024-12. [2025-09-23T17:56:30.080023] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2024-12 (0.28 seconds). [2025-09-23T17:56:30.210020] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-23T17:56:30.602232] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-01. [2025-09-23T17:56:31.402195] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-01. [2025-09-23T17:56:31.957631] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-23T17:56:31.971898] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-23T17:56:32.202238] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-02. [2025-09-23T17:56:33.002240] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-09. [2025-09-23T17:56:33.544173] [INFO ] [REMOTE ] CFND: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-23T17:56:33.545906] [INFO ] [REMOTE ] CFND: Full fetch complete (2526 records). [2025-09-23T17:56:33.545978] [DEBUG] [VALIDATOR ] CFND: Validating primary data. [2025-09-23T17:56:33.738428] [WARN ] [VALIDATOR ] CFND: Validation failed - insufficient historical data. Have 33 unique days, need 200 days [2025-09-23T17:56:33.738811] [FATAL] [MAIN ] CFND: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:56:33.738890] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:56:33.752303] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-09-23T17:56:33.761377] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-23T17:56:33.760445] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-09-23T17:56:33.769801] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-09-23T17:56:33.770372] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-09-23T17:56:33.770894] [INFO ] [MAIN ] Update Progress: 430/2372 symbols completed. CFND took 32.4s. Estimated remaining: 4h 15m 13s. Rate: 7.6 symbols/min [2025-09-23T17:56:33.807283] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-05. [2025-09-23T17:56:33.950227] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:56:33.976179] [DEBUG] [LOCAL ] CHCT: Loaded 24051 existing records from primary storage. [2025-09-23T17:56:33.976345] [INFO ] [MAIN ] CHCT: Loaded 24051 existing records. [2025-09-23T17:56:34.158095] [WARN ] [MAIN ] CHCT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:56:34.158343] [INFO ] [MAIN ] CHCT: Wiping existing primary data before full refresh. [2025-09-23T17:56:34.158390] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-09-23T17:56:34.159086] [DEBUG] [LOCAL ] CHCT: Deleted primary data file. [2025-09-23T17:56:34.159146] [INFO ] [MAIN ] CHCT: Starting full primary refresh. [2025-09-23T17:56:34.544527] [INFO ] [REMOTE ] CHCT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:56:34.602207] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2024-12. [2025-09-23T17:56:34.780417] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-23T17:56:35.402307] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-02. [2025-09-23T17:56:35.685105] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-09-23T17:56:35.991455] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-23T17:56:36.202243] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-03. [2025-09-23T17:56:37.002225] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-03. [2025-09-23T17:56:37.280203] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-09-23T17:56:37.745904] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-23T17:56:37.802203] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-04. [2025-09-23T17:56:38.229143] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-23T17:56:38.602238] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-01. [2025-09-23T17:56:39.402422] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-05. [2025-09-23T17:56:39.404580] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-23T17:56:39.707591] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-23T17:56:40.202228] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-04. [2025-09-23T17:56:41.002219] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-02. [2025-09-23T17:56:41.680447] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-23T17:56:41.777138] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-23T17:56:41.802210] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-05. [2025-09-23T17:56:42.602211] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-03. [2025-09-23T17:56:42.890019] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-23T17:56:43.320320] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-23T17:56:43.402220] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-04. [2025-09-23T17:56:44.202257] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-06. [2025-09-23T17:56:44.513420] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-23T17:56:45.002231] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-06. [2025-09-23T17:56:45.295572] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-23T17:56:45.802225] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-06. [2025-09-23T17:56:45.962498] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-23T17:56:46.222773] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-23T17:56:46.602201] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-07. [2025-09-23T17:56:46.949031] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-23T17:56:47.402348] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-08. [2025-09-23T17:56:47.670106] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-09-23T17:56:48.202185] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-05. [2025-09-23T17:56:49.002259] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-09. [2025-09-23T17:56:49.292449] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-23T17:56:49.409461] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-23T17:56:49.410454] [INFO ] [REMOTE ] CGV: Full fetch complete (2279 records). [2025-09-23T17:56:49.410533] [DEBUG] [VALIDATOR ] CGV: Validating primary data. [2025-09-23T17:56:49.763192] [DEBUG] [VALIDATOR ] CGV: All expected trading days are present. [2025-09-23T17:56:49.763271] [DEBUG] [VALIDATOR ] CGV: Primary data validation passed. [2025-09-23T17:56:49.763363] [INFO ] [MAIN ] CGV: Fetched primary data is valid. [2025-09-23T17:56:49.763491] [DEBUG] [LOCAL ] CGV: Saving primary data. [2025-09-23T17:56:49.763866] [DEBUG] [LOCAL ] CGV: Trimmed 2279 records to 1405 (keeping 200 days of data) [2025-09-23T17:56:49.772820] [DEBUG] [LOCAL ] CGV: Primary data saved (1405 records). [2025-09-23T17:56:49.772883] [INFO ] [MAIN ] CGV: Full history saved. [2025-09-23T17:56:49.772954] [INFO ] [MAIN ] Update Progress: 431/2372 symbols completed. CGV took 21.2s. Estimated remaining: 4h 15m 41s. Rate: 7.6 symbols/min [2025-09-23T17:56:49.807381] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-07. [2025-09-23T17:56:49.943870] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:56:49.997918] [DEBUG] [LOCAL ] CHD: Loaded 52034 existing records from primary storage. [2025-09-23T17:56:49.998067] [INFO ] [MAIN ] CHD: Loaded 52034 existing records. [2025-09-23T17:56:50.173860] [WARN ] [MAIN ] CHD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:56:50.174086] [INFO ] [MAIN ] CHD: Wiping existing primary data before full refresh. [2025-09-23T17:56:50.174131] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-09-23T17:56:50.178721] [DEBUG] [LOCAL ] CHD: Deleted primary data file. [2025-09-23T17:56:50.178808] [INFO ] [MAIN ] CHD: Starting full primary refresh. [2025-09-23T17:56:50.540006] [INFO ] [REMOTE ] CHD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:56:50.602149] [INFO ] [REMOTE ] CHD: Fetching primary data for 2024-12. [2025-09-23T17:56:50.939324] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-23T17:56:51.402256] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-07. [2025-09-23T17:56:51.957005] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-23T17:56:52.202244] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-06. [2025-09-23T17:56:52.472852] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-23T17:56:52.911474] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-23T17:56:53.002185] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-07. [2025-09-23T17:56:53.802192] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-01. [2025-09-23T17:56:54.279711] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-23T17:56:54.602199] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-08. [2025-09-23T17:56:55.177561] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-23T17:56:55.402202] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-08. [2025-09-23T17:56:55.664225] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-23T17:56:56.202202] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-09. [2025-09-23T17:56:57.002214] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-02. [2025-09-23T17:56:57.032040] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-23T17:56:57.332834] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-23T17:56:57.339155] [INFO ] [REMOTE ] CFR: Full fetch complete (48473 records). [2025-09-23T17:56:57.339275] [DEBUG] [VALIDATOR ] CFR: Validating primary data. [2025-09-23T17:56:57.758108] [DEBUG] [VALIDATOR ] CFR: All expected trading days are present. [2025-09-23T17:56:57.758218] [DEBUG] [VALIDATOR ] CFR: Primary data validation passed. [2025-09-23T17:56:57.758901] [INFO ] [MAIN ] CFR: Fetched primary data is valid. [2025-09-23T17:56:57.758972] [DEBUG] [LOCAL ] CFR: Saving primary data. [2025-09-23T17:56:57.760290] [DEBUG] [LOCAL ] CFR: Trimmed 48473 records to 33622 (keeping 200 days of data) [2025-09-23T17:56:57.820503] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-09. [2025-09-23T17:56:57.984911] [DEBUG] [LOCAL ] CFR: Primary data saved (33622 records). [2025-09-23T17:56:57.985066] [INFO ] [MAIN ] CFR: Full history saved. [2025-09-23T17:56:57.985180] [INFO ] [MAIN ] Update Progress: 432/2372 symbols completed. CFR took 49.1s. Estimated remaining: 4h 15m 35s. Rate: 7.6 symbols/min [2025-09-23T17:56:58.163788] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:56:58.179423] [DEBUG] [LOCAL ] CHE: Loaded 14666 existing records from primary storage. [2025-09-23T17:56:58.179547] [INFO ] [MAIN ] CHE: Loaded 14666 existing records. [2025-09-23T17:56:58.359375] [WARN ] [MAIN ] CHE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:56:58.359847] [INFO ] [MAIN ] CHE: Wiping existing primary data before full refresh. [2025-09-23T17:56:58.359905] [INFO ] [LOCAL ] CHE: Starting deletion of primary data. [2025-09-23T17:56:58.360370] [DEBUG] [LOCAL ] CHE: Deleted primary data file. [2025-09-23T17:56:58.360429] [INFO ] [MAIN ] CHE: Starting full primary refresh. [2025-09-23T17:56:58.614927] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-08. [2025-09-23T17:56:58.791282] [INFO ] [REMOTE ] CHE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:56:58.821152] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-23T17:56:59.247802] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-23T17:56:59.258410] [INFO ] [REMOTE ] CGAU: Full fetch complete (60502 records). [2025-09-23T17:56:59.258564] [DEBUG] [VALIDATOR ] CGAU: Validating primary data. [2025-09-23T17:56:59.414399] [INFO ] [REMOTE ] CHE: Fetching primary data for 2024-12. [2025-09-23T17:56:59.713113] [DEBUG] [VALIDATOR ] CGAU: All expected trading days are present. [2025-09-23T17:56:59.713231] [DEBUG] [VALIDATOR ] CGAU: Primary data validation passed. [2025-09-23T17:56:59.713957] [INFO ] [MAIN ] CGAU: Fetched primary data is valid. [2025-09-23T17:56:59.714143] [DEBUG] [LOCAL ] CGAU: Saving primary data. [2025-09-23T17:56:59.730208] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-23T17:56:59.736889] [DEBUG] [LOCAL ] CGAU: Trimmed 60502 records to 42686 (keeping 200 days of data) [2025-09-23T17:56:59.992970] [DEBUG] [LOCAL ] CGAU: Primary data saved (42686 records). [2025-09-23T17:56:59.993114] [INFO ] [MAIN ] CGAU: Full history saved. [2025-09-23T17:56:59.993217] [INFO ] [MAIN ] Update Progress: 433/2372 symbols completed. CGAU took 33.4s. Estimated remaining: 4h 15m 1s. Rate: 7.6 symbols/min [2025-09-23T17:57:00.165790] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:57:00.175240] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-23T17:57:00.204610] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-01. [2025-09-23T17:57:00.226794] [DEBUG] [LOCAL ] CHGG: Loaded 47754 existing records from primary storage. [2025-09-23T17:57:00.226960] [INFO ] [MAIN ] CHGG: Loaded 47754 existing records. [2025-09-23T17:57:00.425391] [WARN ] [MAIN ] CHGG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:57:00.425702] [INFO ] [MAIN ] CHGG: Wiping existing primary data before full refresh. [2025-09-23T17:57:00.425762] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-09-23T17:57:00.426790] [DEBUG] [LOCAL ] CHGG: Deleted primary data file. [2025-09-23T17:57:00.426856] [INFO ] [MAIN ] CHGG: Starting full primary refresh. [2025-09-23T17:57:00.788415] [INFO ] [REMOTE ] CHGG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:57:01.002232] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-09. [2025-09-23T17:57:01.136468] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-23T17:57:01.802262] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-03. [2025-09-23T17:57:02.260683] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-23T17:57:02.265197] [INFO ] [REMOTE ] CHCT: Full fetch complete (35002 records). [2025-09-23T17:57:02.265370] [DEBUG] [VALIDATOR ] CHCT: Validating primary data. [2025-09-23T17:57:02.607900] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2024-12. [2025-09-23T17:57:02.648788] [DEBUG] [VALIDATOR ] CHCT: All expected trading days are present. [2025-09-23T17:57:02.648882] [DEBUG] [VALIDATOR ] CHCT: Primary data validation passed. [2025-09-23T17:57:02.649370] [INFO ] [MAIN ] CHCT: Fetched primary data is valid. [2025-09-23T17:57:02.649413] [DEBUG] [LOCAL ] CHCT: Saving primary data. [2025-09-23T17:57:02.650419] [DEBUG] [LOCAL ] CHCT: Trimmed 35002 records to 24013 (keeping 200 days of data) [2025-09-23T17:57:02.801240] [DEBUG] [LOCAL ] CHCT: Primary data saved (24013 records). [2025-09-23T17:57:02.801419] [INFO ] [MAIN ] CHCT: Full history saved. [2025-09-23T17:57:02.801530] [INFO ] [MAIN ] Update Progress: 434/2372 symbols completed. CHCT took 29.0s. Estimated remaining: 4h 14m 30s. Rate: 7.6 symbols/min [2025-09-23T17:57:02.976550] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:57:03.013493] [DEBUG] [LOCAL ] CHH: Loaded 32240 existing records from primary storage. [2025-09-23T17:57:03.013635] [INFO ] [MAIN ] CHH: Loaded 32240 existing records. [2025-09-23T17:57:03.201119] [WARN ] [MAIN ] CHH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:57:03.201574] [INFO ] [MAIN ] CHH: Wiping existing primary data before full refresh. [2025-09-23T17:57:03.201635] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-09-23T17:57:03.202572] [DEBUG] [LOCAL ] CHH: Deleted primary data file. [2025-09-23T17:57:03.202636] [INFO ] [MAIN ] CHH: Starting full primary refresh. [2025-09-23T17:57:03.411456] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-02. [2025-09-23T17:57:03.560974] [INFO ] [REMOTE ] CHH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:57:04.202270] [INFO ] [REMOTE ] CHH: Fetching primary data for 2024-12. [2025-09-23T17:57:04.954060] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2024-12 (2.35 seconds). [2025-09-23T17:57:05.002148] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-01. [2025-09-23T17:57:05.035939] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-23T17:57:05.114671] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-03 (3.31 seconds). [2025-09-23T17:57:05.500713] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-23T17:57:05.802216] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-01. [2025-09-23T17:57:06.261458] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-23T17:57:06.602200] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-02. [2025-09-23T17:57:07.129042] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-23T17:57:07.402258] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-04. [2025-09-23T17:57:07.929615] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-23T17:57:08.202218] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-02. [2025-09-23T17:57:08.988567] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-23T17:57:09.002391] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-05. [2025-09-23T17:57:09.545036] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-23T17:57:09.802214] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-03. [2025-09-23T17:57:10.458021] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-23T17:57:10.602191] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-06. [2025-09-23T17:57:11.113891] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-23T17:57:11.402188] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-03. [2025-09-23T17:57:11.976860] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-23T17:57:12.202166] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-07. [2025-09-23T17:57:12.471232] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-23T17:57:13.002206] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-04. [2025-09-23T17:57:13.802237] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-04. [2025-09-23T17:57:14.014875] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-23T17:57:14.602206] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-08. [2025-09-23T17:57:14.796272] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-23T17:57:14.869344] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-23T17:57:15.402209] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-05. [2025-09-23T17:57:16.029266] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-23T17:57:16.202153] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-09. [2025-09-23T17:57:16.707433] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-23T17:57:17.002172] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-06. [2025-09-23T17:57:17.752610] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-23T17:57:17.761419] [INFO ] [REMOTE ] CHD: Full fetch complete (74364 records). [2025-09-23T17:57:17.761562] [DEBUG] [VALIDATOR ] CHD: Validating primary data. [2025-09-23T17:57:17.808818] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-05. [2025-09-23T17:57:18.181326] [DEBUG] [VALIDATOR ] CHD: All expected trading days are present. [2025-09-23T17:57:18.181414] [DEBUG] [VALIDATOR ] CHD: Primary data validation passed. [2025-09-23T17:57:18.182205] [INFO ] [MAIN ] CHD: Fetched primary data is valid. [2025-09-23T17:57:18.182270] [DEBUG] [LOCAL ] CHD: Saving primary data. [2025-09-23T17:57:18.183726] [DEBUG] [LOCAL ] CHD: Trimmed 74364 records to 52024 (keeping 200 days of data) [2025-09-23T17:57:18.516430] [DEBUG] [LOCAL ] CHD: Primary data saved (52024 records). [2025-09-23T17:57:18.516581] [INFO ] [MAIN ] CHD: Full history saved. [2025-09-23T17:57:18.516688] [INFO ] [MAIN ] Update Progress: 435/2372 symbols completed. CHD took 28.7s. Estimated remaining: 4h 14m 57s. Rate: 7.6 symbols/min [2025-09-23T17:57:18.608225] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-03. [2025-09-23T17:57:18.692848] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:57:18.713845] [DEBUG] [LOCAL ] CHMI: Loaded 22078 existing records from primary storage. [2025-09-23T17:57:18.714069] [INFO ] [MAIN ] CHMI: Loaded 22078 existing records. [2025-09-23T17:57:18.899348] [WARN ] [MAIN ] CHMI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:57:18.899910] [INFO ] [MAIN ] CHMI: Wiping existing primary data before full refresh. [2025-09-23T17:57:18.900024] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-09-23T17:57:18.900832] [DEBUG] [LOCAL ] CHMI: Deleted primary data file. [2025-09-23T17:57:18.900897] [INFO ] [MAIN ] CHMI: Starting full primary refresh. [2025-09-23T17:57:19.200326] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-23T17:57:19.359918] [INFO ] [REMOTE ] CHMI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:57:19.361447] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-09-23T17:57:19.402153] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-06. [2025-09-23T17:57:19.611656] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-23T17:57:20.202277] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-04. [2025-09-23T17:57:20.284317] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-23T17:57:21.002253] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2024-12. [2025-09-23T17:57:21.280347] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-23T17:57:21.802196] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-05. [2025-09-23T17:57:21.881299] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-23T17:57:22.507362] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-23T17:57:22.602265] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-07. [2025-09-23T17:57:23.402229] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-01. [2025-09-23T17:57:23.696198] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-23T17:57:24.128141] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-23T17:57:24.202174] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-02. [2025-09-23T17:57:24.854022] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-23T17:57:25.002255] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-06. [2025-09-23T17:57:25.802193] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-07. [2025-09-23T17:57:25.939859] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-23T17:57:26.602226] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-08. [2025-09-23T17:57:27.402184] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-07. [2025-09-23T17:57:27.584794] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-23T17:57:27.690012] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-23T17:57:28.080779] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-23T17:57:28.202246] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-08. [2025-09-23T17:57:28.866435] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-23T17:57:29.002237] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-03. [2025-09-23T17:57:29.802160] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-09. [2025-09-23T17:57:29.821771] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-23T17:57:30.602211] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-08. [2025-09-23T17:57:30.700341] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-23T17:57:30.703815] [INFO ] [REMOTE ] CHE: Full fetch complete (19586 records). [2025-09-23T17:57:30.703890] [DEBUG] [VALIDATOR ] CHE: Validating primary data. [2025-09-23T17:57:31.066706] [DEBUG] [VALIDATOR ] CHE: All expected trading days are present. [2025-09-23T17:57:31.066791] [DEBUG] [VALIDATOR ] CHE: Primary data validation passed. [2025-09-23T17:57:31.067144] [INFO ] [MAIN ] CHE: Fetched primary data is valid. [2025-09-23T17:57:31.067218] [DEBUG] [LOCAL ] CHE: Saving primary data. [2025-09-23T17:57:31.067844] [DEBUG] [LOCAL ] CHE: Trimmed 19586 records to 14740 (keeping 200 days of data) [2025-09-23T17:57:31.173913] [DEBUG] [LOCAL ] CHE: Primary data saved (14740 records). [2025-09-23T17:57:31.174317] [INFO ] [MAIN ] CHE: Full history saved. [2025-09-23T17:57:31.174726] [INFO ] [MAIN ] Update Progress: 436/2372 symbols completed. CHE took 33.2s. Estimated remaining: 4h 15m 10s. Rate: 7.6 symbols/min [2025-09-23T17:57:31.348853] [INFO ] [MAIN ] CHN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:57:31.355779] [DEBUG] [LOCAL ] CHN: Loaded 4800 existing records from primary storage. [2025-09-23T17:57:31.355870] [INFO ] [MAIN ] CHN: Loaded 4800 existing records. [2025-09-23T17:57:31.410496] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-04. [2025-09-23T17:57:31.535954] [WARN ] [MAIN ] CHN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:57:31.536201] [INFO ] [MAIN ] CHN: Wiping existing primary data before full refresh. [2025-09-23T17:57:31.536262] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-09-23T17:57:31.536573] [DEBUG] [LOCAL ] CHN: Deleted primary data file. [2025-09-23T17:57:31.536634] [INFO ] [MAIN ] CHN: Starting full primary refresh. [2025-09-23T17:57:31.890066] [INFO ] [REMOTE ] CHN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:57:32.132674] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-23T17:57:32.202148] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-09. [2025-09-23T17:57:32.825602] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-23T17:57:33.002194] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-05. [2025-09-23T17:57:33.690055] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-23T17:57:33.699170] [INFO ] [REMOTE ] CHGG: Full fetch complete (70668 records). [2025-09-23T17:57:33.699296] [DEBUG] [VALIDATOR ] CHGG: Validating primary data. [2025-09-23T17:57:33.804636] [INFO ] [REMOTE ] CHN: Fetching primary data for 2024-12. [2025-09-23T17:57:33.900717] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-23T17:57:34.123138] [DEBUG] [VALIDATOR ] CHGG: All expected trading days are present. [2025-09-23T17:57:34.123219] [DEBUG] [VALIDATOR ] CHGG: Primary data validation passed. [2025-09-23T17:57:34.123982] [INFO ] [MAIN ] CHGG: Fetched primary data is valid. [2025-09-23T17:57:34.124045] [DEBUG] [LOCAL ] CHGG: Saving primary data. [2025-09-23T17:57:34.126073] [DEBUG] [LOCAL ] CHGG: Trimmed 70668 records to 47742 (keeping 200 days of data) [2025-09-23T17:57:34.408856] [DEBUG] [LOCAL ] CHGG: Primary data saved (47742 records). [2025-09-23T17:57:34.409070] [INFO ] [MAIN ] CHGG: Full history saved. [2025-09-23T17:57:34.409265] [INFO ] [MAIN ] Update Progress: 437/2372 symbols completed. CHGG took 34.4s. Estimated remaining: 4h 14m 42s. Rate: 7.6 symbols/min [2025-09-23T17:57:34.442669] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-23T17:57:34.602209] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-06. [2025-09-23T17:57:35.402174] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-01. [2025-09-23T17:57:35.704994] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-23T17:57:35.866943] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-23T17:57:36.202235] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-02. [2025-09-23T17:57:36.668084] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-23T17:57:37.002218] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-09. [2025-09-23T17:57:37.802254] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-03. [2025-09-23T17:57:38.079981] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-23T17:57:38.087593] [INFO ] [REMOTE ] CHH: Full fetch complete (46250 records). [2025-09-23T17:57:38.087833] [DEBUG] [VALIDATOR ] CHH: Validating primary data. [2025-09-23T17:57:38.402835] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-23T17:57:38.492005] [DEBUG] [VALIDATOR ] CHH: All expected trading days are present. [2025-09-23T17:57:38.492096] [DEBUG] [VALIDATOR ] CHH: Primary data validation passed. [2025-09-23T17:57:38.492672] [INFO ] [MAIN ] CHH: Fetched primary data is valid. [2025-09-23T17:57:38.492752] [DEBUG] [LOCAL ] CHH: Saving primary data. [2025-09-23T17:57:38.494116] [DEBUG] [LOCAL ] CHH: Trimmed 46250 records to 32213 (keeping 200 days of data) [2025-09-23T17:57:38.602417] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-04. [2025-09-23T17:57:38.708688] [DEBUG] [LOCAL ] CHH: Primary data saved (32213 records). [2025-09-23T17:57:38.708823] [INFO ] [MAIN ] CHH: Full history saved. [2025-09-23T17:57:38.708944] [INFO ] [MAIN ] Update Progress: 438/2372 symbols completed. CHH took 35.9s. Estimated remaining: 4h 14m 18s. Rate: 7.6 symbols/min [2025-09-23T17:57:39.219330] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-23T17:57:39.402209] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-05. [2025-09-23T17:57:39.772349] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-23T17:57:40.202205] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-06. [2025-09-23T17:57:40.556524] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-23T17:57:41.002234] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-07. [2025-09-23T17:57:41.357555] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-23T17:57:41.802210] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-07. [2025-09-23T17:57:42.602222] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-08. [2025-09-23T17:57:42.942621] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-23T17:57:43.046894] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-23T17:57:43.402241] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-09. [2025-09-23T17:57:44.202207] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-08. [2025-09-23T17:57:45.125301] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-23T17:57:45.126779] [INFO ] [REMOTE ] CHN: Full fetch complete (7571 records). [2025-09-23T17:57:45.126871] [DEBUG] [VALIDATOR ] CHN: Validating primary data. [2025-09-23T17:57:45.461936] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-23T17:57:45.510350] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-09. [2025-09-23T17:57:45.544610] [DEBUG] [VALIDATOR ] CHN: All expected trading days are present. [2025-09-23T17:57:45.544751] [DEBUG] [VALIDATOR ] CHN: Primary data validation passed. [2025-09-23T17:57:45.545029] [INFO ] [MAIN ] CHN: Fetched primary data is valid. [2025-09-23T17:57:45.545094] [DEBUG] [LOCAL ] CHN: Saving primary data. [2025-09-23T17:57:45.545811] [DEBUG] [LOCAL ] CHN: Trimmed 7571 records to 4788 (keeping 200 days of data) [2025-09-23T17:57:45.580107] [DEBUG] [LOCAL ] CHN: Primary data saved (4788 records). [2025-09-23T17:57:45.580258] [INFO ] [MAIN ] CHN: Full history saved. [2025-09-23T17:57:45.580348] [INFO ] [MAIN ] Update Progress: 439/2372 symbols completed. CHN took 14.4s. Estimated remaining: 4h 14m 5s. Rate: 7.6 symbols/min [2025-09-23T17:57:46.701123] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-23T17:57:46.705600] [INFO ] [REMOTE ] CHMI: Full fetch complete (31569 records). [2025-09-23T17:57:46.705804] [DEBUG] [VALIDATOR ] CHMI: Validating primary data. [2025-09-23T17:57:47.102745] [DEBUG] [VALIDATOR ] CHMI: All expected trading days are present. [2025-09-23T17:57:47.102887] [DEBUG] [VALIDATOR ] CHMI: Primary data validation passed. [2025-09-23T17:57:47.103721] [INFO ] [MAIN ] CHMI: Fetched primary data is valid. [2025-09-23T17:57:47.103786] [DEBUG] [LOCAL ] CHMI: Saving primary data. [2025-09-23T17:57:47.104904] [DEBUG] [LOCAL ] CHMI: Trimmed 31569 records to 22112 (keeping 200 days of data) [2025-09-23T17:57:47.251038] [DEBUG] [LOCAL ] CHMI: Primary data saved (22112 records). [2025-09-23T17:57:47.251228] [INFO ] [MAIN ] CHMI: Full history saved. [2025-09-23T17:57:47.251367] [INFO ] [MAIN ] Update Progress: 440/2372 symbols completed. CHMI took 28.7s. Estimated remaining: 4h 13m 30s. Rate: 7.6 symbols/min [2025-09-23T17:57:47.848863] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:57:48.037429] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:57:48.044702] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:57:48.063601] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:57:48.065278] [DEBUG] [LOCAL ] CHT: No existing data file found in primary storage. [2025-09-23T17:57:48.065352] [WARN ] [MAIN ] CHT: No existing data found, performing full refresh instead. [2025-09-23T17:57:48.065629] [INFO ] [MAIN ] CHT: Wiping existing primary data before full refresh. [2025-09-23T17:57:48.065720] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-09-23T17:57:48.065789] [DEBUG] [LOCAL ] CHT: No primary data file found to delete. [2025-09-23T17:57:48.065849] [INFO ] [MAIN ] CHT: Starting full primary refresh. [2025-09-23T17:57:48.502414] [DEBUG] [LOCAL ] CHPT: Loaded 49427 existing records from primary storage. [2025-09-23T17:57:48.528844] [DEBUG] [LOCAL ] CHWY: Loaded 53654 existing records from primary storage. [2025-09-23T17:57:48.540727] [INFO ] [MAIN ] CHPT: Loaded 49427 existing records. [2025-09-23T17:57:48.540546] [DEBUG] [LOCAL ] CI: Loaded 49924 existing records from primary storage. [2025-09-23T17:57:48.544811] [INFO ] [MAIN ] CHWY: Loaded 53654 existing records. [2025-09-23T17:57:48.587245] [INFO ] [MAIN ] CI: Loaded 49924 existing records. [2025-09-23T17:57:48.629022] [INFO ] [REMOTE ] CHT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:57:48.707198] [INFO ] [REMOTE ] CHT: Fetching primary data for 2024-12. [2025-09-23T17:57:49.073808] [WARN ] [MAIN ] CI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:57:49.137247] [WARN ] [MAIN ] CHWY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:57:49.125492] [INFO ] [MAIN ] CI: Wiping existing primary data before full refresh. [2025-09-23T17:57:49.153687] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-09-23T17:57:49.179416] [INFO ] [MAIN ] CHWY: Wiping existing primary data before full refresh. [2025-09-23T17:57:49.179674] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-09-23T17:57:49.179813] [WARN ] [MAIN ] CHPT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:57:49.180363] [INFO ] [MAIN ] CHPT: Wiping existing primary data before full refresh. [2025-09-23T17:57:49.180420] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-09-23T17:57:49.181969] [DEBUG] [LOCAL ] CHWY: Deleted primary data file. [2025-09-23T17:57:49.182066] [INFO ] [MAIN ] CHWY: Starting full primary refresh. [2025-09-23T17:57:49.182111] [DEBUG] [LOCAL ] CHPT: Deleted primary data file. [2025-09-23T17:57:49.187471] [INFO ] [MAIN ] CHPT: Starting full primary refresh. [2025-09-23T17:57:49.187399] [DEBUG] [LOCAL ] CI: Deleted primary data file. [2025-09-23T17:57:49.285190] [INFO ] [MAIN ] CI: Starting full primary refresh. [2025-09-23T17:57:50.216504] [INFO ] [REMOTE ] CHWY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:57:50.338448] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2024-12. [2025-09-23T17:57:50.344523] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-23T17:57:50.376364] [INFO ] [REMOTE ] CHPT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:57:50.385707] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2024-12. [2025-09-23T17:57:50.391842] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-01. [2025-09-23T17:57:50.469679] [INFO ] [REMOTE ] CI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:57:50.469942] [INFO ] [REMOTE ] CI: Fetching primary data for 2024-12. [2025-09-23T17:57:51.072682] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-23T17:57:51.076606] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-02. [2025-09-23T17:57:51.999770] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-23T17:57:52.010833] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-01. [2025-09-23T17:57:52.066484] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-23T17:57:52.070617] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-03. [2025-09-23T17:57:52.116714] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-23T17:57:52.202148] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-01. [2025-09-23T17:57:52.567878] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-09-23T17:57:52.883271] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-23T17:57:53.002210] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-04. [2025-09-23T17:57:53.437280] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-23T17:57:53.765262] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-23T17:57:53.802169] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-02. [2025-09-23T17:57:53.827266] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-23T17:57:54.602237] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-05. [2025-09-23T17:57:55.193889] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-23T17:57:55.372927] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-23T17:57:55.402157] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-06. [2025-09-23T17:57:56.202194] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-02. [2025-09-23T17:57:56.708705] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-23T17:57:57.002220] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-07. [2025-09-23T17:57:57.802241] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-03. [2025-09-23T17:57:58.039768] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-23T17:57:58.364101] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-23T17:57:58.602269] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-08. [2025-09-23T17:57:59.402230] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-01. [2025-09-23T17:57:59.426076] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-23T17:58:00.078222] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-09-23T17:58:00.202187] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-03. [2025-09-23T17:58:01.002183] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-09. [2025-09-23T17:58:01.292926] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-23T17:58:01.802167] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-02. [2025-09-23T17:58:01.818598] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-23T17:58:01.822311] [INFO ] [REMOTE ] CHT: Full fetch complete (27387 records). [2025-09-23T17:58:01.822474] [DEBUG] [VALIDATOR ] CHT: Validating primary data. [2025-09-23T17:58:02.249005] [DEBUG] [VALIDATOR ] CHT: All expected trading days are present. [2025-09-23T17:58:02.249136] [DEBUG] [VALIDATOR ] CHT: Primary data validation passed. [2025-09-23T17:58:02.249868] [INFO ] [MAIN ] CHT: Fetched primary data is valid. [2025-09-23T17:58:02.249959] [DEBUG] [LOCAL ] CHT: Saving primary data. [2025-09-23T17:58:02.251287] [DEBUG] [LOCAL ] CHT: Trimmed 27387 records to 19542 (keeping 200 days of data) [2025-09-23T17:58:02.413806] [DEBUG] [LOCAL ] CHT: Primary data saved (19542 records). [2025-09-23T17:58:02.414971] [INFO ] [MAIN ] CHT: Full history saved. [2025-09-23T17:58:02.415080] [INFO ] [MAIN ] Update Progress: 441/2372 symbols completed. CHT took 15.2s. Estimated remaining: 4h 13m 54s. Rate: 7.6 symbols/min [2025-09-23T17:58:02.416349] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-23T17:58:02.607373] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-04. [2025-09-23T17:58:02.610610] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:58:02.633372] [DEBUG] [LOCAL ] CIA: Loaded 16947 existing records from primary storage. [2025-09-23T17:58:02.633538] [INFO ] [MAIN ] CIA: Loaded 16947 existing records. [2025-09-23T17:58:02.822434] [WARN ] [MAIN ] CIA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:58:02.822828] [INFO ] [MAIN ] CIA: Wiping existing primary data before full refresh. [2025-09-23T17:58:02.822884] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-09-23T17:58:02.823862] [DEBUG] [LOCAL ] CIA: Deleted primary data file. [2025-09-23T17:58:02.823926] [INFO ] [MAIN ] CIA: Starting full primary refresh. [2025-09-23T17:58:03.209087] [INFO ] [REMOTE ] CIA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:58:03.402256] [INFO ] [REMOTE ] CIA: Fetching primary data for 2024-12. [2025-09-23T17:58:03.620290] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-23T17:58:04.001966] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-23T17:58:04.202290] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-03. [2025-09-23T17:58:04.334363] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-23T17:58:05.002204] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-01. [2025-09-23T17:58:05.626585] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-23T17:58:05.802232] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-04. [2025-09-23T17:58:06.014704] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-23T17:58:06.602207] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-04. [2025-09-23T17:58:07.402237] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-02. [2025-09-23T17:58:07.610549] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-23T17:58:07.972195] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-23T17:58:08.202241] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-05. [2025-09-23T17:58:09.008578] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-03. [2025-09-23T17:58:09.011743] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-09-23T17:58:09.755837] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-23T17:58:09.802186] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-06. [2025-09-23T17:58:10.140200] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-23T17:58:10.602187] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-04. [2025-09-23T17:58:11.413042] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-05. [2025-09-23T17:58:11.446192] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-23T17:58:11.588933] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-23T17:58:12.202195] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-05. [2025-09-23T17:58:12.862510] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-23T17:58:13.002291] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-07. [2025-09-23T17:58:13.309711] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-23T17:58:13.802202] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-06. [2025-09-23T17:58:14.602182] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-05. [2025-09-23T17:58:14.697470] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-23T17:58:15.402238] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-06. [2025-09-23T17:58:15.545696] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-23T17:58:16.202165] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-07. [2025-09-23T17:58:16.220179] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-23T17:58:16.492462] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-23T17:58:17.002195] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-08. [2025-09-23T17:58:17.810243] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-06. [2025-09-23T17:58:17.835016] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-23T17:58:18.407102] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-23T17:58:18.602237] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-07. [2025-09-23T17:58:19.308521] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-23T17:58:19.402210] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-08. [2025-09-23T17:58:19.907235] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-23T17:58:20.153509] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-23T17:58:20.202219] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-09. [2025-09-23T17:58:20.948756] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-23T17:58:20.951938] [INFO ] [REMOTE ] CIA: Full fetch complete (23309 records). [2025-09-23T17:58:20.952023] [DEBUG] [VALIDATOR ] CIA: Validating primary data. [2025-09-23T17:58:21.010139] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-07. [2025-09-23T17:58:21.347854] [DEBUG] [VALIDATOR ] CIA: All expected trading days are present. [2025-09-23T17:58:21.347938] [DEBUG] [VALIDATOR ] CIA: Primary data validation passed. [2025-09-23T17:58:21.348359] [INFO ] [MAIN ] CIA: Fetched primary data is valid. [2025-09-23T17:58:21.348421] [DEBUG] [LOCAL ] CIA: Saving primary data. [2025-09-23T17:58:21.349093] [DEBUG] [LOCAL ] CIA: Trimmed 23309 records to 17059 (keeping 200 days of data) [2025-09-23T17:58:21.441413] [DEBUG] [LOCAL ] CIA: Primary data saved (17059 records). [2025-09-23T17:58:21.441579] [INFO ] [MAIN ] CIA: Full history saved. [2025-09-23T17:58:21.441700] [INFO ] [MAIN ] Update Progress: 442/2372 symbols completed. CIA took 19.0s. Estimated remaining: 4h 14m 35s. Rate: 7.6 symbols/min [2025-09-23T17:58:21.609167] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:58:21.642431] [DEBUG] [LOCAL ] CIB: Loaded 31043 existing records from primary storage. [2025-09-23T17:58:21.642566] [INFO ] [MAIN ] CIB: Loaded 31043 existing records. [2025-09-23T17:58:21.815931] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-08. [2025-09-23T17:58:21.823143] [WARN ] [MAIN ] CIB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:58:21.824947] [INFO ] [MAIN ] CIB: Wiping existing primary data before full refresh. [2025-09-23T17:58:21.825017] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-09-23T17:58:21.826115] [DEBUG] [LOCAL ] CIB: Deleted primary data file. [2025-09-23T17:58:21.826184] [INFO ] [MAIN ] CIB: Starting full primary refresh. [2025-09-23T17:58:22.185822] [INFO ] [REMOTE ] CIB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:58:22.602218] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-09. [2025-09-23T17:58:22.924887] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-23T17:58:23.402196] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-08. [2025-09-23T17:58:23.526711] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-23T17:58:24.126214] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-23T17:58:24.134803] [INFO ] [REMOTE ] CI: Full fetch complete (72521 records). [2025-09-23T17:58:24.134959] [DEBUG] [VALIDATOR ] CI: Validating primary data. [2025-09-23T17:58:24.208523] [INFO ] [REMOTE ] CIB: Fetching primary data for 2024-12. [2025-09-23T17:58:24.541320] [DEBUG] [VALIDATOR ] CI: All expected trading days are present. [2025-09-23T17:58:24.541422] [DEBUG] [VALIDATOR ] CI: Primary data validation passed. [2025-09-23T17:58:24.542276] [INFO ] [MAIN ] CI: Fetched primary data is valid. [2025-09-23T17:58:24.542342] [DEBUG] [LOCAL ] CI: Saving primary data. [2025-09-23T17:58:24.543989] [DEBUG] [LOCAL ] CI: Trimmed 72521 records to 49904 (keeping 200 days of data) [2025-09-23T17:58:24.865564] [DEBUG] [LOCAL ] CI: Primary data saved (49904 records). [2025-09-23T17:58:24.865743] [INFO ] [MAIN ] CI: Full history saved. [2025-09-23T17:58:24.865839] [INFO ] [MAIN ] Update Progress: 443/2372 symbols completed. CI took 37.6s. Estimated remaining: 4h 14m 8s. Rate: 7.6 symbols/min [2025-09-23T17:58:25.004779] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-09. [2025-09-23T17:58:25.062184] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:58:25.062452] [DEBUG] [LOCAL ] CICB: No existing data file found in primary storage. [2025-09-23T17:58:25.062695] [WARN ] [MAIN ] CICB: No existing data found, performing full refresh instead. [2025-09-23T17:58:25.063074] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-09-23T17:58:25.063166] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-09-23T17:58:25.063362] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-09-23T17:58:25.063495] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-09-23T17:58:25.254170] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-23T17:58:25.476483] [INFO ] [REMOTE ] CICB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:58:25.676178] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-23T17:58:25.802213] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-01. [2025-09-23T17:58:26.602258] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-09. [2025-09-23T17:58:26.715745] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-23T17:58:26.931830] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-23T17:58:26.940753] [INFO ] [REMOTE ] CHWY: Full fetch complete (77635 records). [2025-09-23T17:58:26.940880] [DEBUG] [VALIDATOR ] CHWY: Validating primary data. [2025-09-23T17:58:27.346677] [DEBUG] [VALIDATOR ] CHWY: All expected trading days are present. [2025-09-23T17:58:27.346781] [DEBUG] [VALIDATOR ] CHWY: Primary data validation passed. [2025-09-23T17:58:27.347675] [INFO ] [MAIN ] CHWY: Fetched primary data is valid. [2025-09-23T17:58:27.347745] [DEBUG] [LOCAL ] CHWY: Saving primary data. [2025-09-23T17:58:27.349583] [DEBUG] [LOCAL ] CHWY: Trimmed 77635 records to 53654 (keeping 200 days of data) [2025-09-23T17:58:27.410851] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-02. [2025-09-23T17:58:27.706610] [DEBUG] [LOCAL ] CHWY: Primary data saved (53654 records). [2025-09-23T17:58:27.706794] [INFO ] [MAIN ] CHWY: Full history saved. [2025-09-23T17:58:27.706932] [INFO ] [MAIN ] Update Progress: 444/2372 symbols completed. CHWY took 40.5s. Estimated remaining: 4h 13m 38s. Rate: 7.6 symbols/min [2025-09-23T17:58:27.893147] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:58:27.943395] [DEBUG] [LOCAL ] CIEN: Loaded 52090 existing records from primary storage. [2025-09-23T17:58:27.943570] [INFO ] [MAIN ] CIEN: Loaded 52090 existing records. [2025-09-23T17:58:28.133370] [WARN ] [MAIN ] CIEN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:58:28.133900] [INFO ] [MAIN ] CIEN: Wiping existing primary data before full refresh. [2025-09-23T17:58:28.134056] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-09-23T17:58:28.142853] [DEBUG] [LOCAL ] CIEN: Deleted primary data file. [2025-09-23T17:58:28.157487] [INFO ] [MAIN ] CIEN: Starting full primary refresh. [2025-09-23T17:58:28.213769] [INFO ] [REMOTE ] CICB: Fetching primary data for 2024-12. [2025-09-23T17:58:28.224807] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-23T17:58:28.271957] [INFO ] [REMOTE ] CHPT: Full fetch complete (73514 records). [2025-09-23T17:58:28.273011] [DEBUG] [VALIDATOR ] CHPT: Validating primary data. [2025-09-23T17:58:28.831423] [INFO ] [REMOTE ] CIEN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:58:28.869688] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-23T17:58:28.995535] [DEBUG] [VALIDATOR ] CHPT: All expected trading days are present. [2025-09-23T17:58:29.004005] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2024-12. [2025-09-23T17:58:29.003875] [DEBUG] [VALIDATOR ] CHPT: Primary data validation passed. [2025-09-23T17:58:29.005543] [INFO ] [MAIN ] CHPT: Fetched primary data is valid. [2025-09-23T17:58:29.023634] [DEBUG] [LOCAL ] CHPT: Saving primary data. [2025-09-23T17:58:29.026515] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-23T17:58:29.034638] [DEBUG] [LOCAL ] CHPT: Trimmed 73514 records to 49401 (keeping 200 days of data) [2025-09-23T17:58:29.344147] [DEBUG] [LOCAL ] CHPT: Primary data saved (49401 records). [2025-09-23T17:58:29.344340] [INFO ] [MAIN ] CHPT: Full history saved. [2025-09-23T17:58:29.345756] [INFO ] [MAIN ] Update Progress: 445/2372 symbols completed. CHPT took 42.1s. Estimated remaining: 4h 13m 3s. Rate: 7.6 symbols/min [2025-09-23T17:58:29.516993] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:58:29.524141] [DEBUG] [LOCAL ] CIF: Loaded 4421 existing records from primary storage. [2025-09-23T17:58:29.524278] [INFO ] [MAIN ] CIF: Loaded 4421 existing records. [2025-09-23T17:58:29.704201] [WARN ] [MAIN ] CIF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:58:29.704449] [INFO ] [MAIN ] CIF: Wiping existing primary data before full refresh. [2025-09-23T17:58:29.704497] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-09-23T17:58:29.704843] [DEBUG] [LOCAL ] CIF: Deleted primary data file. [2025-09-23T17:58:29.704904] [INFO ] [MAIN ] CIF: Starting full primary refresh. [2025-09-23T17:58:29.805398] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-03. [2025-09-23T17:58:30.073068] [INFO ] [REMOTE ] CIF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:58:30.561592] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-23T17:58:30.602165] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-01. [2025-09-23T17:58:30.916561] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-23T17:58:31.402259] [INFO ] [REMOTE ] CIF: Fetching primary data for 2024-12. [2025-09-23T17:58:31.933162] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-23T17:58:32.111563] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-23T17:58:32.202194] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-01. [2025-09-23T17:58:32.845048] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-23T17:58:33.002200] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-02. [2025-09-23T17:58:33.459622] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-23T17:58:33.802228] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-01. [2025-09-23T17:58:34.098344] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-09-23T17:58:34.602192] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-09-23T17:58:35.030426] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-23T17:58:35.402237] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-09-23T17:58:35.822184] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-23T17:58:36.202333] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-04. [2025-09-23T17:58:37.002207] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-03. [2025-09-23T17:58:37.366538] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-23T17:58:37.513816] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-23T17:58:37.802197] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-02. [2025-09-23T17:58:38.602196] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-05. [2025-09-23T17:58:39.108637] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-23T17:58:39.402196] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-03. [2025-09-23T17:58:39.903433] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-23T17:58:40.202265] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-06. [2025-09-23T17:58:41.002166] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-09-23T17:58:41.033457] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-23T17:58:41.133258] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-23T17:58:41.380893] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-23T17:58:41.802267] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-04. [2025-09-23T17:58:42.557319] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-23T17:58:42.602198] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-09-23T17:58:42.953538] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-23T17:58:43.402250] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-09-23T17:58:43.683274] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-09-23T17:58:44.202250] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-07. [2025-09-23T17:58:45.002603] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-04. [2025-09-23T17:58:45.004803] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-23T17:58:45.802200] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-09-23T17:58:46.081975] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-09-23T17:58:46.602222] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-09-23T17:58:46.779137] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-23T17:58:46.881428] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-09-23T17:58:47.402201] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-08. [2025-09-23T17:58:48.202202] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-09-23T17:58:48.573245] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-23T17:58:48.574151] [INFO ] [REMOTE ] CICB: Full fetch complete (2118 records). [2025-09-23T17:58:48.574229] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-09-23T17:58:48.770382] [WARN ] [VALIDATOR ] CICB: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-23T17:58:48.770684] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:58:48.770854] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:58:48.771101] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-09-23T17:58:48.784596] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-09-23T17:58:48.786902] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-09-23T17:58:48.788205] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-23T17:58:48.788291] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-09-23T17:58:48.794593] [INFO ] [MAIN ] Update Progress: 446/2372 symbols completed. CICB took 23.9s. Estimated remaining: 4h 13m 45s. Rate: 7.6 symbols/min [2025-09-23T17:58:48.982560] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:58:49.007038] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-09. [2025-09-23T17:58:49.026083] [DEBUG] [LOCAL ] CIG: Loaded 43600 existing records from primary storage. [2025-09-23T17:58:49.026241] [INFO ] [MAIN ] CIG: Loaded 43600 existing records. [2025-09-23T17:58:49.213530] [WARN ] [MAIN ] CIG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:58:49.213841] [INFO ] [MAIN ] CIG: Wiping existing primary data before full refresh. [2025-09-23T17:58:49.213894] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-09-23T17:58:49.215230] [DEBUG] [LOCAL ] CIG: Deleted primary data file. [2025-09-23T17:58:49.215295] [INFO ] [MAIN ] CIG: Starting full primary refresh. [2025-09-23T17:58:49.583175] [INFO ] [REMOTE ] CIG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:58:49.802248] [INFO ] [REMOTE ] CIG: Fetching primary data for 2024-12. [2025-09-23T17:58:50.019877] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-23T17:58:50.026715] [INFO ] [REMOTE ] CIB: Full fetch complete (44281 records). [2025-09-23T17:58:50.027005] [DEBUG] [VALIDATOR ] CIB: Validating primary data. [2025-09-23T17:58:50.419937] [DEBUG] [VALIDATOR ] CIB: All expected trading days are present. [2025-09-23T17:58:50.420050] [DEBUG] [VALIDATOR ] CIB: Primary data validation passed. [2025-09-23T17:58:50.420779] [INFO ] [MAIN ] CIB: Fetched primary data is valid. [2025-09-23T17:58:50.420864] [DEBUG] [LOCAL ] CIB: Saving primary data. [2025-09-23T17:58:50.422276] [DEBUG] [LOCAL ] CIB: Trimmed 44281 records to 31006 (keeping 200 days of data) [2025-09-23T17:58:50.602284] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-05. [2025-09-23T17:58:50.622623] [DEBUG] [LOCAL ] CIB: Primary data saved (31006 records). [2025-09-23T17:58:50.622814] [INFO ] [MAIN ] CIB: Full history saved. [2025-09-23T17:58:50.622910] [INFO ] [MAIN ] Update Progress: 447/2372 symbols completed. CIB took 29.2s. Estimated remaining: 4h 13m 11s. Rate: 7.6 symbols/min [2025-09-23T17:58:50.794035] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:58:50.811244] [DEBUG] [LOCAL ] CII: Loaded 15615 existing records from primary storage. [2025-09-23T17:58:50.811383] [INFO ] [MAIN ] CII: Loaded 15615 existing records. [2025-09-23T17:58:51.008066] [WARN ] [MAIN ] CII: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:58:51.008513] [INFO ] [MAIN ] CII: Wiping existing primary data before full refresh. [2025-09-23T17:58:51.008620] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-09-23T17:58:51.009161] [DEBUG] [LOCAL ] CII: Deleted primary data file. [2025-09-23T17:58:51.009253] [INFO ] [MAIN ] CII: Starting full primary refresh. [2025-09-23T17:58:51.207566] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-23T17:58:51.269850] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-23T17:58:51.407298] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-05. [2025-09-23T17:58:51.469943] [INFO ] [REMOTE ] CII: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:58:52.202212] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-06. [2025-09-23T17:58:52.784865] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-23T17:58:53.002223] [INFO ] [REMOTE ] CII: Fetching primary data for 2024-12. [2025-09-23T17:58:53.025244] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-23T17:58:53.802170] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-01. [2025-09-23T17:58:54.175521] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-23T17:58:54.602222] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-06. [2025-09-23T17:58:55.402200] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-01. [2025-09-23T17:58:55.454595] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-23T17:58:55.975155] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-23T17:58:56.202205] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-02. [2025-09-23T17:58:56.344959] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-23T17:58:57.002277] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-07. [2025-09-23T17:58:57.230097] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-23T17:58:57.417104] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-23T17:58:57.802210] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-07. [2025-09-23T17:58:58.602189] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-02. [2025-09-23T17:58:59.402165] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-03. [2025-09-23T17:58:59.582617] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-23T17:58:59.603686] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-23T17:59:00.202189] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-08. [2025-09-23T17:59:00.625464] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-23T17:59:00.638322] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-23T17:59:01.002164] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-03. [2025-09-23T17:59:01.802227] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-04. [2025-09-23T17:59:02.039607] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-23T17:59:02.602231] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-09. [2025-09-23T17:59:02.978309] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-23T17:59:03.292043] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-23T17:59:03.293298] [INFO ] [REMOTE ] CIF: Full fetch complete (6603 records). [2025-09-23T17:59:03.293367] [DEBUG] [VALIDATOR ] CIF: Validating primary data. [2025-09-23T17:59:03.407265] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-05. [2025-09-23T17:59:03.651961] [DEBUG] [VALIDATOR ] CIF: All expected trading days are present. [2025-09-23T17:59:03.652041] [DEBUG] [VALIDATOR ] CIF: Primary data validation passed. [2025-09-23T17:59:03.652232] [INFO ] [MAIN ] CIF: Fetched primary data is valid. [2025-09-23T17:59:03.652272] [DEBUG] [LOCAL ] CIF: Saving primary data. [2025-09-23T17:59:03.652696] [DEBUG] [LOCAL ] CIF: Trimmed 6603 records to 4364 (keeping 200 days of data) [2025-09-23T17:59:03.678350] [DEBUG] [LOCAL ] CIF: Primary data saved (4364 records). [2025-09-23T17:59:03.678425] [INFO ] [MAIN ] CIF: Full history saved. [2025-09-23T17:59:03.678502] [INFO ] [MAIN ] Update Progress: 448/2372 symbols completed. CIF took 34.3s. Estimated remaining: 4h 13m 25s. Rate: 7.6 symbols/min [2025-09-23T17:59:03.851855] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:59:03.899906] [DEBUG] [LOCAL ] CIM: Loaded 37152 existing records from primary storage. [2025-09-23T17:59:03.900049] [INFO ] [MAIN ] CIM: Loaded 37152 existing records. [2025-09-23T17:59:04.084458] [WARN ] [MAIN ] CIM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:59:04.084769] [INFO ] [MAIN ] CIM: Wiping existing primary data before full refresh. [2025-09-23T17:59:04.084827] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-09-23T17:59:04.085845] [DEBUG] [LOCAL ] CIM: Deleted primary data file. [2025-09-23T17:59:04.085910] [INFO ] [MAIN ] CIM: Starting full primary refresh. [2025-09-23T17:59:04.207326] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-04. [2025-09-23T17:59:04.501158] [INFO ] [REMOTE ] CIM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:59:04.745028] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-23T17:59:05.002214] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-08. [2025-09-23T17:59:05.170880] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-23T17:59:05.802254] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-05. [2025-09-23T17:59:06.356482] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-23T17:59:06.602214] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-06. [2025-09-23T17:59:06.753240] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-23T17:59:07.162166] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-23T17:59:07.402201] [INFO ] [REMOTE ] CIM: Fetching primary data for 2024-12. [2025-09-23T17:59:08.202195] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-07. [2025-09-23T17:59:08.808771] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-23T17:59:08.946503] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-23T17:59:09.002199] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-01. [2025-09-23T17:59:09.802230] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-09. [2025-09-23T17:59:09.982239] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-23T17:59:10.602191] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-02. [2025-09-23T17:59:11.309587] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-23T17:59:11.318777] [INFO ] [REMOTE ] CIEN: Full fetch complete (75543 records). [2025-09-23T17:59:11.318892] [DEBUG] [VALIDATOR ] CIEN: Validating primary data. [2025-09-23T17:59:11.407334] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-08. [2025-09-23T17:59:11.715442] [DEBUG] [VALIDATOR ] CIEN: All expected trading days are present. [2025-09-23T17:59:11.715521] [DEBUG] [VALIDATOR ] CIEN: Primary data validation passed. [2025-09-23T17:59:11.716277] [INFO ] [MAIN ] CIEN: Fetched primary data is valid. [2025-09-23T17:59:11.716341] [DEBUG] [LOCAL ] CIEN: Saving primary data. [2025-09-23T17:59:11.717909] [DEBUG] [LOCAL ] CIEN: Trimmed 75543 records to 52087 (keeping 200 days of data) [2025-09-23T17:59:12.047062] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-23T17:59:12.050562] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-23T17:59:12.072071] [DEBUG] [LOCAL ] CIEN: Primary data saved (52087 records). [2025-09-23T17:59:12.072208] [INFO ] [MAIN ] CIEN: Full history saved. [2025-09-23T17:59:12.072302] [INFO ] [MAIN ] Update Progress: 449/2372 symbols completed. CIEN took 44.4s. Estimated remaining: 4h 13m 19s. Rate: 7.6 symbols/min [2025-09-23T17:59:12.212925] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-09. [2025-09-23T17:59:12.245868] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:59:12.250182] [DEBUG] [LOCAL ] CIMN: Loaded 2667 existing records from primary storage. [2025-09-23T17:59:12.250262] [INFO ] [MAIN ] CIMN: Loaded 2667 existing records. [2025-09-23T17:59:12.425037] [WARN ] [MAIN ] CIMN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:59:12.425298] [INFO ] [MAIN ] CIMN: Wiping existing primary data before full refresh. [2025-09-23T17:59:12.425348] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-09-23T17:59:12.425674] [DEBUG] [LOCAL ] CIMN: Deleted primary data file. [2025-09-23T17:59:12.425735] [INFO ] [MAIN ] CIMN: Starting full primary refresh. [2025-09-23T17:59:12.804593] [INFO ] [REMOTE ] CIMN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:59:13.002209] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-06. [2025-09-23T17:59:13.475081] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-23T17:59:13.478499] [INFO ] [REMOTE ] CII: Full fetch complete (23120 records). [2025-09-23T17:59:13.478605] [DEBUG] [VALIDATOR ] CII: Validating primary data. [2025-09-23T17:59:13.808369] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-03. [2025-09-23T17:59:13.858801] [DEBUG] [VALIDATOR ] CII: All expected trading days are present. [2025-09-23T17:59:13.858889] [DEBUG] [VALIDATOR ] CII: Primary data validation passed. [2025-09-23T17:59:13.859318] [INFO ] [MAIN ] CII: Fetched primary data is valid. [2025-09-23T17:59:13.859359] [DEBUG] [LOCAL ] CII: Saving primary data. [2025-09-23T17:59:13.860009] [DEBUG] [LOCAL ] CII: Trimmed 23120 records to 15526 (keeping 200 days of data) [2025-09-23T17:59:13.955455] [DEBUG] [LOCAL ] CII: Primary data saved (15526 records). [2025-09-23T17:59:13.955625] [INFO ] [MAIN ] CII: Full history saved. [2025-09-23T17:59:13.955780] [INFO ] [MAIN ] Update Progress: 450/2372 symbols completed. CII took 23.3s. Estimated remaining: 4h 12m 46s. Rate: 7.6 symbols/min [2025-09-23T17:59:14.130999] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:59:14.131207] [DEBUG] [LOCAL ] CIMO: No existing data file found in primary storage. [2025-09-23T17:59:14.131244] [WARN ] [MAIN ] CIMO: No existing data found, performing full refresh instead. [2025-09-23T17:59:14.131396] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-09-23T17:59:14.131438] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-09-23T17:59:14.131478] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-09-23T17:59:14.131566] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-09-23T17:59:14.507766] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:59:14.602213] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2024-12. [2025-09-23T17:59:14.665984] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-23T17:59:15.023088] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-23T17:59:15.353144] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-23T17:59:15.402208] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2024-12. [2025-09-23T17:59:15.877874] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-23T17:59:16.202205] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-04. [2025-09-23T17:59:17.002240] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-07. [2025-09-23T17:59:17.703114] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-23T17:59:17.802164] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-05. [2025-09-23T17:59:18.327815] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-23T17:59:18.602192] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-01. [2025-09-23T17:59:18.916191] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-23T17:59:18.995466] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-23T17:59:19.402239] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-09-23T17:59:19.711035] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-09-23T17:59:20.202261] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-08. [2025-09-23T17:59:21.002232] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-06. [2025-09-23T17:59:21.380422] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-23T17:59:21.802248] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-01. [2025-09-23T17:59:22.187889] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-23T17:59:22.209773] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-23T17:59:22.602219] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-09. [2025-09-23T17:59:23.402249] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-02. [2025-09-23T17:59:23.887028] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-23T17:59:24.156175] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-23T17:59:24.163677] [INFO ] [REMOTE ] CIG: Full fetch complete (60871 records). [2025-09-23T17:59:24.163847] [DEBUG] [VALIDATOR ] CIG: Validating primary data. [2025-09-23T17:59:24.207385] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-09-23T17:59:24.575347] [DEBUG] [VALIDATOR ] CIG: All expected trading days are present. [2025-09-23T17:59:24.575470] [DEBUG] [VALIDATOR ] CIG: Primary data validation passed. [2025-09-23T17:59:24.576186] [INFO ] [MAIN ] CIG: Fetched primary data is valid. [2025-09-23T17:59:24.576252] [DEBUG] [LOCAL ] CIG: Saving primary data. [2025-09-23T17:59:24.577811] [DEBUG] [LOCAL ] CIG: Trimmed 60871 records to 43739 (keeping 200 days of data) [2025-09-23T17:59:24.666469] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-23T17:59:24.834232] [DEBUG] [LOCAL ] CIG: Primary data saved (43739 records). [2025-09-23T17:59:24.834370] [INFO ] [MAIN ] CIG: Full history saved. [2025-09-23T17:59:24.834454] [INFO ] [MAIN ] Update Progress: 451/2372 symbols completed. CIG took 36.0s. Estimated remaining: 4h 12m 50s. Rate: 7.6 symbols/min [2025-09-23T17:59:25.003541] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-09-23T17:59:25.003458] [INFO ] [MAIN ] CIMP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:59:25.004521] [DEBUG] [LOCAL ] CIMP: No existing data file found in primary storage. [2025-09-23T17:59:25.004577] [WARN ] [MAIN ] CIMP: No existing data found, performing full refresh instead. [2025-09-23T17:59:25.004752] [INFO ] [MAIN ] CIMP: Wiping existing primary data before full refresh. [2025-09-23T17:59:25.004803] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-09-23T17:59:25.004903] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-09-23T17:59:25.004943] [INFO ] [MAIN ] CIMP: Starting full primary refresh. [2025-09-23T17:59:25.404083] [INFO ] [REMOTE ] CIMP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:59:25.678218] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-23T17:59:25.802188] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-03. [2025-09-23T17:59:26.340339] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-23T17:59:26.602199] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-04. [2025-09-23T17:59:26.939363] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-23T17:59:27.402294] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2024-12. [2025-09-23T17:59:27.636954] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:59:27.637280] [WARN ] [REMOTE ] CIMP: No data returned for month 2024-12 [2025-09-23T17:59:28.202205] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-01. [2025-09-23T17:59:28.397591] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:59:28.397975] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-01 [2025-09-23T17:59:29.002195] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-05. [2025-09-23T17:59:29.446828] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-23T17:59:29.802245] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-06. [2025-09-23T17:59:30.145319] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-23T17:59:30.602208] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-07. [2025-09-23T17:59:31.034293] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-23T17:59:31.402213] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-09-23T17:59:31.731831] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-23T17:59:32.202210] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-02. [2025-09-23T17:59:32.414558] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:59:32.414905] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-02 [2025-09-23T17:59:33.002189] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-03. [2025-09-23T17:59:33.200462] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:59:33.200802] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-03 [2025-09-23T17:59:33.802189] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-04. [2025-09-23T17:59:34.001111] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:59:34.001459] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-04 [2025-09-23T17:59:34.602197] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-07. [2025-09-23T17:59:35.402211] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-08. [2025-09-23T17:59:35.710017] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-23T17:59:36.135270] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-23T17:59:36.202168] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-08. [2025-09-23T17:59:37.002209] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-09-23T17:59:37.300073] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-23T17:59:37.453411] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-23T17:59:37.802203] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-05. [2025-09-23T17:59:38.005032] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:59:38.005444] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-05 [2025-09-23T17:59:38.602193] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-09. [2025-09-23T17:59:39.109886] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-23T17:59:39.111137] [INFO ] [REMOTE ] CIMN: Full fetch complete (3901 records). [2025-09-23T17:59:39.111213] [DEBUG] [VALIDATOR ] CIMN: Validating primary data. [2025-09-23T17:59:39.407408] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-06. [2025-09-23T17:59:39.482916] [DEBUG] [VALIDATOR ] CIMN: All expected trading days are present. [2025-09-23T17:59:39.483018] [DEBUG] [VALIDATOR ] CIMN: Primary data validation passed. [2025-09-23T17:59:39.483195] [INFO ] [MAIN ] CIMN: Fetched primary data is valid. [2025-09-23T17:59:39.483235] [DEBUG] [LOCAL ] CIMN: Saving primary data. [2025-09-23T17:59:39.483611] [DEBUG] [LOCAL ] CIMN: Trimmed 3901 records to 2681 (keeping 200 days of data) [2025-09-23T17:59:39.500601] [DEBUG] [LOCAL ] CIMN: Primary data saved (2681 records). [2025-09-23T17:59:39.500720] [INFO ] [MAIN ] CIMN: Full history saved. [2025-09-23T17:59:39.500814] [INFO ] [MAIN ] Update Progress: 452/2372 symbols completed. CIMN took 27.4s. Estimated remaining: 4h 13m 11s. Rate: 7.6 symbols/min [2025-09-23T17:59:39.670606] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:59:39.682143] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:59:39.682551] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-06 [2025-09-23T17:59:39.690819] [DEBUG] [LOCAL ] CINT: Loaded 18299 existing records from primary storage. [2025-09-23T17:59:39.690958] [INFO ] [MAIN ] CINT: Loaded 18299 existing records. [2025-09-23T17:59:39.881088] [WARN ] [MAIN ] CINT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:59:39.881370] [INFO ] [MAIN ] CINT: Wiping existing primary data before full refresh. [2025-09-23T17:59:39.881423] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-09-23T17:59:39.881974] [DEBUG] [LOCAL ] CINT: Deleted primary data file. [2025-09-23T17:59:39.882034] [INFO ] [MAIN ] CINT: Starting full primary refresh. [2025-09-23T17:59:40.207354] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-09. [2025-09-23T17:59:40.275722] [INFO ] [REMOTE ] CINT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:59:41.002261] [INFO ] [REMOTE ] CINT: Fetching primary data for 2024-12. [2025-09-23T17:59:41.519699] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-23T17:59:41.696343] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-23T17:59:41.703104] [INFO ] [REMOTE ] CIM: Full fetch complete (54445 records). [2025-09-23T17:59:41.703245] [DEBUG] [VALIDATOR ] CIM: Validating primary data. [2025-09-23T17:59:41.803453] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-01. [2025-09-23T17:59:42.095271] [DEBUG] [VALIDATOR ] CIM: All expected trading days are present. [2025-09-23T17:59:42.095364] [DEBUG] [VALIDATOR ] CIM: Primary data validation passed. [2025-09-23T17:59:42.096106] [INFO ] [MAIN ] CIM: Fetched primary data is valid. [2025-09-23T17:59:42.096206] [DEBUG] [LOCAL ] CIM: Saving primary data. [2025-09-23T17:59:42.097427] [DEBUG] [LOCAL ] CIM: Trimmed 54445 records to 37225 (keeping 200 days of data) [2025-09-23T17:59:42.336913] [DEBUG] [LOCAL ] CIM: Primary data saved (37225 records). [2025-09-23T17:59:42.337217] [INFO ] [MAIN ] CIM: Full history saved. [2025-09-23T17:59:42.337499] [INFO ] [MAIN ] Update Progress: 453/2372 symbols completed. CIM took 38.7s. Estimated remaining: 4h 12m 42s. Rate: 7.6 symbols/min [2025-09-23T17:59:42.511182] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:59:42.534100] [DEBUG] [LOCAL ] CIO: Loaded 20042 existing records from primary storage. [2025-09-23T17:59:42.534226] [INFO ] [MAIN ] CIO: Loaded 20042 existing records. [2025-09-23T17:59:42.607737] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-09-23T17:59:42.713637] [WARN ] [MAIN ] CIO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:59:42.713925] [INFO ] [MAIN ] CIO: Wiping existing primary data before full refresh. [2025-09-23T17:59:42.713986] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-09-23T17:59:42.714588] [DEBUG] [LOCAL ] CIO: Deleted primary data file. [2025-09-23T17:59:42.714679] [INFO ] [MAIN ] CIO: Starting full primary refresh. [2025-09-23T17:59:43.001228] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-09-23T17:59:43.091695] [INFO ] [REMOTE ] CIO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:59:43.093206] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-23T17:59:43.402226] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-07. [2025-09-23T17:59:43.597750] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:59:43.598078] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-07 [2025-09-23T17:59:44.202183] [INFO ] [REMOTE ] CIO: Fetching primary data for 2024-12. [2025-09-23T17:59:44.996765] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-23T17:59:45.002133] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-01. [2025-09-23T17:59:45.802219] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-08. [2025-09-23T17:59:46.027954] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T17:59:46.028300] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-08 [2025-09-23T17:59:46.085237] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-23T17:59:46.602210] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-02. [2025-09-23T17:59:47.402231] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-09-23T17:59:47.572904] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-23T17:59:48.073176] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-23T17:59:48.202172] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-09-23T17:59:48.701917] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-23T17:59:48.703514] [INFO ] [REMOTE ] CIMO: Full fetch complete (5504 records). [2025-09-23T17:59:48.703606] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-09-23T17:59:48.895198] [WARN ] [VALIDATOR ] CIMO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-23T17:59:48.895510] [FATAL] [MAIN ] CIMO: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:59:48.895585] [WARN ] [MAIN ] CIMO: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:59:48.895691] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-09-23T17:59:48.895804] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-09-23T17:59:48.895863] [INFO ] [LOCAL ] CIMO: Starting deletion of derivative data. [2025-09-23T17:59:48.895925] [DEBUG] [LOCAL ] CIMO: No derivative data file found to delete. [2025-09-23T17:59:48.896057] [INFO ] [MAIN ] Update Progress: 454/2372 symbols completed. CIMO took 34.9s. Estimated remaining: 4h 12m 28s. Rate: 7.6 symbols/min [2025-09-23T17:59:49.007727] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-03. [2025-09-23T17:59:49.082576] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:59:49.126739] [DEBUG] [LOCAL ] CION: Loaded 29391 existing records from primary storage. [2025-09-23T17:59:49.126900] [INFO ] [MAIN ] CION: Loaded 29391 existing records. [2025-09-23T17:59:49.336827] [WARN ] [MAIN ] CION: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:59:49.337069] [INFO ] [MAIN ] CION: Wiping existing primary data before full refresh. [2025-09-23T17:59:49.337127] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-09-23T17:59:49.338081] [DEBUG] [LOCAL ] CION: Deleted primary data file. [2025-09-23T17:59:49.338144] [INFO ] [MAIN ] CION: Starting full primary refresh. [2025-09-23T17:59:49.747354] [INFO ] [REMOTE ] CION: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:59:49.802290] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-02. [2025-09-23T17:59:50.157629] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-23T17:59:50.397449] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-23T17:59:50.602213] [INFO ] [REMOTE ] CION: Fetching primary data for 2024-12. [2025-09-23T17:59:51.402300] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-09. [2025-09-23T17:59:51.508569] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-23T17:59:52.202217] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-03. [2025-09-23T17:59:52.313822] [INFO ] [REMOTE ] CIMP: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-23T17:59:52.316093] [INFO ] [REMOTE ] CIMP: Full fetch complete (746 records). [2025-09-23T17:59:52.316180] [DEBUG] [VALIDATOR ] CIMP: Validating primary data. [2025-09-23T17:59:52.503061] [WARN ] [VALIDATOR ] CIMP: Validation failed - insufficient historical data. Have 4 unique days, need 200 days [2025-09-23T17:59:52.503263] [FATAL] [MAIN ] CIMP: Fetched primary data is invalid. Refusing to save it. [2025-09-23T17:59:52.503347] [WARN ] [MAIN ] CIMP: Deleting existing primary and derivative data due to validation failure. [2025-09-23T17:59:52.503421] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-09-23T17:59:52.503532] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-09-23T17:59:52.503591] [INFO ] [LOCAL ] CIMP: Starting deletion of derivative data. [2025-09-23T17:59:52.503669] [DEBUG] [LOCAL ] CIMP: No derivative data file found to delete. [2025-09-23T17:59:52.503800] [INFO ] [MAIN ] Update Progress: 455/2372 symbols completed. CIMP took 27.7s. Estimated remaining: 4h 12m 2s. Rate: 7.6 symbols/min [2025-09-23T17:59:52.687769] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T17:59:52.764639] [DEBUG] [LOCAL ] CIVI: Loaded 52582 existing records from primary storage. [2025-09-23T17:59:52.764835] [INFO ] [MAIN ] CIVI: Loaded 52582 existing records. [2025-09-23T17:59:52.952767] [WARN ] [MAIN ] CIVI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T17:59:52.953127] [INFO ] [MAIN ] CIVI: Wiping existing primary data before full refresh. [2025-09-23T17:59:52.953222] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-09-23T17:59:52.960010] [DEBUG] [LOCAL ] CIVI: Deleted primary data file. [2025-09-23T17:59:52.960130] [INFO ] [MAIN ] CIVI: Starting full primary refresh. [2025-09-23T17:59:53.007381] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-01. [2025-09-23T17:59:53.044944] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-23T17:59:53.359708] [INFO ] [REMOTE ] CIVI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T17:59:53.802373] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-04. [2025-09-23T17:59:53.807170] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-23T17:59:54.602185] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-02. [2025-09-23T17:59:54.618249] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-23T17:59:55.376415] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-23T17:59:55.402154] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-03. [2025-09-23T17:59:56.202194] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-05. [2025-09-23T17:59:56.350291] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-23T17:59:57.002175] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2024-12. [2025-09-23T17:59:57.350430] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-23T17:59:57.802200] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-06. [2025-09-23T17:59:58.399360] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-23T17:59:58.602224] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-04. [2025-09-23T17:59:58.709832] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-23T17:59:59.333908] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-23T17:59:59.402147] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-05. [2025-09-23T18:00:00.202196] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-07. [2025-09-23T18:00:00.256944] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-23T18:00:01.002204] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-06. [2025-09-23T18:00:01.105810] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-23T18:00:01.802237] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-04. [2025-09-23T18:00:02.519481] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-23T18:00:02.602202] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-08. [2025-09-23T18:00:03.402205] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-01. [2025-09-23T18:00:04.202244] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-07. [2025-09-23T18:00:05.948245] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-04 (4.15 seconds). [2025-09-23T18:00:05.956613] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-05. [2025-09-23T18:00:06.009632] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-08 (3.41 seconds). [2025-09-23T18:00:06.015522] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-09. [2025-09-23T18:00:06.476288] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-09-23T18:00:06.602208] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-08. [2025-09-23T18:00:06.964930] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-23T18:00:07.314560] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-23T18:00:07.402150] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-06. [2025-09-23T18:00:07.421742] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-23T18:00:07.425940] [INFO ] [REMOTE ] CIO: Full fetch complete (28992 records). [2025-09-23T18:00:07.426042] [DEBUG] [VALIDATOR ] CIO: Validating primary data. [2025-09-23T18:00:07.625720] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-01 (4.22 seconds). [2025-09-23T18:00:07.860535] [DEBUG] [VALIDATOR ] CIO: All expected trading days are present. [2025-09-23T18:00:07.860660] [DEBUG] [VALIDATOR ] CIO: Primary data validation passed. [2025-09-23T18:00:07.861539] [INFO ] [MAIN ] CIO: Fetched primary data is valid. [2025-09-23T18:00:07.861625] [DEBUG] [LOCAL ] CIO: Saving primary data. [2025-09-23T18:00:07.863830] [DEBUG] [LOCAL ] CIO: Trimmed 28992 records to 20138 (keeping 200 days of data) [2025-09-23T18:00:07.981428] [DEBUG] [LOCAL ] CIO: Primary data saved (20138 records). [2025-09-23T18:00:07.981555] [INFO ] [MAIN ] CIO: Full history saved. [2025-09-23T18:00:07.981773] [INFO ] [MAIN ] Update Progress: 456/2372 symbols completed. CIO took 25.6s. Estimated remaining: 4h 12m 26s. Rate: 7.6 symbols/min [2025-09-23T18:00:08.157688] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:00:08.202172] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-02. [2025-09-23T18:00:08.221933] [DEBUG] [LOCAL ] CL: Loaded 53644 existing records from primary storage. [2025-09-23T18:00:08.222079] [INFO ] [MAIN ] CL: Loaded 53644 existing records. [2025-09-23T18:00:08.403572] [WARN ] [MAIN ] CL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:00:08.403861] [INFO ] [MAIN ] CL: Wiping existing primary data before full refresh. [2025-09-23T18:00:08.403911] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-09-23T18:00:08.407174] [DEBUG] [LOCAL ] CL: Deleted primary data file. [2025-09-23T18:00:08.407238] [INFO ] [MAIN ] CL: Starting full primary refresh. [2025-09-23T18:00:08.796850] [INFO ] [REMOTE ] CL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:00:08.805172] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-23T18:00:09.002198] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-07. [2025-09-23T18:00:09.707051] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-23T18:00:09.789475] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-23T18:00:09.802157] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-09. [2025-09-23T18:00:10.602194] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-08. [2025-09-23T18:00:11.275608] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-23T18:00:11.279985] [INFO ] [REMOTE ] CINT: Full fetch complete (25902 records). [2025-09-23T18:00:11.280120] [DEBUG] [VALIDATOR ] CINT: Validating primary data. [2025-09-23T18:00:11.407602] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-03. [2025-09-23T18:00:11.688362] [DEBUG] [VALIDATOR ] CINT: All expected trading days are present. [2025-09-23T18:00:11.688497] [DEBUG] [VALIDATOR ] CINT: Primary data validation passed. [2025-09-23T18:00:11.705304] [INFO ] [MAIN ] CINT: Fetched primary data is valid. [2025-09-23T18:00:11.706208] [DEBUG] [LOCAL ] CINT: Saving primary data. [2025-09-23T18:00:11.707544] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-23T18:00:11.715387] [DEBUG] [LOCAL ] CINT: Trimmed 25902 records to 18366 (keeping 200 days of data) [2025-09-23T18:00:11.831301] [DEBUG] [LOCAL ] CINT: Primary data saved (18366 records). [2025-09-23T18:00:11.831454] [INFO ] [MAIN ] CINT: Full history saved. [2025-09-23T18:00:11.831563] [INFO ] [MAIN ] Update Progress: 457/2372 symbols completed. CINT took 32.3s. Estimated remaining: 4h 12m 1s. Rate: 7.6 symbols/min [2025-09-23T18:00:12.064358] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:00:12.116521] [DEBUG] [LOCAL ] CLB: Loaded 33100 existing records from primary storage. [2025-09-23T18:00:12.116849] [INFO ] [MAIN ] CLB: Loaded 33100 existing records. [2025-09-23T18:00:12.210309] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-09. [2025-09-23T18:00:12.303453] [WARN ] [MAIN ] CLB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:00:12.303844] [INFO ] [MAIN ] CLB: Wiping existing primary data before full refresh. [2025-09-23T18:00:12.303921] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-09-23T18:00:12.304953] [DEBUG] [LOCAL ] CLB: Deleted primary data file. [2025-09-23T18:00:12.305017] [INFO ] [MAIN ] CLB: Starting full primary refresh. [2025-09-23T18:00:12.674867] [INFO ] [REMOTE ] CLB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:00:13.004354] [INFO ] [REMOTE ] CL: Fetching primary data for 2024-12. [2025-09-23T18:00:13.007798] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-23T18:00:13.267280] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-23T18:00:13.275514] [INFO ] [REMOTE ] CION: Full fetch complete (41297 records). [2025-09-23T18:00:13.275794] [DEBUG] [VALIDATOR ] CION: Validating primary data. [2025-09-23T18:00:13.691350] [DEBUG] [VALIDATOR ] CION: All expected trading days are present. [2025-09-23T18:00:13.691456] [DEBUG] [VALIDATOR ] CION: Primary data validation passed. [2025-09-23T18:00:13.692077] [INFO ] [MAIN ] CION: Fetched primary data is valid. [2025-09-23T18:00:13.692144] [DEBUG] [LOCAL ] CION: Saving primary data. [2025-09-23T18:00:13.694955] [DEBUG] [LOCAL ] CION: Trimmed 41297 records to 29384 (keeping 200 days of data) [2025-09-23T18:00:13.805895] [INFO ] [REMOTE ] CLB: Fetching primary data for 2024-12. [2025-09-23T18:00:13.898135] [DEBUG] [LOCAL ] CION: Primary data saved (29384 records). [2025-09-23T18:00:13.898289] [INFO ] [MAIN ] CION: Full history saved. [2025-09-23T18:00:13.898405] [INFO ] [MAIN ] Update Progress: 458/2372 symbols completed. CION took 25.0s. Estimated remaining: 4h 11m 29s. Rate: 7.6 symbols/min [2025-09-23T18:00:14.081052] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:00:14.097019] [DEBUG] [LOCAL ] CLCO: Loaded 12942 existing records from primary storage. [2025-09-23T18:00:14.097154] [INFO ] [MAIN ] CLCO: Loaded 12942 existing records. [2025-09-23T18:00:14.302955] [WARN ] [MAIN ] CLCO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:00:14.303284] [INFO ] [MAIN ] CLCO: Wiping existing primary data before full refresh. [2025-09-23T18:00:14.303341] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-09-23T18:00:14.303806] [DEBUG] [LOCAL ] CLCO: Deleted primary data file. [2025-09-23T18:00:14.303869] [INFO ] [MAIN ] CLCO: Starting full primary refresh. [2025-09-23T18:00:14.607361] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-04. [2025-09-23T18:00:14.704398] [INFO ] [REMOTE ] CLCO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:00:15.240909] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-23T18:00:15.402198] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-01. [2025-09-23T18:00:15.540456] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2024-12 (2.54 seconds). [2025-09-23T18:00:16.058440] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-23T18:00:16.202214] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-01. [2025-09-23T18:00:16.298039] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-23T18:00:17.002248] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2024-12. [2025-09-23T18:00:17.743777] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-23T18:00:17.802271] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-05. [2025-09-23T18:00:17.943527] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-23T18:00:18.602252] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-02. [2025-09-23T18:00:19.234127] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-23T18:00:19.402200] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-02. [2025-09-23T18:00:20.202164] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-01. [2025-09-23T18:00:20.297427] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-23T18:00:20.439148] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-23T18:00:20.913730] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-23T18:00:21.002232] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-02. [2025-09-23T18:00:21.802196] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-03. [2025-09-23T18:00:22.090974] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-23T18:00:22.602232] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-06. [2025-09-23T18:00:23.402165] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-03. [2025-09-23T18:00:23.611030] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-23T18:00:24.144481] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-23T18:00:24.202255] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-03. [2025-09-23T18:00:24.256114] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-23T18:00:25.002237] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-04. [2025-09-23T18:00:25.345779] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-23T18:00:25.802200] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-04. [2025-09-23T18:00:26.602166] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-07. [2025-09-23T18:00:26.661890] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-23T18:00:26.767906] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-23T18:00:27.402198] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-05. [2025-09-23T18:00:28.019233] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-23T18:00:28.202226] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-04. [2025-09-23T18:00:28.984866] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-23T18:00:29.002156] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-05. [2025-09-23T18:00:29.318319] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-23T18:00:29.635751] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-23T18:00:29.802191] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-05. [2025-09-23T18:00:30.602199] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-08. [2025-09-23T18:00:30.681016] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-23T18:00:31.402227] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-06. [2025-09-23T18:00:31.987574] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-23T18:00:32.209901] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-06. [2025-09-23T18:00:32.229919] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-23T18:00:33.002196] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-09. [2025-09-23T18:00:33.700908] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-23T18:00:33.802197] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-07. [2025-09-23T18:00:34.385687] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-23T18:00:34.394412] [INFO ] [REMOTE ] CIVI: Full fetch complete (75518 records). [2025-09-23T18:00:34.394567] [DEBUG] [VALIDATOR ] CIVI: Validating primary data. [2025-09-23T18:00:34.607698] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-07. [2025-09-23T18:00:34.789736] [DEBUG] [VALIDATOR ] CIVI: All expected trading days are present. [2025-09-23T18:00:34.789840] [DEBUG] [VALIDATOR ] CIVI: Primary data validation passed. [2025-09-23T18:00:34.790776] [INFO ] [MAIN ] CIVI: Fetched primary data is valid. [2025-09-23T18:00:34.790844] [DEBUG] [LOCAL ] CIVI: Saving primary data. [2025-09-23T18:00:34.792376] [DEBUG] [LOCAL ] CIVI: Trimmed 75518 records to 52583 (keeping 200 days of data) [2025-09-23T18:00:35.122823] [DEBUG] [LOCAL ] CIVI: Primary data saved (52583 records). [2025-09-23T18:00:35.122969] [INFO ] [MAIN ] CIVI: Full history saved. [2025-09-23T18:00:35.123055] [INFO ] [MAIN ] Update Progress: 459/2372 symbols completed. CIVI took 42.6s. Estimated remaining: 4h 12m 17s. Rate: 7.6 symbols/min [2025-09-23T18:00:35.297226] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:00:35.305402] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-23T18:00:35.331493] [DEBUG] [LOCAL ] CLDT: Loaded 25898 existing records from primary storage. [2025-09-23T18:00:35.331668] [INFO ] [MAIN ] CLDT: Loaded 25898 existing records. [2025-09-23T18:00:35.404802] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-08. [2025-09-23T18:00:35.522041] [WARN ] [MAIN ] CLDT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:00:35.522299] [INFO ] [MAIN ] CLDT: Wiping existing primary data before full refresh. [2025-09-23T18:00:35.522351] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-09-23T18:00:35.523082] [DEBUG] [LOCAL ] CLDT: Deleted primary data file. [2025-09-23T18:00:35.523146] [INFO ] [MAIN ] CLDT: Starting full primary refresh. [2025-09-23T18:00:35.887623] [INFO ] [REMOTE ] CLDT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:00:35.921872] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-23T18:00:35.952374] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-23T18:00:36.202202] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-08. [2025-09-23T18:00:37.002193] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-06. [2025-09-23T18:00:37.802154] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-09. [2025-09-23T18:00:38.048290] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-23T18:00:38.077232] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-23T18:00:38.504817] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-23T18:00:38.506790] [INFO ] [REMOTE ] CLCO: Full fetch complete (23029 records). [2025-09-23T18:00:38.506889] [DEBUG] [VALIDATOR ] CLCO: Validating primary data. [2025-09-23T18:00:38.607258] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-07. [2025-09-23T18:00:38.924073] [DEBUG] [VALIDATOR ] CLCO: All expected trading days are present. [2025-09-23T18:00:38.924160] [DEBUG] [VALIDATOR ] CLCO: Primary data validation passed. [2025-09-23T18:00:38.924600] [INFO ] [MAIN ] CLCO: Fetched primary data is valid. [2025-09-23T18:00:38.924704] [DEBUG] [LOCAL ] CLCO: Saving primary data. [2025-09-23T18:00:38.925768] [DEBUG] [LOCAL ] CLCO: Trimmed 23029 records to 12763 (keeping 200 days of data) [2025-09-23T18:00:39.001588] [DEBUG] [LOCAL ] CLCO: Primary data saved (12763 records). [2025-09-23T18:00:39.001790] [INFO ] [MAIN ] CLCO: Full history saved. [2025-09-23T18:00:39.001941] [INFO ] [MAIN ] Update Progress: 460/2372 symbols completed. CLCO took 25.1s. Estimated remaining: 4h 11m 52s. Rate: 7.6 symbols/min [2025-09-23T18:00:39.196522] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:00:39.249991] [DEBUG] [LOCAL ] CLF: Loaded 53741 existing records from primary storage. [2025-09-23T18:00:39.250147] [INFO ] [MAIN ] CLF: Loaded 53741 existing records. [2025-09-23T18:00:39.409978] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2024-12. [2025-09-23T18:00:39.435322] [WARN ] [MAIN ] CLF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:00:39.435565] [INFO ] [MAIN ] CLF: Wiping existing primary data before full refresh. [2025-09-23T18:00:39.435622] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-09-23T18:00:39.437041] [DEBUG] [LOCAL ] CLF: Deleted primary data file. [2025-09-23T18:00:39.437104] [INFO ] [MAIN ] CLF: Starting full primary refresh. [2025-09-23T18:00:39.829160] [INFO ] [REMOTE ] CLF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:00:39.850138] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-23T18:00:40.202206] [INFO ] [REMOTE ] CLF: Fetching primary data for 2024-12. [2025-09-23T18:00:40.333857] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-23T18:00:41.002263] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-01. [2025-09-23T18:00:41.773774] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-23T18:00:41.802144] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-02. [2025-09-23T18:00:42.350830] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-23T18:00:42.569289] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-23T18:00:42.602176] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-03. [2025-09-23T18:00:43.402156] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-08. [2025-09-23T18:00:43.445048] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-23T18:00:44.202223] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-04. [2025-09-23T18:00:44.912206] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-23T18:00:45.002147] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-09. [2025-09-23T18:00:45.622269] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-23T18:00:45.802238] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-05. [2025-09-23T18:00:46.602214] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-01. [2025-09-23T18:00:47.057693] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-23T18:00:47.067202] [INFO ] [REMOTE ] CLB: Full fetch complete (46333 records). [2025-09-23T18:00:47.067411] [DEBUG] [VALIDATOR ] CLB: Validating primary data. [2025-09-23T18:00:47.408740] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-09. [2025-09-23T18:00:47.453403] [DEBUG] [VALIDATOR ] CLB: All expected trading days are present. [2025-09-23T18:00:47.453496] [DEBUG] [VALIDATOR ] CLB: Primary data validation passed. [2025-09-23T18:00:47.454138] [INFO ] [MAIN ] CLB: Fetched primary data is valid. [2025-09-23T18:00:47.454202] [DEBUG] [LOCAL ] CLB: Saving primary data. [2025-09-23T18:00:47.455282] [DEBUG] [LOCAL ] CLB: Trimmed 46333 records to 33098 (keeping 200 days of data) [2025-09-23T18:00:47.677820] [DEBUG] [LOCAL ] CLB: Primary data saved (33098 records). [2025-09-23T18:00:47.677988] [INFO ] [MAIN ] CLB: Full history saved. [2025-09-23T18:00:47.678085] [INFO ] [MAIN ] Update Progress: 461/2372 symbols completed. CLB took 35.8s. Estimated remaining: 4h 11m 47s. Rate: 7.6 symbols/min [2025-09-23T18:00:47.847407] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:00:47.875957] [DEBUG] [LOCAL ] CLH: Loaded 28259 existing records from primary storage. [2025-09-23T18:00:47.876095] [INFO ] [MAIN ] CLH: Loaded 28259 existing records. [2025-09-23T18:00:48.059535] [WARN ] [MAIN ] CLH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:00:48.059837] [INFO ] [MAIN ] CLH: Wiping existing primary data before full refresh. [2025-09-23T18:00:48.059889] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-09-23T18:00:48.060742] [DEBUG] [LOCAL ] CLH: Deleted primary data file. [2025-09-23T18:00:48.060804] [INFO ] [MAIN ] CLH: Starting full primary refresh. [2025-09-23T18:00:48.453524] [INFO ] [REMOTE ] CLH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:00:48.459727] [INFO ] [REMOTE ] CLH: Fetching primary data for 2024-12. [2025-09-23T18:00:48.474934] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-05 (2.67 seconds). [2025-09-23T18:00:49.002192] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-06. [2025-09-23T18:00:49.503017] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-23T18:00:49.578371] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-23T18:00:49.587135] [INFO ] [REMOTE ] CL: Full fetch complete (77226 records). [2025-09-23T18:00:49.587310] [DEBUG] [VALIDATOR ] CL: Validating primary data. [2025-09-23T18:00:49.588474] [FATAL] [VALIDATOR ] CL: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:00:49.588578] [FATAL] [MAIN ] CL: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:00:49.588666] [WARN ] [MAIN ] CL: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:00:49.588744] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-09-23T18:00:49.588812] [DEBUG] [LOCAL ] CL: No primary data file found to delete. [2025-09-23T18:00:49.588850] [INFO ] [LOCAL ] CL: Starting deletion of derivative data. [2025-09-23T18:00:49.589353] [DEBUG] [LOCAL ] CL: Deleted derivative data file. [2025-09-23T18:00:49.589464] [INFO ] [MAIN ] Update Progress: 462/2372 symbols completed. CL took 41.6s. Estimated remaining: 4h 11m 15s. Rate: 7.6 symbols/min [2025-09-23T18:00:49.776514] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:00:49.789335] [DEBUG] [LOCAL ] CLPR: Loaded 11586 existing records from primary storage. [2025-09-23T18:00:49.789472] [INFO ] [MAIN ] CLPR: Loaded 11586 existing records. [2025-09-23T18:00:49.819889] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-01. [2025-09-23T18:00:50.006929] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-01 (3.40 seconds). [2025-09-23T18:00:50.035461] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-23T18:00:50.041510] [WARN ] [MAIN ] CLPR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:00:50.050011] [INFO ] [MAIN ] CLPR: Wiping existing primary data before full refresh. [2025-09-23T18:00:50.050478] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-09-23T18:00:50.051001] [DEBUG] [LOCAL ] CLPR: Deleted primary data file. [2025-09-23T18:00:50.051062] [INFO ] [MAIN ] CLPR: Starting full primary refresh. [2025-09-23T18:00:50.412080] [INFO ] [REMOTE ] CLPR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:00:50.602258] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2024-12. [2025-09-23T18:00:50.850776] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-23T18:00:51.394071] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-23T18:00:51.402133] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-01. [2025-09-23T18:00:52.202155] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-02. [2025-09-23T18:00:52.281371] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-23T18:00:53.002187] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-02. [2025-09-23T18:00:53.304679] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-23T18:00:53.493044] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-23T18:00:53.802198] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-03. [2025-09-23T18:00:54.602226] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-07. [2025-09-23T18:00:55.298509] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-23T18:00:55.369949] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-23T18:00:55.402154] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-03. [2025-09-23T18:00:56.202177] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-02. [2025-09-23T18:00:56.414607] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-23T18:00:57.002216] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-04. [2025-09-23T18:00:57.802180] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-04. [2025-09-23T18:00:57.891226] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-23T18:00:57.952174] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-23T18:00:58.602203] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-05. [2025-09-23T18:00:59.402194] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-03. [2025-09-23T18:00:59.620938] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-23T18:00:59.972841] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-23T18:01:00.202186] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-05. [2025-09-23T18:01:01.002192] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-08. [2025-09-23T18:01:01.707741] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-23T18:01:01.802206] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-06. [2025-09-23T18:01:01.978619] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-03 (2.58 seconds). [2025-09-23T18:01:02.004571] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-23T18:01:02.602194] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-04. [2025-09-23T18:01:03.260202] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-23T18:01:03.402199] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-09. [2025-09-23T18:01:04.202205] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-07. [2025-09-23T18:01:04.443530] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-23T18:01:04.603673] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-23T18:01:04.608063] [INFO ] [REMOTE ] CLDT: Full fetch complete (37061 records). [2025-09-23T18:01:04.608176] [DEBUG] [VALIDATOR ] CLDT: Validating primary data. [2025-09-23T18:01:04.911961] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-23T18:01:05.001814] [DEBUG] [VALIDATOR ] CLDT: All expected trading days are present. [2025-09-23T18:01:05.001899] [DEBUG] [VALIDATOR ] CLDT: Primary data validation passed. [2025-09-23T18:01:05.002405] [INFO ] [MAIN ] CLDT: Fetched primary data is valid. [2025-09-23T18:01:05.002476] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-05. [2025-09-23T18:01:05.003451] [DEBUG] [LOCAL ] CLDT: Saving primary data. [2025-09-23T18:01:05.004404] [DEBUG] [LOCAL ] CLDT: Trimmed 37061 records to 25815 (keeping 200 days of data) [2025-09-23T18:01:05.152739] [DEBUG] [LOCAL ] CLDT: Primary data saved (25815 records). [2025-09-23T18:01:05.152881] [INFO ] [MAIN ] CLDT: Full history saved. [2025-09-23T18:01:05.152968] [INFO ] [MAIN ] Update Progress: 463/2372 symbols completed. CLDT took 30.0s. Estimated remaining: 4h 11m 39s. Rate: 7.6 symbols/min [2025-09-23T18:01:05.334308] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:01:05.334539] [DEBUG] [LOCAL ] CLS: No existing data file found in primary storage. [2025-09-23T18:01:05.334590] [WARN ] [MAIN ] CLS: No existing data found, performing full refresh instead. [2025-09-23T18:01:05.334803] [INFO ] [MAIN ] CLS: Wiping existing primary data before full refresh. [2025-09-23T18:01:05.334862] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-09-23T18:01:05.334920] [DEBUG] [LOCAL ] CLS: No primary data file found to delete. [2025-09-23T18:01:05.334965] [INFO ] [MAIN ] CLS: Starting full primary refresh. [2025-09-23T18:01:05.693213] [INFO ] [REMOTE ] CLS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:01:05.802184] [INFO ] [REMOTE ] CLS: Fetching primary data for 2024-12. [2025-09-23T18:01:06.602197] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-06. [2025-09-23T18:01:07.198188] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-23T18:01:07.385008] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-23T18:01:07.402204] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-06. [2025-09-23T18:01:07.507624] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-23T18:01:08.202196] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-01. [2025-09-23T18:01:09.002203] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-07. [2025-09-23T18:01:09.174839] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-23T18:01:09.802265] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-07. [2025-09-23T18:01:10.104782] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-23T18:01:10.138785] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-23T18:01:10.602260] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-02. [2025-09-23T18:01:11.402254] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-08. [2025-09-23T18:01:11.727864] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-23T18:01:11.989083] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-23T18:01:12.202215] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-08. [2025-09-23T18:01:12.677386] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-23T18:01:13.002243] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-08. [2025-09-23T18:01:13.802267] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-09. [2025-09-23T18:01:13.896301] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-23T18:01:13.997064] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-23T18:01:14.427416] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-23T18:01:14.429201] [INFO ] [REMOTE ] CLPR: Full fetch complete (17717 records). [2025-09-23T18:01:14.429298] [DEBUG] [VALIDATOR ] CLPR: Validating primary data. [2025-09-23T18:01:14.611412] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-09. [2025-09-23T18:01:14.817813] [DEBUG] [VALIDATOR ] CLPR: All expected trading days are present. [2025-09-23T18:01:14.817905] [DEBUG] [VALIDATOR ] CLPR: Primary data validation passed. [2025-09-23T18:01:14.818257] [INFO ] [MAIN ] CLPR: Fetched primary data is valid. [2025-09-23T18:01:14.818297] [DEBUG] [LOCAL ] CLPR: Saving primary data. [2025-09-23T18:01:14.818903] [DEBUG] [LOCAL ] CLPR: Trimmed 17717 records to 11559 (keeping 200 days of data) [2025-09-23T18:01:14.886425] [DEBUG] [LOCAL ] CLPR: Primary data saved (11559 records). [2025-09-23T18:01:14.886578] [INFO ] [MAIN ] CLPR: Full history saved. [2025-09-23T18:01:14.886691] [INFO ] [MAIN ] Update Progress: 464/2372 symbols completed. CLPR took 25.3s. Estimated remaining: 4h 11m 38s. Rate: 7.6 symbols/min [2025-09-23T18:01:15.057165] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:01:15.057323] [DEBUG] [LOCAL ] CLVT: No existing data file found in primary storage. [2025-09-23T18:01:15.057360] [WARN ] [MAIN ] CLVT: No existing data found, performing full refresh instead. [2025-09-23T18:01:15.057515] [INFO ] [MAIN ] CLVT: Wiping existing primary data before full refresh. [2025-09-23T18:01:15.057557] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-09-23T18:01:15.057599] [DEBUG] [LOCAL ] CLVT: No primary data file found to delete. [2025-09-23T18:01:15.057662] [INFO ] [MAIN ] CLVT: Starting full primary refresh. [2025-09-23T18:01:15.409222] [INFO ] [REMOTE ] CLVT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:01:15.405563] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-03. [2025-09-23T18:01:16.202214] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2024-12. [2025-09-23T18:01:16.830343] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-23T18:01:16.840791] [INFO ] [REMOTE ] CLF: Full fetch complete (77809 records). [2025-09-23T18:01:16.841019] [DEBUG] [VALIDATOR ] CLF: Validating primary data. [2025-09-23T18:01:17.002507] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-09. [2025-09-23T18:01:17.252885] [DEBUG] [VALIDATOR ] CLF: All expected trading days are present. [2025-09-23T18:01:17.253009] [DEBUG] [VALIDATOR ] CLF: Primary data validation passed. [2025-09-23T18:01:17.254163] [INFO ] [MAIN ] CLF: Fetched primary data is valid. [2025-09-23T18:01:17.254259] [DEBUG] [LOCAL ] CLF: Saving primary data. [2025-09-23T18:01:17.256558] [DEBUG] [LOCAL ] CLF: Trimmed 77809 records to 53741 (keeping 200 days of data) [2025-09-23T18:01:17.515732] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-23T18:01:17.632990] [DEBUG] [LOCAL ] CLF: Primary data saved (53741 records). [2025-09-23T18:01:17.633167] [INFO ] [MAIN ] CLF: Full history saved. [2025-09-23T18:01:17.633263] [INFO ] [MAIN ] Update Progress: 465/2372 symbols completed. CLF took 38.6s. Estimated remaining: 4h 11m 9s. Rate: 7.6 symbols/min [2025-09-23T18:01:17.734756] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-23T18:01:17.807390] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-04. [2025-09-23T18:01:17.857945] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:01:17.883884] [DEBUG] [LOCAL ] CLW: Loaded 21949 existing records from primary storage. [2025-09-23T18:01:17.884043] [INFO ] [MAIN ] CLW: Loaded 21949 existing records. [2025-09-23T18:01:18.067261] [WARN ] [MAIN ] CLW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:01:18.067522] [INFO ] [MAIN ] CLW: Wiping existing primary data before full refresh. [2025-09-23T18:01:18.067570] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-09-23T18:01:18.068274] [DEBUG] [LOCAL ] CLW: Deleted primary data file. [2025-09-23T18:01:18.068336] [INFO ] [MAIN ] CLW: Starting full primary refresh. [2025-09-23T18:01:18.450839] [INFO ] [REMOTE ] CLW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:01:18.463111] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-23T18:01:18.467392] [INFO ] [REMOTE ] CLH: Full fetch complete (41649 records). [2025-09-23T18:01:18.467490] [DEBUG] [VALIDATOR ] CLH: Validating primary data. [2025-09-23T18:01:18.468300] [FATAL] [VALIDATOR ] CLH: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:01:18.468389] [FATAL] [MAIN ] CLH: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:01:18.468431] [WARN ] [MAIN ] CLH: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:01:18.468494] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-09-23T18:01:18.468559] [DEBUG] [LOCAL ] CLH: No primary data file found to delete. [2025-09-23T18:01:18.468596] [INFO ] [LOCAL ] CLH: Starting deletion of derivative data. [2025-09-23T18:01:18.469063] [DEBUG] [LOCAL ] CLH: Deleted derivative data file. [2025-09-23T18:01:18.469162] [INFO ] [MAIN ] Update Progress: 466/2372 symbols completed. CLH took 30.8s. Estimated remaining: 4h 10m 32s. Rate: 7.6 symbols/min [2025-09-23T18:01:18.609204] [INFO ] [REMOTE ] CLW: Fetching primary data for 2024-12. [2025-09-23T18:01:18.646055] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:01:18.704930] [DEBUG] [LOCAL ] CLX: Loaded 51429 existing records from primary storage. [2025-09-23T18:01:18.705187] [INFO ] [MAIN ] CLX: Loaded 51429 existing records. [2025-09-23T18:01:18.892833] [WARN ] [MAIN ] CLX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:01:18.893086] [INFO ] [MAIN ] CLX: Wiping existing primary data before full refresh. [2025-09-23T18:01:18.893136] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-09-23T18:01:18.894706] [DEBUG] [LOCAL ] CLX: Deleted primary data file. [2025-09-23T18:01:18.894771] [INFO ] [MAIN ] CLX: Starting full primary refresh. [2025-09-23T18:01:19.258482] [INFO ] [REMOTE ] CLX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:01:19.402198] [INFO ] [REMOTE ] CLX: Fetching primary data for 2024-12. [2025-09-23T18:01:19.951637] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-23T18:01:20.202236] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-01. [2025-09-23T18:01:20.317144] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-23T18:01:20.697323] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-23T18:01:21.002217] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-01. [2025-09-23T18:01:21.493340] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-23T18:01:21.802276] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-01. [2025-09-23T18:01:22.360567] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-23T18:01:22.602269] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-02. [2025-09-23T18:01:23.192808] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-23T18:01:23.402231] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-05. [2025-09-23T18:01:24.203728] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-02. [2025-09-23T18:01:24.215475] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-23T18:01:25.002191] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-03. [2025-09-23T18:01:25.324259] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-23T18:01:25.600953] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-23T18:01:25.802217] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-06. [2025-09-23T18:01:26.602168] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-02. [2025-09-23T18:01:26.708264] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-23T18:01:27.402165] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-04. [2025-09-23T18:01:27.506960] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-23T18:01:27.546096] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-23T18:01:28.202191] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-07. [2025-09-23T18:01:28.754845] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-23T18:01:29.002207] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-05. [2025-09-23T18:01:29.802214] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-03. [2025-09-23T18:01:30.602224] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-03. [2025-09-23T18:01:30.689500] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-09-23T18:01:30.718578] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-23T18:01:30.771102] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-23T18:01:31.402200] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-04. [2025-09-23T18:01:31.979934] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-23T18:01:32.202226] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-06. [2025-09-23T18:01:32.532781] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-23T18:01:33.002273] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-04. [2025-09-23T18:01:33.693792] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-23T18:01:33.802161] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-08. [2025-09-23T18:01:34.602162] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-05. [2025-09-23T18:01:34.719279] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-23T18:01:35.329344] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-23T18:01:35.402156] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-06. [2025-09-23T18:01:35.888734] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-23T18:01:36.125820] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-23T18:01:36.202162] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-07. [2025-09-23T18:01:37.002213] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-09. [2025-09-23T18:01:37.762965] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-23T18:01:37.802152] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-08. [2025-09-23T18:01:38.602189] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-05. [2025-09-23T18:01:39.208540] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-23T18:01:39.218879] [INFO ] [REMOTE ] CLS: Full fetch complete (77449 records). [2025-09-23T18:01:39.219150] [DEBUG] [VALIDATOR ] CLS: Validating primary data. [2025-09-23T18:01:39.414504] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-07. [2025-09-23T18:01:39.645569] [DEBUG] [VALIDATOR ] CLS: All expected trading days are present. [2025-09-23T18:01:39.645787] [DEBUG] [VALIDATOR ] CLS: Primary data validation passed. [2025-09-23T18:01:39.646820] [INFO ] [MAIN ] CLS: Fetched primary data is valid. [2025-09-23T18:01:39.646959] [DEBUG] [LOCAL ] CLS: Saving primary data. [2025-09-23T18:01:39.648520] [DEBUG] [LOCAL ] CLS: Trimmed 77449 records to 53638 (keeping 200 days of data) [2025-09-23T18:01:39.775440] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-23T18:01:40.016356] [DEBUG] [LOCAL ] CLS: Primary data saved (53638 records). [2025-09-23T18:01:40.016523] [INFO ] [MAIN ] CLS: Full history saved. [2025-09-23T18:01:40.016605] [INFO ] [MAIN ] Update Progress: 467/2372 symbols completed. CLS took 34.9s. Estimated remaining: 4h 11m 20s. Rate: 7.6 symbols/min [2025-09-23T18:01:40.185869] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:01:40.186039] [DEBUG] [LOCAL ] CM: No existing data file found in primary storage. [2025-09-23T18:01:40.186078] [WARN ] [MAIN ] CM: No existing data found, performing full refresh instead. [2025-09-23T18:01:40.186220] [INFO ] [MAIN ] CM: Wiping existing primary data before full refresh. [2025-09-23T18:01:40.186263] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-09-23T18:01:40.186305] [DEBUG] [LOCAL ] CM: No primary data file found to delete. [2025-09-23T18:01:40.186338] [INFO ] [MAIN ] CM: Starting full primary refresh. [2025-09-23T18:01:40.207964] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-09. [2025-09-23T18:01:40.476248] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-23T18:01:40.590012] [INFO ] [REMOTE ] CM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:01:40.620558] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-23T18:01:41.002190] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-08. [2025-09-23T18:01:41.802209] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-06. [2025-09-23T18:01:42.295746] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-23T18:01:42.453083] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-23T18:01:42.463350] [INFO ] [REMOTE ] CLX: Full fetch complete (72474 records). [2025-09-23T18:01:42.463550] [DEBUG] [VALIDATOR ] CLX: Validating primary data. [2025-09-23T18:01:42.464613] [FATAL] [VALIDATOR ] CLX: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:01:42.464838] [FATAL] [MAIN ] CLX: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:01:42.464907] [WARN ] [MAIN ] CLX: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:01:42.464976] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-09-23T18:01:42.465059] [DEBUG] [LOCAL ] CLX: No primary data file found to delete. [2025-09-23T18:01:42.465136] [INFO ] [LOCAL ] CLX: Starting deletion of derivative data. [2025-09-23T18:01:42.465571] [DEBUG] [LOCAL ] CLX: Deleted derivative data file. [2025-09-23T18:01:42.465732] [INFO ] [MAIN ] Update Progress: 468/2372 symbols completed. CLX took 24.0s. Estimated remaining: 4h 10m 50s. Rate: 7.6 symbols/min [2025-09-23T18:01:42.608604] [INFO ] [REMOTE ] CM: Fetching primary data for 2024-12. [2025-09-23T18:01:42.643465] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:01:42.693988] [DEBUG] [LOCAL ] CMA: Loaded 50210 existing records from primary storage. [2025-09-23T18:01:42.694147] [INFO ] [MAIN ] CMA: Loaded 50210 existing records. [2025-09-23T18:01:42.886749] [WARN ] [MAIN ] CMA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:01:42.886989] [INFO ] [MAIN ] CMA: Wiping existing primary data before full refresh. [2025-09-23T18:01:42.887037] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-09-23T18:01:42.888400] [DEBUG] [LOCAL ] CMA: Deleted primary data file. [2025-09-23T18:01:42.888462] [INFO ] [MAIN ] CMA: Starting full primary refresh. [2025-09-23T18:01:43.266783] [INFO ] [REMOTE ] CMA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:01:43.402254] [INFO ] [REMOTE ] CMA: Fetching primary data for 2024-12. [2025-09-23T18:01:43.542066] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-23T18:01:44.202169] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-07. [2025-09-23T18:01:44.425345] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-23T18:01:45.002167] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-01. [2025-09-23T18:01:45.071533] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-23T18:01:45.585245] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-23T18:01:45.802209] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-09. [2025-09-23T18:01:46.201727] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-23T18:01:46.566366] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-23T18:01:46.570633] [INFO ] [REMOTE ] CLW: Full fetch complete (35187 records). [2025-09-23T18:01:46.570821] [DEBUG] [VALIDATOR ] CLW: Validating primary data. [2025-09-23T18:01:46.607286] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-01. [2025-09-23T18:01:46.956538] [DEBUG] [VALIDATOR ] CLW: All expected trading days are present. [2025-09-23T18:01:46.956619] [DEBUG] [VALIDATOR ] CLW: Primary data validation passed. [2025-09-23T18:01:46.957168] [INFO ] [MAIN ] CLW: Fetched primary data is valid. [2025-09-23T18:01:46.957224] [DEBUG] [LOCAL ] CLW: Saving primary data. [2025-09-23T18:01:46.958070] [DEBUG] [LOCAL ] CLW: Trimmed 35187 records to 21956 (keeping 200 days of data) [2025-09-23T18:01:47.102194] [DEBUG] [LOCAL ] CLW: Primary data saved (21956 records). [2025-09-23T18:01:47.102361] [INFO ] [MAIN ] CLW: Full history saved. [2025-09-23T18:01:47.102465] [INFO ] [MAIN ] Update Progress: 469/2372 symbols completed. CLW took 29.4s. Estimated remaining: 4h 10m 29s. Rate: 7.6 symbols/min [2025-09-23T18:01:47.275415] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:01:47.297229] [DEBUG] [LOCAL ] CMBT: Loaded 21739 existing records from primary storage. [2025-09-23T18:01:47.297415] [INFO ] [MAIN ] CMBT: Loaded 21739 existing records. [2025-09-23T18:01:47.407336] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-02. [2025-09-23T18:01:47.494248] [WARN ] [MAIN ] CMBT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:01:47.494520] [INFO ] [MAIN ] CMBT: Wiping existing primary data before full refresh. [2025-09-23T18:01:47.494570] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-09-23T18:01:47.495293] [DEBUG] [LOCAL ] CMBT: Deleted primary data file. [2025-09-23T18:01:47.495357] [INFO ] [MAIN ] CMBT: Starting full primary refresh. [2025-09-23T18:01:47.861739] [INFO ] [REMOTE ] CMBT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:01:48.095582] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-23T18:01:48.202200] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-08. [2025-09-23T18:01:49.002213] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-02. [2025-09-23T18:01:49.079174] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-23T18:01:49.627748] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-23T18:01:49.802187] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-03. [2025-09-23T18:01:50.245238] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-23T18:01:50.602214] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2024-12. [2025-09-23T18:01:51.020974] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-23T18:01:51.402239] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-04. [2025-09-23T18:01:51.495755] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-23T18:01:52.202261] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-03. [2025-09-23T18:01:52.733620] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-23T18:01:53.002259] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-01. [2025-09-23T18:01:53.648330] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-23T18:01:53.802155] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-05. [2025-09-23T18:01:53.987874] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-23T18:01:54.602281] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-09. [2025-09-23T18:01:55.184444] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-23T18:01:55.402218] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-06. [2025-09-23T18:01:56.067165] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-23T18:01:56.076690] [INFO ] [REMOTE ] CLVT: Full fetch complete (75232 records). [2025-09-23T18:01:56.077018] [DEBUG] [VALIDATOR ] CLVT: Validating primary data. [2025-09-23T18:01:56.216993] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-02. [2025-09-23T18:01:56.485725] [DEBUG] [VALIDATOR ] CLVT: All expected trading days are present. [2025-09-23T18:01:56.485817] [DEBUG] [VALIDATOR ] CLVT: Primary data validation passed. [2025-09-23T18:01:56.486611] [INFO ] [MAIN ] CLVT: Fetched primary data is valid. [2025-09-23T18:01:56.486684] [DEBUG] [LOCAL ] CLVT: Saving primary data. [2025-09-23T18:01:56.491742] [DEBUG] [LOCAL ] CLVT: Trimmed 75232 records to 51969 (keeping 200 days of data) [2025-09-23T18:01:56.801599] [DEBUG] [LOCAL ] CLVT: Primary data saved (51969 records). [2025-09-23T18:01:56.801974] [INFO ] [MAIN ] CLVT: Full history saved. [2025-09-23T18:01:56.802066] [INFO ] [MAIN ] Update Progress: 470/2372 symbols completed. CLVT took 41.9s. Estimated remaining: 4h 10m 28s. Rate: 7.6 symbols/min [2025-09-23T18:01:56.984576] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:01:57.009195] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-04. [2025-09-23T18:01:57.015363] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-23T18:01:57.073924] [DEBUG] [LOCAL ] CMC: Loaded 45757 existing records from primary storage. [2025-09-23T18:01:57.074125] [INFO ] [MAIN ] CMC: Loaded 45757 existing records. [2025-09-23T18:01:57.281333] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-23T18:01:57.309631] [WARN ] [MAIN ] CMC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:01:57.310337] [INFO ] [MAIN ] CMC: Wiping existing primary data before full refresh. [2025-09-23T18:01:57.310392] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-09-23T18:01:57.312593] [DEBUG] [LOCAL ] CMC: Deleted primary data file. [2025-09-23T18:01:57.312683] [INFO ] [MAIN ] CMC: Starting full primary refresh. [2025-09-23T18:01:57.692426] [INFO ] [REMOTE ] CMC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:01:57.802252] [INFO ] [REMOTE ] CMC: Fetching primary data for 2024-12. [2025-09-23T18:01:58.602188] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-03. [2025-09-23T18:01:58.676916] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-23T18:01:59.289810] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-23T18:01:59.319360] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-23T18:01:59.402206] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-04. [2025-09-23T18:02:00.202200] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-07. [2025-09-23T18:02:00.488185] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-23T18:02:01.002196] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-01. [2025-09-23T18:02:01.801750] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-23T18:02:01.812311] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-05. [2025-09-23T18:02:02.312991] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-23T18:02:02.602250] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-08. [2025-09-23T18:02:03.117275] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-23T18:02:03.402247] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-05. [2025-09-23T18:02:04.052636] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-23T18:02:04.207328] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-09. [2025-09-23T18:02:04.216595] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-23T18:02:05.002202] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-06. [2025-09-23T18:02:05.661185] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-23T18:02:05.669881] [INFO ] [REMOTE ] CM: Full fetch complete (69421 records). [2025-09-23T18:02:05.670054] [DEBUG] [VALIDATOR ] CM: Validating primary data. [2025-09-23T18:02:05.807307] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-02. [2025-09-23T18:02:06.117890] [DEBUG] [VALIDATOR ] CM: All expected trading days are present. [2025-09-23T18:02:06.117988] [DEBUG] [VALIDATOR ] CM: Primary data validation passed. [2025-09-23T18:02:06.118781] [INFO ] [MAIN ] CM: Fetched primary data is valid. [2025-09-23T18:02:06.118846] [DEBUG] [LOCAL ] CM: Saving primary data. [2025-09-23T18:02:06.120448] [DEBUG] [LOCAL ] CM: Trimmed 69421 records to 48632 (keeping 200 days of data) [2025-09-23T18:02:06.372114] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-23T18:02:06.472507] [DEBUG] [LOCAL ] CM: Primary data saved (48632 records). [2025-09-23T18:02:06.472680] [INFO ] [MAIN ] CM: Full history saved. [2025-09-23T18:02:06.472780] [INFO ] [MAIN ] Update Progress: 471/2372 symbols completed. CM took 26.5s. Estimated remaining: 4h 10m 27s. Rate: 7.6 symbols/min [2025-09-23T18:02:06.607453] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-06. [2025-09-23T18:02:06.677986] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:02:06.686247] [DEBUG] [LOCAL ] CMCM: Loaded 4698 existing records from primary storage. [2025-09-23T18:02:06.686354] [INFO ] [MAIN ] CMCM: Loaded 4698 existing records. [2025-09-23T18:02:06.876153] [WARN ] [MAIN ] CMCM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:02:06.876430] [INFO ] [MAIN ] CMCM: Wiping existing primary data before full refresh. [2025-09-23T18:02:06.876480] [INFO ] [LOCAL ] CMCM: Starting deletion of primary data. [2025-09-23T18:02:06.876881] [DEBUG] [LOCAL ] CMCM: Deleted primary data file. [2025-09-23T18:02:06.876945] [INFO ] [MAIN ] CMCM: Starting full primary refresh. [2025-09-23T18:02:07.295006] [INFO ] [REMOTE ] CMCM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:02:07.316804] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-23T18:02:07.363954] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-23T18:02:07.402190] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-07. [2025-09-23T18:02:08.202244] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-03. [2025-09-23T18:02:09.002231] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2024-12. [2025-09-23T18:02:09.385241] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-23T18:02:09.615550] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-23T18:02:09.649781] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-23T18:02:09.802310] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-04. [2025-09-23T18:02:10.602203] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-01. [2025-09-23T18:02:11.169088] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-23T18:02:11.402198] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-07. [2025-09-23T18:02:11.654019] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-23T18:02:12.094766] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-23T18:02:12.202237] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-05. [2025-09-23T18:02:13.002404] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-02. [2025-09-23T18:02:13.512749] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-23T18:02:13.634545] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-23T18:02:13.802236] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-08. [2025-09-23T18:02:14.602233] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-03. [2025-09-23T18:02:15.362228] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-23T18:02:15.373979] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-23T18:02:15.402190] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-09. [2025-09-23T18:02:16.202414] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-04. [2025-09-23T18:02:16.559193] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-23T18:02:16.814017] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-23T18:02:16.822296] [INFO ] [REMOTE ] CMBT: Full fetch complete (28706 records). [2025-09-23T18:02:16.822677] [DEBUG] [VALIDATOR ] CMBT: Validating primary data. [2025-09-23T18:02:16.823667] [FATAL] [VALIDATOR ] CMBT: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:02:16.823783] [FATAL] [MAIN ] CMBT: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:02:16.823866] [WARN ] [MAIN ] CMBT: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:02:16.823976] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-09-23T18:02:16.824121] [DEBUG] [LOCAL ] CMBT: No primary data file found to delete. [2025-09-23T18:02:16.824203] [INFO ] [LOCAL ] CMBT: Starting deletion of derivative data. [2025-09-23T18:02:16.824882] [DEBUG] [LOCAL ] CMBT: Deleted derivative data file. [2025-09-23T18:02:16.825143] [INFO ] [MAIN ] Update Progress: 472/2372 symbols completed. CMBT took 29.7s. Estimated remaining: 4h 10m 29s. Rate: 7.6 symbols/min [2025-09-23T18:02:17.000667] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:02:17.000878] [DEBUG] [LOCAL ] CMDB: No existing data file found in primary storage. [2025-09-23T18:02:17.000932] [WARN ] [MAIN ] CMDB: No existing data found, performing full refresh instead. [2025-09-23T18:02:17.001078] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-09-23T18:02:17.001132] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-09-23T18:02:17.001233] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-09-23T18:02:17.001296] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-09-23T18:02:17.007437] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-05. [2025-09-23T18:02:17.398624] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:02:17.429883] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-23T18:02:17.802225] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2024-12. [2025-09-23T18:02:18.039175] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:02:18.039752] [WARN ] [REMOTE ] CMDB: No data returned for month 2024-12 [2025-09-23T18:02:18.602262] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-06. [2025-09-23T18:02:19.261091] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-23T18:02:19.402266] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-06. [2025-09-23T18:02:20.202220] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-08. [2025-09-23T18:02:20.820330] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-23T18:02:21.002207] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-07. [2025-09-23T18:02:21.612625] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-23T18:02:21.802240] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-01. [2025-09-23T18:02:22.028952] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:02:22.029357] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-01 [2025-09-23T18:02:22.233943] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-23T18:02:22.602202] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-08. [2025-09-23T18:02:23.402245] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-02. [2025-09-23T18:02:23.600628] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:02:23.601360] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-02 [2025-09-23T18:02:24.098597] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-23T18:02:24.202219] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-09. [2025-09-23T18:02:25.002252] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-07. [2025-09-23T18:02:25.452787] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-23T18:02:25.465948] [INFO ] [REMOTE ] CMC: Full fetch complete (66885 records). [2025-09-23T18:02:25.466279] [DEBUG] [VALIDATOR ] CMC: Validating primary data. [2025-09-23T18:02:25.808463] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-03. [2025-09-23T18:02:25.878005] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-23T18:02:25.988487] [DEBUG] [VALIDATOR ] CMC: All expected trading days are present. [2025-09-23T18:02:25.988591] [DEBUG] [VALIDATOR ] CMC: Primary data validation passed. [2025-09-23T18:02:25.989466] [INFO ] [MAIN ] CMC: Fetched primary data is valid. [2025-09-23T18:02:25.989605] [DEBUG] [LOCAL ] CMC: Saving primary data. [2025-09-23T18:02:25.995786] [DEBUG] [LOCAL ] CMC: Trimmed 66885 records to 45728 (keeping 200 days of data) [2025-09-23T18:02:26.070066] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:02:26.112477] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-03 [2025-09-23T18:02:26.328680] [DEBUG] [LOCAL ] CMC: Primary data saved (45728 records). [2025-09-23T18:02:26.328844] [INFO ] [MAIN ] CMC: Full history saved. [2025-09-23T18:02:26.328983] [INFO ] [MAIN ] Update Progress: 473/2372 symbols completed. CMC took 29.5s. Estimated remaining: 4h 10m 28s. Rate: 7.6 symbols/min [2025-09-23T18:02:26.608776] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-09. [2025-09-23T18:02:26.612740] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:02:26.614408] [DEBUG] [LOCAL ] CMG: No existing data file found in primary storage. [2025-09-23T18:02:26.614472] [WARN ] [MAIN ] CMG: No existing data found, performing full refresh instead. [2025-09-23T18:02:26.614639] [INFO ] [MAIN ] CMG: Wiping existing primary data before full refresh. [2025-09-23T18:02:26.614726] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-09-23T18:02:26.614777] [DEBUG] [LOCAL ] CMG: No primary data file found to delete. [2025-09-23T18:02:26.614813] [INFO ] [MAIN ] CMG: Starting full primary refresh. [2025-09-23T18:02:27.008032] [INFO ] [REMOTE ] CMG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:02:27.402262] [INFO ] [REMOTE ] CMG: Fetching primary data for 2024-12. [2025-09-23T18:02:28.062370] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-23T18:02:28.074165] [INFO ] [REMOTE ] CMA: Full fetch complete (73321 records). [2025-09-23T18:02:28.074578] [DEBUG] [VALIDATOR ] CMA: Validating primary data. [2025-09-23T18:02:28.207404] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-04. [2025-09-23T18:02:28.470378] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:02:28.497884] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-04 [2025-09-23T18:02:28.544490] [DEBUG] [VALIDATOR ] CMA: All expected trading days are present. [2025-09-23T18:02:28.544805] [DEBUG] [VALIDATOR ] CMA: Primary data validation passed. [2025-09-23T18:02:28.546068] [INFO ] [MAIN ] CMA: Fetched primary data is valid. [2025-09-23T18:02:28.546139] [DEBUG] [LOCAL ] CMA: Saving primary data. [2025-09-23T18:02:28.548560] [DEBUG] [LOCAL ] CMA: Trimmed 73321 records to 50140 (keeping 200 days of data) [2025-09-23T18:02:28.890015] [DEBUG] [LOCAL ] CMA: Primary data saved (50140 records). [2025-09-23T18:02:28.890171] [INFO ] [MAIN ] CMA: Full history saved. [2025-09-23T18:02:28.890283] [INFO ] [MAIN ] Update Progress: 474/2372 symbols completed. CMA took 46.4s. Estimated remaining: 4h 9m 58s. Rate: 7.6 symbols/min [2025-09-23T18:02:29.007384] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-08. [2025-09-23T18:02:29.066152] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:02:29.066357] [DEBUG] [LOCAL ] CMI: No existing data file found in primary storage. [2025-09-23T18:02:29.066432] [WARN ] [MAIN ] CMI: No existing data found, performing full refresh instead. [2025-09-23T18:02:29.066692] [INFO ] [MAIN ] CMI: Wiping existing primary data before full refresh. [2025-09-23T18:02:29.066751] [INFO ] [LOCAL ] CMI: Starting deletion of primary data. [2025-09-23T18:02:29.066798] [DEBUG] [LOCAL ] CMI: No primary data file found to delete. [2025-09-23T18:02:29.066836] [INFO ] [MAIN ] CMI: Starting full primary refresh. [2025-09-23T18:02:29.467832] [INFO ] [REMOTE ] CMI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:02:29.494758] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-23T18:02:29.589047] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-23T18:02:29.802262] [INFO ] [REMOTE ] CMI: Fetching primary data for 2024-12. [2025-09-23T18:02:30.602228] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-09. [2025-09-23T18:02:31.078738] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-23T18:02:31.241682] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-23T18:02:31.243901] [INFO ] [REMOTE ] CMCM: Full fetch complete (7051 records). [2025-09-23T18:02:31.243979] [DEBUG] [VALIDATOR ] CMCM: Validating primary data. [2025-09-23T18:02:31.411366] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-05. [2025-09-23T18:02:31.632246] [DEBUG] [VALIDATOR ] CMCM: All expected trading days are present. [2025-09-23T18:02:31.632342] [DEBUG] [VALIDATOR ] CMCM: Primary data validation passed. [2025-09-23T18:02:31.632546] [INFO ] [MAIN ] CMCM: Fetched primary data is valid. [2025-09-23T18:02:31.632588] [DEBUG] [LOCAL ] CMCM: Saving primary data. [2025-09-23T18:02:31.633139] [DEBUG] [LOCAL ] CMCM: Trimmed 7051 records to 4730 (keeping 200 days of data) [2025-09-23T18:02:31.662049] [DEBUG] [LOCAL ] CMCM: Primary data saved (4730 records). [2025-09-23T18:02:31.662187] [INFO ] [MAIN ] CMCM: Full history saved. [2025-09-23T18:02:31.662278] [INFO ] [MAIN ] Update Progress: 475/2372 symbols completed. CMCM took 25.2s. Estimated remaining: 4h 9m 30s. Rate: 7.6 symbols/min [2025-09-23T18:02:31.845343] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:02:31.845550] [DEBUG] [LOCAL ] CMP: No existing data file found in primary storage. [2025-09-23T18:02:31.845588] [WARN ] [MAIN ] CMP: No existing data found, performing full refresh instead. [2025-09-23T18:02:31.845821] [INFO ] [MAIN ] CMP: Wiping existing primary data before full refresh. [2025-09-23T18:02:31.845869] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-09-23T18:02:31.845914] [DEBUG] [LOCAL ] CMP: No primary data file found to delete. [2025-09-23T18:02:31.845948] [INFO ] [MAIN ] CMP: Starting full primary refresh. [2025-09-23T18:02:32.209472] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-01. [2025-09-23T18:02:32.215341] [INFO ] [REMOTE ] CMP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:02:32.562419] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-23T18:02:33.002220] [INFO ] [REMOTE ] CMP: Fetching primary data for 2024-12. [2025-09-23T18:02:33.802211] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-06. [2025-09-23T18:02:33.985318] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-23T18:02:34.503076] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-23T18:02:34.540637] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-23T18:02:34.602232] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-07. [2025-09-23T18:02:35.402179] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-01. [2025-09-23T18:02:35.565452] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-23T18:02:36.202244] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-08. [2025-09-23T18:02:36.573567] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-23T18:02:36.733135] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-23T18:02:37.002236] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-09. [2025-09-23T18:02:37.669997] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-23T18:02:37.672627] [INFO ] [REMOTE ] CMDB: Full fetch complete (10699 records). [2025-09-23T18:02:37.672732] [DEBUG] [VALIDATOR ] CMDB: Validating primary data. [2025-09-23T18:02:37.812208] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-02. [2025-09-23T18:02:37.856494] [WARN ] [VALIDATOR ] CMDB: Validation failed - insufficient historical data. Have 96 unique days, need 200 days [2025-09-23T18:02:37.856845] [FATAL] [MAIN ] CMDB: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:02:37.856930] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:02:37.857017] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-09-23T18:02:37.857127] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-09-23T18:02:37.857203] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-09-23T18:02:37.857297] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-09-23T18:02:37.857406] [INFO ] [MAIN ] Update Progress: 476/2372 symbols completed. CMDB took 21.0s. Estimated remaining: 4h 9m 15s. Rate: 7.6 symbols/min [2025-09-23T18:02:38.034458] [INFO ] [MAIN ] CMPO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:02:38.034775] [DEBUG] [LOCAL ] CMPO: No existing data file found in primary storage. [2025-09-23T18:02:38.034833] [WARN ] [MAIN ] CMPO: No existing data found, performing full refresh instead. [2025-09-23T18:02:38.035013] [INFO ] [MAIN ] CMPO: Wiping existing primary data before full refresh. [2025-09-23T18:02:38.035078] [INFO ] [LOCAL ] CMPO: Starting deletion of primary data. [2025-09-23T18:02:38.035178] [DEBUG] [LOCAL ] CMPO: No primary data file found to delete. [2025-09-23T18:02:38.035257] [INFO ] [MAIN ] CMPO: Starting full primary refresh. [2025-09-23T18:02:38.398117] [INFO ] [REMOTE ] CMPO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:02:38.602208] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2024-12. [2025-09-23T18:02:39.402239] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-02. [2025-09-23T18:02:39.771756] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-23T18:02:39.814063] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-23T18:02:40.202206] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-01. [2025-09-23T18:02:40.511177] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-23T18:02:41.002238] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-03. [2025-09-23T18:02:41.811544] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-01. [2025-09-23T18:02:41.829008] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-23T18:02:42.602272] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-02. [2025-09-23T18:02:42.745068] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-23T18:02:42.812779] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-23T18:02:43.402232] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-04. [2025-09-23T18:02:44.074376] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-23T18:02:44.202206] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-03. [2025-09-23T18:02:45.002232] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-02. [2025-09-23T18:02:45.516434] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-23T18:02:45.762756] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-09-23T18:02:45.802205] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-05. [2025-09-23T18:02:46.051458] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-23T18:02:46.602198] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-04. [2025-09-23T18:02:47.418020] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-03. [2025-09-23T18:02:47.446759] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-23T18:02:47.660867] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-23T18:02:48.202207] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-06. [2025-09-23T18:02:48.428300] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-23T18:02:49.002366] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-05. [2025-09-23T18:02:49.802210] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-03. [2025-09-23T18:02:50.097418] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-23T18:02:50.327185] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-23T18:02:50.602191] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-06. [2025-09-23T18:02:51.389523] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-23T18:02:51.402147] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-04. [2025-09-23T18:02:51.637829] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-23T18:02:52.202189] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-04. [2025-09-23T18:02:52.735576] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-23T18:02:53.002204] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-05. [2025-09-23T18:02:53.309243] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-23T18:02:53.802192] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-05. [2025-09-23T18:02:54.240705] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-23T18:02:54.602212] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-07. [2025-09-23T18:02:55.342801] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-23T18:02:55.402285] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-06. [2025-09-23T18:02:56.202222] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-06. [2025-09-23T18:02:56.937157] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-23T18:02:57.002198] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-07. [2025-09-23T18:02:57.240142] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-07 (2.64 seconds). [2025-09-23T18:02:57.320451] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-23T18:02:57.802226] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-08. [2025-09-23T18:02:58.602267] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-07. [2025-09-23T18:02:58.658278] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-23T18:02:59.402214] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-08. [2025-09-23T18:02:59.762096] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-23T18:02:59.951072] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-23T18:03:00.202209] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-08. [2025-09-23T18:03:00.383625] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-23T18:03:01.002200] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-07. [2025-09-23T18:03:01.802161] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-09. [2025-09-23T18:03:01.830685] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-23T18:03:02.602195] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-09. [2025-09-23T18:03:03.238878] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-23T18:03:03.402218] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-09. [2025-09-23T18:03:04.202243] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-08. [2025-09-23T18:03:04.633818] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-23T18:03:04.640467] [INFO ] [REMOTE ] CMPO: Full fetch complete (58654 records). [2025-09-23T18:03:04.640697] [DEBUG] [VALIDATOR ] CMPO: Validating primary data. [2025-09-23T18:03:04.641871] [FATAL] [VALIDATOR ] CMPO: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:03:04.642183] [FATAL] [MAIN ] CMPO: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:03:04.642259] [WARN ] [MAIN ] CMPO: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:03:04.642338] [INFO ] [LOCAL ] CMPO: Starting deletion of primary data. [2025-09-23T18:03:04.642409] [DEBUG] [LOCAL ] CMPO: No primary data file found to delete. [2025-09-23T18:03:04.642447] [INFO ] [LOCAL ] CMPO: Starting deletion of derivative data. [2025-09-23T18:03:04.642547] [DEBUG] [LOCAL ] CMPO: No derivative data file found to delete. [2025-09-23T18:03:04.642634] [INFO ] [MAIN ] Update Progress: 477/2372 symbols completed. CMPO took 26.8s. Estimated remaining: 4h 10m 23s. Rate: 7.6 symbols/min [2025-09-23T18:03:05.043751] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-23T18:03:05.051792] [INFO ] [REMOTE ] CMP: Full fetch complete (52958 records). [2025-09-23T18:03:05.052102] [DEBUG] [VALIDATOR ] CMP: Validating primary data. [2025-09-23T18:03:05.053342] [FATAL] [VALIDATOR ] CMP: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:03:05.053442] [FATAL] [MAIN ] CMP: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:03:05.053490] [WARN ] [MAIN ] CMP: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:03:05.053533] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-09-23T18:03:05.053599] [DEBUG] [LOCAL ] CMP: No primary data file found to delete. [2025-09-23T18:03:05.053637] [INFO ] [LOCAL ] CMP: Starting deletion of derivative data. [2025-09-23T18:03:05.053732] [DEBUG] [LOCAL ] CMP: No derivative data file found to delete. [2025-09-23T18:03:05.053851] [INFO ] [MAIN ] Update Progress: 478/2372 symbols completed. CMP took 33.4s. Estimated remaining: 4h 9m 45s. Rate: 7.6 symbols/min [2025-09-23T18:03:05.600914] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-09 (3.80 seconds). [2025-09-23T18:03:05.609798] [INFO ] [REMOTE ] CMG: Full fetch complete (77795 records). [2025-09-23T18:03:05.609921] [DEBUG] [VALIDATOR ] CMG: Validating primary data. [2025-09-23T18:03:06.041163] [DEBUG] [VALIDATOR ] CMG: All expected trading days are present. [2025-09-23T18:03:06.041328] [DEBUG] [VALIDATOR ] CMG: Primary data validation passed. [2025-09-23T18:03:06.042207] [INFO ] [MAIN ] CMG: Fetched primary data is valid. [2025-09-23T18:03:06.042298] [DEBUG] [LOCAL ] CMG: Saving primary data. [2025-09-23T18:03:06.068282] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-23T18:03:06.076898] [DEBUG] [LOCAL ] CMG: Trimmed 77795 records to 53720 (keeping 200 days of data) [2025-09-23T18:03:06.078558] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-09. [2025-09-23T18:03:06.418332] [DEBUG] [LOCAL ] CMG: Primary data saved (53720 records). [2025-09-23T18:03:06.418502] [INFO ] [MAIN ] CMG: Full history saved. [2025-09-23T18:03:06.418591] [INFO ] [MAIN ] Update Progress: 479/2372 symbols completed. CMG took 40.1s. Estimated remaining: 4h 9m 11s. Rate: 7.6 symbols/min [2025-09-23T18:03:07.467459] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-23T18:03:07.474746] [INFO ] [REMOTE ] CMI: Full fetch complete (59862 records). [2025-09-23T18:03:07.474854] [DEBUG] [VALIDATOR ] CMI: Validating primary data. [2025-09-23T18:03:07.879846] [DEBUG] [VALIDATOR ] CMI: All expected trading days are present. [2025-09-23T18:03:07.879952] [DEBUG] [VALIDATOR ] CMI: Primary data validation passed. [2025-09-23T18:03:07.880795] [INFO ] [MAIN ] CMI: Fetched primary data is valid. [2025-09-23T18:03:07.880866] [DEBUG] [LOCAL ] CMI: Saving primary data. [2025-09-23T18:03:07.882288] [DEBUG] [LOCAL ] CMI: Trimmed 59862 records to 41900 (keeping 200 days of data) [2025-09-23T18:03:08.157936] [DEBUG] [LOCAL ] CMI: Primary data saved (41900 records). [2025-09-23T18:03:08.158088] [INFO ] [MAIN ] CMI: Full history saved. [2025-09-23T18:03:08.158182] [INFO ] [MAIN ] Update Progress: 480/2372 symbols completed. CMI took 39.3s. Estimated remaining: 4h 8m 39s. Rate: 7.6 symbols/min [2025-09-23T18:03:08.841614] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:03:08.924140] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:03:08.993457] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:03:09.027524] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:03:09.032774] [DEBUG] [LOCAL ] CMSC: Loaded 5089 existing records from primary storage. [2025-09-23T18:03:09.033031] [INFO ] [MAIN ] CMSC: Loaded 5089 existing records. [2025-09-23T18:03:09.078947] [DEBUG] [LOCAL ] CMSA: Loaded 3375 existing records from primary storage. [2025-09-23T18:03:09.103033] [INFO ] [MAIN ] CMSA: Loaded 3375 existing records. [2025-09-23T18:03:09.375700] [DEBUG] [LOCAL ] CMRE: Loaded 35472 existing records from primary storage. [2025-09-23T18:03:09.392124] [INFO ] [MAIN ] CMRE: Loaded 35472 existing records. [2025-09-23T18:03:09.523976] [WARN ] [MAIN ] CMSC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:03:09.567182] [WARN ] [MAIN ] CMSA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:03:09.597486] [INFO ] [MAIN ] CMSC: Wiping existing primary data before full refresh. [2025-09-23T18:03:09.603664] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-09-23T18:03:09.609007] [INFO ] [MAIN ] CMSA: Wiping existing primary data before full refresh. [2025-09-23T18:03:09.620006] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-09-23T18:03:09.630772] [DEBUG] [LOCAL ] CMSC: Deleted primary data file. [2025-09-23T18:03:09.636924] [DEBUG] [LOCAL ] CMS: Loaded 52636 existing records from primary storage. [2025-09-23T18:03:09.636119] [DEBUG] [LOCAL ] CMSA: Deleted primary data file. [2025-09-23T18:03:09.637132] [INFO ] [MAIN ] CMSC: Starting full primary refresh. [2025-09-23T18:03:09.647505] [INFO ] [MAIN ] CMSA: Starting full primary refresh. [2025-09-23T18:03:09.716798] [INFO ] [MAIN ] CMS: Loaded 52636 existing records. [2025-09-23T18:03:09.790525] [WARN ] [MAIN ] CMRE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:03:09.851023] [INFO ] [MAIN ] CMRE: Wiping existing primary data before full refresh. [2025-09-23T18:03:09.940486] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-09-23T18:03:10.028518] [DEBUG] [LOCAL ] CMRE: Deleted primary data file. [2025-09-23T18:03:10.081846] [INFO ] [MAIN ] CMRE: Starting full primary refresh. [2025-09-23T18:03:10.374888] [WARN ] [MAIN ] CMS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:03:10.541311] [INFO ] [MAIN ] CMS: Wiping existing primary data before full refresh. [2025-09-23T18:03:10.592227] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-09-23T18:03:10.768852] [DEBUG] [LOCAL ] CMS: Deleted primary data file. [2025-09-23T18:03:10.854577] [INFO ] [MAIN ] CMS: Starting full primary refresh. [2025-09-23T18:03:11.072349] [INFO ] [REMOTE ] CMSA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:03:11.145043] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2024-12. [2025-09-23T18:03:11.183236] [INFO ] [REMOTE ] CMSC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:03:11.234720] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2024-12. [2025-09-23T18:03:11.300392] [INFO ] [REMOTE ] CMRE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:03:11.306283] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2024-12. [2025-09-23T18:03:11.571233] [INFO ] [REMOTE ] CMS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:03:11.571789] [INFO ] [REMOTE ] CMS: Fetching primary data for 2024-12. [2025-09-23T18:03:11.627490] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-23T18:03:11.629233] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-01. [2025-09-23T18:03:11.857101] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-23T18:03:11.858931] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-01. [2025-09-23T18:03:11.984130] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-23T18:03:11.985974] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-02. [2025-09-23T18:03:12.333182] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-23T18:03:12.338869] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-01. [2025-09-23T18:03:12.454038] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-23T18:03:12.456769] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-02. [2025-09-23T18:03:12.523742] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-23T18:03:12.927699] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-23T18:03:13.002185] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-03. [2025-09-23T18:03:13.191475] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-23T18:03:13.270985] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-23T18:03:13.312894] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-23T18:03:13.802241] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-03. [2025-09-23T18:03:14.567161] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-23T18:03:14.602201] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-04. [2025-09-23T18:03:15.025776] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-23T18:03:15.402234] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-01. [2025-09-23T18:03:16.202183] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-02. [2025-09-23T18:03:16.867309] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-23T18:03:17.002235] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-04. [2025-09-23T18:03:17.084925] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-23T18:03:17.427818] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-23T18:03:17.802215] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-02. [2025-09-23T18:03:18.602215] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-05. [2025-09-23T18:03:19.013739] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-23T18:03:19.345238] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-23T18:03:19.402234] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-06. [2025-09-23T18:03:19.758932] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-23T18:03:20.202271] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-07. [2025-09-23T18:03:20.590554] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-09-23T18:03:21.002255] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-03. [2025-09-23T18:03:21.802260] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-03. [2025-09-23T18:03:22.443631] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-23T18:03:22.602189] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-04. [2025-09-23T18:03:22.856462] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-23T18:03:23.402200] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-05. [2025-09-23T18:03:24.065697] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-23T18:03:24.131471] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-23T18:03:24.202169] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-05. [2025-09-23T18:03:25.002245] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-08. [2025-09-23T18:03:25.802170] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-04. [2025-09-23T18:03:25.837134] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-23T18:03:26.088631] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-23T18:03:26.602258] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-06. [2025-09-23T18:03:27.392557] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-23T18:03:27.402149] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-07. [2025-09-23T18:03:27.710839] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-23T18:03:28.202198] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-09. [2025-09-23T18:03:28.880456] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-23T18:03:29.002209] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-05. [2025-09-23T18:03:29.029463] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-23T18:03:29.031563] [INFO ] [REMOTE ] CMSC: Full fetch complete (7172 records). [2025-09-23T18:03:29.031635] [DEBUG] [VALIDATOR ] CMSC: Validating primary data. [2025-09-23T18:03:29.421456] [DEBUG] [VALIDATOR ] CMSC: All expected trading days are present. [2025-09-23T18:03:29.421577] [DEBUG] [VALIDATOR ] CMSC: Primary data validation passed. [2025-09-23T18:03:29.421867] [INFO ] [MAIN ] CMSC: Fetched primary data is valid. [2025-09-23T18:03:29.421927] [DEBUG] [LOCAL ] CMSC: Saving primary data. [2025-09-23T18:03:29.422611] [DEBUG] [LOCAL ] CMSC: Trimmed 7172 records to 5090 (keeping 200 days of data) [2025-09-23T18:03:29.456535] [DEBUG] [LOCAL ] CMSC: Primary data saved (5090 records). [2025-09-23T18:03:29.456679] [INFO ] [MAIN ] CMSC: Full history saved. [2025-09-23T18:03:29.456822] [INFO ] [MAIN ] Update Progress: 481/2372 symbols completed. CMSC took 21.3s. Estimated remaining: 4h 9m 24s. Rate: 7.6 symbols/min [2025-09-23T18:03:29.675247] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:03:29.675453] [DEBUG] [LOCAL ] CMSD: No existing data file found in primary storage. [2025-09-23T18:03:29.675491] [WARN ] [MAIN ] CMSD: No existing data found, performing full refresh instead. [2025-09-23T18:03:29.675639] [INFO ] [MAIN ] CMSD: Wiping existing primary data before full refresh. [2025-09-23T18:03:29.675728] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-09-23T18:03:29.675820] [DEBUG] [LOCAL ] CMSD: No primary data file found to delete. [2025-09-23T18:03:29.675866] [INFO ] [MAIN ] CMSD: Starting full primary refresh. [2025-09-23T18:03:29.807282] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-08. [2025-09-23T18:03:30.044098] [INFO ] [REMOTE ] CMSD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:03:30.232503] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-23T18:03:30.439550] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-23T18:03:30.602214] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-06. [2025-09-23T18:03:31.402252] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-06. [2025-09-23T18:03:31.638958] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-23T18:03:32.202214] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2024-12. [2025-09-23T18:03:32.747326] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-23T18:03:32.773147] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-23T18:03:33.002241] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-07. [2025-09-23T18:03:33.802206] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-01. [2025-09-23T18:03:34.286832] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-23T18:03:34.602199] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-07. [2025-09-23T18:03:34.942987] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-23T18:03:35.402215] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-08. [2025-09-23T18:03:35.721803] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-23T18:03:36.202210] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-08. [2025-09-23T18:03:36.760613] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-23T18:03:37.002255] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-09. [2025-09-23T18:03:37.660548] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-23T18:03:37.802188] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-09. [2025-09-23T18:03:38.602222] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-09. [2025-09-23T18:03:38.735428] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-23T18:03:38.741301] [INFO ] [REMOTE ] CMRE: Full fetch complete (49470 records). [2025-09-23T18:03:38.741466] [DEBUG] [VALIDATOR ] CMRE: Validating primary data. [2025-09-23T18:03:39.186585] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-23T18:03:39.215243] [DEBUG] [VALIDATOR ] CMRE: All expected trading days are present. [2025-09-23T18:03:39.215346] [DEBUG] [VALIDATOR ] CMRE: Primary data validation passed. [2025-09-23T18:03:39.216083] [INFO ] [MAIN ] CMRE: Fetched primary data is valid. [2025-09-23T18:03:39.216167] [DEBUG] [LOCAL ] CMRE: Saving primary data. [2025-09-23T18:03:39.216485] [INFO ] [REMOTE ] CMS: Full fetch complete (76017 records). [2025-09-23T18:03:39.217019] [DEBUG] [VALIDATOR ] CMS: Validating primary data. [2025-09-23T18:03:39.218017] [DEBUG] [LOCAL ] CMRE: Trimmed 49470 records to 35502 (keeping 200 days of data) [2025-09-23T18:03:39.412900] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-02. [2025-09-23T18:03:39.386793] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-23T18:03:39.422632] [INFO ] [REMOTE ] CMSA: Full fetch complete (5047 records). [2025-09-23T18:03:39.445092] [DEBUG] [VALIDATOR ] CMSA: Validating primary data. [2025-09-23T18:03:40.063724] [DEBUG] [VALIDATOR ] CMS: All expected trading days are present. [2025-09-23T18:03:40.069287] [DEBUG] [VALIDATOR ] CMS: Primary data validation passed. [2025-09-23T18:03:40.078711] [INFO ] [MAIN ] CMS: Fetched primary data is valid. [2025-09-23T18:03:40.092105] [DEBUG] [LOCAL ] CMS: Saving primary data. [2025-09-23T18:03:40.179375] [DEBUG] [LOCAL ] CMS: Trimmed 76017 records to 52611 (keeping 200 days of data) [2025-09-23T18:03:40.180369] [DEBUG] [VALIDATOR ] CMSA: All expected trading days are present. [2025-09-23T18:03:40.180852] [DEBUG] [VALIDATOR ] CMSA: Primary data validation passed. [2025-09-23T18:03:40.181297] [INFO ] [MAIN ] CMSA: Fetched primary data is valid. [2025-09-23T18:03:40.181616] [DEBUG] [LOCAL ] CMSA: Saving primary data. [2025-09-23T18:03:40.183408] [DEBUG] [LOCAL ] CMSA: Trimmed 5047 records to 3391 (keeping 200 days of data) [2025-09-23T18:03:40.305624] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-23T18:03:40.310345] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-03. [2025-09-23T18:03:40.319814] [DEBUG] [LOCAL ] CMSA: Primary data saved (3391 records). [2025-09-23T18:03:40.320917] [INFO ] [MAIN ] CMSA: Full history saved. [2025-09-23T18:03:40.321095] [INFO ] [MAIN ] Update Progress: 482/2372 symbols completed. CMSA took 32.1s. Estimated remaining: 4h 9m 27s. Rate: 7.6 symbols/min [2025-09-23T18:03:40.582221] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:03:40.631893] [DEBUG] [LOCAL ] CMTG: Loaded 37558 existing records from primary storage. [2025-09-23T18:03:40.632938] [INFO ] [MAIN ] CMTG: Loaded 37558 existing records. [2025-09-23T18:03:40.925535] [WARN ] [MAIN ] CMTG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:03:40.928219] [INFO ] [MAIN ] CMTG: Wiping existing primary data before full refresh. [2025-09-23T18:03:40.928664] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-09-23T18:03:40.937860] [DEBUG] [LOCAL ] CMTG: Deleted primary data file. [2025-09-23T18:03:40.938077] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-23T18:03:40.943032] [INFO ] [MAIN ] CMTG: Starting full primary refresh. [2025-09-23T18:03:40.957070] [DEBUG] [LOCAL ] CMRE: Primary data saved (35502 records). [2025-09-23T18:03:40.957251] [INFO ] [MAIN ] CMRE: Full history saved. [2025-09-23T18:03:40.967426] [INFO ] [MAIN ] Update Progress: 483/2372 symbols completed. CMRE took 32.8s. Estimated remaining: 4h 8m 51s. Rate: 7.6 symbols/min [2025-09-23T18:03:41.007235] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-04. [2025-09-23T18:03:41.313003] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:03:41.425629] [DEBUG] [LOCAL ] CMU: Loaded 7353 existing records from primary storage. [2025-09-23T18:03:41.439600] [INFO ] [MAIN ] CMU: Loaded 7353 existing records. [2025-09-23T18:03:41.638482] [INFO ] [REMOTE ] CMTG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:03:41.780982] [WARN ] [MAIN ] CMU: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:03:41.800115] [INFO ] [MAIN ] CMU: Wiping existing primary data before full refresh. [2025-09-23T18:03:41.801077] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-09-23T18:03:41.802291] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2024-12. [2025-09-23T18:03:41.802639] [DEBUG] [LOCAL ] CMU: Deleted primary data file. [2025-09-23T18:03:41.802904] [INFO ] [MAIN ] CMU: Starting full primary refresh. [2025-09-23T18:03:41.925748] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-23T18:03:42.188304] [DEBUG] [LOCAL ] CMS: Primary data saved (52611 records). [2025-09-23T18:03:42.203577] [INFO ] [MAIN ] CMS: Full history saved. [2025-09-23T18:03:42.210059] [INFO ] [MAIN ] Update Progress: 484/2372 symbols completed. CMS took 34.1s. Estimated remaining: 4h 8m 17s. Rate: 7.6 symbols/min [2025-09-23T18:03:42.208773] [INFO ] [REMOTE ] CMU: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:03:42.411531] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:03:42.451065] [DEBUG] [LOCAL ] CNA: Loaded 32761 existing records from primary storage. [2025-09-23T18:03:42.451244] [INFO ] [MAIN ] CNA: Loaded 32761 existing records. [2025-09-23T18:03:42.607376] [INFO ] [REMOTE ] CMU: Fetching primary data for 2024-12. [2025-09-23T18:03:42.637840] [WARN ] [MAIN ] CNA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:03:42.638082] [INFO ] [MAIN ] CNA: Wiping existing primary data before full refresh. [2025-09-23T18:03:42.638132] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-09-23T18:03:42.639066] [DEBUG] [LOCAL ] CNA: Deleted primary data file. [2025-09-23T18:03:42.639129] [INFO ] [MAIN ] CNA: Starting full primary refresh. [2025-09-23T18:03:43.018245] [INFO ] [REMOTE ] CNA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:03:43.075304] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-23T18:03:43.237581] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-23T18:03:43.402181] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-01. [2025-09-23T18:03:44.202202] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-05. [2025-09-23T18:03:44.529009] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-23T18:03:44.670394] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-23T18:03:45.002218] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-06. [2025-09-23T18:03:45.463805] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-23T18:03:45.802269] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-02. [2025-09-23T18:03:46.602259] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-01. [2025-09-23T18:03:47.087030] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-23T18:03:47.195237] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-23T18:03:47.402211] [INFO ] [REMOTE ] CNA: Fetching primary data for 2024-12. [2025-09-23T18:03:48.202193] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-03. [2025-09-23T18:03:48.382247] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-23T18:03:49.002191] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-01. [2025-09-23T18:03:49.760285] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-23T18:03:49.802168] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-02. [2025-09-23T18:03:49.897290] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-23T18:03:50.216317] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-23T18:03:50.602192] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-03. [2025-09-23T18:03:51.098236] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-23T18:03:51.402227] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-07. [2025-09-23T18:03:52.202195] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-04. [2025-09-23T18:03:52.407238] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-23T18:03:53.002189] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-08. [2025-09-23T18:03:53.414989] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-23T18:03:53.604039] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-23T18:03:53.802213] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-02. [2025-09-23T18:03:54.602209] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-09. [2025-09-23T18:03:54.785728] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-23T18:03:55.174110] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-23T18:03:55.175953] [INFO ] [REMOTE ] CMSD: Full fetch complete (12557 records). [2025-09-23T18:03:55.176028] [DEBUG] [VALIDATOR ] CMSD: Validating primary data. [2025-09-23T18:03:55.407273] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-05. [2025-09-23T18:03:55.554270] [DEBUG] [VALIDATOR ] CMSD: All expected trading days are present. [2025-09-23T18:03:55.554350] [DEBUG] [VALIDATOR ] CMSD: Primary data validation passed. [2025-09-23T18:03:55.554660] [INFO ] [MAIN ] CMSD: Fetched primary data is valid. [2025-09-23T18:03:55.554723] [DEBUG] [LOCAL ] CMSD: Saving primary data. [2025-09-23T18:03:55.555211] [DEBUG] [LOCAL ] CMSD: Trimmed 12557 records to 8098 (keeping 200 days of data) [2025-09-23T18:03:55.608916] [DEBUG] [LOCAL ] CMSD: Primary data saved (8098 records). [2025-09-23T18:03:55.609077] [INFO ] [MAIN ] CMSD: Full history saved. [2025-09-23T18:03:55.609157] [INFO ] [MAIN ] Update Progress: 485/2372 symbols completed. CMSD took 26.2s. Estimated remaining: 4h 8m 31s. Rate: 7.6 symbols/min [2025-09-23T18:03:55.780592] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:03:55.833955] [DEBUG] [LOCAL ] CNC: Loaded 53733 existing records from primary storage. [2025-09-23T18:03:55.834110] [INFO ] [MAIN ] CNC: Loaded 53733 existing records. [2025-09-23T18:03:56.030380] [WARN ] [MAIN ] CNC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:03:56.030720] [INFO ] [MAIN ] CNC: Wiping existing primary data before full refresh. [2025-09-23T18:03:56.030798] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-09-23T18:03:56.032289] [DEBUG] [LOCAL ] CNC: Deleted primary data file. [2025-09-23T18:03:56.032353] [INFO ] [MAIN ] CNC: Starting full primary refresh. [2025-09-23T18:03:56.220711] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-04. [2025-09-23T18:03:56.409090] [INFO ] [REMOTE ] CNC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:03:57.002219] [INFO ] [REMOTE ] CNC: Fetching primary data for 2024-12. [2025-09-23T18:03:57.047499] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-23T18:03:57.149536] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-23T18:03:57.802194] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-03. [2025-09-23T18:03:58.602187] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-05. [2025-09-23T18:03:58.860924] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-23T18:03:58.919332] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-23T18:03:58.962929] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-23T18:03:59.402166] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-01. [2025-09-23T18:04:00.202206] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-04. [2025-09-23T18:04:01.011454] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-06. [2025-09-23T18:04:01.037741] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-23T18:04:01.445425] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-23T18:04:01.741718] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-23T18:04:01.802232] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-02. [2025-09-23T18:04:02.602203] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-05. [2025-09-23T18:04:03.173704] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-23T18:04:03.402165] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-03. [2025-09-23T18:04:03.433627] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-23T18:04:04.202254] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-06. [2025-09-23T18:04:04.818100] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-23T18:04:05.002252] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-07. [2025-09-23T18:04:05.486086] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-23T18:04:05.782404] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-23T18:04:05.802145] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-08. [2025-09-23T18:04:06.445701] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-23T18:04:06.602236] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-06. [2025-09-23T18:04:07.402238] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-09. [2025-09-23T18:04:07.987990] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-23T18:04:07.989414] [INFO ] [REMOTE ] CMU: Full fetch complete (9677 records). [2025-09-23T18:04:07.989482] [DEBUG] [VALIDATOR ] CMU: Validating primary data. [2025-09-23T18:04:08.195558] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-23T18:04:08.205330] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-04. [2025-09-23T18:04:08.396557] [DEBUG] [VALIDATOR ] CMU: All expected trading days are present. [2025-09-23T18:04:08.396672] [DEBUG] [VALIDATOR ] CMU: Primary data validation passed. [2025-09-23T18:04:08.396923] [INFO ] [MAIN ] CMU: Fetched primary data is valid. [2025-09-23T18:04:08.397006] [DEBUG] [LOCAL ] CMU: Saving primary data. [2025-09-23T18:04:08.397445] [DEBUG] [LOCAL ] CMU: Trimmed 9677 records to 7381 (keeping 200 days of data) [2025-09-23T18:04:08.439673] [DEBUG] [LOCAL ] CMU: Primary data saved (7381 records). [2025-09-23T18:04:08.439777] [INFO ] [MAIN ] CMU: Full history saved. [2025-09-23T18:04:08.439860] [INFO ] [MAIN ] Update Progress: 486/2372 symbols completed. CMU took 27.5s. Estimated remaining: 4h 8m 42s. Rate: 7.6 symbols/min [2025-09-23T18:04:08.610203] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:04:08.622089] [DEBUG] [LOCAL ] CNF: Loaded 10809 existing records from primary storage. [2025-09-23T18:04:08.622210] [INFO ] [MAIN ] CNF: Loaded 10809 existing records. [2025-09-23T18:04:08.803778] [WARN ] [MAIN ] CNF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:04:08.804084] [INFO ] [MAIN ] CNF: Wiping existing primary data before full refresh. [2025-09-23T18:04:08.804135] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-09-23T18:04:08.804626] [DEBUG] [LOCAL ] CNF: Deleted primary data file. [2025-09-23T18:04:08.804723] [INFO ] [MAIN ] CNF: Starting full primary refresh. [2025-09-23T18:04:09.007423] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-07. [2025-09-23T18:04:09.176931] [INFO ] [REMOTE ] CNF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:04:09.811834] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-07. [2025-09-23T18:04:09.833602] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-23T18:04:10.500416] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-23T18:04:10.602179] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-08. [2025-09-23T18:04:11.015314] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-23T18:04:11.402193] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-08. [2025-09-23T18:04:11.454138] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-23T18:04:12.202198] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-05. [2025-09-23T18:04:12.351898] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-23T18:04:13.002197] [INFO ] [REMOTE ] CNF: Fetching primary data for 2024-12. [2025-09-23T18:04:13.504348] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-23T18:04:13.634050] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-23T18:04:13.802204] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-01. [2025-09-23T18:04:14.160453] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-23T18:04:14.602228] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-09. [2025-09-23T18:04:15.402193] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-06. [2025-09-23T18:04:15.554157] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-23T18:04:15.560403] [INFO ] [REMOTE ] CMTG: Full fetch complete (53087 records). [2025-09-23T18:04:15.560501] [DEBUG] [VALIDATOR ] CMTG: Validating primary data. [2025-09-23T18:04:15.948167] [DEBUG] [VALIDATOR ] CMTG: All expected trading days are present. [2025-09-23T18:04:15.948258] [DEBUG] [VALIDATOR ] CMTG: Primary data validation passed. [2025-09-23T18:04:15.948909] [INFO ] [MAIN ] CMTG: Fetched primary data is valid. [2025-09-23T18:04:15.948973] [DEBUG] [LOCAL ] CMTG: Saving primary data. [2025-09-23T18:04:15.952126] [DEBUG] [LOCAL ] CMTG: Trimmed 53087 records to 37485 (keeping 200 days of data) [2025-09-23T18:04:16.163890] [DEBUG] [LOCAL ] CMTG: Primary data saved (37485 records). [2025-09-23T18:04:16.164033] [INFO ] [MAIN ] CMTG: Full history saved. [2025-09-23T18:04:16.164171] [INFO ] [MAIN ] Update Progress: 487/2372 symbols completed. CMTG took 35.8s. Estimated remaining: 4h 8m 33s. Rate: 7.6 symbols/min [2025-09-23T18:04:16.207266] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-09. [2025-09-23T18:04:16.338589] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:04:16.392933] [DEBUG] [LOCAL ] CNH: Loaded 53562 existing records from primary storage. [2025-09-23T18:04:16.393084] [INFO ] [MAIN ] CNH: Loaded 53562 existing records. [2025-09-23T18:04:16.574610] [WARN ] [MAIN ] CNH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:04:16.574922] [INFO ] [MAIN ] CNH: Wiping existing primary data before full refresh. [2025-09-23T18:04:16.574971] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-09-23T18:04:16.576448] [DEBUG] [LOCAL ] CNH: Deleted primary data file. [2025-09-23T18:04:16.576512] [INFO ] [MAIN ] CNH: Starting full primary refresh. [2025-09-23T18:04:16.954872] [INFO ] [REMOTE ] CNH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:04:17.009784] [INFO ] [REMOTE ] CNH: Fetching primary data for 2024-12. [2025-09-23T18:04:17.036274] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-23T18:04:17.575542] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-23T18:04:17.580842] [INFO ] [REMOTE ] CNA: Full fetch complete (45482 records). [2025-09-23T18:04:17.580966] [DEBUG] [VALIDATOR ] CNA: Validating primary data. [2025-09-23T18:04:17.807565] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-02. [2025-09-23T18:04:17.994102] [DEBUG] [VALIDATOR ] CNA: All expected trading days are present. [2025-09-23T18:04:17.994185] [DEBUG] [VALIDATOR ] CNA: Primary data validation passed. [2025-09-23T18:04:17.994766] [INFO ] [MAIN ] CNA: Fetched primary data is valid. [2025-09-23T18:04:17.994828] [DEBUG] [LOCAL ] CNA: Saving primary data. [2025-09-23T18:04:17.997787] [DEBUG] [LOCAL ] CNA: Trimmed 45482 records to 32752 (keeping 200 days of data) [2025-09-23T18:04:18.191148] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-23T18:04:18.208684] [DEBUG] [LOCAL ] CNA: Primary data saved (32752 records). [2025-09-23T18:04:18.208877] [INFO ] [MAIN ] CNA: Full history saved. [2025-09-23T18:04:18.208968] [INFO ] [MAIN ] Update Progress: 488/2372 symbols completed. CNA took 36.0s. Estimated remaining: 4h 8m 3s. Rate: 7.6 symbols/min [2025-09-23T18:04:18.395899] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:04:18.447594] [DEBUG] [LOCAL ] CNI: Loaded 51660 existing records from primary storage. [2025-09-23T18:04:18.447800] [INFO ] [MAIN ] CNI: Loaded 51660 existing records. [2025-09-23T18:04:18.613393] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-07. [2025-09-23T18:04:18.639147] [WARN ] [MAIN ] CNI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:04:18.639679] [INFO ] [MAIN ] CNI: Wiping existing primary data before full refresh. [2025-09-23T18:04:18.639822] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-09-23T18:04:18.641431] [DEBUG] [LOCAL ] CNI: Deleted primary data file. [2025-09-23T18:04:18.641500] [INFO ] [MAIN ] CNI: Starting full primary refresh. [2025-09-23T18:04:18.936847] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-23T18:04:19.061013] [INFO ] [REMOTE ] CNI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:04:19.402213] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-01. [2025-09-23T18:04:20.202220] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-03. [2025-09-23T18:04:20.735054] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-23T18:04:21.002217] [INFO ] [REMOTE ] CNI: Fetching primary data for 2024-12. [2025-09-23T18:04:21.039336] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-23T18:04:21.155416] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-09-23T18:04:21.802263] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-04. [2025-09-23T18:04:22.199794] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-23T18:04:22.477093] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-23T18:04:22.602212] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-01. [2025-09-23T18:04:23.402254] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-08. [2025-09-23T18:04:24.202207] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-05. [2025-09-23T18:04:24.505579] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-23T18:04:24.775914] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-23T18:04:25.002237] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-02. [2025-09-23T18:04:25.144220] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-23T18:04:25.802205] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-06. [2025-09-23T18:04:26.338943] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-23T18:04:26.400773] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-23T18:04:26.602212] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-03. [2025-09-23T18:04:27.402194] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-02. [2025-09-23T18:04:28.041015] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-23T18:04:28.202183] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-04. [2025-09-23T18:04:28.802779] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-23T18:04:29.002186] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-09. [2025-09-23T18:04:29.609198] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-23T18:04:29.802206] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-07. [2025-09-23T18:04:30.380235] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-23T18:04:30.602214] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-03. [2025-09-23T18:04:31.381617] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-09-23T18:04:31.390789] [INFO ] [REMOTE ] CNC: Full fetch complete (77671 records). [2025-09-23T18:04:31.390969] [DEBUG] [VALIDATOR ] CNC: Validating primary data. [2025-09-23T18:04:31.407320] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-05. [2025-09-23T18:04:31.819084] [DEBUG] [VALIDATOR ] CNC: All expected trading days are present. [2025-09-23T18:04:31.819204] [DEBUG] [VALIDATOR ] CNC: Primary data validation passed. [2025-09-23T18:04:31.822577] [INFO ] [MAIN ] CNC: Fetched primary data is valid. [2025-09-23T18:04:31.822670] [DEBUG] [LOCAL ] CNC: Saving primary data. [2025-09-23T18:04:31.828085] [DEBUG] [LOCAL ] CNC: Trimmed 77671 records to 53737 (keeping 200 days of data) [2025-09-23T18:04:32.091898] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-23T18:04:32.195348] [DEBUG] [LOCAL ] CNC: Primary data saved (53737 records). [2025-09-23T18:04:32.195486] [INFO ] [MAIN ] CNC: Full history saved. [2025-09-23T18:04:32.195593] [INFO ] [MAIN ] Update Progress: 489/2372 symbols completed. CNC took 36.6s. Estimated remaining: 4h 8m 18s. Rate: 7.6 symbols/min [2025-09-23T18:04:32.207304] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-04. [2025-09-23T18:04:32.372628] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:04:32.427772] [DEBUG] [LOCAL ] CNK: Loaded 52908 existing records from primary storage. [2025-09-23T18:04:32.427927] [INFO ] [MAIN ] CNK: Loaded 52908 existing records. [2025-09-23T18:04:32.617006] [WARN ] [MAIN ] CNK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:04:32.617346] [INFO ] [MAIN ] CNK: Wiping existing primary data before full refresh. [2025-09-23T18:04:32.617429] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-09-23T18:04:32.618881] [DEBUG] [LOCAL ] CNK: Deleted primary data file. [2025-09-23T18:04:32.618952] [INFO ] [MAIN ] CNK: Starting full primary refresh. [2025-09-23T18:04:33.005590] [INFO ] [REMOTE ] CNK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:04:33.002501] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-08. [2025-09-23T18:04:33.092849] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-23T18:04:33.689476] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-23T18:04:33.742259] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-23T18:04:33.802190] [INFO ] [REMOTE ] CNK: Fetching primary data for 2024-12. [2025-09-23T18:04:34.602214] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-09. [2025-09-23T18:04:35.276896] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-23T18:04:35.402150] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-01. [2025-09-23T18:04:35.556828] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-23T18:04:35.559498] [INFO ] [REMOTE ] CNF: Full fetch complete (12663 records). [2025-09-23T18:04:35.559681] [DEBUG] [VALIDATOR ] CNF: Validating primary data. [2025-09-23T18:04:35.995481] [DEBUG] [VALIDATOR ] CNF: All expected trading days are present. [2025-09-23T18:04:35.995563] [DEBUG] [VALIDATOR ] CNF: Primary data validation passed. [2025-09-23T18:04:35.995917] [INFO ] [MAIN ] CNF: Fetched primary data is valid. [2025-09-23T18:04:35.995981] [DEBUG] [LOCAL ] CNF: Saving primary data. [2025-09-23T18:04:35.996529] [DEBUG] [LOCAL ] CNF: Trimmed 12663 records to 10858 (keeping 200 days of data) [2025-09-23T18:04:36.061614] [DEBUG] [LOCAL ] CNF: Primary data saved (10858 records). [2025-09-23T18:04:36.061782] [INFO ] [MAIN ] CNF: Full history saved. [2025-09-23T18:04:36.061889] [INFO ] [MAIN ] Update Progress: 490/2372 symbols completed. CNF took 27.6s. Estimated remaining: 4h 7m 55s. Rate: 7.6 symbols/min [2025-09-23T18:04:36.209071] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-05. [2025-09-23T18:04:36.243243] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:04:36.313349] [DEBUG] [LOCAL ] CNM: Loaded 50963 existing records from primary storage. [2025-09-23T18:04:36.313586] [INFO ] [MAIN ] CNM: Loaded 50963 existing records. [2025-09-23T18:04:36.501706] [WARN ] [MAIN ] CNM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:04:36.502061] [INFO ] [MAIN ] CNM: Wiping existing primary data before full refresh. [2025-09-23T18:04:36.502149] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-09-23T18:04:36.503487] [DEBUG] [LOCAL ] CNM: Deleted primary data file. [2025-09-23T18:04:36.503565] [INFO ] [MAIN ] CNM: Starting full primary refresh. [2025-09-23T18:04:36.869423] [INFO ] [REMOTE ] CNM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:04:37.002192] [INFO ] [REMOTE ] CNM: Fetching primary data for 2024-12. [2025-09-23T18:04:37.138149] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-23T18:04:37.802159] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-06. [2025-09-23T18:04:37.922115] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-23T18:04:38.602211] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-02. [2025-09-23T18:04:38.702371] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-23T18:04:39.256085] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-23T18:04:39.402182] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-06. [2025-09-23T18:04:39.919498] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-23T18:04:40.202198] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-03. [2025-09-23T18:04:41.002163] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-01. [2025-09-23T18:04:41.248840] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-23T18:04:41.691433] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-23T18:04:41.802172] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-04. [2025-09-23T18:04:42.246295] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-23T18:04:42.602187] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-07. [2025-09-23T18:04:43.402206] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-07. [2025-09-23T18:04:43.653527] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-23T18:04:44.202210] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-05. [2025-09-23T18:04:44.278396] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-23T18:04:44.872890] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-23T18:04:45.002216] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-02. [2025-09-23T18:04:45.765966] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-23T18:04:45.802161] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-06. [2025-09-23T18:04:46.205336] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-23T18:04:46.602203] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-03. [2025-09-23T18:04:47.402252] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-08. [2025-09-23T18:04:47.570984] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-23T18:04:47.893521] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-23T18:04:48.202207] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-04. [2025-09-23T18:04:48.878386] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-23T18:04:49.002201] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-09. [2025-09-23T18:04:49.802221] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-08. [2025-09-23T18:04:50.047601] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-23T18:04:50.455257] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-23T18:04:50.470717] [INFO ] [REMOTE ] CNI: Full fetch complete (74305 records). [2025-09-23T18:04:50.471221] [DEBUG] [VALIDATOR ] CNI: Validating primary data. [2025-09-23T18:04:50.476460] [FATAL] [VALIDATOR ] CNI: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:04:50.476616] [FATAL] [MAIN ] CNI: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:04:50.476708] [WARN ] [MAIN ] CNI: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:04:50.476859] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-09-23T18:04:50.476959] [DEBUG] [LOCAL ] CNI: No primary data file found to delete. [2025-09-23T18:04:50.477050] [INFO ] [LOCAL ] CNI: Starting deletion of derivative data. [2025-09-23T18:04:50.477846] [DEBUG] [LOCAL ] CNI: Deleted derivative data file. [2025-09-23T18:04:50.478009] [INFO ] [MAIN ] Update Progress: 491/2372 symbols completed. CNI took 32.3s. Estimated remaining: 4h 8m 12s. Rate: 7.6 symbols/min [2025-09-23T18:04:50.607282] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-05. [2025-09-23T18:04:50.663165] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:04:50.704386] [DEBUG] [LOCAL ] CNMD: Loaded 32447 existing records from primary storage. [2025-09-23T18:04:50.704540] [INFO ] [MAIN ] CNMD: Loaded 32447 existing records. [2025-09-23T18:04:50.897198] [WARN ] [MAIN ] CNMD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:04:50.897477] [INFO ] [MAIN ] CNMD: Wiping existing primary data before full refresh. [2025-09-23T18:04:50.897526] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-09-23T18:04:50.898532] [DEBUG] [LOCAL ] CNMD: Deleted primary data file. [2025-09-23T18:04:50.898594] [INFO ] [MAIN ] CNMD: Starting full primary refresh. [2025-09-23T18:04:51.292167] [INFO ] [REMOTE ] CNMD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:04:51.368196] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-23T18:04:51.402218] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2024-12. [2025-09-23T18:04:52.202182] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-07. [2025-09-23T18:04:52.236076] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-23T18:04:52.450794] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-23T18:04:53.002197] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-09. [2025-09-23T18:04:53.615909] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-23T18:04:53.802207] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-01. [2025-09-23T18:04:54.366715] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-23T18:04:54.375806] [INFO ] [REMOTE ] CNH: Full fetch complete (77535 records). [2025-09-23T18:04:54.375958] [DEBUG] [VALIDATOR ] CNH: Validating primary data. [2025-09-23T18:04:54.607316] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-08. [2025-09-23T18:04:54.808413] [DEBUG] [VALIDATOR ] CNH: All expected trading days are present. [2025-09-23T18:04:54.808605] [DEBUG] [VALIDATOR ] CNH: Primary data validation passed. [2025-09-23T18:04:54.809562] [INFO ] [MAIN ] CNH: Fetched primary data is valid. [2025-09-23T18:04:54.809633] [DEBUG] [LOCAL ] CNH: Saving primary data. [2025-09-23T18:04:54.811870] [DEBUG] [LOCAL ] CNH: Trimmed 77535 records to 53561 (keeping 200 days of data) [2025-09-23T18:04:55.061531] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-23T18:04:55.176858] [DEBUG] [LOCAL ] CNH: Primary data saved (53561 records). [2025-09-23T18:04:55.177007] [INFO ] [MAIN ] CNH: Full history saved. [2025-09-23T18:04:55.177107] [INFO ] [MAIN ] Update Progress: 492/2372 symbols completed. CNH took 39.0s. Estimated remaining: 4h 7m 52s. Rate: 7.6 symbols/min [2025-09-23T18:04:55.350507] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:04:55.351735] [DEBUG] [LOCAL ] CNNE: No existing data file found in primary storage. [2025-09-23T18:04:55.351788] [WARN ] [MAIN ] CNNE: No existing data found, performing full refresh instead. [2025-09-23T18:04:55.352180] [INFO ] [MAIN ] CNNE: Wiping existing primary data before full refresh. [2025-09-23T18:04:55.352231] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-09-23T18:04:55.352274] [DEBUG] [LOCAL ] CNNE: No primary data file found to delete. [2025-09-23T18:04:55.352308] [INFO ] [MAIN ] CNNE: Starting full primary refresh. [2025-09-23T18:04:55.409251] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-06. [2025-09-23T18:04:55.735291] [INFO ] [REMOTE ] CNNE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:04:56.203982] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-02. [2025-09-23T18:04:56.209940] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-23T18:04:57.002173] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-09. [2025-09-23T18:04:57.157475] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-23T18:04:57.235875] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-23T18:04:57.802203] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2024-12. [2025-09-23T18:04:58.382628] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-23T18:04:58.391281] [INFO ] [REMOTE ] CNK: Full fetch complete (75626 records). [2025-09-23T18:04:58.391403] [DEBUG] [VALIDATOR ] CNK: Validating primary data. [2025-09-23T18:04:58.607522] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-03. [2025-09-23T18:04:58.792847] [DEBUG] [VALIDATOR ] CNK: All expected trading days are present. [2025-09-23T18:04:58.793026] [DEBUG] [VALIDATOR ] CNK: Primary data validation passed. [2025-09-23T18:04:58.793975] [INFO ] [MAIN ] CNK: Fetched primary data is valid. [2025-09-23T18:04:58.794093] [DEBUG] [LOCAL ] CNK: Saving primary data. [2025-09-23T18:04:58.809686] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-23T18:04:58.815575] [DEBUG] [LOCAL ] CNK: Trimmed 75626 records to 52903 (keeping 200 days of data) [2025-09-23T18:04:59.143394] [DEBUG] [LOCAL ] CNK: Primary data saved (52903 records). [2025-09-23T18:04:59.143532] [INFO ] [MAIN ] CNK: Full history saved. [2025-09-23T18:04:59.143627] [INFO ] [MAIN ] Update Progress: 493/2372 symbols completed. CNK took 26.9s. Estimated remaining: 4h 7m 29s. Rate: 7.6 symbols/min [2025-09-23T18:04:59.312848] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:04:59.356434] [DEBUG] [LOCAL ] CNO: Loaded 41486 existing records from primary storage. [2025-09-23T18:04:59.356584] [INFO ] [MAIN ] CNO: Loaded 41486 existing records. [2025-09-23T18:04:59.410737] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-07. [2025-09-23T18:04:59.539911] [WARN ] [MAIN ] CNO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:04:59.540188] [INFO ] [MAIN ] CNO: Wiping existing primary data before full refresh. [2025-09-23T18:04:59.540237] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-09-23T18:04:59.541532] [DEBUG] [LOCAL ] CNO: Deleted primary data file. [2025-09-23T18:04:59.541593] [INFO ] [MAIN ] CNO: Starting full primary refresh. [2025-09-23T18:05:00.017396] [INFO ] [REMOTE ] CNO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:05:00.074554] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-23T18:05:00.202263] [INFO ] [REMOTE ] CNO: Fetching primary data for 2024-12. [2025-09-23T18:05:01.002227] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-04. [2025-09-23T18:05:01.244601] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-23T18:05:01.486813] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-23T18:05:01.802359] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-08. [2025-09-23T18:05:02.312797] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-23T18:05:02.602221] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-05. [2025-09-23T18:05:03.082033] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-23T18:05:03.402252] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-01. [2025-09-23T18:05:03.690103] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-23T18:05:04.202211] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-01. [2025-09-23T18:05:04.939416] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-23T18:05:05.002190] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-09. [2025-09-23T18:05:05.052712] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-23T18:05:05.802237] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-02. [2025-09-23T18:05:06.602230] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-06. [2025-09-23T18:05:06.686634] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-23T18:05:06.695288] [INFO ] [REMOTE ] CNM: Full fetch complete (73237 records). [2025-09-23T18:05:06.695424] [DEBUG] [VALIDATOR ] CNM: Validating primary data. [2025-09-23T18:05:06.696160] [FATAL] [VALIDATOR ] CNM: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:05:06.696251] [FATAL] [MAIN ] CNM: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:05:06.696294] [WARN ] [MAIN ] CNM: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:05:06.696333] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-09-23T18:05:06.696390] [DEBUG] [LOCAL ] CNM: No primary data file found to delete. [2025-09-23T18:05:06.696425] [INFO ] [LOCAL ] CNM: Starting deletion of derivative data. [2025-09-23T18:05:06.696827] [DEBUG] [LOCAL ] CNM: Deleted derivative data file. [2025-09-23T18:05:06.696936] [INFO ] [MAIN ] Update Progress: 494/2372 symbols completed. CNM took 30.6s. Estimated remaining: 4h 7m 20s. Rate: 7.6 symbols/min [2025-09-23T18:05:06.865959] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:05:06.921010] [DEBUG] [LOCAL ] CNP: Loaded 53469 existing records from primary storage. [2025-09-23T18:05:06.921164] [INFO ] [MAIN ] CNP: Loaded 53469 existing records. [2025-09-23T18:05:07.110514] [WARN ] [MAIN ] CNP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:05:07.111062] [INFO ] [MAIN ] CNP: Wiping existing primary data before full refresh. [2025-09-23T18:05:07.111134] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-09-23T18:05:07.113693] [DEBUG] [LOCAL ] CNP: Deleted primary data file. [2025-09-23T18:05:07.113758] [INFO ] [MAIN ] CNP: Starting full primary refresh. [2025-09-23T18:05:07.300302] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-23T18:05:07.414319] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-03. [2025-09-23T18:05:07.557590] [INFO ] [REMOTE ] CNP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:05:07.602199] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-23T18:05:08.202254] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-07. [2025-09-23T18:05:08.752247] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-23T18:05:09.002266] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-04. [2025-09-23T18:05:09.238401] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-23T18:05:09.802271] [INFO ] [REMOTE ] CNP: Fetching primary data for 2024-12. [2025-09-23T18:05:10.229373] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-23T18:05:10.602285] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-08. [2025-09-23T18:05:11.402217] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-05. [2025-09-23T18:05:11.614131] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-23T18:05:11.684008] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-23T18:05:12.202231] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-09. [2025-09-23T18:05:12.579315] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-23T18:05:13.002199] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-01. [2025-09-23T18:05:13.633415] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-23T18:05:13.638639] [INFO ] [REMOTE ] CNMD: Full fetch complete (46929 records). [2025-09-23T18:05:13.638795] [DEBUG] [VALIDATOR ] CNMD: Validating primary data. [2025-09-23T18:05:13.806248] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-02. [2025-09-23T18:05:14.028160] [DEBUG] [VALIDATOR ] CNMD: All expected trading days are present. [2025-09-23T18:05:14.028243] [DEBUG] [VALIDATOR ] CNMD: Primary data validation passed. [2025-09-23T18:05:14.028880] [INFO ] [MAIN ] CNMD: Fetched primary data is valid. [2025-09-23T18:05:14.028944] [DEBUG] [LOCAL ] CNMD: Saving primary data. [2025-09-23T18:05:14.030712] [DEBUG] [LOCAL ] CNMD: Trimmed 46929 records to 32416 (keeping 200 days of data) [2025-09-23T18:05:14.250857] [DEBUG] [LOCAL ] CNMD: Primary data saved (32416 records). [2025-09-23T18:05:14.251034] [INFO ] [MAIN ] CNMD: Full history saved. [2025-09-23T18:05:14.251147] [INFO ] [MAIN ] Update Progress: 495/2372 symbols completed. CNMD took 23.8s. Estimated remaining: 4h 7m 10s. Rate: 7.6 symbols/min [2025-09-23T18:05:14.433305] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:05:14.463584] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-23T18:05:14.527984] [DEBUG] [LOCAL ] CNQ: Loaded 53582 existing records from primary storage. [2025-09-23T18:05:14.528152] [INFO ] [MAIN ] CNQ: Loaded 53582 existing records. [2025-09-23T18:05:14.607309] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-06. [2025-09-23T18:05:14.728131] [WARN ] [MAIN ] CNQ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:05:14.728381] [INFO ] [MAIN ] CNQ: Wiping existing primary data before full refresh. [2025-09-23T18:05:14.728429] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-09-23T18:05:14.729877] [DEBUG] [LOCAL ] CNQ: Deleted primary data file. [2025-09-23T18:05:14.729940] [INFO ] [MAIN ] CNQ: Starting full primary refresh. [2025-09-23T18:05:15.074462] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-23T18:05:15.120224] [INFO ] [REMOTE ] CNQ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:05:15.402245] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2024-12. [2025-09-23T18:05:15.756772] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-23T18:05:16.202231] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-02. [2025-09-23T18:05:17.002152] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-07. [2025-09-23T18:05:17.092452] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-23T18:05:17.594048] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-23T18:05:17.802202] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-03. [2025-09-23T18:05:18.247546] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-23T18:05:18.602210] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-08. [2025-09-23T18:05:19.402176] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-01. [2025-09-23T18:05:19.502102] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-23T18:05:19.666380] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-23T18:05:20.202228] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-04. [2025-09-23T18:05:21.002189] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-03. [2025-09-23T18:05:21.234911] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-23T18:05:21.766852] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-23T18:05:21.802162] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-05. [2025-09-23T18:05:22.196854] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-23T18:05:22.602197] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-09. [2025-09-23T18:05:23.402204] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-02. [2025-09-23T18:05:23.596624] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-23T18:05:23.921477] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-23T18:05:23.928566] [INFO ] [REMOTE ] CNO: Full fetch complete (60564 records). [2025-09-23T18:05:23.928743] [DEBUG] [VALIDATOR ] CNO: Validating primary data. [2025-09-23T18:05:24.207317] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-04. [2025-09-23T18:05:24.327533] [DEBUG] [VALIDATOR ] CNO: All expected trading days are present. [2025-09-23T18:05:24.327621] [DEBUG] [VALIDATOR ] CNO: Primary data validation passed. [2025-09-23T18:05:24.328407] [INFO ] [MAIN ] CNO: Fetched primary data is valid. [2025-09-23T18:05:24.328467] [DEBUG] [LOCAL ] CNO: Saving primary data. [2025-09-23T18:05:24.329825] [DEBUG] [LOCAL ] CNO: Trimmed 60564 records to 41431 (keeping 200 days of data) [2025-09-23T18:05:24.586682] [DEBUG] [LOCAL ] CNO: Primary data saved (41431 records). [2025-09-23T18:05:24.586831] [INFO ] [MAIN ] CNO: Full history saved. [2025-09-23T18:05:24.586923] [INFO ] [MAIN ] Update Progress: 496/2372 symbols completed. CNO took 25.4s. Estimated remaining: 4h 7m 12s. Rate: 7.6 symbols/min [2025-09-23T18:05:24.762393] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:05:24.762598] [DEBUG] [LOCAL ] CNR: No existing data file found in primary storage. [2025-09-23T18:05:24.762698] [WARN ] [MAIN ] CNR: No existing data found, performing full refresh instead. [2025-09-23T18:05:24.763089] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-09-23T18:05:24.763175] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-09-23T18:05:24.763395] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-09-23T18:05:24.763574] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-09-23T18:05:25.009929] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-06. [2025-09-23T18:05:25.078946] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-23T18:05:25.166788] [INFO ] [REMOTE ] CNR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:05:25.381465] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-23T18:05:25.802225] [INFO ] [REMOTE ] CNR: Fetching primary data for 2024-12. [2025-09-23T18:05:26.008563] [DEBUG] [REMOTE ] CNR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:05:26.009061] [WARN ] [REMOTE ] CNR: No data returned for month 2024-12 [2025-09-23T18:05:26.602187] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-05. [2025-09-23T18:05:26.794490] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-23T18:05:27.402669] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-03. [2025-09-23T18:05:27.451217] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-23T18:05:28.202211] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-01. [2025-09-23T18:05:28.943154] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-23T18:05:29.002170] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-04. [2025-09-23T18:05:29.101313] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-23T18:05:29.802238] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-02. [2025-09-23T18:05:30.499105] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-23T18:05:30.602211] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-06. [2025-09-23T18:05:31.402226] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-05. [2025-09-23T18:05:31.572449] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-23T18:05:31.601792] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-23T18:05:32.202203] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-03. [2025-09-23T18:05:32.788555] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-23T18:05:33.002217] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-06. [2025-09-23T18:05:33.802180] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-07. [2025-09-23T18:05:33.899850] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-23T18:05:34.317475] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-23T18:05:34.602192] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-04. [2025-09-23T18:05:35.402169] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-07. [2025-09-23T18:05:35.455707] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-23T18:05:35.861453] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-23T18:05:36.202213] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-05. [2025-09-23T18:05:36.974551] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-23T18:05:37.002167] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-08. [2025-09-23T18:05:37.435962] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-23T18:05:37.802216] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-07. [2025-09-23T18:05:38.482903] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-23T18:05:38.602186] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-08. [2025-09-23T18:05:39.402211] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-06. [2025-09-23T18:05:39.576316] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-23T18:05:39.984717] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-23T18:05:40.202204] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-09. [2025-09-23T18:05:40.795031] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-23T18:05:41.002193] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-07. [2025-09-23T18:05:41.802247] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-09. [2025-09-23T18:05:41.906836] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-23T18:05:41.917090] [INFO ] [REMOTE ] CNP: Full fetch complete (77361 records). [2025-09-23T18:05:41.917394] [DEBUG] [VALIDATOR ] CNP: Validating primary data. [2025-09-23T18:05:42.339425] [DEBUG] [VALIDATOR ] CNP: All expected trading days are present. [2025-09-23T18:05:42.339630] [DEBUG] [VALIDATOR ] CNP: Primary data validation passed. [2025-09-23T18:05:42.340684] [INFO ] [MAIN ] CNP: Fetched primary data is valid. [2025-09-23T18:05:42.340804] [DEBUG] [LOCAL ] CNP: Saving primary data. [2025-09-23T18:05:42.352239] [DEBUG] [LOCAL ] CNP: Trimmed 77361 records to 53469 (keeping 200 days of data) [2025-09-23T18:05:42.370248] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-23T18:05:42.603724] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-08. [2025-09-23T18:05:42.717410] [DEBUG] [LOCAL ] CNP: Primary data saved (53469 records). [2025-09-23T18:05:42.717559] [INFO ] [MAIN ] CNP: Full history saved. [2025-09-23T18:05:42.717686] [INFO ] [MAIN ] Update Progress: 497/2372 symbols completed. CNP took 36.0s. Estimated remaining: 4h 7m 42s. Rate: 7.6 symbols/min [2025-09-23T18:05:42.891387] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:05:42.911789] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-23T18:05:42.918507] [INFO ] [REMOTE ] CNNE: Full fetch complete (49199 records). [2025-09-23T18:05:42.918627] [DEBUG] [VALIDATOR ] CNNE: Validating primary data. [2025-09-23T18:05:43.051701] [DEBUG] [LOCAL ] CNS: Loaded 20981 existing records from primary storage. [2025-09-23T18:05:43.062190] [INFO ] [MAIN ] CNS: Loaded 20981 existing records. [2025-09-23T18:05:43.404164] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-08. [2025-09-23T18:05:43.459850] [WARN ] [MAIN ] CNS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:05:43.499628] [INFO ] [MAIN ] CNS: Wiping existing primary data before full refresh. [2025-09-23T18:05:43.512867] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-09-23T18:05:43.516444] [DEBUG] [VALIDATOR ] CNNE: All expected trading days are present. [2025-09-23T18:05:43.516611] [DEBUG] [VALIDATOR ] CNNE: Primary data validation passed. [2025-09-23T18:05:43.517342] [INFO ] [MAIN ] CNNE: Fetched primary data is valid. [2025-09-23T18:05:43.517396] [DEBUG] [LOCAL ] CNNE: Saving primary data. [2025-09-23T18:05:43.517555] [DEBUG] [LOCAL ] CNS: Deleted primary data file. [2025-09-23T18:05:43.518160] [INFO ] [MAIN ] CNS: Starting full primary refresh. [2025-09-23T18:05:43.584914] [DEBUG] [LOCAL ] CNNE: Trimmed 49199 records to 36888 (keeping 200 days of data) [2025-09-23T18:05:43.994526] [INFO ] [REMOTE ] CNS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:05:44.130616] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-23T18:05:44.163895] [DEBUG] [LOCAL ] CNNE: Primary data saved (36888 records). [2025-09-23T18:05:44.164038] [INFO ] [MAIN ] CNNE: Full history saved. [2025-09-23T18:05:44.164127] [INFO ] [MAIN ] Update Progress: 498/2372 symbols completed. CNNE took 49.0s. Estimated remaining: 4h 7m 10s. Rate: 7.6 symbols/min [2025-09-23T18:05:44.207569] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-09. [2025-09-23T18:05:44.339491] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:05:44.388837] [DEBUG] [LOCAL ] CNX: Loaded 51393 existing records from primary storage. [2025-09-23T18:05:44.388987] [INFO ] [MAIN ] CNX: Loaded 51393 existing records. [2025-09-23T18:05:44.568421] [WARN ] [MAIN ] CNX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:05:44.568717] [INFO ] [MAIN ] CNX: Wiping existing primary data before full refresh. [2025-09-23T18:05:44.568798] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-09-23T18:05:44.569986] [DEBUG] [LOCAL ] CNX: Deleted primary data file. [2025-09-23T18:05:44.570048] [INFO ] [MAIN ] CNX: Starting full primary refresh. [2025-09-23T18:05:44.937835] [INFO ] [REMOTE ] CNX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:05:45.002157] [INFO ] [REMOTE ] CNX: Fetching primary data for 2024-12. [2025-09-23T18:05:45.029914] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-23T18:05:45.688228] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-23T18:05:45.697288] [INFO ] [REMOTE ] CNQ: Full fetch complete (77543 records). [2025-09-23T18:05:45.697460] [DEBUG] [VALIDATOR ] CNQ: Validating primary data. [2025-09-23T18:05:45.807105] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-09. [2025-09-23T18:05:46.167031] [DEBUG] [VALIDATOR ] CNQ: All expected trading days are present. [2025-09-23T18:05:46.167157] [DEBUG] [VALIDATOR ] CNQ: Primary data validation passed. [2025-09-23T18:05:46.168115] [INFO ] [MAIN ] CNQ: Fetched primary data is valid. [2025-09-23T18:05:46.168183] [DEBUG] [LOCAL ] CNQ: Saving primary data. [2025-09-23T18:05:46.169789] [DEBUG] [LOCAL ] CNQ: Trimmed 77543 records to 53582 (keeping 200 days of data) [2025-09-23T18:05:46.426552] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-23T18:05:46.555711] [DEBUG] [LOCAL ] CNQ: Primary data saved (53582 records). [2025-09-23T18:05:46.555872] [INFO ] [MAIN ] CNQ: Full history saved. [2025-09-23T18:05:46.555974] [INFO ] [MAIN ] Update Progress: 499/2372 symbols completed. CNQ took 32.3s. Estimated remaining: 4h 6m 41s. Rate: 7.6 symbols/min [2025-09-23T18:05:46.607399] [INFO ] [REMOTE ] CNS: Fetching primary data for 2024-12. [2025-09-23T18:05:46.738908] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:05:46.739402] [DEBUG] [LOCAL ] CODI: No existing data file found in primary storage. [2025-09-23T18:05:46.739458] [WARN ] [MAIN ] CODI: No existing data found, performing full refresh instead. [2025-09-23T18:05:46.739599] [INFO ] [MAIN ] CODI: Wiping existing primary data before full refresh. [2025-09-23T18:05:46.739663] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-09-23T18:05:46.739732] [DEBUG] [LOCAL ] CODI: No primary data file found to delete. [2025-09-23T18:05:46.739767] [INFO ] [MAIN ] CODI: Starting full primary refresh. [2025-09-23T18:05:47.095243] [INFO ] [REMOTE ] CODI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:05:47.374552] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-23T18:05:47.381427] [INFO ] [REMOTE ] CNR: Full fetch complete (55854 records). [2025-09-23T18:05:47.381532] [DEBUG] [VALIDATOR ] CNR: Validating primary data. [2025-09-23T18:05:47.413123] [INFO ] [REMOTE ] CODI: Fetching primary data for 2024-12. [2025-09-23T18:05:47.577988] [WARN ] [VALIDATOR ] CNR: Validation failed - insufficient historical data. Have 173 unique days, need 200 days [2025-09-23T18:05:47.578550] [FATAL] [MAIN ] CNR: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:05:47.578627] [WARN ] [MAIN ] CNR: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:05:47.578720] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-09-23T18:05:47.578788] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-09-23T18:05:47.578824] [INFO ] [LOCAL ] CNR: Starting deletion of derivative data. [2025-09-23T18:05:47.578864] [DEBUG] [LOCAL ] CNR: No derivative data file found to delete. [2025-09-23T18:05:47.578923] [INFO ] [MAIN ] Update Progress: 500/2372 symbols completed. CNR took 23.0s. Estimated remaining: 4h 6m 8s. Rate: 7.6 symbols/min [2025-09-23T18:05:47.748313] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:05:47.806081] [DEBUG] [LOCAL ] COF: Loaded 53611 existing records from primary storage. [2025-09-23T18:05:47.806283] [INFO ] [MAIN ] COF: Loaded 53611 existing records. [2025-09-23T18:05:48.004638] [WARN ] [MAIN ] COF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:05:48.005121] [INFO ] [MAIN ] COF: Wiping existing primary data before full refresh. [2025-09-23T18:05:48.005203] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-09-23T18:05:48.015555] [DEBUG] [LOCAL ] COF: Deleted primary data file. [2025-09-23T18:05:48.015683] [INFO ] [MAIN ] COF: Starting full primary refresh. [2025-09-23T18:05:48.048835] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-23T18:05:48.209346] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-01. [2025-09-23T18:05:48.391920] [INFO ] [REMOTE ] COF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:05:48.405549] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-23T18:05:49.002180] [INFO ] [REMOTE ] COF: Fetching primary data for 2024-12. [2025-09-23T18:05:49.802175] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-01. [2025-09-23T18:05:50.199620] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-23T18:05:50.558111] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-23T18:05:50.587317] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-23T18:05:50.602156] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-01. [2025-09-23T18:05:51.402149] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-01. [2025-09-23T18:05:51.423975] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-23T18:05:52.202193] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-02. [2025-09-23T18:05:52.789538] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-23T18:05:53.002166] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-02. [2025-09-23T18:05:53.027233] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-23T18:05:53.802223] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-02. [2025-09-23T18:05:54.376150] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-23T18:05:54.602282] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-03. [2025-09-23T18:05:54.838780] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-23T18:05:55.402201] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-03. [2025-09-23T18:05:56.194041] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-23T18:05:56.202133] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-04. [2025-09-23T18:05:56.730609] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-23T18:05:57.002399] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-04. [2025-09-23T18:05:57.091785] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-23T18:05:57.802204] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-05. [2025-09-23T18:05:58.602267] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-02. [2025-09-23T18:05:58.752526] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-23T18:05:58.910445] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-23T18:05:59.402220] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-06. [2025-09-23T18:05:59.966897] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-23T18:06:00.202248] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-03. [2025-09-23T18:06:00.380332] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-23T18:06:01.002220] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-05. [2025-09-23T18:06:01.802190] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-03. [2025-09-23T18:06:02.259401] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-23T18:06:02.602233] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-07. [2025-09-23T18:06:03.402229] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-04. [2025-09-23T18:06:03.920768] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-05 (2.92 seconds). [2025-09-23T18:06:04.202191] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-06. [2025-09-23T18:06:04.413856] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-03 (2.61 seconds). [2025-09-23T18:06:04.988190] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-09-23T18:06:05.002142] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-08. [2025-09-23T18:06:05.383804] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-23T18:06:05.784244] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-23T18:06:05.802145] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-09. [2025-09-23T18:06:06.371291] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-23T18:06:06.574772] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-23T18:06:06.578441] [INFO ] [REMOTE ] CNS: Full fetch complete (29644 records). [2025-09-23T18:06:06.578539] [DEBUG] [VALIDATOR ] CNS: Validating primary data. [2025-09-23T18:06:06.579090] [FATAL] [VALIDATOR ] CNS: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:06:06.579175] [FATAL] [MAIN ] CNS: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:06:06.579217] [WARN ] [MAIN ] CNS: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:06:06.579284] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-09-23T18:06:06.579373] [DEBUG] [LOCAL ] CNS: No primary data file found to delete. [2025-09-23T18:06:06.579430] [INFO ] [LOCAL ] CNS: Starting deletion of derivative data. [2025-09-23T18:06:06.579807] [DEBUG] [LOCAL ] CNS: Deleted derivative data file. [2025-09-23T18:06:06.579912] [INFO ] [MAIN ] Update Progress: 501/2372 symbols completed. CNS took 23.9s. Estimated remaining: 4h 6m 41s. Rate: 7.6 symbols/min [2025-09-23T18:06:06.609426] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-07. [2025-09-23T18:06:06.766990] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:06:06.824306] [DEBUG] [LOCAL ] COHR: Loaded 53366 existing records from primary storage. [2025-09-23T18:06:06.824501] [INFO ] [MAIN ] COHR: Loaded 53366 existing records. [2025-09-23T18:06:07.010574] [WARN ] [MAIN ] COHR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:06:07.010889] [INFO ] [MAIN ] COHR: Wiping existing primary data before full refresh. [2025-09-23T18:06:07.010939] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-09-23T18:06:07.012080] [DEBUG] [LOCAL ] COHR: Deleted primary data file. [2025-09-23T18:06:07.012141] [INFO ] [MAIN ] COHR: Starting full primary refresh. [2025-09-23T18:06:07.378834] [INFO ] [REMOTE ] COHR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:06:07.402153] [INFO ] [REMOTE ] COHR: Fetching primary data for 2024-12. [2025-09-23T18:06:08.202197] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-05. [2025-09-23T18:06:08.403798] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-23T18:06:09.002268] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-08. [2025-09-23T18:06:09.040741] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-23T18:06:09.484206] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-23T18:06:09.802192] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-01. [2025-09-23T18:06:10.564730] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-23T18:06:10.602154] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-09. [2025-09-23T18:06:11.367459] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-23T18:06:11.402146] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-02. [2025-09-23T18:06:12.202169] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-04. [2025-09-23T18:06:12.246503] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-23T18:06:12.255341] [INFO ] [REMOTE ] COF: Full fetch complete (77388 records). [2025-09-23T18:06:12.255467] [DEBUG] [VALIDATOR ] COF: Validating primary data. [2025-09-23T18:06:12.650910] [DEBUG] [VALIDATOR ] COF: All expected trading days are present. [2025-09-23T18:06:12.651058] [DEBUG] [VALIDATOR ] COF: Primary data validation passed. [2025-09-23T18:06:12.651941] [INFO ] [MAIN ] COF: Fetched primary data is valid. [2025-09-23T18:06:12.652008] [DEBUG] [LOCAL ] COF: Saving primary data. [2025-09-23T18:06:12.653595] [DEBUG] [LOCAL ] COF: Trimmed 77388 records to 53610 (keeping 200 days of data) [2025-09-23T18:06:13.001739] [DEBUG] [LOCAL ] COF: Primary data saved (53610 records). [2025-09-23T18:06:13.001887] [INFO ] [MAIN ] COF: Full history saved. [2025-09-23T18:06:13.001973] [INFO ] [MAIN ] Update Progress: 502/2372 symbols completed. COF took 25.4s. Estimated remaining: 4h 6m 28s. Rate: 7.6 symbols/min [2025-09-23T18:06:13.002270] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-06. [2025-09-23T18:06:13.181130] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-23T18:06:13.220034] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:06:13.274078] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-23T18:06:13.296945] [DEBUG] [LOCAL ] COLD: Loaded 51973 existing records from primary storage. [2025-09-23T18:06:13.297089] [INFO ] [MAIN ] COLD: Loaded 51973 existing records. [2025-09-23T18:06:13.475142] [WARN ] [MAIN ] COLD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:06:13.475545] [INFO ] [MAIN ] COLD: Wiping existing primary data before full refresh. [2025-09-23T18:06:13.475603] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-09-23T18:06:13.477772] [DEBUG] [LOCAL ] COLD: Deleted primary data file. [2025-09-23T18:06:13.477839] [INFO ] [MAIN ] COLD: Starting full primary refresh. [2025-09-23T18:06:13.807319] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-05. [2025-09-23T18:06:13.848753] [INFO ] [REMOTE ] COLD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:06:14.602204] [INFO ] [REMOTE ] COLD: Fetching primary data for 2024-12. [2025-09-23T18:06:15.325807] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-09-23T18:06:15.402205] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-07. [2025-09-23T18:06:15.824213] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-23T18:06:16.202239] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-06. [2025-09-23T18:06:16.901443] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-09-23T18:06:17.002219] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-01. [2025-09-23T18:06:17.488094] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-23T18:06:17.756668] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-09-23T18:06:17.802256] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-07. [2025-09-23T18:06:18.160717] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-23T18:06:18.602192] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-03. [2025-09-23T18:06:19.402171] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-02. [2025-09-23T18:06:19.443311] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-23T18:06:20.202200] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-08. [2025-09-23T18:06:20.476088] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-23T18:06:20.679202] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-23T18:06:21.002192] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-03. [2025-09-23T18:06:21.760295] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-23T18:06:21.802166] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-09. [2025-09-23T18:06:22.602150] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-08. [2025-09-23T18:06:22.852105] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-23T18:06:23.162116] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-23T18:06:23.168194] [INFO ] [REMOTE ] CODI: Full fetch complete (50208 records). [2025-09-23T18:06:23.168294] [DEBUG] [VALIDATOR ] CODI: Validating primary data. [2025-09-23T18:06:23.407359] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-04. [2025-09-23T18:06:23.559231] [DEBUG] [VALIDATOR ] CODI: All expected trading days are present. [2025-09-23T18:06:23.559324] [DEBUG] [VALIDATOR ] CODI: Primary data validation passed. [2025-09-23T18:06:23.560031] [INFO ] [MAIN ] CODI: Fetched primary data is valid. [2025-09-23T18:06:23.560096] [DEBUG] [LOCAL ] CODI: Saving primary data. [2025-09-23T18:06:23.561375] [DEBUG] [LOCAL ] CODI: Trimmed 50208 records to 39695 (keeping 200 days of data) [2025-09-23T18:06:23.791541] [DEBUG] [LOCAL ] CODI: Primary data saved (39695 records). [2025-09-23T18:06:23.791746] [INFO ] [MAIN ] CODI: Full history saved. [2025-09-23T18:06:23.791845] [INFO ] [MAIN ] Update Progress: 503/2372 symbols completed. CODI took 37.2s. Estimated remaining: 4h 6m 31s. Rate: 7.6 symbols/min [2025-09-23T18:06:23.966923] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:06:24.025263] [DEBUG] [LOCAL ] COMP: Loaded 53384 existing records from primary storage. [2025-09-23T18:06:24.025429] [INFO ] [MAIN ] COMP: Loaded 53384 existing records. [2025-09-23T18:06:24.207089] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-04. [2025-09-23T18:06:24.207310] [WARN ] [MAIN ] COMP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:06:24.208824] [INFO ] [MAIN ] COMP: Wiping existing primary data before full refresh. [2025-09-23T18:06:24.208892] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-09-23T18:06:24.219946] [DEBUG] [LOCAL ] COMP: Deleted primary data file. [2025-09-23T18:06:24.234006] [INFO ] [MAIN ] COMP: Starting full primary refresh. [2025-09-23T18:06:24.321588] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-23T18:06:24.605951] [INFO ] [REMOTE ] COMP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:06:24.803967] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-23T18:06:25.002205] [INFO ] [REMOTE ] COMP: Fetching primary data for 2024-12. [2025-09-23T18:06:25.802231] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-05. [2025-09-23T18:06:26.268451] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-23T18:06:26.446149] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-23T18:06:26.602198] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-01. [2025-09-23T18:06:27.402195] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-05. [2025-09-23T18:06:27.824913] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-23T18:06:28.028518] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-23T18:06:28.202160] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-02. [2025-09-23T18:06:29.002165] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-09. [2025-09-23T18:06:29.100833] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-23T18:06:29.487979] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-23T18:06:29.802246] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-06. [2025-09-23T18:06:30.364766] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-23T18:06:30.373112] [INFO ] [REMOTE ] CNX: Full fetch complete (74763 records). [2025-09-23T18:06:30.373241] [DEBUG] [VALIDATOR ] CNX: Validating primary data. [2025-09-23T18:06:30.612854] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-03. [2025-09-23T18:06:30.796251] [DEBUG] [VALIDATOR ] CNX: All expected trading days are present. [2025-09-23T18:06:30.796347] [DEBUG] [VALIDATOR ] CNX: Primary data validation passed. [2025-09-23T18:06:30.797184] [INFO ] [MAIN ] CNX: Fetched primary data is valid. [2025-09-23T18:06:30.797249] [DEBUG] [LOCAL ] CNX: Saving primary data. [2025-09-23T18:06:30.800909] [DEBUG] [LOCAL ] CNX: Trimmed 74763 records to 51391 (keeping 200 days of data) [2025-09-23T18:06:31.110574] [DEBUG] [LOCAL ] CNX: Primary data saved (51391 records). [2025-09-23T18:06:31.110933] [INFO ] [MAIN ] CNX: Full history saved. [2025-09-23T18:06:31.111196] [INFO ] [MAIN ] Update Progress: 504/2372 symbols completed. CNX took 46.9s. Estimated remaining: 4h 6m 21s. Rate: 7.6 symbols/min [2025-09-23T18:06:31.297212] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:06:31.337665] [DEBUG] [LOCAL ] CON: Loaded 38793 existing records from primary storage. [2025-09-23T18:06:31.337831] [INFO ] [MAIN ] CON: Loaded 38793 existing records. [2025-09-23T18:06:31.407253] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-06. [2025-09-23T18:06:31.525288] [WARN ] [MAIN ] CON: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:06:31.525749] [INFO ] [MAIN ] CON: Wiping existing primary data before full refresh. [2025-09-23T18:06:31.525820] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-09-23T18:06:31.526848] [DEBUG] [LOCAL ] CON: Deleted primary data file. [2025-09-23T18:06:31.527006] [INFO ] [MAIN ] CON: Starting full primary refresh. [2025-09-23T18:06:31.913099] [INFO ] [REMOTE ] CON: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:06:31.952297] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-09-23T18:06:32.041761] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-23T18:06:32.202211] [INFO ] [REMOTE ] CON: Fetching primary data for 2024-12. [2025-09-23T18:06:32.786957] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-23T18:06:33.002181] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-07. [2025-09-23T18:06:33.451070] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-23T18:06:33.802256] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-04. [2025-09-23T18:06:34.607256] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-07. [2025-09-23T18:06:34.623671] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-23T18:06:35.239103] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-23T18:06:35.402174] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-08. [2025-09-23T18:06:36.202192] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-01. [2025-09-23T18:06:36.444839] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-23T18:06:37.002195] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-08. [2025-09-23T18:06:37.203308] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-23T18:06:37.667335] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-23T18:06:37.802174] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-02. [2025-09-23T18:06:38.365354] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-23T18:06:38.602193] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-09. [2025-09-23T18:06:39.259160] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-23T18:06:39.402225] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-05. [2025-09-23T18:06:40.199155] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-23T18:06:40.207968] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-03. [2025-09-23T18:06:40.210152] [INFO ] [REMOTE ] COLD: Full fetch complete (74062 records). [2025-09-23T18:06:40.210401] [DEBUG] [VALIDATOR ] COLD: Validating primary data. [2025-09-23T18:06:40.639895] [DEBUG] [VALIDATOR ] COLD: All expected trading days are present. [2025-09-23T18:06:40.640060] [DEBUG] [VALIDATOR ] COLD: Primary data validation passed. [2025-09-23T18:06:40.640994] [INFO ] [MAIN ] COLD: Fetched primary data is valid. [2025-09-23T18:06:40.641116] [DEBUG] [LOCAL ] COLD: Saving primary data. [2025-09-23T18:06:40.642847] [DEBUG] [LOCAL ] COLD: Trimmed 74062 records to 51991 (keeping 200 days of data) [2025-09-23T18:06:40.974390] [DEBUG] [LOCAL ] COLD: Primary data saved (51991 records). [2025-09-23T18:06:40.974555] [INFO ] [MAIN ] COLD: Full history saved. [2025-09-23T18:06:40.974882] [INFO ] [MAIN ] Update Progress: 505/2372 symbols completed. COLD took 28.0s. Estimated remaining: 4h 6m 20s. Rate: 7.6 symbols/min [2025-09-23T18:06:41.030484] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-09. [2025-09-23T18:06:41.207351] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:06:41.230988] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-23T18:06:41.263238] [DEBUG] [LOCAL ] COOK: Loaded 24380 existing records from primary storage. [2025-09-23T18:06:41.263382] [INFO ] [MAIN ] COOK: Loaded 24380 existing records. [2025-09-23T18:06:41.466253] [WARN ] [MAIN ] COOK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:06:41.467305] [INFO ] [MAIN ] COOK: Wiping existing primary data before full refresh. [2025-09-23T18:06:41.467510] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-09-23T18:06:41.468462] [DEBUG] [LOCAL ] COOK: Deleted primary data file. [2025-09-23T18:06:41.468743] [INFO ] [MAIN ] COOK: Starting full primary refresh. [2025-09-23T18:06:41.617051] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-23T18:06:41.808419] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-06. [2025-09-23T18:06:41.895963] [INFO ] [REMOTE ] COOK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:06:42.602250] [INFO ] [REMOTE ] COOK: Fetching primary data for 2024-12. [2025-09-23T18:06:43.014133] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-23T18:06:43.023199] [INFO ] [REMOTE ] COHR: Full fetch complete (77087 records). [2025-09-23T18:06:43.023353] [DEBUG] [VALIDATOR ] COHR: Validating primary data. [2025-09-23T18:06:43.428243] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-04. [2025-09-23T18:06:43.500423] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-23T18:06:43.500513] [DEBUG] [VALIDATOR ] COHR: All expected trading days are present. [2025-09-23T18:06:43.510814] [DEBUG] [VALIDATOR ] COHR: Primary data validation passed. [2025-09-23T18:06:43.512198] [INFO ] [MAIN ] COHR: Fetched primary data is valid. [2025-09-23T18:06:43.512291] [DEBUG] [LOCAL ] COHR: Saving primary data. [2025-09-23T18:06:43.519310] [DEBUG] [LOCAL ] COHR: Trimmed 77087 records to 53365 (keeping 200 days of data) [2025-09-23T18:06:43.828785] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-23T18:06:43.873245] [DEBUG] [LOCAL ] COHR: Primary data saved (53365 records). [2025-09-23T18:06:43.873395] [INFO ] [MAIN ] COHR: Full history saved. [2025-09-23T18:06:43.873519] [INFO ] [MAIN ] Update Progress: 506/2372 symbols completed. COHR took 37.3s. Estimated remaining: 4h 5m 53s. Rate: 7.6 symbols/min [2025-09-23T18:06:44.049096] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:06:44.110237] [DEBUG] [LOCAL ] COP: Loaded 53727 existing records from primary storage. [2025-09-23T18:06:44.110399] [INFO ] [MAIN ] COP: Loaded 53727 existing records. [2025-09-23T18:06:44.208357] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-07. [2025-09-23T18:06:44.292437] [WARN ] [MAIN ] COP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:06:44.292885] [INFO ] [MAIN ] COP: Wiping existing primary data before full refresh. [2025-09-23T18:06:44.292936] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-09-23T18:06:44.294423] [DEBUG] [LOCAL ] COP: Deleted primary data file. [2025-09-23T18:06:44.294485] [INFO ] [MAIN ] COP: Starting full primary refresh. [2025-09-23T18:06:44.659618] [INFO ] [REMOTE ] COP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:06:44.719857] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-23T18:06:45.002184] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-01. [2025-09-23T18:06:45.698593] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-23T18:06:45.743943] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-23T18:06:45.802206] [INFO ] [REMOTE ] COP: Fetching primary data for 2024-12. [2025-09-23T18:06:46.602258] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-05. [2025-09-23T18:06:47.402251] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-02. [2025-09-23T18:06:47.474559] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-23T18:06:47.547049] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-23T18:06:47.941062] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-23T18:06:48.202229] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-06. [2025-09-23T18:06:49.002202] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-08. [2025-09-23T18:06:49.621894] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-23T18:06:49.802207] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-07. [2025-09-23T18:06:50.560539] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-23T18:06:50.602159] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-09. [2025-09-23T18:06:51.218695] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-23T18:06:51.402186] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-08. [2025-09-23T18:06:52.126693] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-23T18:06:52.139863] [INFO ] [REMOTE ] COMP: Full fetch complete (77071 records). [2025-09-23T18:06:52.140030] [DEBUG] [VALIDATOR ] COMP: Validating primary data. [2025-09-23T18:06:52.208178] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-01. [2025-09-23T18:06:52.550268] [DEBUG] [VALIDATOR ] COMP: All expected trading days are present. [2025-09-23T18:06:52.550437] [DEBUG] [VALIDATOR ] COMP: Primary data validation passed. [2025-09-23T18:06:52.551315] [INFO ] [MAIN ] COMP: Fetched primary data is valid. [2025-09-23T18:06:52.551399] [DEBUG] [LOCAL ] COMP: Saving primary data. [2025-09-23T18:06:52.553422] [DEBUG] [LOCAL ] COMP: Trimmed 77071 records to 53386 (keeping 200 days of data) [2025-09-23T18:06:52.577984] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-23T18:06:52.888801] [DEBUG] [LOCAL ] COMP: Primary data saved (53386 records). [2025-09-23T18:06:52.889303] [INFO ] [MAIN ] COMP: Full history saved. [2025-09-23T18:06:52.889546] [INFO ] [MAIN ] Update Progress: 507/2372 symbols completed. COMP took 29.1s. Estimated remaining: 4h 5m 50s. Rate: 7.6 symbols/min [2025-09-23T18:06:53.007261] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-03. [2025-09-23T18:06:53.063424] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:06:53.113008] [DEBUG] [LOCAL ] COR: Loaded 47281 existing records from primary storage. [2025-09-23T18:06:53.113154] [INFO ] [MAIN ] COR: Loaded 47281 existing records. [2025-09-23T18:06:53.289282] [WARN ] [MAIN ] COR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:06:53.289608] [INFO ] [MAIN ] COR: Wiping existing primary data before full refresh. [2025-09-23T18:06:53.289694] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-09-23T18:06:53.291020] [DEBUG] [LOCAL ] COR: Deleted primary data file. [2025-09-23T18:06:53.291079] [INFO ] [MAIN ] COR: Starting full primary refresh. [2025-09-23T18:06:53.647180] [INFO ] [REMOTE ] COR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:06:53.807369] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-09. [2025-09-23T18:06:53.827056] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-23T18:06:53.992163] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-23T18:06:54.602192] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-04. [2025-09-23T18:06:55.207020] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-23T18:06:55.214794] [INFO ] [REMOTE ] CON: Full fetch complete (57182 records). [2025-09-23T18:06:55.214983] [DEBUG] [VALIDATOR ] CON: Validating primary data. [2025-09-23T18:06:55.410590] [INFO ] [REMOTE ] COR: Fetching primary data for 2024-12. [2025-09-23T18:06:55.495942] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-23T18:06:55.651291] [DEBUG] [VALIDATOR ] CON: All expected trading days are present. [2025-09-23T18:06:55.651520] [DEBUG] [VALIDATOR ] CON: Primary data validation passed. [2025-09-23T18:06:55.652248] [INFO ] [MAIN ] CON: Fetched primary data is valid. [2025-09-23T18:06:55.652312] [DEBUG] [LOCAL ] CON: Saving primary data. [2025-09-23T18:06:55.653469] [DEBUG] [LOCAL ] CON: Trimmed 57182 records to 38791 (keeping 200 days of data) [2025-09-23T18:06:55.894576] [DEBUG] [LOCAL ] CON: Primary data saved (38791 records). [2025-09-23T18:06:55.894748] [INFO ] [MAIN ] CON: Full history saved. [2025-09-23T18:06:55.894841] [INFO ] [MAIN ] Update Progress: 508/2372 symbols completed. CON took 24.8s. Estimated remaining: 4h 5m 24s. Rate: 7.6 symbols/min [2025-09-23T18:06:56.062302] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:06:56.122597] [DEBUG] [LOCAL ] COTY: Loaded 53252 existing records from primary storage. [2025-09-23T18:06:56.122794] [INFO ] [MAIN ] COTY: Loaded 53252 existing records. [2025-09-23T18:06:56.207417] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-02. [2025-09-23T18:06:56.306201] [WARN ] [MAIN ] COTY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:06:56.306513] [INFO ] [MAIN ] COTY: Wiping existing primary data before full refresh. [2025-09-23T18:06:56.306561] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-09-23T18:06:56.307843] [DEBUG] [LOCAL ] COTY: Deleted primary data file. [2025-09-23T18:06:56.307906] [INFO ] [MAIN ] COTY: Starting full primary refresh. [2025-09-23T18:06:56.657801] [INFO ] [REMOTE ] COTY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:06:57.002166] [INFO ] [REMOTE ] COTY: Fetching primary data for 2024-12. [2025-09-23T18:06:57.049578] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-23T18:06:57.802209] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-01. [2025-09-23T18:06:57.852451] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-23T18:06:58.516632] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-23T18:06:58.602150] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-01. [2025-09-23T18:06:59.402224] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-05. [2025-09-23T18:06:59.701683] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-23T18:07:00.202191] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-02. [2025-09-23T18:07:00.342106] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-23T18:07:00.375589] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-23T18:07:01.002240] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-06. [2025-09-23T18:07:01.615374] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-23T18:07:01.802192] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-02. [2025-09-23T18:07:02.398361] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-23T18:07:02.602296] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-03. [2025-09-23T18:07:03.217436] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-23T18:07:03.402226] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-03. [2025-09-23T18:07:04.202195] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-03. [2025-09-23T18:07:04.295801] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-23T18:07:05.002222] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-04. [2025-09-23T18:07:05.081073] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-23T18:07:05.611583] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-23T18:07:05.802192] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-07. [2025-09-23T18:07:06.602261] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-04. [2025-09-23T18:07:06.675560] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-23T18:07:06.706125] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-23T18:07:07.402239] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-05. [2025-09-23T18:07:08.202241] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-08. [2025-09-23T18:07:08.808711] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-09-23T18:07:09.002162] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-05. [2025-09-23T18:07:09.122673] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-23T18:07:09.359774] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-23T18:07:09.802218] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-09. [2025-09-23T18:07:10.602216] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-06. [2025-09-23T18:07:11.251552] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-09-23T18:07:11.279631] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-23T18:07:11.286551] [INFO ] [REMOTE ] COOK: Full fetch complete (32964 records). [2025-09-23T18:07:11.286680] [DEBUG] [VALIDATOR ] COOK: Validating primary data. [2025-09-23T18:07:11.407274] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-06. [2025-09-23T18:07:11.684215] [DEBUG] [VALIDATOR ] COOK: All expected trading days are present. [2025-09-23T18:07:11.684318] [DEBUG] [VALIDATOR ] COOK: Primary data validation passed. [2025-09-23T18:07:11.684871] [INFO ] [MAIN ] COOK: Fetched primary data is valid. [2025-09-23T18:07:11.684934] [DEBUG] [LOCAL ] COOK: Saving primary data. [2025-09-23T18:07:11.685942] [DEBUG] [LOCAL ] COOK: Trimmed 32964 records to 24522 (keeping 200 days of data) [2025-09-23T18:07:11.840003] [DEBUG] [LOCAL ] COOK: Primary data saved (24522 records). [2025-09-23T18:07:11.840144] [INFO ] [MAIN ] COOK: Full history saved. [2025-09-23T18:07:11.840235] [INFO ] [MAIN ] Update Progress: 509/2372 symbols completed. COOK took 30.9s. Estimated remaining: 4h 5m 45s. Rate: 7.6 symbols/min [2025-09-23T18:07:12.023037] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:07:12.075046] [DEBUG] [LOCAL ] COUR: Loaded 48918 existing records from primary storage. [2025-09-23T18:07:12.075226] [INFO ] [MAIN ] COUR: Loaded 48918 existing records. [2025-09-23T18:07:12.207241] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-04. [2025-09-23T18:07:12.269160] [WARN ] [MAIN ] COUR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:07:12.269433] [INFO ] [MAIN ] COUR: Wiping existing primary data before full refresh. [2025-09-23T18:07:12.269483] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-09-23T18:07:12.271594] [DEBUG] [LOCAL ] COUR: Deleted primary data file. [2025-09-23T18:07:12.271686] [INFO ] [MAIN ] COUR: Starting full primary refresh. [2025-09-23T18:07:12.645718] [INFO ] [REMOTE ] COUR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:07:12.739989] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-23T18:07:12.804299] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-23T18:07:13.002190] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-07. [2025-09-23T18:07:13.744793] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-23T18:07:13.802155] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-05. [2025-09-23T18:07:14.550290] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-23T18:07:14.602157] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-08. [2025-09-23T18:07:15.151069] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-23T18:07:15.402218] [INFO ] [REMOTE ] COUR: Fetching primary data for 2024-12. [2025-09-23T18:07:16.194377] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-23T18:07:16.203425] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-07. [2025-09-23T18:07:17.002195] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-06. [2025-09-23T18:07:17.031869] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-23T18:07:17.802231] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-09. [2025-09-23T18:07:17.948126] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-23T18:07:18.477961] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-23T18:07:18.602216] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-07. [2025-09-23T18:07:19.406702] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-01. [2025-09-23T18:07:19.408964] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-23T18:07:19.416808] [INFO ] [REMOTE ] COR: Full fetch complete (68848 records). [2025-09-23T18:07:19.416913] [DEBUG] [VALIDATOR ] COR: Validating primary data. [2025-09-23T18:07:19.810049] [DEBUG] [VALIDATOR ] COR: All expected trading days are present. [2025-09-23T18:07:19.810156] [DEBUG] [VALIDATOR ] COR: Primary data validation passed. [2025-09-23T18:07:19.810947] [INFO ] [MAIN ] COR: Fetched primary data is valid. [2025-09-23T18:07:19.811010] [DEBUG] [LOCAL ] COR: Saving primary data. [2025-09-23T18:07:19.812380] [DEBUG] [LOCAL ] COR: Trimmed 68848 records to 47253 (keeping 200 days of data) [2025-09-23T18:07:20.141549] [DEBUG] [LOCAL ] COR: Primary data saved (47253 records). [2025-09-23T18:07:20.145581] [INFO ] [MAIN ] COR: Full history saved. [2025-09-23T18:07:20.145767] [INFO ] [MAIN ] Update Progress: 510/2372 symbols completed. COR took 27.3s. Estimated remaining: 4h 5m 39s. Rate: 7.6 symbols/min [2025-09-23T18:07:20.211144] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-08. [2025-09-23T18:07:20.248864] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-23T18:07:20.347732] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:07:20.400326] [DEBUG] [LOCAL ] CP: Loaded 53286 existing records from primary storage. [2025-09-23T18:07:20.400482] [INFO ] [MAIN ] CP: Loaded 53286 existing records. [2025-09-23T18:07:20.582389] [WARN ] [MAIN ] CP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:07:20.582689] [INFO ] [MAIN ] CP: Wiping existing primary data before full refresh. [2025-09-23T18:07:20.582760] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-09-23T18:07:20.583823] [DEBUG] [LOCAL ] CP: Deleted primary data file. [2025-09-23T18:07:20.583905] [INFO ] [MAIN ] CP: Starting full primary refresh. [2025-09-23T18:07:20.950235] [INFO ] [REMOTE ] CP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:07:20.977749] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-23T18:07:21.002202] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-02. [2025-09-23T18:07:21.802194] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-08. [2025-09-23T18:07:21.856787] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-23T18:07:22.299741] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-23T18:07:22.602208] [INFO ] [REMOTE ] CP: Fetching primary data for 2024-12. [2025-09-23T18:07:23.318962] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-23T18:07:23.402222] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-09. [2025-09-23T18:07:24.202239] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-09. [2025-09-23T18:07:24.429819] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-23T18:07:25.002234] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-03. [2025-09-23T18:07:25.268517] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-23T18:07:25.277301] [INFO ] [REMOTE ] COTY: Full fetch complete (77091 records). [2025-09-23T18:07:25.277421] [DEBUG] [VALIDATOR ] COTY: Validating primary data. [2025-09-23T18:07:25.667039] [DEBUG] [VALIDATOR ] COTY: All expected trading days are present. [2025-09-23T18:07:25.667150] [DEBUG] [VALIDATOR ] COTY: Primary data validation passed. [2025-09-23T18:07:25.668032] [INFO ] [MAIN ] COTY: Fetched primary data is valid. [2025-09-23T18:07:25.668093] [DEBUG] [LOCAL ] COTY: Saving primary data. [2025-09-23T18:07:25.669565] [DEBUG] [LOCAL ] COTY: Trimmed 77091 records to 53248 (keeping 200 days of data) [2025-09-23T18:07:25.833069] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-01. [2025-09-23T18:07:25.977541] [DEBUG] [LOCAL ] COTY: Primary data saved (53248 records). [2025-09-23T18:07:25.977705] [INFO ] [MAIN ] COTY: Full history saved. [2025-09-23T18:07:25.977802] [INFO ] [MAIN ] Update Progress: 511/2372 symbols completed. COTY took 30.1s. Estimated remaining: 4h 5m 23s. Rate: 7.6 symbols/min [2025-09-23T18:07:26.145975] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:07:26.175978] [DEBUG] [LOCAL ] CPA: Loaded 28894 existing records from primary storage. [2025-09-23T18:07:26.176124] [INFO ] [MAIN ] CPA: Loaded 28894 existing records. [2025-09-23T18:07:26.359998] [WARN ] [MAIN ] CPA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:07:26.360489] [INFO ] [MAIN ] CPA: Wiping existing primary data before full refresh. [2025-09-23T18:07:26.360671] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-09-23T18:07:26.361479] [DEBUG] [LOCAL ] CPA: Deleted primary data file. [2025-09-23T18:07:26.361543] [INFO ] [MAIN ] CPA: Starting full primary refresh. [2025-09-23T18:07:26.518621] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-23T18:07:26.621464] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-04. [2025-09-23T18:07:26.774308] [INFO ] [REMOTE ] CPA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:07:26.858255] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-09 (2.66 seconds). [2025-09-23T18:07:26.867508] [INFO ] [REMOTE ] COP: Full fetch complete (77769 records). [2025-09-23T18:07:26.867759] [DEBUG] [VALIDATOR ] COP: Validating primary data. [2025-09-23T18:07:27.265395] [DEBUG] [VALIDATOR ] COP: All expected trading days are present. [2025-09-23T18:07:27.265519] [DEBUG] [VALIDATOR ] COP: Primary data validation passed. [2025-09-23T18:07:27.266414] [INFO ] [MAIN ] COP: Fetched primary data is valid. [2025-09-23T18:07:27.266494] [DEBUG] [LOCAL ] COP: Saving primary data. [2025-09-23T18:07:27.268440] [DEBUG] [LOCAL ] COP: Trimmed 77769 records to 53727 (keeping 200 days of data) [2025-09-23T18:07:27.449254] [INFO ] [REMOTE ] CPA: Fetching primary data for 2024-12. [2025-09-23T18:07:27.547846] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-23T18:07:27.644668] [DEBUG] [LOCAL ] COP: Primary data saved (53727 records). [2025-09-23T18:07:27.644834] [INFO ] [MAIN ] COP: Full history saved. [2025-09-23T18:07:27.644932] [INFO ] [MAIN ] Update Progress: 512/2372 symbols completed. COP took 43.8s. Estimated remaining: 4h 4m 53s. Rate: 7.6 symbols/min [2025-09-23T18:07:27.811969] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:07:27.812135] [DEBUG] [LOCAL ] CPAC: No existing data file found in primary storage. [2025-09-23T18:07:27.812171] [WARN ] [MAIN ] CPAC: No existing data found, performing full refresh instead. [2025-09-23T18:07:27.812320] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-09-23T18:07:27.812361] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-09-23T18:07:27.812401] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-09-23T18:07:27.812434] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-09-23T18:07:28.171160] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:07:28.202142] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2024-12. [2025-09-23T18:07:28.615980] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-23T18:07:28.812831] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-23T18:07:29.002246] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-05. [2025-09-23T18:07:29.122817] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-23T18:07:29.802210] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-02. [2025-09-23T18:07:30.295179] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-23T18:07:30.602254] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-01. [2025-09-23T18:07:31.402178] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-06. [2025-09-23T18:07:31.530727] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-23T18:07:31.558773] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-23T18:07:32.202212] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-01. [2025-09-23T18:07:32.516760] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-09-23T18:07:32.597834] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-23T18:07:33.002215] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-03. [2025-09-23T18:07:33.802231] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-02. [2025-09-23T18:07:34.602194] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-07. [2025-09-23T18:07:34.758863] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-23T18:07:35.057539] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-23T18:07:35.402209] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-03. [2025-09-23T18:07:36.202239] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-04. [2025-09-23T18:07:36.488113] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-23T18:07:36.527496] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-23T18:07:37.002198] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-08. [2025-09-23T18:07:37.802171] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-09-23T18:07:38.132517] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-23T18:07:38.202001] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-23T18:07:38.602198] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-04. [2025-09-23T18:07:39.402205] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-05. [2025-09-23T18:07:39.883227] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-08 (2.88 seconds). [2025-09-23T18:07:40.033505] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-23T18:07:40.202201] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-05. [2025-09-23T18:07:41.002226] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-09-23T18:07:41.229978] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-23T18:07:41.446240] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-23T18:07:41.519466] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-23T18:07:41.802204] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-09-23T18:07:42.135833] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-09-23T18:07:42.602250] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-06. [2025-09-23T18:07:43.402245] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-06. [2025-09-23T18:07:43.581328] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-23T18:07:44.202208] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-07. [2025-09-23T18:07:45.002199] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-09. [2025-09-23T18:07:45.132276] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-23T18:07:45.337390] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-23T18:07:45.802215] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-09-23T18:07:46.093185] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-09-23T18:07:46.536556] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-23T18:07:46.544818] [INFO ] [REMOTE ] COUR: Full fetch complete (70900 records). [2025-09-23T18:07:46.544932] [DEBUG] [VALIDATOR ] COUR: Validating primary data. [2025-09-23T18:07:46.607432] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-09-23T18:07:46.951825] [DEBUG] [VALIDATOR ] COUR: All expected trading days are present. [2025-09-23T18:07:46.951917] [DEBUG] [VALIDATOR ] COUR: Primary data validation passed. [2025-09-23T18:07:46.952806] [INFO ] [MAIN ] COUR: Fetched primary data is valid. [2025-09-23T18:07:46.952873] [DEBUG] [LOCAL ] COUR: Saving primary data. [2025-09-23T18:07:46.954326] [DEBUG] [LOCAL ] COUR: Trimmed 70900 records to 48950 (keeping 200 days of data) [2025-09-23T18:07:47.044733] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-23T18:07:47.253503] [DEBUG] [LOCAL ] COUR: Primary data saved (48950 records). [2025-09-23T18:07:47.253711] [INFO ] [MAIN ] COUR: Full history saved. [2025-09-23T18:07:47.253812] [INFO ] [MAIN ] Update Progress: 513/2372 symbols completed. COUR took 35.4s. Estimated remaining: 4h 5m 27s. Rate: 7.6 symbols/min [2025-09-23T18:07:47.410004] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-07. [2025-09-23T18:07:47.428977] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:07:47.462444] [DEBUG] [LOCAL ] CPAY: Loaded 31224 existing records from primary storage. [2025-09-23T18:07:47.462593] [INFO ] [MAIN ] CPAY: Loaded 31224 existing records. [2025-09-23T18:07:47.642476] [WARN ] [MAIN ] CPAY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:07:47.642766] [INFO ] [MAIN ] CPAY: Wiping existing primary data before full refresh. [2025-09-23T18:07:47.642823] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-09-23T18:07:47.643735] [DEBUG] [LOCAL ] CPAY: Deleted primary data file. [2025-09-23T18:07:47.643799] [INFO ] [MAIN ] CPAY: Starting full primary refresh. [2025-09-23T18:07:48.006847] [INFO ] [REMOTE ] CPAY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:07:48.202194] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2024-12. [2025-09-23T18:07:49.002199] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-09-23T18:07:49.087028] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-23T18:07:49.314770] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-23T18:07:49.802186] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-09-23T18:07:49.839847] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-23T18:07:50.108591] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-23T18:07:50.602192] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-08. [2025-09-23T18:07:51.402204] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-09-23T18:07:51.904711] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-23T18:07:51.987932] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-23T18:07:51.989134] [INFO ] [REMOTE ] CPAC: Full fetch complete (1900 records). [2025-09-23T18:07:51.989208] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-09-23T18:07:52.181779] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-23T18:07:52.182032] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:07:52.182108] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:07:52.182183] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-09-23T18:07:52.182252] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-09-23T18:07:52.182292] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-09-23T18:07:52.182331] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-09-23T18:07:52.182397] [INFO ] [MAIN ] Update Progress: 514/2372 symbols completed. CPAC took 24.5s. Estimated remaining: 4h 5m 8s. Rate: 7.6 symbols/min [2025-09-23T18:07:52.207434] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-08. [2025-09-23T18:07:52.364804] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:07:52.382791] [DEBUG] [LOCAL ] CPF: Loaded 15454 existing records from primary storage. [2025-09-23T18:07:52.382934] [INFO ] [MAIN ] CPF: Loaded 15454 existing records. [2025-09-23T18:07:52.569062] [WARN ] [MAIN ] CPF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:07:52.569378] [INFO ] [MAIN ] CPF: Wiping existing primary data before full refresh. [2025-09-23T18:07:52.569436] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-09-23T18:07:52.569998] [DEBUG] [LOCAL ] CPF: Deleted primary data file. [2025-09-23T18:07:52.570058] [INFO ] [MAIN ] CPF: Starting full primary refresh. [2025-09-23T18:07:52.951931] [INFO ] [REMOTE ] CPF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:07:53.002208] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-09. [2025-09-23T18:07:53.650607] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-23T18:07:53.802202] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-09. [2025-09-23T18:07:54.455897] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-23T18:07:54.464851] [INFO ] [REMOTE ] CP: Full fetch complete (77130 records). [2025-09-23T18:07:54.465023] [DEBUG] [VALIDATOR ] CP: Validating primary data. [2025-09-23T18:07:54.607271] [INFO ] [REMOTE ] CPF: Fetching primary data for 2024-12. [2025-09-23T18:07:54.861823] [DEBUG] [VALIDATOR ] CP: All expected trading days are present. [2025-09-23T18:07:54.862063] [DEBUG] [VALIDATOR ] CP: Primary data validation passed. [2025-09-23T18:07:54.862941] [INFO ] [MAIN ] CP: Fetched primary data is valid. [2025-09-23T18:07:54.863011] [DEBUG] [LOCAL ] CP: Saving primary data. [2025-09-23T18:07:54.864494] [DEBUG] [LOCAL ] CP: Trimmed 77130 records to 53279 (keeping 200 days of data) [2025-09-23T18:07:55.093549] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-23T18:07:55.099539] [INFO ] [REMOTE ] CPA: Full fetch complete (42105 records). [2025-09-23T18:07:55.100855] [DEBUG] [VALIDATOR ] CPA: Validating primary data. [2025-09-23T18:07:55.406175] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-01. [2025-09-23T18:07:55.518322] [DEBUG] [VALIDATOR ] CPA: All expected trading days are present. [2025-09-23T18:07:55.519284] [DEBUG] [VALIDATOR ] CPA: Primary data validation passed. [2025-09-23T18:07:55.520351] [INFO ] [MAIN ] CPA: Fetched primary data is valid. [2025-09-23T18:07:55.520907] [DEBUG] [LOCAL ] CPA: Saving primary data. [2025-09-23T18:07:55.526300] [DEBUG] [LOCAL ] CPA: Trimmed 42105 records to 28837 (keeping 200 days of data) [2025-09-23T18:07:55.711633] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-23T18:07:55.748588] [DEBUG] [LOCAL ] CP: Primary data saved (53279 records). [2025-09-23T18:07:55.749463] [INFO ] [MAIN ] CP: Full history saved. [2025-09-23T18:07:55.749828] [INFO ] [MAIN ] Update Progress: 515/2372 symbols completed. CP took 35.6s. Estimated remaining: 4h 4m 45s. Rate: 7.6 symbols/min [2025-09-23T18:07:55.959285] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:07:55.990597] [DEBUG] [LOCAL ] CPK: Loaded 13280 existing records from primary storage. [2025-09-23T18:07:55.991554] [INFO ] [MAIN ] CPK: Loaded 13280 existing records. [2025-09-23T18:07:56.158566] [DEBUG] [LOCAL ] CPA: Primary data saved (28837 records). [2025-09-23T18:07:56.178769] [WARN ] [MAIN ] CPK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:07:56.178666] [INFO ] [MAIN ] CPA: Full history saved. [2025-09-23T18:07:56.179040] [INFO ] [MAIN ] Update Progress: 516/2372 symbols completed. CPA took 30.2s. Estimated remaining: 4h 4m 10s. Rate: 7.6 symbols/min [2025-09-23T18:07:56.179166] [INFO ] [MAIN ] CPK: Wiping existing primary data before full refresh. [2025-09-23T18:07:56.222594] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-09-23T18:07:56.210298] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-01. [2025-09-23T18:07:56.251079] [DEBUG] [LOCAL ] CPK: Deleted primary data file. [2025-09-23T18:07:56.257239] [INFO ] [MAIN ] CPK: Starting full primary refresh. [2025-09-23T18:07:56.478464] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:07:56.731041] [INFO ] [REMOTE ] CPK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:07:56.749719] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-23T18:07:56.789411] [DEBUG] [LOCAL ] CPNG: Loaded 53671 existing records from primary storage. [2025-09-23T18:07:56.789551] [INFO ] [MAIN ] CPNG: Loaded 53671 existing records. [2025-09-23T18:07:56.965831] [WARN ] [MAIN ] CPNG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:07:56.966318] [INFO ] [MAIN ] CPNG: Wiping existing primary data before full refresh. [2025-09-23T18:07:56.966514] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-09-23T18:07:56.967828] [DEBUG] [LOCAL ] CPNG: Deleted primary data file. [2025-09-23T18:07:56.967889] [INFO ] [MAIN ] CPNG: Starting full primary refresh. [2025-09-23T18:07:57.012442] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-02. [2025-09-23T18:07:57.161719] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-23T18:07:57.345897] [INFO ] [REMOTE ] CPNG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:07:57.802261] [INFO ] [REMOTE ] CPK: Fetching primary data for 2024-12. [2025-09-23T18:07:58.039498] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-23T18:07:58.573273] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-23T18:07:58.602265] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-03. [2025-09-23T18:07:59.402293] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2024-12. [2025-09-23T18:07:59.773709] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-23T18:08:00.202262] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-02. [2025-09-23T18:08:00.985283] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-23T18:08:01.002201] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-03. [2025-09-23T18:08:01.335665] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-23T18:08:01.802190] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-04. [2025-09-23T18:08:01.841807] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-23T18:08:02.602235] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-01. [2025-09-23T18:08:02.825816] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-23T18:08:03.191533] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-23T18:08:03.402213] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-01. [2025-09-23T18:08:04.202211] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-02. [2025-09-23T18:08:05.002253] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-05. [2025-09-23T18:08:05.020204] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-23T18:08:05.545261] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-09-23T18:08:05.802208] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-04. [2025-09-23T18:08:06.350360] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-23T18:08:06.602224] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-02. [2025-09-23T18:08:06.659164] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-23T18:08:07.402195] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-03. [2025-09-23T18:08:08.202225] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-05. [2025-09-23T18:08:08.299092] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-23T18:08:08.544147] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-23T18:08:08.747288] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-23T18:08:09.002209] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-06. [2025-09-23T18:08:09.601446] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-23T18:08:09.802230] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-03. [2025-09-23T18:08:10.602253] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-04. [2025-09-23T18:08:11.402200] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-06. [2025-09-23T18:08:11.521437] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-23T18:08:11.911446] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-23T18:08:12.202312] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-05. [2025-09-23T18:08:12.463554] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-23T18:08:12.851749] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-23T18:08:13.002233] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-04. [2025-09-23T18:08:13.802265] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-06. [2025-09-23T18:08:14.448379] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-23T18:08:14.602229] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-07. [2025-09-23T18:08:15.167569] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-23T18:08:15.402219] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-07. [2025-09-23T18:08:15.677840] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-23T18:08:16.045235] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-23T18:08:16.202239] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-07. [2025-09-23T18:08:16.886318] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-23T18:08:17.002190] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-05. [2025-09-23T18:08:17.802257] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-08. [2025-09-23T18:08:18.602219] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-08. [2025-09-23T18:08:18.765436] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-23T18:08:19.013776] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-23T18:08:19.402238] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-09. [2025-09-23T18:08:19.551690] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-23T18:08:20.202243] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-09. [2025-09-23T18:08:20.398695] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-23T18:08:20.404149] [INFO ] [REMOTE ] CPAY: Full fetch complete (45282 records). [2025-09-23T18:08:20.404296] [DEBUG] [VALIDATOR ] CPAY: Validating primary data. [2025-09-23T18:08:20.839126] [DEBUG] [VALIDATOR ] CPAY: All expected trading days are present. [2025-09-23T18:08:20.839261] [DEBUG] [VALIDATOR ] CPAY: Primary data validation passed. [2025-09-23T18:08:20.840303] [INFO ] [MAIN ] CPAY: Fetched primary data is valid. [2025-09-23T18:08:20.840382] [DEBUG] [LOCAL ] CPAY: Saving primary data. [2025-09-23T18:08:20.842009] [DEBUG] [LOCAL ] CPAY: Trimmed 45282 records to 31109 (keeping 200 days of data) [2025-09-23T18:08:20.950247] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-23T18:08:20.958135] [INFO ] [REMOTE ] CPF: Full fetch complete (24233 records). [2025-09-23T18:08:20.958535] [DEBUG] [VALIDATOR ] CPF: Validating primary data. [2025-09-23T18:08:21.005234] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-06. [2025-09-23T18:08:21.391511] [DEBUG] [VALIDATOR ] CPF: All expected trading days are present. [2025-09-23T18:08:21.392226] [DEBUG] [VALIDATOR ] CPF: Primary data validation passed. [2025-09-23T18:08:21.393552] [INFO ] [MAIN ] CPF: Fetched primary data is valid. [2025-09-23T18:08:21.393671] [DEBUG] [LOCAL ] CPF: Saving primary data. [2025-09-23T18:08:21.396311] [DEBUG] [LOCAL ] CPF: Trimmed 24233 records to 15434 (keeping 200 days of data) [2025-09-23T18:08:21.565244] [DEBUG] [LOCAL ] CPAY: Primary data saved (31109 records). [2025-09-23T18:08:21.566959] [INFO ] [MAIN ] CPAY: Full history saved. [2025-09-23T18:08:21.567471] [INFO ] [MAIN ] Update Progress: 517/2372 symbols completed. CPAY took 34.3s. Estimated remaining: 4h 5m 5s. Rate: 7.6 symbols/min [2025-09-23T18:08:21.576954] [DEBUG] [LOCAL ] CPF: Primary data saved (15434 records). [2025-09-23T18:08:21.577141] [INFO ] [MAIN ] CPF: Full history saved. [2025-09-23T18:08:21.577251] [INFO ] [MAIN ] Update Progress: 518/2372 symbols completed. CPF took 29.4s. Estimated remaining: 4h 4m 29s. Rate: 7.6 symbols/min [2025-09-23T18:08:21.802220] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-08. [2025-09-23T18:08:22.669574] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-23T18:08:22.672488] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-09. [2025-09-23T18:08:23.030499] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-23T18:08:23.402260] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-07. [2025-09-23T18:08:23.580873] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-23T18:08:23.584336] [INFO ] [REMOTE ] CPK: Full fetch complete (17634 records). [2025-09-23T18:08:23.584418] [DEBUG] [VALIDATOR ] CPK: Validating primary data. [2025-09-23T18:08:23.979439] [DEBUG] [VALIDATOR ] CPK: All expected trading days are present. [2025-09-23T18:08:23.979525] [DEBUG] [VALIDATOR ] CPK: Primary data validation passed. [2025-09-23T18:08:23.979908] [INFO ] [MAIN ] CPK: Fetched primary data is valid. [2025-09-23T18:08:23.979969] [DEBUG] [LOCAL ] CPK: Saving primary data. [2025-09-23T18:08:23.980705] [DEBUG] [LOCAL ] CPK: Trimmed 17634 records to 13338 (keeping 200 days of data) [2025-09-23T18:08:24.077430] [DEBUG] [LOCAL ] CPK: Primary data saved (13338 records). [2025-09-23T18:08:24.077638] [INFO ] [MAIN ] CPK: Full history saved. [2025-09-23T18:08:24.077848] [INFO ] [MAIN ] Update Progress: 519/2372 symbols completed. CPK took 28.3s. Estimated remaining: 4h 4m 1s. Rate: 7.6 symbols/min [2025-09-23T18:08:25.306931] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-23T18:08:25.319461] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-08. [2025-09-23T18:08:27.458802] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-23T18:08:27.470408] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-09. [2025-09-23T18:08:29.447742] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-23T18:08:29.457311] [INFO ] [REMOTE ] CPNG: Full fetch complete (77667 records). [2025-09-23T18:08:29.457490] [DEBUG] [VALIDATOR ] CPNG: Validating primary data. [2025-09-23T18:08:29.864342] [DEBUG] [VALIDATOR ] CPNG: All expected trading days are present. [2025-09-23T18:08:29.864424] [DEBUG] [VALIDATOR ] CPNG: Primary data validation passed. [2025-09-23T18:08:29.865287] [INFO ] [MAIN ] CPNG: Fetched primary data is valid. [2025-09-23T18:08:29.865349] [DEBUG] [LOCAL ] CPNG: Saving primary data. [2025-09-23T18:08:29.867474] [DEBUG] [LOCAL ] CPNG: Trimmed 77667 records to 53670 (keeping 200 days of data) [2025-09-23T18:08:30.202866] [DEBUG] [LOCAL ] CPNG: Primary data saved (53670 records). [2025-09-23T18:08:30.203181] [INFO ] [MAIN ] CPNG: Full history saved. [2025-09-23T18:08:30.203415] [INFO ] [MAIN ] Update Progress: 520/2372 symbols completed. CPNG took 34.0s. Estimated remaining: 4h 3m 47s. Rate: 7.6 symbols/min [2025-09-23T18:08:30.786245] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:08:30.874405] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:08:30.999516] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:08:31.004770] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:08:31.046866] [DEBUG] [LOCAL ] CQP: Loaded 19936 existing records from primary storage. [2025-09-23T18:08:31.063578] [INFO ] [MAIN ] CQP: Loaded 19936 existing records. [2025-09-23T18:08:31.151128] [DEBUG] [LOCAL ] CPRI: Loaded 52583 existing records from primary storage. [2025-09-23T18:08:31.168702] [INFO ] [MAIN ] CPRI: Loaded 52583 existing records. [2025-09-23T18:08:31.249798] [DEBUG] [LOCAL ] CPS: Loaded 26249 existing records from primary storage. [2025-09-23T18:08:31.275260] [INFO ] [MAIN ] CPS: Loaded 26249 existing records. [2025-09-23T18:08:31.295792] [DEBUG] [LOCAL ] CPT: Loaded 44347 existing records from primary storage. [2025-09-23T18:08:31.339003] [INFO ] [MAIN ] CPT: Loaded 44347 existing records. [2025-09-23T18:08:31.635688] [WARN ] [MAIN ] CQP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:08:31.735814] [INFO ] [MAIN ] CQP: Wiping existing primary data before full refresh. [2025-09-23T18:08:31.767183] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-09-23T18:08:31.831553] [WARN ] [MAIN ] CPS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:08:31.871560] [DEBUG] [LOCAL ] CQP: Deleted primary data file. [2025-09-23T18:08:31.875072] [INFO ] [MAIN ] CQP: Starting full primary refresh. [2025-09-23T18:08:31.875247] [INFO ] [MAIN ] CPS: Wiping existing primary data before full refresh. [2025-09-23T18:08:31.841894] [WARN ] [MAIN ] CPRI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:08:31.874974] [WARN ] [MAIN ] CPT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:08:31.880610] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-09-23T18:08:31.906290] [INFO ] [MAIN ] CPT: Wiping existing primary data before full refresh. [2025-09-23T18:08:31.911931] [INFO ] [MAIN ] CPRI: Wiping existing primary data before full refresh. [2025-09-23T18:08:31.917281] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-09-23T18:08:31.911783] [DEBUG] [LOCAL ] CPS: Deleted primary data file. [2025-09-23T18:08:31.917528] [INFO ] [MAIN ] CPS: Starting full primary refresh. [2025-09-23T18:08:31.917460] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-09-23T18:08:31.947102] [DEBUG] [LOCAL ] CPT: Deleted primary data file. [2025-09-23T18:08:31.953307] [DEBUG] [LOCAL ] CPRI: Deleted primary data file. [2025-09-23T18:08:31.982346] [INFO ] [MAIN ] CPT: Starting full primary refresh. [2025-09-23T18:08:31.982270] [INFO ] [MAIN ] CPRI: Starting full primary refresh. [2025-09-23T18:08:33.179902] [INFO ] [REMOTE ] CQP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:08:33.190707] [INFO ] [REMOTE ] CQP: Fetching primary data for 2024-12. [2025-09-23T18:08:33.395766] [INFO ] [REMOTE ] CPRI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:08:33.418929] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2024-12. [2025-09-23T18:08:33.424777] [INFO ] [REMOTE ] CPT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:08:33.418632] [INFO ] [REMOTE ] CPS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:08:33.425204] [INFO ] [REMOTE ] CPS: Fetching primary data for 2024-12. [2025-09-23T18:08:33.426746] [INFO ] [REMOTE ] CPT: Fetching primary data for 2024-12. [2025-09-23T18:08:34.218560] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-23T18:08:34.222899] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-01. [2025-09-23T18:08:34.374397] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-23T18:08:34.379128] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-01. [2025-09-23T18:08:34.645586] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-23T18:08:34.653390] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-01. [2025-09-23T18:08:34.980453] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-23T18:08:34.985539] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-02. [2025-09-23T18:08:35.139101] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-23T18:08:35.149775] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-01. [2025-09-23T18:08:35.263477] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-23T18:08:35.269355] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-02. [2025-09-23T18:08:35.751607] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-23T18:08:35.757010] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-03. [2025-09-23T18:08:35.955344] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-23T18:08:35.964516] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-02. [2025-09-23T18:08:36.055850] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-23T18:08:36.061469] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-03. [2025-09-23T18:08:36.628407] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-23T18:08:36.639476] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-02. [2025-09-23T18:08:36.757529] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-23T18:08:37.002176] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-04. [2025-09-23T18:08:37.071736] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-23T18:08:37.349069] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-23T18:08:37.662912] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-23T18:08:37.802168] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-05. [2025-09-23T18:08:37.903285] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-23T18:08:38.602160] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-03. [2025-09-23T18:08:39.010080] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-23T18:08:39.402219] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-04. [2025-09-23T18:08:40.202161] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-06. [2025-09-23T18:08:40.334728] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-23T18:08:40.379050] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-23T18:08:41.002150] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-04. [2025-09-23T18:08:41.038157] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-23T18:08:41.802222] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-07. [2025-09-23T18:08:42.546042] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-23T18:08:42.602192] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-05. [2025-09-23T18:08:42.983807] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-23T18:08:43.402244] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-05. [2025-09-23T18:08:44.179497] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-23T18:08:44.202297] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-08. [2025-09-23T18:08:44.558456] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-23T18:08:44.733333] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-23T18:08:45.002192] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-09. [2025-09-23T18:08:45.676203] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-23T18:08:45.681979] [INFO ] [REMOTE ] CQP: Full fetch complete (30876 records). [2025-09-23T18:08:45.682287] [DEBUG] [VALIDATOR ] CQP: Validating primary data. [2025-09-23T18:08:45.807360] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-03. [2025-09-23T18:08:46.086354] [DEBUG] [VALIDATOR ] CQP: All expected trading days are present. [2025-09-23T18:08:46.086462] [DEBUG] [VALIDATOR ] CQP: Primary data validation passed. [2025-09-23T18:08:46.087212] [INFO ] [MAIN ] CQP: Fetched primary data is valid. [2025-09-23T18:08:46.087334] [DEBUG] [LOCAL ] CQP: Saving primary data. [2025-09-23T18:08:46.088534] [DEBUG] [LOCAL ] CQP: Trimmed 30876 records to 19922 (keeping 200 days of data) [2025-09-23T18:08:46.228154] [DEBUG] [LOCAL ] CQP: Primary data saved (19922 records). [2025-09-23T18:08:46.228435] [INFO ] [MAIN ] CQP: Full history saved. [2025-09-23T18:08:46.228602] [INFO ] [MAIN ] Update Progress: 521/2372 symbols completed. CQP took 16.0s. Estimated remaining: 4h 4m 8s. Rate: 7.6 symbols/min [2025-09-23T18:08:46.403374] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:08:46.436057] [DEBUG] [LOCAL ] CR: Loaded 24776 existing records from primary storage. [2025-09-23T18:08:46.436329] [INFO ] [MAIN ] CR: Loaded 24776 existing records. [2025-09-23T18:08:46.605036] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-06. [2025-09-23T18:08:46.628850] [WARN ] [MAIN ] CR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:08:46.630978] [INFO ] [MAIN ] CR: Wiping existing primary data before full refresh. [2025-09-23T18:08:46.631123] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-09-23T18:08:46.632310] [DEBUG] [LOCAL ] CR: Deleted primary data file. [2025-09-23T18:08:46.632397] [INFO ] [MAIN ] CR: Starting full primary refresh. [2025-09-23T18:08:46.997390] [INFO ] [REMOTE ] CR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:08:47.402170] [INFO ] [REMOTE ] CR: Fetching primary data for 2024-12. [2025-09-23T18:08:47.451304] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-23T18:08:48.084811] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-23T18:08:48.202205] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-04. [2025-09-23T18:08:48.276996] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-23T18:08:49.002193] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-07. [2025-09-23T18:08:49.697750] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-23T18:08:49.802213] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-05. [2025-09-23T18:08:50.514307] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-23T18:08:50.602216] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-01. [2025-09-23T18:08:51.406288] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-08. [2025-09-23T18:08:51.411783] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-23T18:08:51.467994] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-23T18:08:52.202207] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-06. [2025-09-23T18:08:53.002202] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-06. [2025-09-23T18:08:53.209725] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-23T18:08:53.339848] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-23T18:08:53.756342] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-23T18:08:53.802206] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-07. [2025-09-23T18:08:54.602227] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-07. [2025-09-23T18:08:55.410065] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-02. [2025-09-23T18:08:55.415628] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-23T18:08:55.625849] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-23T18:08:56.202164] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-08. [2025-09-23T18:08:56.286689] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-23T18:08:56.973077] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-23T18:08:57.002150] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-03. [2025-09-23T18:08:57.802150] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-08. [2025-09-23T18:08:58.268037] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-23T18:08:58.602220] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-04. [2025-09-23T18:08:59.022597] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-23T18:08:59.402211] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-09. [2025-09-23T18:09:00.121468] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-23T18:09:00.202158] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-09. [2025-09-23T18:09:00.234121] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-23T18:09:00.238476] [INFO ] [REMOTE ] CPS: Full fetch complete (36292 records). [2025-09-23T18:09:00.238562] [DEBUG] [VALIDATOR ] CPS: Validating primary data. [2025-09-23T18:09:00.629978] [DEBUG] [VALIDATOR ] CPS: All expected trading days are present. [2025-09-23T18:09:00.630074] [DEBUG] [VALIDATOR ] CPS: Primary data validation passed. [2025-09-23T18:09:00.630719] [INFO ] [MAIN ] CPS: Fetched primary data is valid. [2025-09-23T18:09:00.630783] [DEBUG] [LOCAL ] CPS: Saving primary data. [2025-09-23T18:09:00.633176] [DEBUG] [LOCAL ] CPS: Trimmed 36292 records to 26259 (keeping 200 days of data) [2025-09-23T18:09:00.812204] [DEBUG] [LOCAL ] CPS: Primary data saved (26259 records). [2025-09-23T18:09:00.812364] [INFO ] [MAIN ] CPS: Full history saved. [2025-09-23T18:09:00.812479] [INFO ] [MAIN ] Update Progress: 522/2372 symbols completed. CPS took 30.6s. Estimated remaining: 4h 4m 24s. Rate: 7.6 symbols/min [2025-09-23T18:09:00.997110] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:09:00.997339] [DEBUG] [LOCAL ] CRBD: No existing data file found in primary storage. [2025-09-23T18:09:00.997396] [WARN ] [MAIN ] CRBD: No existing data found, performing full refresh instead. [2025-09-23T18:09:00.997563] [INFO ] [MAIN ] CRBD: Wiping existing primary data before full refresh. [2025-09-23T18:09:00.997606] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-09-23T18:09:00.997684] [DEBUG] [LOCAL ] CRBD: No primary data file found to delete. [2025-09-23T18:09:00.997739] [INFO ] [MAIN ] CRBD: Starting full primary refresh. [2025-09-23T18:09:01.009286] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-09. [2025-09-23T18:09:01.357626] [INFO ] [REMOTE ] CRBD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:09:01.802260] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-05. [2025-09-23T18:09:01.895808] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-23T18:09:01.902835] [INFO ] [REMOTE ] CPT: Full fetch complete (63196 records). [2025-09-23T18:09:01.902949] [DEBUG] [VALIDATOR ] CPT: Validating primary data. [2025-09-23T18:09:01.905054] [FATAL] [VALIDATOR ] CPT: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:09:01.905211] [FATAL] [MAIN ] CPT: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:09:01.905275] [WARN ] [MAIN ] CPT: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:09:01.905350] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-09-23T18:09:01.905416] [DEBUG] [LOCAL ] CPT: No primary data file found to delete. [2025-09-23T18:09:01.905470] [INFO ] [LOCAL ] CPT: Starting deletion of derivative data. [2025-09-23T18:09:01.906025] [DEBUG] [LOCAL ] CPT: Deleted derivative data file. [2025-09-23T18:09:01.906123] [INFO ] [MAIN ] Update Progress: 523/2372 symbols completed. CPT took 31.7s. Estimated remaining: 4h 3m 52s. Rate: 7.6 symbols/min [2025-09-23T18:09:02.074354] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:09:02.074550] [DEBUG] [LOCAL ] CRBG: No existing data file found in primary storage. [2025-09-23T18:09:02.074587] [WARN ] [MAIN ] CRBG: No existing data found, performing full refresh instead. [2025-09-23T18:09:02.074758] [INFO ] [MAIN ] CRBG: Wiping existing primary data before full refresh. [2025-09-23T18:09:02.074805] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-09-23T18:09:02.074846] [DEBUG] [LOCAL ] CRBG: No primary data file found to delete. [2025-09-23T18:09:02.074876] [INFO ] [MAIN ] CRBG: Starting full primary refresh. [2025-09-23T18:09:02.435493] [INFO ] [REMOTE ] CRBG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:09:02.602276] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2024-12. [2025-09-23T18:09:03.402164] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2024-12. [2025-09-23T18:09:03.471054] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-09-23T18:09:03.480724] [INFO ] [REMOTE ] CPRI: Full fetch complete (76176 records). [2025-09-23T18:09:03.480910] [DEBUG] [VALIDATOR ] CPRI: Validating primary data. [2025-09-23T18:09:03.876810] [DEBUG] [VALIDATOR ] CPRI: All expected trading days are present. [2025-09-23T18:09:03.876892] [DEBUG] [VALIDATOR ] CPRI: Primary data validation passed. [2025-09-23T18:09:03.877803] [INFO ] [MAIN ] CPRI: Fetched primary data is valid. [2025-09-23T18:09:03.877868] [DEBUG] [LOCAL ] CPRI: Saving primary data. [2025-09-23T18:09:03.879345] [DEBUG] [LOCAL ] CPRI: Trimmed 76176 records to 52595 (keeping 200 days of data) [2025-09-23T18:09:04.208322] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-09-23T18:09:04.214901] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-06. [2025-09-23T18:09:04.229846] [DEBUG] [LOCAL ] CPRI: Primary data saved (52595 records). [2025-09-23T18:09:04.230008] [INFO ] [MAIN ] CPRI: Full history saved. [2025-09-23T18:09:04.230121] [INFO ] [MAIN ] Update Progress: 524/2372 symbols completed. CPRI took 34.0s. Estimated remaining: 4h 3m 24s. Rate: 7.6 symbols/min [2025-09-23T18:09:04.408786] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:09:04.425452] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-23T18:09:04.470447] [DEBUG] [LOCAL ] CRC: Loaded 44421 existing records from primary storage. [2025-09-23T18:09:04.470601] [INFO ] [MAIN ] CRC: Loaded 44421 existing records. [2025-09-23T18:09:04.646240] [WARN ] [MAIN ] CRC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:09:04.646487] [INFO ] [MAIN ] CRC: Wiping existing primary data before full refresh. [2025-09-23T18:09:04.646533] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-09-23T18:09:04.647971] [DEBUG] [LOCAL ] CRC: Deleted primary data file. [2025-09-23T18:09:04.648034] [INFO ] [MAIN ] CRC: Starting full primary refresh. [2025-09-23T18:09:05.008806] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-01. [2025-09-23T18:09:05.011893] [INFO ] [REMOTE ] CRC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:09:05.043183] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2024-12 (2.44 seconds). [2025-09-23T18:09:05.192865] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-23T18:09:05.560308] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-23T18:09:05.802232] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-07. [2025-09-23T18:09:06.602214] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-01. [2025-09-23T18:09:06.620381] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-23T18:09:07.402242] [INFO ] [REMOTE ] CRC: Fetching primary data for 2024-12. [2025-09-23T18:09:07.934418] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-23T18:09:08.202264] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-02. [2025-09-23T18:09:09.002219] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-08. [2025-09-23T18:09:09.247498] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-23T18:09:09.474279] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-23T18:09:09.802231] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-02. [2025-09-23T18:09:10.005361] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-23T18:09:10.308823] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-23T18:09:10.602210] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-03. [2025-09-23T18:09:11.076343] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-23T18:09:11.402179] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-04. [2025-09-23T18:09:11.941373] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-23T18:09:12.202198] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-03. [2025-09-23T18:09:13.002267] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-01. [2025-09-23T18:09:13.802196] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-05. [2025-09-23T18:09:13.957038] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-23T18:09:14.086690] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-23T18:09:14.220060] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-23T18:09:14.602306] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-09. [2025-09-23T18:09:15.402194] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-04. [2025-09-23T18:09:16.125212] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-23T18:09:16.129938] [INFO ] [REMOTE ] CR: Full fetch complete (34971 records). [2025-09-23T18:09:16.130032] [DEBUG] [VALIDATOR ] CR: Validating primary data. [2025-09-23T18:09:16.207357] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-02. [2025-09-23T18:09:16.514560] [DEBUG] [VALIDATOR ] CR: All expected trading days are present. [2025-09-23T18:09:16.514667] [DEBUG] [VALIDATOR ] CR: Primary data validation passed. [2025-09-23T18:09:16.515229] [INFO ] [MAIN ] CR: Fetched primary data is valid. [2025-09-23T18:09:16.515291] [DEBUG] [LOCAL ] CR: Saving primary data. [2025-09-23T18:09:16.516106] [DEBUG] [LOCAL ] CR: Trimmed 34971 records to 24782 (keeping 200 days of data) [2025-09-23T18:09:16.672299] [DEBUG] [LOCAL ] CR: Primary data saved (24782 records). [2025-09-23T18:09:16.672433] [INFO ] [MAIN ] CR: Full history saved. [2025-09-23T18:09:16.672515] [INFO ] [MAIN ] Update Progress: 525/2372 symbols completed. CR took 30.4s. Estimated remaining: 4h 3m 32s. Rate: 7.6 symbols/min [2025-09-23T18:09:16.844406] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:09:16.844585] [DEBUG] [LOCAL ] CRCL: No existing data file found in primary storage. [2025-09-23T18:09:16.844621] [WARN ] [MAIN ] CRCL: No existing data found, performing full refresh instead. [2025-09-23T18:09:16.844782] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-09-23T18:09:16.844823] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-09-23T18:09:16.844864] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-09-23T18:09:16.844896] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-09-23T18:09:17.003873] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-06. [2025-09-23T18:09:17.210733] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:09:17.728716] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-23T18:09:17.802165] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-07. [2025-09-23T18:09:17.928144] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-04 (2.53 seconds). [2025-09-23T18:09:18.537816] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-09-23T18:09:18.562243] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-23T18:09:18.602144] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-08. [2025-09-23T18:09:19.081882] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-23T18:09:19.402204] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-03. [2025-09-23T18:09:20.202227] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2024-12. [2025-09-23T18:09:20.442449] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:09:20.442797] [WARN ] [REMOTE ] CRCL: No data returned for month 2024-12 [2025-09-23T18:09:21.002248] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-05. [2025-09-23T18:09:21.467752] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-23T18:09:21.802211] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-09. [2025-09-23T18:09:22.366506] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-23T18:09:22.381183] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-23T18:09:22.383559] [INFO ] [REMOTE ] CRBD: Full fetch complete (15456 records). [2025-09-23T18:09:22.383636] [DEBUG] [VALIDATOR ] CRBD: Validating primary data. [2025-09-23T18:09:22.563848] [WARN ] [VALIDATOR ] CRBD: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-23T18:09:22.564145] [FATAL] [MAIN ] CRBD: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:09:22.564213] [WARN ] [MAIN ] CRBD: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:09:22.564281] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-09-23T18:09:22.564346] [DEBUG] [LOCAL ] CRBD: No primary data file found to delete. [2025-09-23T18:09:22.564382] [INFO ] [LOCAL ] CRBD: Starting deletion of derivative data. [2025-09-23T18:09:22.564421] [DEBUG] [LOCAL ] CRBD: No derivative data file found to delete. [2025-09-23T18:09:22.564477] [INFO ] [MAIN ] Update Progress: 526/2372 symbols completed. CRBD took 21.8s. Estimated remaining: 4h 3m 17s. Rate: 7.6 symbols/min [2025-09-23T18:09:22.607335] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-01. [2025-09-23T18:09:22.738228] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:09:22.794078] [DEBUG] [LOCAL ] CRGY: Loaded 52511 existing records from primary storage. [2025-09-23T18:09:22.794269] [INFO ] [MAIN ] CRGY: Loaded 52511 existing records. [2025-09-23T18:09:22.892138] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:09:22.894974] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-01 [2025-09-23T18:09:22.972187] [WARN ] [MAIN ] CRGY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:09:22.972437] [INFO ] [MAIN ] CRGY: Wiping existing primary data before full refresh. [2025-09-23T18:09:22.972484] [INFO ] [LOCAL ] CRGY: Starting deletion of primary data. [2025-09-23T18:09:22.973905] [DEBUG] [LOCAL ] CRGY: Deleted primary data file. [2025-09-23T18:09:22.973967] [INFO ] [MAIN ] CRGY: Starting full primary refresh. [2025-09-23T18:09:23.324733] [INFO ] [REMOTE ] CRGY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:09:23.402167] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-04. [2025-09-23T18:09:24.202189] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-02. [2025-09-23T18:09:24.412159] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:09:24.412479] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-02 [2025-09-23T18:09:24.481865] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-23T18:09:25.002236] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-05. [2025-09-23T18:09:25.802217] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2024-12. [2025-09-23T18:09:26.545997] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-23T18:09:26.602188] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-06. [2025-09-23T18:09:27.271312] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-23T18:09:27.402193] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-06. [2025-09-23T18:09:27.731614] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-23T18:09:28.202229] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-01. [2025-09-23T18:09:29.002214] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-07. [2025-09-23T18:09:29.086450] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-23T18:09:29.563548] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-23T18:09:29.802205] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-02. [2025-09-23T18:09:30.602170] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-07. [2025-09-23T18:09:30.634544] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-23T18:09:31.001700] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-23T18:09:31.402205] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-08. [2025-09-23T18:09:32.202252] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-03. [2025-09-23T18:09:32.410626] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:09:32.411098] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-03 [2025-09-23T18:09:32.591111] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-23T18:09:32.657848] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-23T18:09:33.002231] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-04. [2025-09-23T18:09:33.359221] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:09:33.359570] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-04 [2025-09-23T18:09:33.802192] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-03. [2025-09-23T18:09:34.602192] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-09. [2025-09-23T18:09:35.278409] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-23T18:09:35.402160] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-04. [2025-09-23T18:09:36.202171] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-05. [2025-09-23T18:09:36.321960] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-23T18:09:36.330959] [INFO ] [REMOTE ] CRC: Full fetch complete (62186 records). [2025-09-23T18:09:36.331136] [DEBUG] [VALIDATOR ] CRC: Validating primary data. [2025-09-23T18:09:36.441481] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:09:36.452978] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-05 [2025-09-23T18:09:36.740487] [DEBUG] [VALIDATOR ] CRC: All expected trading days are present. [2025-09-23T18:09:36.740755] [DEBUG] [VALIDATOR ] CRC: Primary data validation passed. [2025-09-23T18:09:36.741483] [INFO ] [MAIN ] CRC: Fetched primary data is valid. [2025-09-23T18:09:36.741530] [DEBUG] [LOCAL ] CRC: Saving primary data. [2025-09-23T18:09:36.743143] [DEBUG] [LOCAL ] CRC: Trimmed 62186 records to 44375 (keeping 200 days of data) [2025-09-23T18:09:37.003383] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-23T18:09:37.003797] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-06. [2025-09-23T18:09:37.075150] [DEBUG] [LOCAL ] CRC: Primary data saved (44375 records). [2025-09-23T18:09:37.075300] [INFO ] [MAIN ] CRC: Full history saved. [2025-09-23T18:09:37.075390] [INFO ] [MAIN ] Update Progress: 527/2372 symbols completed. CRC took 32.8s. Estimated remaining: 4h 3m 32s. Rate: 7.6 symbols/min [2025-09-23T18:09:37.288461] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:09:37.344868] [DEBUG] [LOCAL ] CRH: Loaded 53472 existing records from primary storage. [2025-09-23T18:09:37.345032] [INFO ] [MAIN ] CRH: Loaded 53472 existing records. [2025-09-23T18:09:37.519145] [WARN ] [MAIN ] CRH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:09:37.519408] [INFO ] [MAIN ] CRH: Wiping existing primary data before full refresh. [2025-09-23T18:09:37.519463] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-09-23T18:09:37.521827] [DEBUG] [LOCAL ] CRH: Deleted primary data file. [2025-09-23T18:09:37.521891] [INFO ] [MAIN ] CRH: Starting full primary refresh. [2025-09-23T18:09:37.802316] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-08. [2025-09-23T18:09:37.889245] [INFO ] [REMOTE ] CRH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:09:38.602211] [INFO ] [REMOTE ] CRH: Fetching primary data for 2024-12. [2025-09-23T18:09:38.968369] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-23T18:09:39.402191] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-05. [2025-09-23T18:09:39.974993] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-23T18:09:40.202214] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-09. [2025-09-23T18:09:40.655775] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-23T18:09:40.861051] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-23T18:09:41.002227] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-06. [2025-09-23T18:09:41.565756] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-23T18:09:41.575160] [INFO ] [REMOTE ] CRBG: Full fetch complete (75693 records). [2025-09-23T18:09:41.575365] [DEBUG] [VALIDATOR ] CRBG: Validating primary data. [2025-09-23T18:09:41.813001] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-01. [2025-09-23T18:09:41.995308] [DEBUG] [VALIDATOR ] CRBG: All expected trading days are present. [2025-09-23T18:09:41.995455] [DEBUG] [VALIDATOR ] CRBG: Primary data validation passed. [2025-09-23T18:09:41.996545] [INFO ] [MAIN ] CRBG: Fetched primary data is valid. [2025-09-23T18:09:41.996635] [DEBUG] [LOCAL ] CRBG: Saving primary data. [2025-09-23T18:09:41.999259] [DEBUG] [LOCAL ] CRBG: Trimmed 75693 records to 52352 (keeping 200 days of data) [2025-09-23T18:09:42.342790] [DEBUG] [LOCAL ] CRBG: Primary data saved (52352 records). [2025-09-23T18:09:42.342963] [INFO ] [MAIN ] CRBG: Full history saved. [2025-09-23T18:09:42.343051] [INFO ] [MAIN ] Update Progress: 528/2372 symbols completed. CRBG took 40.4s. Estimated remaining: 4h 3m 15s. Rate: 7.6 symbols/min [2025-09-23T18:09:42.521622] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:09:42.560859] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-23T18:09:42.612096] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-07. [2025-09-23T18:09:42.615163] [DEBUG] [LOCAL ] CRI: Loaded 49968 existing records from primary storage. [2025-09-23T18:09:42.615321] [INFO ] [MAIN ] CRI: Loaded 49968 existing records. [2025-09-23T18:09:42.794098] [WARN ] [MAIN ] CRI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:09:42.794369] [INFO ] [MAIN ] CRI: Wiping existing primary data before full refresh. [2025-09-23T18:09:42.794418] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-09-23T18:09:42.795894] [DEBUG] [LOCAL ] CRI: Deleted primary data file. [2025-09-23T18:09:42.795956] [INFO ] [MAIN ] CRI: Starting full primary refresh. [2025-09-23T18:09:43.169767] [INFO ] [REMOTE ] CRI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:09:43.404095] [INFO ] [REMOTE ] CRI: Fetching primary data for 2024-12. [2025-09-23T18:09:43.403889] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-23T18:09:44.202311] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-07. [2025-09-23T18:09:44.591260] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-23T18:09:44.810616] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-23T18:09:45.002179] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-01. [2025-09-23T18:09:45.802244] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-08. [2025-09-23T18:09:46.535461] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-23T18:09:46.602212] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-02. [2025-09-23T18:09:47.007933] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-07 (2.81 seconds). [2025-09-23T18:09:47.261341] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-23T18:09:47.402187] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-09. [2025-09-23T18:09:47.755683] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-23T18:09:48.202214] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-02. [2025-09-23T18:09:49.002222] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-03. [2025-09-23T18:09:49.193790] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-23T18:09:49.202715] [INFO ] [REMOTE ] CRGY: Full fetch complete (75955 records). [2025-09-23T18:09:49.202850] [DEBUG] [VALIDATOR ] CRGY: Validating primary data. [2025-09-23T18:09:49.594628] [DEBUG] [VALIDATOR ] CRGY: All expected trading days are present. [2025-09-23T18:09:49.594757] [DEBUG] [VALIDATOR ] CRGY: Primary data validation passed. [2025-09-23T18:09:49.595595] [INFO ] [MAIN ] CRGY: Fetched primary data is valid. [2025-09-23T18:09:49.595724] [DEBUG] [LOCAL ] CRGY: Saving primary data. [2025-09-23T18:09:49.597718] [DEBUG] [LOCAL ] CRGY: Trimmed 75955 records to 52511 (keeping 200 days of data) [2025-09-23T18:09:49.714624] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-23T18:09:49.807107] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-08. [2025-09-23T18:09:49.950962] [DEBUG] [LOCAL ] CRGY: Primary data saved (52511 records). [2025-09-23T18:09:49.951101] [INFO ] [MAIN ] CRGY: Full history saved. [2025-09-23T18:09:49.951181] [INFO ] [MAIN ] Update Progress: 529/2372 symbols completed. CRGY took 27.4s. Estimated remaining: 4h 3m 6s. Rate: 7.6 symbols/min [2025-09-23T18:09:50.122892] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:09:50.175366] [DEBUG] [LOCAL ] CRK: Loaded 52118 existing records from primary storage. [2025-09-23T18:09:50.175632] [INFO ] [MAIN ] CRK: Loaded 52118 existing records. [2025-09-23T18:09:50.362215] [WARN ] [MAIN ] CRK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:09:50.362707] [INFO ] [MAIN ] CRK: Wiping existing primary data before full refresh. [2025-09-23T18:09:50.362830] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-09-23T18:09:50.373497] [DEBUG] [LOCAL ] CRK: Deleted primary data file. [2025-09-23T18:09:50.390593] [INFO ] [MAIN ] CRK: Starting full primary refresh. [2025-09-23T18:09:50.398239] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-23T18:09:50.612764] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-03. [2025-09-23T18:09:50.774128] [INFO ] [REMOTE ] CRK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:09:51.402202] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-04. [2025-09-23T18:09:52.202156] [INFO ] [REMOTE ] CRK: Fetching primary data for 2024-12. [2025-09-23T18:09:52.389661] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-08 (2.58 seconds). [2025-09-23T18:09:52.828280] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-23T18:09:52.968026] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-09-23T18:09:53.002163] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-09. [2025-09-23T18:09:53.802213] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-05. [2025-09-23T18:09:53.939070] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-23T18:09:54.602253] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-04. [2025-09-23T18:09:55.263627] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-23T18:09:55.402215] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-06. [2025-09-23T18:09:55.518197] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-09-23T18:09:55.527273] [INFO ] [REMOTE ] CRCL: Full fetch complete (29439 records). [2025-09-23T18:09:55.527387] [DEBUG] [VALIDATOR ] CRCL: Validating primary data. [2025-09-23T18:09:55.719820] [WARN ] [VALIDATOR ] CRCL: Validation failed - insufficient historical data. Have 76 unique days, need 200 days [2025-09-23T18:09:55.720340] [FATAL] [MAIN ] CRCL: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:09:55.720444] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:09:55.720521] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-09-23T18:09:55.720598] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-09-23T18:09:55.720636] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-09-23T18:09:55.720739] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-09-23T18:09:55.720834] [INFO ] [MAIN ] Update Progress: 530/2372 symbols completed. CRCL took 39.0s. Estimated remaining: 4h 2m 51s. Rate: 7.6 symbols/min [2025-09-23T18:09:55.895272] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:09:55.947445] [DEBUG] [LOCAL ] CRL: Loaded 43362 existing records from primary storage. [2025-09-23T18:09:55.947715] [INFO ] [MAIN ] CRL: Loaded 43362 existing records. [2025-09-23T18:09:56.144762] [WARN ] [MAIN ] CRL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:09:56.145280] [INFO ] [MAIN ] CRL: Wiping existing primary data before full refresh. [2025-09-23T18:09:56.145359] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-09-23T18:09:56.146780] [DEBUG] [LOCAL ] CRL: Deleted primary data file. [2025-09-23T18:09:56.146850] [INFO ] [MAIN ] CRL: Starting full primary refresh. [2025-09-23T18:09:56.213692] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-01. [2025-09-23T18:09:56.508193] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-23T18:09:56.580925] [INFO ] [REMOTE ] CRL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:09:56.649218] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-23T18:09:57.002228] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-05. [2025-09-23T18:09:57.726151] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-23T18:09:57.802159] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-02. [2025-09-23T18:09:58.602209] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-07. [2025-09-23T18:09:58.880154] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-23T18:09:59.169079] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-23T18:09:59.402215] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-03. [2025-09-23T18:10:00.016548] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-23T18:10:00.202245] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-08. [2025-09-23T18:10:01.002172] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-06. [2025-09-23T18:10:01.264717] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-23T18:10:01.491394] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-23T18:10:01.802280] [INFO ] [REMOTE ] CRL: Fetching primary data for 2024-12. [2025-09-23T18:10:02.602223] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-04. [2025-09-23T18:10:02.997246] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-23T18:10:03.241490] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-23T18:10:03.402264] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-01. [2025-09-23T18:10:04.055336] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-23T18:10:04.202246] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-09. [2025-09-23T18:10:04.735992] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-23T18:10:05.002252] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-05. [2025-09-23T18:10:05.639436] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-23T18:10:05.647520] [INFO ] [REMOTE ] CRI: Full fetch complete (70864 records). [2025-09-23T18:10:05.647678] [DEBUG] [VALIDATOR ] CRI: Validating primary data. [2025-09-23T18:10:05.805989] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-07. [2025-09-23T18:10:06.038545] [DEBUG] [VALIDATOR ] CRI: All expected trading days are present. [2025-09-23T18:10:06.038632] [DEBUG] [VALIDATOR ] CRI: Primary data validation passed. [2025-09-23T18:10:06.039425] [INFO ] [MAIN ] CRI: Fetched primary data is valid. [2025-09-23T18:10:06.039476] [DEBUG] [LOCAL ] CRI: Saving primary data. [2025-09-23T18:10:06.040893] [DEBUG] [LOCAL ] CRI: Trimmed 70864 records to 49985 (keeping 200 days of data) [2025-09-23T18:10:06.354062] [DEBUG] [LOCAL ] CRI: Primary data saved (49985 records). [2025-09-23T18:10:06.354209] [INFO ] [MAIN ] CRI: Full history saved. [2025-09-23T18:10:06.354311] [INFO ] [MAIN ] Update Progress: 531/2372 symbols completed. CRI took 24.0s. Estimated remaining: 4h 2m 52s. Rate: 7.6 symbols/min [2025-09-23T18:10:06.539923] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:10:06.603946] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-02. [2025-09-23T18:10:06.607862] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-23T18:10:06.637530] [DEBUG] [LOCAL ] CRM: Loaded 53770 existing records from primary storage. [2025-09-23T18:10:06.637727] [INFO ] [MAIN ] CRM: Loaded 53770 existing records. [2025-09-23T18:10:06.836749] [WARN ] [MAIN ] CRM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:10:06.837086] [INFO ] [MAIN ] CRM: Wiping existing primary data before full refresh. [2025-09-23T18:10:06.837148] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-09-23T18:10:06.838894] [DEBUG] [LOCAL ] CRM: Deleted primary data file. [2025-09-23T18:10:06.838961] [INFO ] [MAIN ] CRM: Starting full primary refresh. [2025-09-23T18:10:07.204432] [INFO ] [REMOTE ] CRM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:10:07.402146] [INFO ] [REMOTE ] CRM: Fetching primary data for 2024-12. [2025-09-23T18:10:07.526144] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-23T18:10:08.199413] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-23T18:10:08.207911] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-06. [2025-09-23T18:10:09.002216] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-03. [2025-09-23T18:10:09.802177] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-08. [2025-09-23T18:10:09.947912] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2024-12 (2.55 seconds). [2025-09-23T18:10:10.017250] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-23T18:10:10.334193] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-23T18:10:10.602195] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-07. [2025-09-23T18:10:11.402160] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-01. [2025-09-23T18:10:11.528529] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-23T18:10:12.068407] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-23T18:10:12.202225] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-08. [2025-09-23T18:10:13.002271] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-04. [2025-09-23T18:10:13.777287] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-09-23T18:10:13.802156] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-02. [2025-09-23T18:10:14.467738] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-09-23T18:10:14.535777] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-23T18:10:14.602183] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-09. [2025-09-23T18:10:15.402216] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-09. [2025-09-23T18:10:15.921440] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-09-23T18:10:16.191817] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-23T18:10:16.200498] [INFO ] [REMOTE ] CRK: Full fetch complete (75514 records). [2025-09-23T18:10:16.200677] [DEBUG] [VALIDATOR ] CRK: Validating primary data. [2025-09-23T18:10:16.212762] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-05. [2025-09-23T18:10:16.633919] [DEBUG] [VALIDATOR ] CRK: All expected trading days are present. [2025-09-23T18:10:16.634067] [DEBUG] [VALIDATOR ] CRK: Primary data validation passed. [2025-09-23T18:10:16.634916] [INFO ] [MAIN ] CRK: Fetched primary data is valid. [2025-09-23T18:10:16.634982] [DEBUG] [LOCAL ] CRK: Saving primary data. [2025-09-23T18:10:16.636571] [DEBUG] [LOCAL ] CRK: Trimmed 75514 records to 52121 (keeping 200 days of data) [2025-09-23T18:10:16.942343] [DEBUG] [LOCAL ] CRK: Primary data saved (52121 records). [2025-09-23T18:10:16.942501] [INFO ] [MAIN ] CRK: Full history saved. [2025-09-23T18:10:16.942616] [INFO ] [MAIN ] Update Progress: 532/2372 symbols completed. CRK took 27.0s. Estimated remaining: 4h 2m 54s. Rate: 7.6 symbols/min [2025-09-23T18:10:17.011921] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-03. [2025-09-23T18:10:17.134403] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:10:17.178879] [DEBUG] [LOCAL ] CRS: Loaded 43444 existing records from primary storage. [2025-09-23T18:10:17.179060] [INFO ] [MAIN ] CRS: Loaded 43444 existing records. [2025-09-23T18:10:17.335796] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-23T18:10:17.381000] [INFO ] [REMOTE ] CRH: Full fetch complete (77299 records). [2025-09-23T18:10:17.394404] [DEBUG] [VALIDATOR ] CRH: Validating primary data. [2025-09-23T18:10:17.405842] [WARN ] [MAIN ] CRS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:10:17.406199] [INFO ] [MAIN ] CRS: Wiping existing primary data before full refresh. [2025-09-23T18:10:17.406260] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-09-23T18:10:17.429358] [DEBUG] [LOCAL ] CRS: Deleted primary data file. [2025-09-23T18:10:17.429456] [INFO ] [MAIN ] CRS: Starting full primary refresh. [2025-09-23T18:10:18.246827] [INFO ] [REMOTE ] CRS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:10:18.247414] [INFO ] [REMOTE ] CRS: Fetching primary data for 2024-12. [2025-09-23T18:10:18.248533] [DEBUG] [VALIDATOR ] CRH: All expected trading days are present. [2025-09-23T18:10:18.248700] [DEBUG] [VALIDATOR ] CRH: Primary data validation passed. [2025-09-23T18:10:18.249612] [INFO ] [MAIN ] CRH: Fetched primary data is valid. [2025-09-23T18:10:18.249862] [DEBUG] [LOCAL ] CRH: Saving primary data. [2025-09-23T18:10:18.279552] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-23T18:10:18.279761] [DEBUG] [LOCAL ] CRH: Trimmed 77299 records to 53472 (keeping 200 days of data) [2025-09-23T18:10:18.602866] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-06. [2025-09-23T18:10:18.629341] [DEBUG] [LOCAL ] CRH: Primary data saved (53472 records). [2025-09-23T18:10:18.629493] [INFO ] [MAIN ] CRH: Full history saved. [2025-09-23T18:10:18.629587] [INFO ] [MAIN ] Update Progress: 533/2372 symbols completed. CRH took 41.6s. Estimated remaining: 4h 2m 24s. Rate: 7.6 symbols/min [2025-09-23T18:10:18.799899] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:10:18.806170] [DEBUG] [LOCAL ] CRT: Loaded 4932 existing records from primary storage. [2025-09-23T18:10:18.806256] [INFO ] [MAIN ] CRT: Loaded 4932 existing records. [2025-09-23T18:10:18.988323] [WARN ] [MAIN ] CRT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:10:18.988827] [INFO ] [MAIN ] CRT: Wiping existing primary data before full refresh. [2025-09-23T18:10:18.988993] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-09-23T18:10:18.989470] [DEBUG] [LOCAL ] CRT: Deleted primary data file. [2025-09-23T18:10:18.989568] [INFO ] [MAIN ] CRT: Starting full primary refresh. [2025-09-23T18:10:19.347891] [INFO ] [REMOTE ] CRT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:10:19.378465] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-09-23T18:10:19.402154] [INFO ] [REMOTE ] CRT: Fetching primary data for 2024-12. [2025-09-23T18:10:19.778722] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-23T18:10:19.983107] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-23T18:10:19.996950] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-23T18:10:20.202201] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-04. [2025-09-23T18:10:21.002192] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-07. [2025-09-23T18:10:21.802221] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-01. [2025-09-23T18:10:22.208025] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-23T18:10:22.320717] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-23T18:10:22.602200] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-05. [2025-09-23T18:10:23.068421] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-23T18:10:23.402206] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-02. [2025-09-23T18:10:24.202201] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-01. [2025-09-23T18:10:24.704364] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-23T18:10:24.963187] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-23T18:10:25.002151] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-03. [2025-09-23T18:10:25.082857] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-09-23T18:10:25.802233] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-08. [2025-09-23T18:10:26.602215] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-02. [2025-09-23T18:10:26.765321] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-23T18:10:27.009630] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-23T18:10:27.043624] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-23T18:10:27.402256] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-06. [2025-09-23T18:10:28.202235] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-03. [2025-09-23T18:10:28.622322] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-23T18:10:29.002230] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-04. [2025-09-23T18:10:29.495590] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-23T18:10:29.498918] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-23T18:10:29.802193] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-09. [2025-09-23T18:10:30.602242] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-07. [2025-09-23T18:10:31.072962] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-23T18:10:31.082619] [INFO ] [REMOTE ] CRL: Full fetch complete (62374 records). [2025-09-23T18:10:31.082782] [DEBUG] [VALIDATOR ] CRL: Validating primary data. [2025-09-23T18:10:31.083703] [FATAL] [VALIDATOR ] CRL: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:10:31.083806] [FATAL] [MAIN ] CRL: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:10:31.083850] [WARN ] [MAIN ] CRL: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:10:31.083892] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-09-23T18:10:31.083974] [DEBUG] [LOCAL ] CRL: No primary data file found to delete. [2025-09-23T18:10:31.084033] [INFO ] [LOCAL ] CRL: Starting deletion of derivative data. [2025-09-23T18:10:31.084482] [DEBUG] [LOCAL ] CRL: Deleted derivative data file. [2025-09-23T18:10:31.084595] [INFO ] [MAIN ] Update Progress: 534/2372 symbols completed. CRL took 35.4s. Estimated remaining: 4h 2m 32s. Rate: 7.6 symbols/min [2025-09-23T18:10:31.256054] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:10:31.297695] [DEBUG] [LOCAL ] CSAN: Loaded 42137 existing records from primary storage. [2025-09-23T18:10:31.297865] [INFO ] [MAIN ] CSAN: Loaded 42137 existing records. [2025-09-23T18:10:31.407357] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-04. [2025-09-23T18:10:31.481142] [WARN ] [MAIN ] CSAN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:10:31.481381] [INFO ] [MAIN ] CSAN: Wiping existing primary data before full refresh. [2025-09-23T18:10:31.481429] [INFO ] [LOCAL ] CSAN: Starting deletion of primary data. [2025-09-23T18:10:31.482429] [DEBUG] [LOCAL ] CSAN: Deleted primary data file. [2025-09-23T18:10:31.482494] [INFO ] [MAIN ] CSAN: Starting full primary refresh. [2025-09-23T18:10:31.902380] [INFO ] [REMOTE ] CSAN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:10:32.202255] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2024-12. [2025-09-23T18:10:33.002224] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-05. [2025-09-23T18:10:33.157712] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-09-23T18:10:33.319551] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-23T18:10:33.433827] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-23T18:10:33.461232] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-23T18:10:33.802240] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-08. [2025-09-23T18:10:34.602192] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-05. [2025-09-23T18:10:35.402268] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-06. [2025-09-23T18:10:35.941167] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-23T18:10:36.007537] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-23T18:10:36.014702] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-23T18:10:36.202269] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-01. [2025-09-23T18:10:37.002271] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-07. [2025-09-23T18:10:37.343712] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-23T18:10:37.440427] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-23T18:10:37.802202] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-02. [2025-09-23T18:10:38.602231] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-08. [2025-09-23T18:10:38.981878] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-23T18:10:39.059062] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-23T18:10:39.402491] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-09. [2025-09-23T18:10:40.202189] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-06. [2025-09-23T18:10:41.002202] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-03. [2025-09-23T18:10:41.767537] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-09-23T18:10:41.783093] [INFO ] [REMOTE ] CRM: Full fetch complete (77844 records). [2025-09-23T18:10:41.783290] [DEBUG] [VALIDATOR ] CRM: Validating primary data. [2025-09-23T18:10:41.813755] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-09. [2025-09-23T18:10:42.262288] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-23T18:10:42.259815] [DEBUG] [VALIDATOR ] CRM: All expected trading days are present. [2025-09-23T18:10:42.271753] [DEBUG] [VALIDATOR ] CRM: Primary data validation passed. [2025-09-23T18:10:42.273097] [INFO ] [MAIN ] CRM: Fetched primary data is valid. [2025-09-23T18:10:42.273269] [DEBUG] [LOCAL ] CRM: Saving primary data. [2025-09-23T18:10:42.280110] [DEBUG] [LOCAL ] CRM: Trimmed 77844 records to 53770 (keeping 200 days of data) [2025-09-23T18:10:42.410197] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-23T18:10:42.579245] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-23T18:10:42.583063] [INFO ] [REMOTE ] CRT: Full fetch complete (7625 records). [2025-09-23T18:10:42.583399] [DEBUG] [VALIDATOR ] CRT: Validating primary data. [2025-09-23T18:10:42.607402] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-07. [2025-09-23T18:10:43.042681] [DEBUG] [VALIDATOR ] CRT: All expected trading days are present. [2025-09-23T18:10:43.043115] [DEBUG] [VALIDATOR ] CRT: Primary data validation passed. [2025-09-23T18:10:43.043888] [INFO ] [MAIN ] CRT: Fetched primary data is valid. [2025-09-23T18:10:43.044816] [DEBUG] [LOCAL ] CRT: Saving primary data. [2025-09-23T18:10:43.047619] [DEBUG] [LOCAL ] CRT: Trimmed 7625 records to 4954 (keeping 200 days of data) [2025-09-23T18:10:43.083180] [DEBUG] [LOCAL ] CRT: Primary data saved (4954 records). [2025-09-23T18:10:43.083861] [INFO ] [MAIN ] CRT: Full history saved. [2025-09-23T18:10:43.084293] [INFO ] [MAIN ] Update Progress: 535/2372 symbols completed. CRT took 24.5s. Estimated remaining: 4h 2m 38s. Rate: 7.6 symbols/min [2025-09-23T18:10:43.270367] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:10:43.284934] [DEBUG] [LOCAL ] CRM: Primary data saved (53770 records). [2025-09-23T18:10:43.285087] [INFO ] [MAIN ] CRM: Full history saved. [2025-09-23T18:10:43.290061] [INFO ] [MAIN ] Update Progress: 536/2372 symbols completed. CRM took 36.9s. Estimated remaining: 4h 2m 4s. Rate: 7.6 symbols/min [2025-09-23T18:10:43.406277] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-04. [2025-09-23T18:10:43.488303] [DEBUG] [LOCAL ] CSL: Loaded 31486 existing records from primary storage. [2025-09-23T18:10:43.518455] [INFO ] [MAIN ] CSL: Loaded 31486 existing records. [2025-09-23T18:10:43.518031] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:10:43.710976] [DEBUG] [LOCAL ] CSR: Loaded 12483 existing records from primary storage. [2025-09-23T18:10:43.726956] [INFO ] [MAIN ] CSR: Loaded 12483 existing records. [2025-09-23T18:10:43.733047] [WARN ] [MAIN ] CSL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:10:43.816542] [INFO ] [MAIN ] CSL: Wiping existing primary data before full refresh. [2025-09-23T18:10:43.838159] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-09-23T18:10:43.844957] [DEBUG] [LOCAL ] CSL: Deleted primary data file. [2025-09-23T18:10:43.878334] [INFO ] [MAIN ] CSL: Starting full primary refresh. [2025-09-23T18:10:44.006966] [WARN ] [MAIN ] CSR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:10:44.036699] [INFO ] [MAIN ] CSR: Wiping existing primary data before full refresh. [2025-09-23T18:10:44.072188] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-09-23T18:10:44.110872] [DEBUG] [LOCAL ] CSR: Deleted primary data file. [2025-09-23T18:10:44.149500] [INFO ] [MAIN ] CSR: Starting full primary refresh. [2025-09-23T18:10:44.514087] [INFO ] [REMOTE ] CSL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:10:44.536841] [INFO ] [REMOTE ] CSL: Fetching primary data for 2024-12. [2025-09-23T18:10:44.736266] [INFO ] [REMOTE ] CSR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:10:44.764875] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-23T18:10:44.803360] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-23T18:10:45.002190] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-08. [2025-09-23T18:10:45.802180] [INFO ] [REMOTE ] CSR: Fetching primary data for 2024-12. [2025-09-23T18:10:46.105282] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-23T18:10:46.350703] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-23T18:10:46.500952] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-23T18:10:46.602195] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-01. [2025-09-23T18:10:47.402208] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-01. [2025-09-23T18:10:47.945126] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-23T18:10:48.147185] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-23T18:10:48.202149] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-02. [2025-09-23T18:10:48.703616] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-23T18:10:49.002212] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-03. [2025-09-23T18:10:49.789944] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-23T18:10:49.802139] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-04. [2025-09-23T18:10:50.602216] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-02. [2025-09-23T18:10:50.792894] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-23T18:10:51.402263] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-05. [2025-09-23T18:10:51.711460] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-23T18:10:52.018599] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-23T18:10:52.202251] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-09. [2025-09-23T18:10:53.002214] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-05. [2025-09-23T18:10:53.452060] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-23T18:10:53.459311] [INFO ] [REMOTE ] CRS: Full fetch complete (62522 records). [2025-09-23T18:10:53.459509] [DEBUG] [VALIDATOR ] CRS: Validating primary data. [2025-09-23T18:10:53.807395] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-06. [2025-09-23T18:10:53.862298] [DEBUG] [VALIDATOR ] CRS: All expected trading days are present. [2025-09-23T18:10:53.862384] [DEBUG] [VALIDATOR ] CRS: Primary data validation passed. [2025-09-23T18:10:53.863141] [INFO ] [MAIN ] CRS: Fetched primary data is valid. [2025-09-23T18:10:53.863206] [DEBUG] [LOCAL ] CRS: Saving primary data. [2025-09-23T18:10:53.865878] [DEBUG] [LOCAL ] CRS: Trimmed 62522 records to 43423 (keeping 200 days of data) [2025-09-23T18:10:54.165137] [DEBUG] [LOCAL ] CRS: Primary data saved (43423 records). [2025-09-23T18:10:54.165396] [INFO ] [MAIN ] CRS: Full history saved. [2025-09-23T18:10:54.165874] [INFO ] [MAIN ] Update Progress: 537/2372 symbols completed. CRS took 37.2s. Estimated remaining: 4h 2m 6s. Rate: 7.6 symbols/min [2025-09-23T18:10:54.297773] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-23T18:10:54.393826] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:10:54.444942] [DEBUG] [LOCAL ] CSTM: Loaded 47773 existing records from primary storage. [2025-09-23T18:10:54.445087] [INFO ] [MAIN ] CSTM: Loaded 47773 existing records. [2025-09-23T18:10:54.625440] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-03. [2025-09-23T18:10:54.632331] [WARN ] [MAIN ] CSTM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:10:54.640425] [INFO ] [MAIN ] CSTM: Wiping existing primary data before full refresh. [2025-09-23T18:10:54.641417] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-23T18:10:54.641159] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-09-23T18:10:54.646195] [DEBUG] [LOCAL ] CSTM: Deleted primary data file. [2025-09-23T18:10:54.646261] [INFO ] [MAIN ] CSTM: Starting full primary refresh. [2025-09-23T18:10:55.007235] [INFO ] [REMOTE ] CSTM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:10:55.402249] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-06. [2025-09-23T18:10:55.898700] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-23T18:10:56.202252] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-04. [2025-09-23T18:10:56.894048] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-23T18:10:57.002174] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2024-12. [2025-09-23T18:10:57.474057] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-23T18:10:57.802230] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-07. [2025-09-23T18:10:58.231710] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-23T18:10:58.500265] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-23T18:10:58.602263] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-07. [2025-09-23T18:10:59.402242] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-08. [2025-09-23T18:10:59.951205] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-23T18:11:00.164395] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-23T18:11:00.202173] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-08. [2025-09-23T18:11:01.002261] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-05. [2025-09-23T18:11:01.260738] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-23T18:11:01.802233] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-09. [2025-09-23T18:11:01.981257] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-23T18:11:02.602301] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-09. [2025-09-23T18:11:02.978413] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-23T18:11:02.981425] [INFO ] [REMOTE ] CSR: Full fetch complete (17427 records). [2025-09-23T18:11:02.981513] [DEBUG] [VALIDATOR ] CSR: Validating primary data. [2025-09-23T18:11:03.367740] [DEBUG] [VALIDATOR ] CSR: All expected trading days are present. [2025-09-23T18:11:03.367899] [DEBUG] [VALIDATOR ] CSR: Primary data validation passed. [2025-09-23T18:11:03.368229] [INFO ] [MAIN ] CSR: Fetched primary data is valid. [2025-09-23T18:11:03.368270] [DEBUG] [LOCAL ] CSR: Saving primary data. [2025-09-23T18:11:03.368829] [DEBUG] [LOCAL ] CSR: Trimmed 17427 records to 12558 (keeping 200 days of data) [2025-09-23T18:11:03.405177] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-06. [2025-09-23T18:11:03.450407] [DEBUG] [LOCAL ] CSR: Primary data saved (12558 records). [2025-09-23T18:11:03.450564] [INFO ] [MAIN ] CSR: Full history saved. [2025-09-23T18:11:03.450723] [INFO ] [MAIN ] Update Progress: 538/2372 symbols completed. CSR took 20.2s. Estimated remaining: 4h 2m 3s. Rate: 7.6 symbols/min [2025-09-23T18:11:03.625295] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:11:03.640540] [DEBUG] [LOCAL ] CSV: Loaded 13038 existing records from primary storage. [2025-09-23T18:11:03.640695] [INFO ] [MAIN ] CSV: Loaded 13038 existing records. [2025-09-23T18:11:03.830869] [WARN ] [MAIN ] CSV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:11:03.831347] [INFO ] [MAIN ] CSV: Wiping existing primary data before full refresh. [2025-09-23T18:11:03.831465] [INFO ] [LOCAL ] CSV: Starting deletion of primary data. [2025-09-23T18:11:03.832281] [DEBUG] [LOCAL ] CSV: Deleted primary data file. [2025-09-23T18:11:03.832349] [INFO ] [MAIN ] CSV: Starting full primary refresh. [2025-09-23T18:11:03.930502] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-23T18:11:03.966521] [INFO ] [REMOTE ] CSAN: Full fetch complete (60839 records). [2025-09-23T18:11:03.977245] [DEBUG] [VALIDATOR ] CSAN: Validating primary data. [2025-09-23T18:11:04.207822] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-01. [2025-09-23T18:11:04.554581] [INFO ] [REMOTE ] CSV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:11:04.688464] [DEBUG] [VALIDATOR ] CSAN: All expected trading days are present. [2025-09-23T18:11:04.688575] [DEBUG] [VALIDATOR ] CSAN: Primary data validation passed. [2025-09-23T18:11:04.689388] [INFO ] [MAIN ] CSAN: Fetched primary data is valid. [2025-09-23T18:11:04.689456] [DEBUG] [LOCAL ] CSAN: Saving primary data. [2025-09-23T18:11:04.696867] [DEBUG] [LOCAL ] CSAN: Trimmed 60839 records to 42250 (keeping 200 days of data) [2025-09-23T18:11:04.708427] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-23T18:11:04.973037] [DEBUG] [LOCAL ] CSAN: Primary data saved (42250 records). [2025-09-23T18:11:04.973447] [INFO ] [MAIN ] CSAN: Full history saved. [2025-09-23T18:11:04.973580] [INFO ] [MAIN ] Update Progress: 539/2372 symbols completed. CSAN took 33.9s. Estimated remaining: 4h 1m 33s. Rate: 7.6 symbols/min [2025-09-23T18:11:05.007368] [INFO ] [REMOTE ] CSV: Fetching primary data for 2024-12. [2025-09-23T18:11:05.150353] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:11:05.150544] [DEBUG] [LOCAL ] CSW: No existing data file found in primary storage. [2025-09-23T18:11:05.150600] [WARN ] [MAIN ] CSW: No existing data found, performing full refresh instead. [2025-09-23T18:11:05.150808] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-09-23T18:11:05.150851] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-09-23T18:11:05.150895] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-09-23T18:11:05.150996] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-09-23T18:11:05.512485] [INFO ] [REMOTE ] CSW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:11:05.580436] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-23T18:11:05.802199] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-02. [2025-09-23T18:11:06.026321] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-23T18:11:06.602302] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-07. [2025-09-23T18:11:06.922882] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-23T18:11:07.402305] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-03. [2025-09-23T18:11:07.948358] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-23T18:11:08.202246] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-01. [2025-09-23T18:11:08.845076] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-23T18:11:08.943970] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-23T18:11:09.002231] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-04. [2025-09-23T18:11:09.802246] [INFO ] [REMOTE ] CSW: Fetching primary data for 2024-12. [2025-09-23T18:11:10.021246] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:11:10.021592] [WARN ] [REMOTE ] CSW: No data returned for month 2024-12 [2025-09-23T18:11:10.602166] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-01. [2025-09-23T18:11:10.759489] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-23T18:11:10.842338] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:11:10.842747] [WARN ] [REMOTE ] CSW: No data returned for month 2025-01 [2025-09-23T18:11:11.402190] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-08. [2025-09-23T18:11:12.202253] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-05. [2025-09-23T18:11:12.381122] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-23T18:11:13.002195] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-09. [2025-09-23T18:11:13.807409] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-02. [2025-09-23T18:11:13.825566] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-23T18:11:14.214806] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-23T18:11:14.223170] [INFO ] [REMOTE ] CSL: Full fetch complete (45081 records). [2025-09-23T18:11:14.223368] [DEBUG] [VALIDATOR ] CSL: Validating primary data. [2025-09-23T18:11:14.602694] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-06. [2025-09-23T18:11:14.642715] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-23T18:11:14.699029] [DEBUG] [VALIDATOR ] CSL: All expected trading days are present. [2025-09-23T18:11:14.699122] [DEBUG] [VALIDATOR ] CSL: Primary data validation passed. [2025-09-23T18:11:14.699924] [INFO ] [MAIN ] CSL: Fetched primary data is valid. [2025-09-23T18:11:14.699991] [DEBUG] [LOCAL ] CSL: Saving primary data. [2025-09-23T18:11:14.701221] [DEBUG] [LOCAL ] CSL: Trimmed 45081 records to 31553 (keeping 200 days of data) [2025-09-23T18:11:14.931156] [DEBUG] [LOCAL ] CSL: Primary data saved (31553 records). [2025-09-23T18:11:14.931316] [INFO ] [MAIN ] CSL: Full history saved. [2025-09-23T18:11:14.931428] [INFO ] [MAIN ] Update Progress: 540/2372 symbols completed. CSL took 31.8s. Estimated remaining: 4h 1m 32s. Rate: 7.6 symbols/min [2025-09-23T18:11:15.106076] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:11:15.115869] [DEBUG] [LOCAL ] CTBB: Loaded 7179 existing records from primary storage. [2025-09-23T18:11:15.115977] [INFO ] [MAIN ] CTBB: Loaded 7179 existing records. [2025-09-23T18:11:15.299170] [WARN ] [MAIN ] CTBB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:11:15.299463] [INFO ] [MAIN ] CTBB: Wiping existing primary data before full refresh. [2025-09-23T18:11:15.299515] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-09-23T18:11:15.299918] [DEBUG] [LOCAL ] CTBB: Deleted primary data file. [2025-09-23T18:11:15.299984] [INFO ] [MAIN ] CTBB: Starting full primary refresh. [2025-09-23T18:11:15.410143] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-02. [2025-09-23T18:11:15.654634] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:11:15.676189] [INFO ] [REMOTE ] CTBB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:11:15.676516] [WARN ] [REMOTE ] CSW: No data returned for month 2025-02 [2025-09-23T18:11:16.176438] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-23T18:11:16.202153] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-07. [2025-09-23T18:11:17.002246] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-03. [2025-09-23T18:11:17.802167] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-03. [2025-09-23T18:11:17.832474] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-23T18:11:18.013805] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:11:18.014116] [WARN ] [REMOTE ] CSW: No data returned for month 2025-03 [2025-09-23T18:11:18.255356] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-23T18:11:18.602223] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-04. [2025-09-23T18:11:19.402219] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-08. [2025-09-23T18:11:19.497990] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-23T18:11:20.202193] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2024-12. [2025-09-23T18:11:20.772586] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-23T18:11:20.817520] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-23T18:11:21.002206] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-01. [2025-09-23T18:11:21.504151] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-23T18:11:21.802192] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-02. [2025-09-23T18:11:22.180311] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-23T18:11:22.602216] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-05. [2025-09-23T18:11:23.402185] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-03. [2025-09-23T18:11:23.476215] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-23T18:11:24.048822] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-23T18:11:24.202230] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-04. [2025-09-23T18:11:24.400416] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:11:24.400820] [WARN ] [REMOTE ] CSW: No data returned for month 2025-04 [2025-09-23T18:11:25.002235] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-09. [2025-09-23T18:11:25.802233] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-06. [2025-09-23T18:11:26.291884] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-23T18:11:26.300583] [INFO ] [REMOTE ] CSTM: Full fetch complete (69011 records). [2025-09-23T18:11:26.300785] [DEBUG] [VALIDATOR ] CSTM: Validating primary data. [2025-09-23T18:11:26.607326] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-05. [2025-09-23T18:11:26.688687] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-23T18:11:26.732791] [DEBUG] [VALIDATOR ] CSTM: All expected trading days are present. [2025-09-23T18:11:26.733044] [DEBUG] [VALIDATOR ] CSTM: Primary data validation passed. [2025-09-23T18:11:26.734481] [INFO ] [MAIN ] CSTM: Fetched primary data is valid. [2025-09-23T18:11:26.734550] [DEBUG] [LOCAL ] CSTM: Saving primary data. [2025-09-23T18:11:26.736086] [DEBUG] [LOCAL ] CSTM: Trimmed 69011 records to 47738 (keeping 200 days of data) [2025-09-23T18:11:26.834918] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:11:26.836622] [WARN ] [REMOTE ] CSW: No data returned for month 2025-05 [2025-09-23T18:11:27.035427] [DEBUG] [LOCAL ] CSTM: Primary data saved (47738 records). [2025-09-23T18:11:27.035564] [INFO ] [MAIN ] CSTM: Full history saved. [2025-09-23T18:11:27.035680] [INFO ] [MAIN ] Update Progress: 541/2372 symbols completed. CSTM took 32.9s. Estimated remaining: 4h 1m 38s. Rate: 7.6 symbols/min [2025-09-23T18:11:27.203834] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:11:27.211470] [DEBUG] [LOCAL ] CTDD: Loaded 5837 existing records from primary storage. [2025-09-23T18:11:27.211604] [INFO ] [MAIN ] CTDD: Loaded 5837 existing records. [2025-09-23T18:11:27.388011] [WARN ] [MAIN ] CTDD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:11:27.388247] [INFO ] [MAIN ] CTDD: Wiping existing primary data before full refresh. [2025-09-23T18:11:27.388294] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-09-23T18:11:27.388720] [DEBUG] [LOCAL ] CTDD: Deleted primary data file. [2025-09-23T18:11:27.388781] [INFO ] [MAIN ] CTDD: Starting full primary refresh. [2025-09-23T18:11:27.408853] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-04. [2025-09-23T18:11:27.750819] [INFO ] [REMOTE ] CTDD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:11:27.974527] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-23T18:11:28.202242] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-05. [2025-09-23T18:11:28.663296] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-23T18:11:29.002253] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-07. [2025-09-23T18:11:29.623147] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-23T18:11:29.802205] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-08. [2025-09-23T18:11:30.602243] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-06. [2025-09-23T18:11:30.702756] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-23T18:11:31.186154] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-23T18:11:31.402257] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2024-12. [2025-09-23T18:11:31.996086] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-23T18:11:32.202194] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-09. [2025-09-23T18:11:32.839378] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-23T18:11:32.842242] [INFO ] [REMOTE ] CSV: Full fetch complete (19471 records). [2025-09-23T18:11:32.842344] [DEBUG] [VALIDATOR ] CSV: Validating primary data. [2025-09-23T18:11:33.016287] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-07. [2025-09-23T18:11:33.215623] [DEBUG] [VALIDATOR ] CSV: All expected trading days are present. [2025-09-23T18:11:33.215734] [DEBUG] [VALIDATOR ] CSV: Primary data validation passed. [2025-09-23T18:11:33.216113] [INFO ] [MAIN ] CSV: Fetched primary data is valid. [2025-09-23T18:11:33.216153] [DEBUG] [LOCAL ] CSV: Saving primary data. [2025-09-23T18:11:33.216846] [DEBUG] [LOCAL ] CSV: Trimmed 19471 records to 13081 (keeping 200 days of data) [2025-09-23T18:11:33.297324] [DEBUG] [LOCAL ] CSV: Primary data saved (13081 records). [2025-09-23T18:11:33.297476] [INFO ] [MAIN ] CSV: Full history saved. [2025-09-23T18:11:33.297563] [INFO ] [MAIN ] Update Progress: 542/2372 symbols completed. CSV took 29.8s. Estimated remaining: 4h 1m 25s. Rate: 7.6 symbols/min [2025-09-23T18:11:33.469271] [INFO ] [MAIN ] CTEST: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:11:33.469490] [DEBUG] [LOCAL ] CTEST: No existing data file found in primary storage. [2025-09-23T18:11:33.469545] [WARN ] [MAIN ] CTEST: No existing data found, performing full refresh instead. [2025-09-23T18:11:33.469731] [INFO ] [MAIN ] CTEST: Wiping existing primary data before full refresh. [2025-09-23T18:11:33.469782] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-09-23T18:11:33.469824] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-09-23T18:11:33.469856] [INFO ] [MAIN ] CTEST: Starting full primary refresh. [2025-09-23T18:11:33.811255] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-06. [2025-09-23T18:11:33.834700] [INFO ] [REMOTE ] CTEST: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:11:33.985520] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-23T18:11:34.407002] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-23T18:11:34.602201] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-01. [2025-09-23T18:11:34.982063] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-23T18:11:35.402245] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-02. [2025-09-23T18:11:35.982432] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-23T18:11:36.202259] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2024-12. [2025-09-23T18:11:36.745797] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:11:36.746124] [WARN ] [REMOTE ] CTEST: No data returned for month 2024-12 [2025-09-23T18:11:37.002239] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-08. [2025-09-23T18:11:37.802213] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-07. [2025-09-23T18:11:38.099848] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-23T18:11:38.209375] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-23T18:11:38.602197] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-03. [2025-09-23T18:11:39.060423] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-23T18:11:39.402204] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-04. [2025-09-23T18:11:40.196196] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-23T18:11:40.202130] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-05. [2025-09-23T18:11:40.614716] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-23T18:11:41.002211] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-09. [2025-09-23T18:11:41.802214] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-08. [2025-09-23T18:11:41.945972] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-23T18:11:41.949148] [INFO ] [REMOTE ] CSW: Full fetch complete (7993 records). [2025-09-23T18:11:41.949218] [DEBUG] [VALIDATOR ] CSW: Validating primary data. [2025-09-23T18:11:42.130495] [WARN ] [VALIDATOR ] CSW: Validation failed - insufficient historical data. Have 74 unique days, need 200 days [2025-09-23T18:11:42.130780] [FATAL] [MAIN ] CSW: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:11:42.130870] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:11:42.130945] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-09-23T18:11:42.131014] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-09-23T18:11:42.131064] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-09-23T18:11:42.131137] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-09-23T18:11:42.131213] [INFO ] [MAIN ] Update Progress: 543/2372 symbols completed. CSW took 37.2s. Estimated remaining: 4h 1m 20s. Rate: 7.6 symbols/min [2025-09-23T18:11:42.379557] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:11:42.380007] [DEBUG] [LOCAL ] CTEV: No existing data file found in primary storage. [2025-09-23T18:11:42.380065] [WARN ] [MAIN ] CTEV: No existing data found, performing full refresh instead. [2025-09-23T18:11:42.380219] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-09-23T18:11:42.380263] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-09-23T18:11:42.380307] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-09-23T18:11:42.380340] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-09-23T18:11:42.508523] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-23T18:11:42.607297] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-06. [2025-09-23T18:11:42.770921] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:11:43.375292] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-23T18:11:43.402212] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-09. [2025-09-23T18:11:44.025861] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-23T18:11:44.027448] [INFO ] [REMOTE ] CTBB: Full fetch complete (10982 records). [2025-09-23T18:11:44.027519] [DEBUG] [VALIDATOR ] CTBB: Validating primary data. [2025-09-23T18:11:44.214536] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-07. [2025-09-23T18:11:44.399982] [DEBUG] [VALIDATOR ] CTBB: All expected trading days are present. [2025-09-23T18:11:44.400062] [DEBUG] [VALIDATOR ] CTBB: Primary data validation passed. [2025-09-23T18:11:44.400354] [INFO ] [MAIN ] CTBB: Fetched primary data is valid. [2025-09-23T18:11:44.400393] [DEBUG] [LOCAL ] CTBB: Saving primary data. [2025-09-23T18:11:44.400869] [DEBUG] [LOCAL ] CTBB: Trimmed 10982 records to 7105 (keeping 200 days of data) [2025-09-23T18:11:44.443580] [DEBUG] [LOCAL ] CTBB: Primary data saved (7105 records). [2025-09-23T18:11:44.443722] [INFO ] [MAIN ] CTBB: Full history saved. [2025-09-23T18:11:44.443818] [INFO ] [MAIN ] Update Progress: 544/2372 symbols completed. CTBB took 29.5s. Estimated remaining: 4h 0m 53s. Rate: 7.6 symbols/min [2025-09-23T18:11:44.610881] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:11:44.611064] [DEBUG] [LOCAL ] CTO: No existing data file found in primary storage. [2025-09-23T18:11:44.611100] [WARN ] [MAIN ] CTO: No existing data found, performing full refresh instead. [2025-09-23T18:11:44.611257] [INFO ] [MAIN ] CTO: Wiping existing primary data before full refresh. [2025-09-23T18:11:44.611298] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-09-23T18:11:44.611338] [DEBUG] [LOCAL ] CTO: No primary data file found to delete. [2025-09-23T18:11:44.611371] [INFO ] [MAIN ] CTO: Starting full primary refresh. [2025-09-23T18:11:44.791944] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-23T18:11:44.983801] [INFO ] [REMOTE ] CTO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:11:45.002147] [INFO ] [REMOTE ] CTO: Fetching primary data for 2024-12. [2025-09-23T18:11:45.802199] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-08. [2025-09-23T18:11:46.260078] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-23T18:11:46.453906] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-23T18:11:46.602250] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-01. [2025-09-23T18:11:46.931679] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:11:46.932212] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-01 [2025-09-23T18:11:47.402269] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-02. [2025-09-23T18:11:47.619940] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:11:47.620531] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-02 [2025-09-23T18:11:48.202241] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-03. [2025-09-23T18:11:48.420965] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:11:48.421309] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-03 [2025-09-23T18:11:49.002203] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2024-12. [2025-09-23T18:11:49.196390] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:11:49.196821] [WARN ] [REMOTE ] CTEV: No data returned for month 2024-12 [2025-09-23T18:11:49.802212] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-09. [2025-09-23T18:11:50.336422] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-23T18:11:50.338101] [INFO ] [REMOTE ] CTDD: Full fetch complete (8544 records). [2025-09-23T18:11:50.338189] [DEBUG] [VALIDATOR ] CTDD: Validating primary data. [2025-09-23T18:11:50.607378] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-04. [2025-09-23T18:11:50.714680] [DEBUG] [VALIDATOR ] CTDD: All expected trading days are present. [2025-09-23T18:11:50.714778] [DEBUG] [VALIDATOR ] CTDD: Primary data validation passed. [2025-09-23T18:11:50.715036] [INFO ] [MAIN ] CTDD: Fetched primary data is valid. [2025-09-23T18:11:50.715076] [DEBUG] [LOCAL ] CTDD: Saving primary data. [2025-09-23T18:11:50.715530] [DEBUG] [LOCAL ] CTDD: Trimmed 8544 records to 5842 (keeping 200 days of data) [2025-09-23T18:11:50.751615] [DEBUG] [LOCAL ] CTDD: Primary data saved (5842 records). [2025-09-23T18:11:50.751768] [INFO ] [MAIN ] CTDD: Full history saved. [2025-09-23T18:11:50.751876] [INFO ] [MAIN ] Update Progress: 545/2372 symbols completed. CTDD took 23.7s. Estimated remaining: 4h 0m 40s. Rate: 7.6 symbols/min [2025-09-23T18:11:50.899441] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:11:50.923717] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:11:50.924354] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-04 [2025-09-23T18:11:50.961620] [DEBUG] [LOCAL ] CTOS: Loaded 36886 existing records from primary storage. [2025-09-23T18:11:50.961810] [INFO ] [MAIN ] CTOS: Loaded 36886 existing records. [2025-09-23T18:11:51.138597] [WARN ] [MAIN ] CTOS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:11:51.138882] [INFO ] [MAIN ] CTOS: Wiping existing primary data before full refresh. [2025-09-23T18:11:51.138932] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-09-23T18:11:51.140386] [DEBUG] [LOCAL ] CTOS: Deleted primary data file. [2025-09-23T18:11:51.140449] [INFO ] [MAIN ] CTOS: Starting full primary refresh. [2025-09-23T18:11:51.407383] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-01. [2025-09-23T18:11:51.521195] [INFO ] [REMOTE ] CTOS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:11:51.656982] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:11:51.657239] [WARN ] [REMOTE ] CTEV: No data returned for month 2025-01 [2025-09-23T18:11:52.202198] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-05. [2025-09-23T18:11:52.827611] [INFO ] [REMOTE ] CTEST: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-23T18:11:53.002198] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-02. [2025-09-23T18:11:53.462743] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-23T18:11:53.802222] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2024-12. [2025-09-23T18:11:54.602261] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-03. [2025-09-23T18:11:55.131116] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-23T18:11:55.159202] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-23T18:11:55.402224] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-06. [2025-09-23T18:11:55.675969] [INFO ] [REMOTE ] CTEST: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-09-23T18:11:56.202211] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-01. [2025-09-23T18:11:57.002231] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-01. [2025-09-23T18:11:57.156502] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-23T18:11:57.802196] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-02. [2025-09-23T18:11:57.933452] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-23T18:11:58.602213] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-04. [2025-09-23T18:11:58.690937] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-23T18:11:59.263946] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-23T18:11:59.402213] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-07. [2025-09-23T18:11:59.763841] [INFO ] [REMOTE ] CTEST: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-23T18:12:00.202192] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-08. [2025-09-23T18:12:00.602961] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:12:00.603419] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-08 [2025-09-23T18:12:01.002219] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-02. [2025-09-23T18:12:01.802268] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-09. [2025-09-23T18:12:02.602258] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-05. [2025-09-23T18:12:02.715350] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-23T18:12:03.402246] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-03. [2025-09-23T18:12:04.202277] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-03. [2025-09-23T18:12:04.430409] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:12:04.430807] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-09 [2025-09-23T18:12:04.430927] [INFO ] [REMOTE ] CTEST: Full fetch complete (1020 records). [2025-09-23T18:12:04.430997] [DEBUG] [VALIDATOR ] CTEST: Validating primary data. [2025-09-23T18:12:04.431628] [FATAL] [VALIDATOR ] CTEST: Data is stale - most recent date (2025-07-02) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:12:04.431731] [FATAL] [MAIN ] CTEST: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:12:04.431798] [WARN ] [MAIN ] CTEST: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:12:04.431870] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-09-23T18:12:04.431934] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-09-23T18:12:04.431969] [INFO ] [LOCAL ] CTEST: Starting deletion of derivative data. [2025-09-23T18:12:04.432022] [DEBUG] [LOCAL ] CTEST: No derivative data file found to delete. [2025-09-23T18:12:04.432102] [INFO ] [MAIN ] Update Progress: 546/2372 symbols completed. CTEST took 31.1s. Estimated remaining: 4h 0m 52s. Rate: 7.6 symbols/min [2025-09-23T18:12:04.603607] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:12:04.656587] [DEBUG] [LOCAL ] CTRA: Loaded 53649 existing records from primary storage. [2025-09-23T18:12:04.656782] [INFO ] [MAIN ] CTRA: Loaded 53649 existing records. [2025-09-23T18:12:04.832993] [WARN ] [MAIN ] CTRA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:12:04.833235] [INFO ] [MAIN ] CTRA: Wiping existing primary data before full refresh. [2025-09-23T18:12:04.833285] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-09-23T18:12:04.834875] [DEBUG] [LOCAL ] CTRA: Deleted primary data file. [2025-09-23T18:12:04.834938] [INFO ] [MAIN ] CTRA: Starting full primary refresh. [2025-09-23T18:12:05.189665] [INFO ] [REMOTE ] CTRA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:12:05.190009] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2024-12. [2025-09-23T18:12:05.208414] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-05 (2.61 seconds). [2025-09-23T18:12:05.802176] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-06. [2025-09-23T18:12:05.864292] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-09-23T18:12:05.949111] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-23T18:12:06.357465] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-23T18:12:06.602241] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-07. [2025-09-23T18:12:06.890793] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-23T18:12:07.402176] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-04. [2025-09-23T18:12:07.440312] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-23T18:12:08.202282] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-01. [2025-09-23T18:12:08.870747] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-23T18:12:09.002251] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-08. [2025-09-23T18:12:09.732295] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-23T18:12:09.802241] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-05. [2025-09-23T18:12:10.002008] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-23T18:12:10.540074] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-23T18:12:10.602234] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-04. [2025-09-23T18:12:11.402224] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-09. [2025-09-23T18:12:11.824476] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-23T18:12:12.047087] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-23T18:12:12.049563] [INFO ] [REMOTE ] CTEV: Full fetch complete (13486 records). [2025-09-23T18:12:12.049634] [DEBUG] [VALIDATOR ] CTEV: Validating primary data. [2025-09-23T18:12:12.206677] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-02. [2025-09-23T18:12:12.234130] [WARN ] [VALIDATOR ] CTEV: Validation failed - insufficient historical data. Have 143 unique days, need 200 days [2025-09-23T18:12:12.234369] [FATAL] [MAIN ] CTEV: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:12:12.234445] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:12:12.234492] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-09-23T18:12:12.234561] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-09-23T18:12:12.234615] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-09-23T18:12:12.234688] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-09-23T18:12:12.234762] [INFO ] [MAIN ] Update Progress: 547/2372 symbols completed. CTEV took 30.1s. Estimated remaining: 4h 0m 43s. Rate: 7.6 symbols/min [2025-09-23T18:12:12.403870] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:12:12.458618] [DEBUG] [LOCAL ] CTRE: Loaded 49213 existing records from primary storage. [2025-09-23T18:12:12.458807] [INFO ] [MAIN ] CTRE: Loaded 49213 existing records. [2025-09-23T18:12:12.635752] [WARN ] [MAIN ] CTRE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:12:12.635967] [INFO ] [MAIN ] CTRE: Wiping existing primary data before full refresh. [2025-09-23T18:12:12.636014] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-09-23T18:12:12.637843] [DEBUG] [LOCAL ] CTRE: Deleted primary data file. [2025-09-23T18:12:12.637906] [INFO ] [MAIN ] CTRE: Starting full primary refresh. [2025-09-23T18:12:12.992467] [INFO ] [REMOTE ] CTRE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:12:13.002149] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2024-12. [2025-09-23T18:12:13.802189] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-05. [2025-09-23T18:12:13.840211] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-23T18:12:14.188959] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-23T18:12:14.602195] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-06. [2025-09-23T18:12:15.256610] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-23T18:12:15.402190] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-06. [2025-09-23T18:12:16.202173] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-03. [2025-09-23T18:12:16.505616] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-23T18:12:17.002236] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-07. [2025-09-23T18:12:17.706197] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-09-23T18:12:17.802184] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-01. [2025-09-23T18:12:18.241725] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-23T18:12:18.349272] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-23T18:12:18.602197] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-08. [2025-09-23T18:12:19.070045] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-23T18:12:19.402218] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-02. [2025-09-23T18:12:19.649547] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-23T18:12:20.202235] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-09. [2025-09-23T18:12:20.971857] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-23T18:12:21.002149] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-03. [2025-09-23T18:12:21.143469] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-23T18:12:21.149006] [INFO ] [REMOTE ] CTO: Full fetch complete (41854 records). [2025-09-23T18:12:21.149126] [DEBUG] [VALIDATOR ] CTO: Validating primary data. [2025-09-23T18:12:21.534299] [DEBUG] [VALIDATOR ] CTO: All expected trading days are present. [2025-09-23T18:12:21.534385] [DEBUG] [VALIDATOR ] CTO: Primary data validation passed. [2025-09-23T18:12:21.534960] [INFO ] [MAIN ] CTO: Fetched primary data is valid. [2025-09-23T18:12:21.535024] [DEBUG] [LOCAL ] CTO: Saving primary data. [2025-09-23T18:12:21.536074] [DEBUG] [LOCAL ] CTO: Trimmed 41854 records to 28318 (keeping 200 days of data) [2025-09-23T18:12:21.719658] [DEBUG] [LOCAL ] CTO: Primary data saved (28318 records). [2025-09-23T18:12:21.719815] [INFO ] [MAIN ] CTO: Full history saved. [2025-09-23T18:12:21.719901] [INFO ] [MAIN ] Update Progress: 548/2372 symbols completed. CTO took 37.3s. Estimated remaining: 4h 0m 41s. Rate: 7.6 symbols/min [2025-09-23T18:12:21.807396] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-07. [2025-09-23T18:12:21.931296] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:12:21.970132] [DEBUG] [LOCAL ] CTRI: Loaded 37728 existing records from primary storage. [2025-09-23T18:12:21.970273] [INFO ] [MAIN ] CTRI: Loaded 37728 existing records. [2025-09-23T18:12:22.150897] [WARN ] [MAIN ] CTRI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:12:22.151183] [INFO ] [MAIN ] CTRI: Wiping existing primary data before full refresh. [2025-09-23T18:12:22.151231] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-09-23T18:12:22.152271] [DEBUG] [LOCAL ] CTRI: Deleted primary data file. [2025-09-23T18:12:22.152338] [INFO ] [MAIN ] CTRI: Starting full primary refresh. [2025-09-23T18:12:22.534431] [INFO ] [REMOTE ] CTRI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:12:22.564472] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-23T18:12:22.602159] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-04. [2025-09-23T18:12:22.915480] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-23T18:12:23.402224] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-08. [2025-09-23T18:12:24.202174] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-04. [2025-09-23T18:12:24.271364] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-23T18:12:24.547556] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-23T18:12:25.002198] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2024-12. [2025-09-23T18:12:25.802213] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-05. [2025-09-23T18:12:25.931727] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-23T18:12:26.054200] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-23T18:12:26.602208] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-05. [2025-09-23T18:12:27.155473] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-23T18:12:27.402205] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-09. [2025-09-23T18:12:28.197389] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-23T18:12:28.207927] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-06. [2025-09-23T18:12:29.002215] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-01. [2025-09-23T18:12:29.134875] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-23T18:12:29.141357] [INFO ] [REMOTE ] CTOS: Full fetch complete (53424 records). [2025-09-23T18:12:29.141538] [DEBUG] [VALIDATOR ] CTOS: Validating primary data. [2025-09-23T18:12:29.532607] [DEBUG] [VALIDATOR ] CTOS: All expected trading days are present. [2025-09-23T18:12:29.532727] [DEBUG] [VALIDATOR ] CTOS: Primary data validation passed. [2025-09-23T18:12:29.533432] [INFO ] [MAIN ] CTOS: Fetched primary data is valid. [2025-09-23T18:12:29.533486] [DEBUG] [LOCAL ] CTOS: Saving primary data. [2025-09-23T18:12:29.534820] [DEBUG] [LOCAL ] CTOS: Trimmed 53424 records to 36812 (keeping 200 days of data) [2025-09-23T18:12:29.746134] [DEBUG] [LOCAL ] CTOS: Primary data saved (36812 records). [2025-09-23T18:12:29.746298] [INFO ] [MAIN ] CTOS: Full history saved. [2025-09-23T18:12:29.746392] [INFO ] [MAIN ] Update Progress: 549/2372 symbols completed. CTOS took 39.0s. Estimated remaining: 4h 0m 33s. Rate: 7.6 symbols/min [2025-09-23T18:12:29.809607] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-06. [2025-09-23T18:12:29.916562] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:12:29.936375] [DEBUG] [LOCAL ] CTS: Loaded 19390 existing records from primary storage. [2025-09-23T18:12:29.936509] [INFO ] [MAIN ] CTS: Loaded 19390 existing records. [2025-09-23T18:12:30.115839] [WARN ] [MAIN ] CTS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:12:30.116142] [INFO ] [MAIN ] CTS: Wiping existing primary data before full refresh. [2025-09-23T18:12:30.116195] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-09-23T18:12:30.116852] [DEBUG] [LOCAL ] CTS: Deleted primary data file. [2025-09-23T18:12:30.116945] [INFO ] [MAIN ] CTS: Starting full primary refresh. [2025-09-23T18:12:30.494162] [INFO ] [REMOTE ] CTS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:12:30.564414] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-09-23T18:12:30.602202] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-07. [2025-09-23T18:12:30.886722] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-23T18:12:31.369378] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-23T18:12:31.402149] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-07. [2025-09-23T18:12:31.971556] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-23T18:12:32.202189] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-08. [2025-09-23T18:12:33.002165] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-02. [2025-09-23T18:12:33.072746] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-23T18:12:33.802196] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-08. [2025-09-23T18:12:33.895154] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-23T18:12:34.158048] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-23T18:12:34.602193] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-03. [2025-09-23T18:12:35.402238] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-09. [2025-09-23T18:12:35.509974] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-23T18:12:35.933316] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-23T18:12:36.202210] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-09. [2025-09-23T18:12:36.754910] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-23T18:12:36.763807] [INFO ] [REMOTE ] CTRE: Full fetch complete (71087 records). [2025-09-23T18:12:36.763980] [DEBUG] [VALIDATOR ] CTRE: Validating primary data. [2025-09-23T18:12:37.007297] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-04. [2025-09-23T18:12:37.179139] [DEBUG] [VALIDATOR ] CTRE: All expected trading days are present. [2025-09-23T18:12:37.179233] [DEBUG] [VALIDATOR ] CTRE: Primary data validation passed. [2025-09-23T18:12:37.180122] [INFO ] [MAIN ] CTRE: Fetched primary data is valid. [2025-09-23T18:12:37.180189] [DEBUG] [LOCAL ] CTRE: Saving primary data. [2025-09-23T18:12:37.181735] [DEBUG] [LOCAL ] CTRE: Trimmed 71087 records to 49212 (keeping 200 days of data) [2025-09-23T18:12:37.480413] [DEBUG] [LOCAL ] CTRE: Primary data saved (49212 records). [2025-09-23T18:12:37.480558] [INFO ] [MAIN ] CTRE: Full history saved. [2025-09-23T18:12:37.480666] [INFO ] [MAIN ] Update Progress: 550/2372 symbols completed. CTRE took 25.2s. Estimated remaining: 4h 0m 24s. Rate: 7.6 symbols/min [2025-09-23T18:12:37.652433] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:12:37.652670] [DEBUG] [LOCAL ] CTVA: No existing data file found in primary storage. [2025-09-23T18:12:37.652741] [WARN ] [MAIN ] CTVA: No existing data found, performing full refresh instead. [2025-09-23T18:12:37.652920] [INFO ] [MAIN ] CTVA: Wiping existing primary data before full refresh. [2025-09-23T18:12:37.652964] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-09-23T18:12:37.653006] [DEBUG] [LOCAL ] CTVA: No primary data file found to delete. [2025-09-23T18:12:37.653039] [INFO ] [MAIN ] CTVA: Starting full primary refresh. [2025-09-23T18:12:37.808048] [INFO ] [REMOTE ] CTS: Fetching primary data for 2024-12. [2025-09-23T18:12:38.067880] [INFO ] [REMOTE ] CTVA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:12:38.097427] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-23T18:12:38.123771] [INFO ] [REMOTE ] CTRA: Full fetch complete (77664 records). [2025-09-23T18:12:38.125462] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-23T18:12:38.125736] [DEBUG] [VALIDATOR ] CTRA: Validating primary data. [2025-09-23T18:12:38.538241] [DEBUG] [VALIDATOR ] CTRA: All expected trading days are present. [2025-09-23T18:12:38.538341] [DEBUG] [VALIDATOR ] CTRA: Primary data validation passed. [2025-09-23T18:12:38.539253] [INFO ] [MAIN ] CTRA: Fetched primary data is valid. [2025-09-23T18:12:38.539365] [DEBUG] [LOCAL ] CTRA: Saving primary data. [2025-09-23T18:12:38.541984] [DEBUG] [LOCAL ] CTRA: Trimmed 77664 records to 53649 (keeping 200 days of data) [2025-09-23T18:12:38.617460] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2024-12. [2025-09-23T18:12:38.685353] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-23T18:12:38.986370] [DEBUG] [LOCAL ] CTRA: Primary data saved (53649 records). [2025-09-23T18:12:38.986576] [INFO ] [MAIN ] CTRA: Full history saved. [2025-09-23T18:12:38.986745] [INFO ] [MAIN ] Update Progress: 551/2372 symbols completed. CTRA took 34.6s. Estimated remaining: 3h 59m 55s. Rate: 7.6 symbols/min [2025-09-23T18:12:39.250375] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:12:39.250617] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-09-23T18:12:39.250698] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-09-23T18:12:39.250860] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-09-23T18:12:39.250903] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-09-23T18:12:39.250959] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-09-23T18:12:39.251027] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-09-23T18:12:39.407542] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-01. [2025-09-23T18:12:39.816057] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:12:40.202189] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-05. [2025-09-23T18:12:40.490875] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-23T18:12:40.529208] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-23T18:12:41.002215] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2024-12. [2025-09-23T18:12:41.273252] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-23T18:12:41.330973] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-09-23T18:12:41.802204] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-01. [2025-09-23T18:12:42.602196] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-02. [2025-09-23T18:12:43.090374] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-23T18:12:43.173670] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-23T18:12:43.402186] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-03. [2025-09-23T18:12:44.202200] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-06. [2025-09-23T18:12:44.282915] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-23T18:12:45.002203] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-02. [2025-09-23T18:12:45.265238] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-23T18:12:45.802206] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-07. [2025-09-23T18:12:46.281881] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-23T18:12:46.602205] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-03. [2025-09-23T18:12:46.872631] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-23T18:12:47.402224] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-08. [2025-09-23T18:12:48.046879] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-23T18:12:48.202236] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-04. [2025-09-23T18:12:49.002267] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-01. [2025-09-23T18:12:49.073593] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-23T18:12:49.313466] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-09-23T18:12:49.571845] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-23T18:12:49.802237] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-09-23T18:12:50.043463] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-09-23T18:12:50.602206] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-05. [2025-09-23T18:12:51.402210] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-04. [2025-09-23T18:12:52.214611] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-09. [2025-09-23T18:12:52.235958] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-23T18:12:52.280620] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-23T18:12:53.002196] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-09-23T18:12:53.384464] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-23T18:12:53.448002] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-23T18:12:53.456291] [INFO ] [REMOTE ] CTRI: Full fetch complete (50928 records). [2025-09-23T18:12:53.456436] [DEBUG] [VALIDATOR ] CTRI: Validating primary data. [2025-09-23T18:12:53.814330] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-05. [2025-09-23T18:12:53.874915] [DEBUG] [VALIDATOR ] CTRI: All expected trading days are present. [2025-09-23T18:12:53.875014] [DEBUG] [VALIDATOR ] CTRI: Primary data validation passed. [2025-09-23T18:12:53.875776] [INFO ] [MAIN ] CTRI: Fetched primary data is valid. [2025-09-23T18:12:53.875904] [DEBUG] [LOCAL ] CTRI: Saving primary data. [2025-09-23T18:12:53.881297] [DEBUG] [LOCAL ] CTRI: Trimmed 50928 records to 37835 (keeping 200 days of data) [2025-09-23T18:12:54.107907] [DEBUG] [LOCAL ] CTRI: Primary data saved (37835 records). [2025-09-23T18:12:54.108052] [INFO ] [MAIN ] CTRI: Full history saved. [2025-09-23T18:12:54.108245] [INFO ] [MAIN ] Update Progress: 552/2372 symbols completed. CTRI took 32.4s. Estimated remaining: 4h 0m 11s. Rate: 7.6 symbols/min [2025-09-23T18:12:54.296277] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:12:54.375732] [DEBUG] [LOCAL ] CUBE: Loaded 50744 existing records from primary storage. [2025-09-23T18:12:54.375913] [INFO ] [MAIN ] CUBE: Loaded 50744 existing records. [2025-09-23T18:12:54.558288] [WARN ] [MAIN ] CUBE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:12:54.558625] [INFO ] [MAIN ] CUBE: Wiping existing primary data before full refresh. [2025-09-23T18:12:54.558733] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-09-23T18:12:54.560976] [DEBUG] [LOCAL ] CUBE: Deleted primary data file. [2025-09-23T18:12:54.561058] [INFO ] [MAIN ] CUBE: Starting full primary refresh. [2025-09-23T18:12:54.607328] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-06. [2025-09-23T18:12:54.936810] [INFO ] [REMOTE ] CUBE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:12:54.946298] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-23T18:12:55.402195] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-09-23T18:12:55.674617] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.27 seconds). [2025-09-23T18:12:56.018354] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-23T18:12:56.202201] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-09-23T18:12:56.479552] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-09-23T18:12:57.002255] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-09-23T18:12:57.268825] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-09-23T18:12:57.802254] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-09-23T18:12:58.115594] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-23T18:12:58.602314] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2024-12. [2025-09-23T18:12:59.402243] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-07. [2025-09-23T18:13:00.202205] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-06. [2025-09-23T18:13:00.422516] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-23T18:13:00.887492] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-23T18:13:01.002227] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-01. [2025-09-23T18:13:01.152546] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-23T18:13:01.802288] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-08. [2025-09-23T18:13:02.242004] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-23T18:13:02.602206] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-02. [2025-09-23T18:13:03.339841] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-23T18:13:03.402200] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-09-23T18:13:03.734295] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-23T18:13:03.819212] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-23T18:13:04.202229] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-07. [2025-09-23T18:13:05.002261] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-03. [2025-09-23T18:13:05.486353] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-23T18:13:05.802197] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-09. [2025-09-23T18:13:06.263102] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-23T18:13:06.602229] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-08. [2025-09-23T18:13:07.402188] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-09-23T18:13:07.649418] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-23T18:13:07.659048] [INFO ] [REMOTE ] CTVA: Full fetch complete (76933 records). [2025-09-23T18:13:07.659185] [DEBUG] [VALIDATOR ] CTVA: Validating primary data. [2025-09-23T18:13:07.802443] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-23T18:13:07.796105] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-23T18:13:07.822733] [INFO ] [REMOTE ] CUBB: Full fetch complete (934 records). [2025-09-23T18:13:07.837328] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-09-23T18:13:08.208966] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-09. [2025-09-23T18:13:08.286547] [WARN ] [VALIDATOR ] CUBB: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-23T18:13:08.327537] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:13:08.371935] [DEBUG] [VALIDATOR ] CTVA: All expected trading days are present. [2025-09-23T18:13:08.372209] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:13:08.372396] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-09-23T18:13:08.372288] [DEBUG] [VALIDATOR ] CTVA: Primary data validation passed. [2025-09-23T18:13:08.373377] [INFO ] [MAIN ] CTVA: Fetched primary data is valid. [2025-09-23T18:13:08.373471] [DEBUG] [LOCAL ] CTVA: Saving primary data. [2025-09-23T18:13:08.373573] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-09-23T18:13:08.373860] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-09-23T18:13:08.373969] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-09-23T18:13:08.374144] [INFO ] [MAIN ] Update Progress: 553/2372 symbols completed. CUBB took 29.4s. Estimated remaining: 4h 0m 24s. Rate: 7.6 symbols/min [2025-09-23T18:13:08.463742] [DEBUG] [LOCAL ] CTVA: Trimmed 76933 records to 53229 (keeping 200 days of data) [2025-09-23T18:13:08.676469] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:13:08.905209] [DEBUG] [LOCAL ] CUBI: Loaded 27251 existing records from primary storage. [2025-09-23T18:13:08.916463] [INFO ] [MAIN ] CUBI: Loaded 27251 existing records. [2025-09-23T18:13:09.005486] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-04. [2025-09-23T18:13:09.117503] [DEBUG] [LOCAL ] CTVA: Primary data saved (53229 records). [2025-09-23T18:13:09.132946] [INFO ] [MAIN ] CTVA: Full history saved. [2025-09-23T18:13:09.133115] [INFO ] [MAIN ] Update Progress: 554/2372 symbols completed. CTVA took 31.7s. Estimated remaining: 3h 59m 53s. Rate: 7.6 symbols/min [2025-09-23T18:13:09.132837] [WARN ] [MAIN ] CUBI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:13:09.218418] [INFO ] [MAIN ] CUBI: Wiping existing primary data before full refresh. [2025-09-23T18:13:09.237675] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-09-23T18:13:09.256184] [DEBUG] [LOCAL ] CUBI: Deleted primary data file. [2025-09-23T18:13:09.266588] [INFO ] [MAIN ] CUBI: Starting full primary refresh. [2025-09-23T18:13:09.395682] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:13:09.620615] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-23T18:13:09.657534] [INFO ] [REMOTE ] CTS: Full fetch complete (26577 records). [2025-09-23T18:13:09.676079] [DEBUG] [VALIDATOR ] CTS: Validating primary data. [2025-09-23T18:13:09.776099] [INFO ] [REMOTE ] CUBI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:13:09.814128] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2024-12. [2025-09-23T18:13:09.882030] [DEBUG] [LOCAL ] CUK: Loaded 51015 existing records from primary storage. [2025-09-23T18:13:09.888006] [INFO ] [MAIN ] CUK: Loaded 51015 existing records. [2025-09-23T18:13:10.287359] [WARN ] [MAIN ] CUK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:13:10.320738] [INFO ] [MAIN ] CUK: Wiping existing primary data before full refresh. [2025-09-23T18:13:10.341313] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-09-23T18:13:10.348192] [DEBUG] [VALIDATOR ] CTS: All expected trading days are present. [2025-09-23T18:13:10.348319] [DEBUG] [VALIDATOR ] CTS: Primary data validation passed. [2025-09-23T18:13:10.348840] [INFO ] [MAIN ] CTS: Fetched primary data is valid. [2025-09-23T18:13:10.348900] [DEBUG] [LOCAL ] CTS: Saving primary data. [2025-09-23T18:13:10.349696] [DEBUG] [LOCAL ] CUK: Deleted primary data file. [2025-09-23T18:13:10.349765] [INFO ] [MAIN ] CUK: Starting full primary refresh. [2025-09-23T18:13:10.382515] [DEBUG] [LOCAL ] CTS: Trimmed 26577 records to 19403 (keeping 200 days of data) [2025-09-23T18:13:10.774911] [DEBUG] [LOCAL ] CTS: Primary data saved (19403 records). [2025-09-23T18:13:10.775690] [INFO ] [MAIN ] CTS: Full history saved. [2025-09-23T18:13:10.775870] [INFO ] [MAIN ] Update Progress: 555/2372 symbols completed. CTS took 41.0s. Estimated remaining: 3h 59m 24s. Rate: 7.6 symbols/min [2025-09-23T18:13:10.961121] [INFO ] [REMOTE ] CUK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:13:10.965924] [INFO ] [REMOTE ] CUK: Fetching primary data for 2024-12. [2025-09-23T18:13:11.072554] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:13:11.075629] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-23T18:13:11.108009] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-23T18:13:11.107422] [DEBUG] [LOCAL ] CULP: Loaded 3114 existing records from primary storage. [2025-09-23T18:13:11.113482] [INFO ] [MAIN ] CULP: Loaded 3114 existing records. [2025-09-23T18:13:11.300818] [WARN ] [MAIN ] CULP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:13:11.301136] [INFO ] [MAIN ] CULP: Wiping existing primary data before full refresh. [2025-09-23T18:13:11.301188] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-09-23T18:13:11.301609] [DEBUG] [LOCAL ] CULP: Deleted primary data file. [2025-09-23T18:13:11.301699] [INFO ] [MAIN ] CULP: Starting full primary refresh. [2025-09-23T18:13:11.407340] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-05. [2025-09-23T18:13:11.684032] [INFO ] [REMOTE ] CULP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:13:12.202243] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-01. [2025-09-23T18:13:12.442777] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-23T18:13:12.920598] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-23T18:13:13.002279] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-01. [2025-09-23T18:13:13.175078] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-23T18:13:13.802255] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-02. [2025-09-23T18:13:14.356152] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-23T18:13:14.608902] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-02. [2025-09-23T18:13:14.614415] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-23T18:13:15.402238] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-03. [2025-09-23T18:13:15.953255] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-23T18:13:16.202203] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-06. [2025-09-23T18:13:16.354071] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-23T18:13:17.002204] [INFO ] [REMOTE ] CULP: Fetching primary data for 2024-12. [2025-09-23T18:13:17.693206] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-23T18:13:17.802241] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-03. [2025-09-23T18:13:17.894869] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-23T18:13:18.602206] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-07. [2025-09-23T18:13:19.402220] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-01. [2025-09-23T18:13:19.547507] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-23T18:13:19.861068] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-23T18:13:19.977697] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-23T18:13:20.202210] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-04. [2025-09-23T18:13:21.002193] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-04. [2025-09-23T18:13:21.802224] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-08. [2025-09-23T18:13:22.119725] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-23T18:13:22.399771] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-23T18:13:22.602158] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-05. [2025-09-23T18:13:23.281261] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-23T18:13:23.402174] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-09. [2025-09-23T18:13:24.202223] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-02. [2025-09-23T18:13:24.438893] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-23T18:13:24.617298] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-23T18:13:25.002259] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-03. [2025-09-23T18:13:25.370558] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-23T18:13:25.802227] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-04. [2025-09-23T18:13:26.181391] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-23T18:13:26.602195] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-06. [2025-09-23T18:13:27.402230] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-05. [2025-09-23T18:13:27.774412] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-09 (4.37 seconds). [2025-09-23T18:13:27.783128] [INFO ] [REMOTE ] CUBE: Full fetch complete (72984 records). [2025-09-23T18:13:27.783305] [DEBUG] [VALIDATOR ] CUBE: Validating primary data. [2025-09-23T18:13:28.185550] [DEBUG] [VALIDATOR ] CUBE: All expected trading days are present. [2025-09-23T18:13:28.185683] [DEBUG] [VALIDATOR ] CUBE: Primary data validation passed. [2025-09-23T18:13:28.186523] [INFO ] [MAIN ] CUBE: Fetched primary data is valid. [2025-09-23T18:13:28.186590] [DEBUG] [LOCAL ] CUBE: Saving primary data. [2025-09-23T18:13:28.188847] [DEBUG] [LOCAL ] CUBE: Trimmed 72984 records to 50740 (keeping 200 days of data) [2025-09-23T18:13:28.248890] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-05. [2025-09-23T18:13:28.512624] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-23T18:13:28.529575] [DEBUG] [LOCAL ] CUBE: Primary data saved (50740 records). [2025-09-23T18:13:28.529707] [INFO ] [MAIN ] CUBE: Full history saved. [2025-09-23T18:13:28.529795] [INFO ] [MAIN ] Update Progress: 556/2372 symbols completed. CUBE took 34.4s. Estimated remaining: 3h 59m 49s. Rate: 7.6 symbols/min [2025-09-23T18:13:28.704803] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:13:28.736063] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-23T18:13:28.774750] [DEBUG] [LOCAL ] CURB: Loaded 32976 existing records from primary storage. [2025-09-23T18:13:28.774916] [INFO ] [MAIN ] CURB: Loaded 32976 existing records. [2025-09-23T18:13:28.973121] [WARN ] [MAIN ] CURB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:13:28.973731] [INFO ] [MAIN ] CURB: Wiping existing primary data before full refresh. [2025-09-23T18:13:28.973805] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-09-23T18:13:28.974930] [DEBUG] [LOCAL ] CURB: Deleted primary data file. [2025-09-23T18:13:28.975005] [INFO ] [MAIN ] CURB: Starting full primary refresh. [2025-09-23T18:13:29.007325] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-06. [2025-09-23T18:13:29.102965] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-23T18:13:29.371111] [INFO ] [REMOTE ] CURB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:13:29.802218] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-06. [2025-09-23T18:13:30.137722] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-23T18:13:30.157117] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-23T18:13:30.602211] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-07. [2025-09-23T18:13:31.402217] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-07. [2025-09-23T18:13:31.661941] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-23T18:13:32.202270] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-07. [2025-09-23T18:13:32.792929] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-23T18:13:32.943079] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-23T18:13:33.002213] [INFO ] [REMOTE ] CURB: Fetching primary data for 2024-12. [2025-09-23T18:13:33.802207] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-08. [2025-09-23T18:13:34.106070] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-23T18:13:34.602207] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-01. [2025-09-23T18:13:34.822979] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-23T18:13:35.402212] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-09. [2025-09-23T18:13:35.714455] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-23T18:13:36.202224] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-08. [2025-09-23T18:13:36.697836] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-23T18:13:36.703050] [INFO ] [REMOTE ] CUBI: Full fetch complete (39215 records). [2025-09-23T18:13:36.703152] [DEBUG] [VALIDATOR ] CUBI: Validating primary data. [2025-09-23T18:13:37.008672] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-02. [2025-09-23T18:13:37.100952] [DEBUG] [VALIDATOR ] CUBI: All expected trading days are present. [2025-09-23T18:13:37.101058] [DEBUG] [VALIDATOR ] CUBI: Primary data validation passed. [2025-09-23T18:13:37.101631] [INFO ] [MAIN ] CUBI: Fetched primary data is valid. [2025-09-23T18:13:37.101711] [DEBUG] [LOCAL ] CUBI: Saving primary data. [2025-09-23T18:13:37.102542] [DEBUG] [LOCAL ] CUBI: Trimmed 39215 records to 27245 (keeping 200 days of data) [2025-09-23T18:13:37.264964] [DEBUG] [LOCAL ] CUBI: Primary data saved (27245 records). [2025-09-23T18:13:37.265180] [INFO ] [MAIN ] CUBI: Full history saved. [2025-09-23T18:13:37.265291] [INFO ] [MAIN ] Update Progress: 557/2372 symbols completed. CUBI took 28.9s. Estimated remaining: 3h 59m 43s. Rate: 7.6 symbols/min [2025-09-23T18:13:37.672931] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-23T18:13:37.802249] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-08. [2025-09-23T18:13:38.240972] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-23T18:13:38.286349] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-23T18:13:38.602190] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-03. [2025-09-23T18:13:39.402256] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-09. [2025-09-23T18:13:39.890411] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-23T18:13:39.901302] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-23T18:13:39.903099] [INFO ] [REMOTE ] CULP: Full fetch complete (4774 records). [2025-09-23T18:13:39.903528] [DEBUG] [VALIDATOR ] CULP: Validating primary data. [2025-09-23T18:13:40.207288] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-04. [2025-09-23T18:13:40.291820] [DEBUG] [VALIDATOR ] CULP: All expected trading days are present. [2025-09-23T18:13:40.291900] [DEBUG] [VALIDATOR ] CULP: Primary data validation passed. [2025-09-23T18:13:40.292042] [INFO ] [MAIN ] CULP: Fetched primary data is valid. [2025-09-23T18:13:40.292100] [DEBUG] [LOCAL ] CULP: Saving primary data. [2025-09-23T18:13:40.292461] [DEBUG] [LOCAL ] CULP: Trimmed 4774 records to 3010 (keeping 200 days of data) [2025-09-23T18:13:40.309383] [DEBUG] [LOCAL ] CULP: Primary data saved (3010 records). [2025-09-23T18:13:40.309454] [INFO ] [MAIN ] CULP: Full history saved. [2025-09-23T18:13:40.309529] [INFO ] [MAIN ] Update Progress: 558/2372 symbols completed. CULP took 29.5s. Estimated remaining: 3h 59m 19s. Rate: 7.6 symbols/min [2025-09-23T18:13:41.002202] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-09. [2025-09-23T18:13:41.316955] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-23T18:13:41.802197] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-05. [2025-09-23T18:13:42.496473] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-23T18:13:42.505623] [INFO ] [REMOTE ] CUK: Full fetch complete (73701 records). [2025-09-23T18:13:42.505817] [DEBUG] [VALIDATOR ] CUK: Validating primary data. [2025-09-23T18:13:42.930045] [DEBUG] [VALIDATOR ] CUK: All expected trading days are present. [2025-09-23T18:13:42.930133] [DEBUG] [VALIDATOR ] CUK: Primary data validation passed. [2025-09-23T18:13:42.931024] [INFO ] [MAIN ] CUK: Fetched primary data is valid. [2025-09-23T18:13:42.931090] [DEBUG] [LOCAL ] CUK: Saving primary data. [2025-09-23T18:13:42.932585] [DEBUG] [LOCAL ] CUK: Trimmed 73701 records to 51014 (keeping 200 days of data) [2025-09-23T18:13:43.250914] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-23T18:13:43.259123] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-06. [2025-09-23T18:13:43.277489] [DEBUG] [LOCAL ] CUK: Primary data saved (51014 records). [2025-09-23T18:13:43.277669] [INFO ] [MAIN ] CUK: Full history saved. [2025-09-23T18:13:43.277783] [INFO ] [MAIN ] Update Progress: 559/2372 symbols completed. CUK took 34.1s. Estimated remaining: 3h 58m 56s. Rate: 7.6 symbols/min [2025-09-23T18:13:44.210375] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-23T18:13:44.217108] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-07. [2025-09-23T18:13:45.084096] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-23T18:13:45.091600] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-08. [2025-09-23T18:13:46.450746] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-23T18:13:46.458500] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-09. [2025-09-23T18:13:47.418384] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-23T18:13:47.424283] [INFO ] [REMOTE ] CURB: Full fetch complete (47213 records). [2025-09-23T18:13:47.424394] [DEBUG] [VALIDATOR ] CURB: Validating primary data. [2025-09-23T18:13:47.827541] [DEBUG] [VALIDATOR ] CURB: All expected trading days are present. [2025-09-23T18:13:47.827618] [DEBUG] [VALIDATOR ] CURB: Primary data validation passed. [2025-09-23T18:13:47.828224] [INFO ] [MAIN ] CURB: Fetched primary data is valid. [2025-09-23T18:13:47.828280] [DEBUG] [LOCAL ] CURB: Saving primary data. [2025-09-23T18:13:47.829272] [DEBUG] [LOCAL ] CURB: Trimmed 47213 records to 33003 (keeping 200 days of data) [2025-09-23T18:13:48.038218] [DEBUG] [LOCAL ] CURB: Primary data saved (33003 records). [2025-09-23T18:13:48.038375] [INFO ] [MAIN ] CURB: Full history saved. [2025-09-23T18:13:48.038477] [INFO ] [MAIN ] Update Progress: 560/2372 symbols completed. CURB took 19.5s. Estimated remaining: 3h 58m 37s. Rate: 7.6 symbols/min [2025-09-23T18:13:48.715520] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:13:48.714099] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:13:48.757710] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:13:48.761921] [DEBUG] [LOCAL ] CURV: No existing data file found in primary storage. [2025-09-23T18:13:48.762317] [WARN ] [MAIN ] CURV: No existing data found, performing full refresh instead. [2025-09-23T18:13:48.761472] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:13:48.763718] [INFO ] [MAIN ] CURV: Wiping existing primary data before full refresh. [2025-09-23T18:13:48.763884] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-09-23T18:13:48.763966] [DEBUG] [LOCAL ] CURV: No primary data file found to delete. [2025-09-23T18:13:48.764009] [INFO ] [MAIN ] CURV: Starting full primary refresh. [2025-09-23T18:13:48.888191] [DEBUG] [LOCAL ] CVEO: Loaded 15262 existing records from primary storage. [2025-09-23T18:13:48.888569] [INFO ] [MAIN ] CVEO: Loaded 15262 existing records. [2025-09-23T18:13:49.252559] [DEBUG] [LOCAL ] CUZ: Loaded 49416 existing records from primary storage. [2025-09-23T18:13:49.302784] [DEBUG] [LOCAL ] CVE: Loaded 53557 existing records from primary storage. [2025-09-23T18:13:49.309125] [INFO ] [MAIN ] CVE: Loaded 53557 existing records. [2025-09-23T18:13:49.309019] [INFO ] [MAIN ] CUZ: Loaded 49416 existing records. [2025-09-23T18:13:49.352678] [WARN ] [MAIN ] CVEO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:13:49.418888] [INFO ] [MAIN ] CVEO: Wiping existing primary data before full refresh. [2025-09-23T18:13:49.457839] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-09-23T18:13:49.644505] [DEBUG] [LOCAL ] CVEO: Deleted primary data file. [2025-09-23T18:13:49.649895] [INFO ] [MAIN ] CVEO: Starting full primary refresh. [2025-09-23T18:13:49.644445] [INFO ] [REMOTE ] CURV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:13:49.693363] [INFO ] [REMOTE ] CURV: Fetching primary data for 2024-12. [2025-09-23T18:13:49.866011] [WARN ] [MAIN ] CVE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:13:49.919685] [WARN ] [MAIN ] CUZ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:13:49.944678] [INFO ] [MAIN ] CVE: Wiping existing primary data before full refresh. [2025-09-23T18:13:49.945126] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-09-23T18:13:49.984626] [DEBUG] [LOCAL ] CVE: Deleted primary data file. [2025-09-23T18:13:49.994935] [INFO ] [MAIN ] CVE: Starting full primary refresh. [2025-09-23T18:13:49.984540] [INFO ] [MAIN ] CUZ: Wiping existing primary data before full refresh. [2025-09-23T18:13:50.041997] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-09-23T18:13:50.111637] [DEBUG] [LOCAL ] CUZ: Deleted primary data file. [2025-09-23T18:13:50.151195] [INFO ] [MAIN ] CUZ: Starting full primary refresh. [2025-09-23T18:13:50.655961] [INFO ] [REMOTE ] CVEO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:13:50.721826] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2024-12. [2025-09-23T18:13:50.881436] [INFO ] [REMOTE ] CVE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:13:50.907422] [INFO ] [REMOTE ] CVE: Fetching primary data for 2024-12. [2025-09-23T18:13:50.995024] [INFO ] [REMOTE ] CUZ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:13:50.995474] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2024-12. [2025-09-23T18:13:51.430749] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-23T18:13:51.438967] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-01. [2025-09-23T18:13:51.446085] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-23T18:13:51.448848] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-01. [2025-09-23T18:13:51.970783] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-23T18:13:51.973042] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-02. [2025-09-23T18:13:52.232910] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-23T18:13:52.239818] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-02. [2025-09-23T18:13:52.421880] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-23T18:13:52.458754] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-01. [2025-09-23T18:13:52.464104] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-23T18:13:52.553154] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-23T18:13:52.961373] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-23T18:13:53.002226] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-03. [2025-09-23T18:13:53.802177] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-03. [2025-09-23T18:13:53.963982] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-23T18:13:54.473436] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-23T18:13:54.590962] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-23T18:13:54.602147] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-04. [2025-09-23T18:13:55.402163] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-01. [2025-09-23T18:13:55.646285] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-23T18:13:56.202233] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-02. [2025-09-23T18:13:56.561429] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-23T18:13:57.002228] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-05. [2025-09-23T18:13:57.513795] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-23T18:13:57.698231] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-23T18:13:57.802199] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-02. [2025-09-23T18:13:58.602207] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-03. [2025-09-23T18:13:59.131233] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-23T18:13:59.402206] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-04. [2025-09-23T18:14:00.003519] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-23T18:14:00.026510] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-23T18:14:00.202207] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-04. [2025-09-23T18:14:01.002196] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-05. [2025-09-23T18:14:01.802261] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-03. [2025-09-23T18:14:01.850445] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-23T18:14:02.104257] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-23T18:14:02.602260] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-05. [2025-09-23T18:14:03.306998] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-23T18:14:03.402177] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-04. [2025-09-23T18:14:04.208215] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-06. [2025-09-23T18:14:04.215954] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-23T18:14:04.994797] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-23T18:14:05.005321] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-06. [2025-09-23T18:14:05.206834] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-23T18:14:05.802267] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-05. [2025-09-23T18:14:06.602210] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-06. [2025-09-23T18:14:07.121818] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-23T18:14:07.300031] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-09-23T18:14:07.402168] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-07. [2025-09-23T18:14:07.517134] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-23T18:14:08.202199] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-07. [2025-09-23T18:14:08.753097] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-23T18:14:08.874515] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-23T18:14:09.002207] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-07. [2025-09-23T18:14:09.802211] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-08. [2025-09-23T18:14:09.946003] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-23T18:14:10.602227] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-08. [2025-09-23T18:14:11.375064] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-23T18:14:11.402162] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-09. [2025-09-23T18:14:11.941048] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-23T18:14:12.202266] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-08. [2025-09-23T18:14:12.863147] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-23T18:14:13.002199] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-09. [2025-09-23T18:14:13.400032] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-23T18:14:13.409171] [INFO ] [REMOTE ] CVE: Full fetch complete (77538 records). [2025-09-23T18:14:13.409339] [DEBUG] [VALIDATOR ] CVE: Validating primary data. [2025-09-23T18:14:13.808777] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-06. [2025-09-23T18:14:13.835009] [DEBUG] [VALIDATOR ] CVE: All expected trading days are present. [2025-09-23T18:14:13.835673] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-23T18:14:13.835787] [DEBUG] [VALIDATOR ] CVE: Primary data validation passed. [2025-09-23T18:14:13.840547] [INFO ] [MAIN ] CVE: Fetched primary data is valid. [2025-09-23T18:14:13.840674] [DEBUG] [LOCAL ] CVE: Saving primary data. [2025-09-23T18:14:13.840836] [INFO ] [REMOTE ] CVEO: Full fetch complete (20088 records). [2025-09-23T18:14:13.841201] [DEBUG] [VALIDATOR ] CVEO: Validating primary data. [2025-09-23T18:14:13.842017] [FATAL] [VALIDATOR ] CVEO: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:14:13.842799] [FATAL] [MAIN ] CVEO: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:14:13.843011] [WARN ] [MAIN ] CVEO: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:14:13.843199] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-09-23T18:14:13.843466] [DEBUG] [LOCAL ] CVEO: No primary data file found to delete. [2025-09-23T18:14:13.843527] [INFO ] [LOCAL ] CVEO: Starting deletion of derivative data. [2025-09-23T18:14:13.843635] [DEBUG] [LOCAL ] CVE: Trimmed 77538 records to 53556 (keeping 200 days of data) [2025-09-23T18:14:13.844261] [DEBUG] [LOCAL ] CVEO: Deleted derivative data file. [2025-09-23T18:14:13.844681] [INFO ] [MAIN ] Update Progress: 561/2372 symbols completed. CVEO took 25.8s. Estimated remaining: 3h 59m 27s. Rate: 7.6 symbols/min [2025-09-23T18:14:14.121457] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:14:14.171318] [DEBUG] [LOCAL ] CVI: Loaded 46417 existing records from primary storage. [2025-09-23T18:14:14.172251] [INFO ] [MAIN ] CVI: Loaded 46417 existing records. [2025-09-23T18:14:14.457765] [WARN ] [MAIN ] CVI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:14:14.459007] [INFO ] [MAIN ] CVI: Wiping existing primary data before full refresh. [2025-09-23T18:14:14.459084] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-09-23T18:14:14.460693] [DEBUG] [LOCAL ] CVI: Deleted primary data file. [2025-09-23T18:14:14.461039] [INFO ] [MAIN ] CVI: Starting full primary refresh. [2025-09-23T18:14:14.607018] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-09. [2025-09-23T18:14:14.855118] [INFO ] [REMOTE ] CVI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:14:14.960983] [DEBUG] [LOCAL ] CVE: Primary data saved (53556 records). [2025-09-23T18:14:14.961127] [INFO ] [MAIN ] CVE: Full history saved. [2025-09-23T18:14:14.961214] [INFO ] [MAIN ] Update Progress: 562/2372 symbols completed. CVE took 26.9s. Estimated remaining: 3h 58m 57s. Rate: 7.6 symbols/min [2025-09-23T18:14:15.130667] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:14:15.147437] [DEBUG] [LOCAL ] CVLG: Loaded 15573 existing records from primary storage. [2025-09-23T18:14:15.147582] [INFO ] [MAIN ] CVLG: Loaded 15573 existing records. [2025-09-23T18:14:15.336590] [WARN ] [MAIN ] CVLG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:14:15.336886] [INFO ] [MAIN ] CVLG: Wiping existing primary data before full refresh. [2025-09-23T18:14:15.336943] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-09-23T18:14:15.337534] [DEBUG] [LOCAL ] CVLG: Deleted primary data file. [2025-09-23T18:14:15.337594] [INFO ] [MAIN ] CVLG: Starting full primary refresh. [2025-09-23T18:14:15.406704] [INFO ] [REMOTE ] CVI: Fetching primary data for 2024-12. [2025-09-23T18:14:15.706524] [INFO ] [REMOTE ] CVLG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:14:15.735264] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-23T18:14:15.762998] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-23T18:14:15.769506] [INFO ] [REMOTE ] CURV: Full fetch complete (39808 records). [2025-09-23T18:14:15.769608] [DEBUG] [VALIDATOR ] CURV: Validating primary data. [2025-09-23T18:14:16.143811] [DEBUG] [VALIDATOR ] CURV: All expected trading days are present. [2025-09-23T18:14:16.143895] [DEBUG] [VALIDATOR ] CURV: Primary data validation passed. [2025-09-23T18:14:16.144506] [INFO ] [MAIN ] CURV: Fetched primary data is valid. [2025-09-23T18:14:16.144546] [DEBUG] [LOCAL ] CURV: Saving primary data. [2025-09-23T18:14:16.145524] [DEBUG] [LOCAL ] CURV: Trimmed 39808 records to 26669 (keeping 200 days of data) [2025-09-23T18:14:16.222218] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-07. [2025-09-23T18:14:16.291999] [DEBUG] [LOCAL ] CURV: Primary data saved (26669 records). [2025-09-23T18:14:16.292146] [INFO ] [MAIN ] CURV: Full history saved. [2025-09-23T18:14:16.292238] [INFO ] [MAIN ] Update Progress: 563/2372 symbols completed. CURV took 28.3s. Estimated remaining: 3h 58m 28s. Rate: 7.6 symbols/min [2025-09-23T18:14:16.459478] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:14:16.515539] [DEBUG] [LOCAL ] CVNA: Loaded 53029 existing records from primary storage. [2025-09-23T18:14:16.515714] [INFO ] [MAIN ] CVNA: Loaded 53029 existing records. [2025-09-23T18:14:16.694661] [WARN ] [MAIN ] CVNA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:14:16.694921] [INFO ] [MAIN ] CVNA: Wiping existing primary data before full refresh. [2025-09-23T18:14:16.694973] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-09-23T18:14:16.696452] [DEBUG] [LOCAL ] CVNA: Deleted primary data file. [2025-09-23T18:14:16.696514] [INFO ] [MAIN ] CVNA: Starting full primary refresh. [2025-09-23T18:14:17.007206] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2024-12. [2025-09-23T18:14:17.063882] [INFO ] [REMOTE ] CVNA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:14:17.094239] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-23T18:14:17.645919] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-23T18:14:17.803839] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2024-12. [2025-09-23T18:14:17.807750] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-23T18:14:18.602211] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-08. [2025-09-23T18:14:19.402198] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-01. [2025-09-23T18:14:19.654459] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-23T18:14:19.956213] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-23T18:14:20.202237] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-09. [2025-09-23T18:14:20.386103] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-23T18:14:21.002239] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-01. [2025-09-23T18:14:21.555825] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-23T18:14:21.563554] [INFO ] [REMOTE ] CUZ: Full fetch complete (70362 records). [2025-09-23T18:14:21.563705] [DEBUG] [VALIDATOR ] CUZ: Validating primary data. [2025-09-23T18:14:21.564376] [FATAL] [VALIDATOR ] CUZ: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:14:21.564464] [FATAL] [MAIN ] CUZ: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:14:21.564508] [WARN ] [MAIN ] CUZ: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:14:21.564547] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-09-23T18:14:21.564602] [DEBUG] [LOCAL ] CUZ: No primary data file found to delete. [2025-09-23T18:14:21.564636] [INFO ] [LOCAL ] CUZ: Starting deletion of derivative data. [2025-09-23T18:14:21.565053] [DEBUG] [LOCAL ] CUZ: Deleted derivative data file. [2025-09-23T18:14:21.565169] [INFO ] [MAIN ] Update Progress: 564/2372 symbols completed. CUZ took 33.5s. Estimated remaining: 3h 58m 12s. Rate: 7.6 symbols/min [2025-09-23T18:14:21.735771] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:14:21.788057] [DEBUG] [LOCAL ] CVS: Loaded 53698 existing records from primary storage. [2025-09-23T18:14:21.788201] [INFO ] [MAIN ] CVS: Loaded 53698 existing records. [2025-09-23T18:14:21.808696] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-01. [2025-09-23T18:14:21.967894] [WARN ] [MAIN ] CVS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:14:21.968186] [INFO ] [MAIN ] CVS: Wiping existing primary data before full refresh. [2025-09-23T18:14:21.968238] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-09-23T18:14:21.969847] [DEBUG] [LOCAL ] CVS: Deleted primary data file. [2025-09-23T18:14:21.969908] [INFO ] [MAIN ] CVS: Starting full primary refresh. [2025-09-23T18:14:22.337153] [INFO ] [REMOTE ] CVS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:14:22.388514] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-23T18:14:22.602162] [INFO ] [REMOTE ] CVS: Fetching primary data for 2024-12. [2025-09-23T18:14:23.402263] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-02. [2025-09-23T18:14:23.936194] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-23T18:14:24.096163] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-09-23T18:14:24.202200] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-03. [2025-09-23T18:14:24.500367] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-23T18:14:24.736357] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-23T18:14:25.002283] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-04. [2025-09-23T18:14:25.802210] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-01. [2025-09-23T18:14:26.286578] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-23T18:14:26.602214] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-02. [2025-09-23T18:14:27.402259] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-02. [2025-09-23T18:14:27.908490] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-23T18:14:27.911085] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-23T18:14:28.202232] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-03. [2025-09-23T18:14:29.002178] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-05. [2025-09-23T18:14:29.145498] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-23T18:14:29.517288] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-23T18:14:29.802240] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-04. [2025-09-23T18:14:30.177499] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-23T18:14:30.602206] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-02. [2025-09-23T18:14:31.056152] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-23T18:14:31.402204] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-03. [2025-09-23T18:14:32.170208] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-23T18:14:32.202151] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-05. [2025-09-23T18:14:33.002257] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-03. [2025-09-23T18:14:33.526910] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-23T18:14:33.806616] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-06. [2025-09-23T18:14:33.812136] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-23T18:14:34.577001] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-23T18:14:34.602151] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-07. [2025-09-23T18:14:34.743675] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-23T18:14:35.195449] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-23T18:14:35.402203] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-04. [2025-09-23T18:14:36.202242] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-08. [2025-09-23T18:14:36.839147] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-23T18:14:37.002258] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-09. [2025-09-23T18:14:37.187116] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-23T18:14:37.656327] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-23T18:14:37.659475] [INFO ] [REMOTE ] CVLG: Full fetch complete (20680 records). [2025-09-23T18:14:37.659575] [DEBUG] [VALIDATOR ] CVLG: Validating primary data. [2025-09-23T18:14:37.807418] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-05. [2025-09-23T18:14:38.082225] [DEBUG] [VALIDATOR ] CVLG: All expected trading days are present. [2025-09-23T18:14:38.082306] [DEBUG] [VALIDATOR ] CVLG: Primary data validation passed. [2025-09-23T18:14:38.082813] [INFO ] [MAIN ] CVLG: Fetched primary data is valid. [2025-09-23T18:14:38.082877] [DEBUG] [LOCAL ] CVLG: Saving primary data. [2025-09-23T18:14:38.083498] [DEBUG] [LOCAL ] CVLG: Trimmed 20680 records to 15567 (keeping 200 days of data) [2025-09-23T18:14:38.183741] [DEBUG] [LOCAL ] CVLG: Primary data saved (15567 records). [2025-09-23T18:14:38.183891] [INFO ] [MAIN ] CVLG: Full history saved. [2025-09-23T18:14:38.183977] [INFO ] [MAIN ] Update Progress: 565/2372 symbols completed. CVLG took 23.2s. Estimated remaining: 3h 58m 32s. Rate: 7.6 symbols/min [2025-09-23T18:14:38.373426] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:14:38.442472] [DEBUG] [LOCAL ] CVX: Loaded 53760 existing records from primary storage. [2025-09-23T18:14:38.442736] [INFO ] [MAIN ] CVX: Loaded 53760 existing records. [2025-09-23T18:14:38.605140] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-06. [2025-09-23T18:14:38.631831] [WARN ] [MAIN ] CVX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:14:38.632178] [INFO ] [MAIN ] CVX: Wiping existing primary data before full refresh. [2025-09-23T18:14:38.632251] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-09-23T18:14:38.634849] [DEBUG] [LOCAL ] CVX: Deleted primary data file. [2025-09-23T18:14:38.634966] [INFO ] [MAIN ] CVX: Starting full primary refresh. [2025-09-23T18:14:39.003275] [INFO ] [REMOTE ] CVX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:14:39.402210] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-04. [2025-09-23T18:14:39.620063] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-23T18:14:39.905477] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-23T18:14:40.202192] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-07. [2025-09-23T18:14:41.002247] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-06. [2025-09-23T18:14:41.333800] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-23T18:14:41.514399] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-23T18:14:41.802195] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-05. [2025-09-23T18:14:42.602172] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-08. [2025-09-23T18:14:42.834844] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-23T18:14:43.402277] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-07. [2025-09-23T18:14:43.789756] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-23T18:14:43.828794] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-23T18:14:44.202186] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-09. [2025-09-23T18:14:45.002192] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-06. [2025-09-23T18:14:45.515973] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-23T18:14:45.524195] [INFO ] [REMOTE ] CVI: Full fetch complete (67264 records). [2025-09-23T18:14:45.524432] [DEBUG] [VALIDATOR ] CVI: Validating primary data. [2025-09-23T18:14:45.651565] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-23T18:14:45.808419] [INFO ] [REMOTE ] CVX: Fetching primary data for 2024-12. [2025-09-23T18:14:45.963781] [DEBUG] [VALIDATOR ] CVI: All expected trading days are present. [2025-09-23T18:14:45.963893] [DEBUG] [VALIDATOR ] CVI: Primary data validation passed. [2025-09-23T18:14:45.964639] [INFO ] [MAIN ] CVI: Fetched primary data is valid. [2025-09-23T18:14:45.964721] [DEBUG] [LOCAL ] CVI: Saving primary data. [2025-09-23T18:14:45.966093] [DEBUG] [LOCAL ] CVI: Trimmed 67264 records to 46431 (keeping 200 days of data) [2025-09-23T18:14:46.241733] [DEBUG] [LOCAL ] CVI: Primary data saved (46431 records). [2025-09-23T18:14:46.241874] [INFO ] [MAIN ] CVI: Full history saved. [2025-09-23T18:14:46.241957] [INFO ] [MAIN ] Update Progress: 566/2372 symbols completed. CVI took 32.4s. Estimated remaining: 3h 58m 24s. Rate: 7.6 symbols/min [2025-09-23T18:14:46.416409] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:14:46.438790] [DEBUG] [LOCAL ] CW: Loaded 22575 existing records from primary storage. [2025-09-23T18:14:46.438918] [INFO ] [MAIN ] CW: Loaded 22575 existing records. [2025-09-23T18:14:46.610997] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-08. [2025-09-23T18:14:46.616588] [WARN ] [MAIN ] CW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:14:46.617560] [INFO ] [MAIN ] CW: Wiping existing primary data before full refresh. [2025-09-23T18:14:46.617615] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-09-23T18:14:46.618388] [DEBUG] [LOCAL ] CW: Deleted primary data file. [2025-09-23T18:14:46.618450] [INFO ] [MAIN ] CW: Starting full primary refresh. [2025-09-23T18:14:46.989157] [INFO ] [REMOTE ] CW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:14:47.062532] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-23T18:14:47.402190] [INFO ] [REMOTE ] CW: Fetching primary data for 2024-12. [2025-09-23T18:14:48.119389] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-09-23T18:14:48.202151] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-01. [2025-09-23T18:14:48.305039] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-23T18:14:48.491153] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-23T18:14:49.002201] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-01. [2025-09-23T18:14:49.802217] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-09. [2025-09-23T18:14:49.978998] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-23T18:14:49.980276] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-23T18:14:50.602194] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-02. [2025-09-23T18:14:51.378084] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-23T18:14:51.387545] [INFO ] [REMOTE ] CVS: Full fetch complete (77814 records). [2025-09-23T18:14:51.387755] [DEBUG] [VALIDATOR ] CVS: Validating primary data. [2025-09-23T18:14:51.409227] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-02. [2025-09-23T18:14:51.812026] [DEBUG] [VALIDATOR ] CVS: All expected trading days are present. [2025-09-23T18:14:51.812176] [DEBUG] [VALIDATOR ] CVS: Primary data validation passed. [2025-09-23T18:14:51.813134] [INFO ] [MAIN ] CVS: Fetched primary data is valid. [2025-09-23T18:14:51.813202] [DEBUG] [LOCAL ] CVS: Saving primary data. [2025-09-23T18:14:51.815218] [DEBUG] [LOCAL ] CVS: Trimmed 77814 records to 53697 (keeping 200 days of data) [2025-09-23T18:14:52.157198] [DEBUG] [LOCAL ] CVS: Primary data saved (53697 records). [2025-09-23T18:14:52.157331] [INFO ] [MAIN ] CVS: Full history saved. [2025-09-23T18:14:52.157417] [INFO ] [MAIN ] Update Progress: 567/2372 symbols completed. CVS took 30.6s. Estimated remaining: 3h 58m 10s. Rate: 7.6 symbols/min [2025-09-23T18:14:52.205731] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-07. [2025-09-23T18:14:52.369415] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:14:52.419611] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-23T18:14:52.468925] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-23T18:14:52.469964] [DEBUG] [LOCAL ] CWAN: Loaded 52393 existing records from primary storage. [2025-09-23T18:14:52.479862] [INFO ] [MAIN ] CWAN: Loaded 52393 existing records. [2025-09-23T18:14:52.659288] [WARN ] [MAIN ] CWAN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:14:52.659564] [INFO ] [MAIN ] CWAN: Wiping existing primary data before full refresh. [2025-09-23T18:14:52.659611] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-09-23T18:14:52.660977] [DEBUG] [LOCAL ] CWAN: Deleted primary data file. [2025-09-23T18:14:52.661038] [INFO ] [MAIN ] CWAN: Starting full primary refresh. [2025-09-23T18:14:53.013977] [INFO ] [REMOTE ] CWAN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:14:53.008449] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-03. [2025-09-23T18:14:53.802213] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-03. [2025-09-23T18:14:54.329421] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-23T18:14:54.602251] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-08. [2025-09-23T18:14:54.827679] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-23T18:14:54.847315] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-23T18:14:55.402223] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-04. [2025-09-23T18:14:56.202169] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2024-12. [2025-09-23T18:14:56.447281] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-23T18:14:57.002267] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-04. [2025-09-23T18:14:57.520560] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-23T18:14:57.590278] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-23T18:14:57.802212] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-09. [2025-09-23T18:14:57.921172] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-23T18:14:58.602208] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-01. [2025-09-23T18:14:59.402216] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-05. [2025-09-23T18:14:59.831709] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-23T18:14:59.872514] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-23T18:14:59.883375] [INFO ] [REMOTE ] CVNA: Full fetch complete (76674 records). [2025-09-23T18:14:59.883579] [DEBUG] [VALIDATOR ] CVNA: Validating primary data. [2025-09-23T18:15:00.209749] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-05. [2025-09-23T18:15:00.322125] [DEBUG] [VALIDATOR ] CVNA: All expected trading days are present. [2025-09-23T18:15:00.322231] [DEBUG] [VALIDATOR ] CVNA: Primary data validation passed. [2025-09-23T18:15:00.323137] [INFO ] [MAIN ] CVNA: Fetched primary data is valid. [2025-09-23T18:15:00.323202] [DEBUG] [LOCAL ] CVNA: Saving primary data. [2025-09-23T18:15:00.325392] [DEBUG] [LOCAL ] CVNA: Trimmed 76674 records to 53022 (keeping 200 days of data) [2025-09-23T18:15:00.677600] [DEBUG] [LOCAL ] CVNA: Primary data saved (53022 records). [2025-09-23T18:15:00.677928] [INFO ] [MAIN ] CVNA: Full history saved. [2025-09-23T18:15:00.678165] [INFO ] [MAIN ] Update Progress: 568/2372 symbols completed. CVNA took 44.4s. Estimated remaining: 3h 58m 4s. Rate: 7.6 symbols/min [2025-09-23T18:15:00.848290] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:15:00.898902] [DEBUG] [LOCAL ] CWEN: Loaded 45071 existing records from primary storage. [2025-09-23T18:15:00.899061] [INFO ] [MAIN ] CWEN: Loaded 45071 existing records. [2025-09-23T18:15:01.007430] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-02. [2025-09-23T18:15:01.076964] [WARN ] [MAIN ] CWEN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:15:01.077215] [INFO ] [MAIN ] CWEN: Wiping existing primary data before full refresh. [2025-09-23T18:15:01.077273] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-09-23T18:15:01.078401] [DEBUG] [LOCAL ] CWEN: Deleted primary data file. [2025-09-23T18:15:01.078471] [INFO ] [MAIN ] CWEN: Starting full primary refresh. [2025-09-23T18:15:01.455607] [INFO ] [REMOTE ] CWEN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:15:01.721046] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-23T18:15:01.762520] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-09-23T18:15:01.802229] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2024-12. [2025-09-23T18:15:02.602241] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-06. [2025-09-23T18:15:03.062764] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-23T18:15:03.402239] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-06. [2025-09-23T18:15:04.202225] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-03. [2025-09-23T18:15:05.677307] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2024-12 (3.88 seconds). [2025-09-23T18:15:05.686061] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-01. [2025-09-23T18:15:06.882090] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-06 (4.28 seconds). [2025-09-23T18:15:06.893004] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-07. [2025-09-23T18:15:06.972011] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-06 (3.57 seconds). [2025-09-23T18:15:06.978144] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-07. [2025-09-23T18:15:07.824709] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-09-23T18:15:07.834306] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-02. [2025-09-23T18:15:07.868146] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-03 (3.67 seconds). [2025-09-23T18:15:07.893592] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-23T18:15:08.202444] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-08. [2025-09-23T18:15:09.002185] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-04. [2025-09-23T18:15:09.070766] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-23T18:15:09.094047] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-23T18:15:09.297391] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-09-23T18:15:09.802201] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-03. [2025-09-23T18:15:10.602210] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-09. [2025-09-23T18:15:10.930762] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-23T18:15:11.174338] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-23T18:15:11.402215] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-08. [2025-09-23T18:15:11.542162] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-23T18:15:11.545729] [INFO ] [REMOTE ] CW: Full fetch complete (33525 records). [2025-09-23T18:15:11.545855] [DEBUG] [VALIDATOR ] CW: Validating primary data. [2025-09-23T18:15:11.926962] [DEBUG] [VALIDATOR ] CW: All expected trading days are present. [2025-09-23T18:15:11.927066] [DEBUG] [VALIDATOR ] CW: Primary data validation passed. [2025-09-23T18:15:11.927626] [INFO ] [MAIN ] CW: Fetched primary data is valid. [2025-09-23T18:15:11.927771] [DEBUG] [LOCAL ] CW: Saving primary data. [2025-09-23T18:15:11.929342] [DEBUG] [LOCAL ] CW: Trimmed 33525 records to 22479 (keeping 200 days of data) [2025-09-23T18:15:12.078585] [DEBUG] [LOCAL ] CW: Primary data saved (22479 records). [2025-09-23T18:15:12.078756] [INFO ] [MAIN ] CW: Full history saved. [2025-09-23T18:15:12.078905] [INFO ] [MAIN ] Update Progress: 569/2372 symbols completed. CW took 25.8s. Estimated remaining: 3h 58m 7s. Rate: 7.6 symbols/min [2025-09-23T18:15:12.207421] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-05. [2025-09-23T18:15:12.267937] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:15:12.335111] [DEBUG] [LOCAL ] CWH: Loaded 51418 existing records from primary storage. [2025-09-23T18:15:12.335275] [INFO ] [MAIN ] CWH: Loaded 51418 existing records. [2025-09-23T18:15:12.513955] [WARN ] [MAIN ] CWH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:15:12.514301] [INFO ] [MAIN ] CWH: Wiping existing primary data before full refresh. [2025-09-23T18:15:12.514375] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-09-23T18:15:12.515868] [DEBUG] [LOCAL ] CWH: Deleted primary data file. [2025-09-23T18:15:12.515946] [INFO ] [MAIN ] CWH: Starting full primary refresh. [2025-09-23T18:15:12.876495] [INFO ] [REMOTE ] CWH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:15:13.002198] [INFO ] [REMOTE ] CWH: Fetching primary data for 2024-12. [2025-09-23T18:15:13.513765] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-23T18:15:13.610923] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-23T18:15:13.802200] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-09. [2025-09-23T18:15:14.602233] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-04. [2025-09-23T18:15:14.739061] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-23T18:15:15.402249] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-01. [2025-09-23T18:15:16.027018] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-23T18:15:16.036090] [INFO ] [REMOTE ] CVX: Full fetch complete (77845 records). [2025-09-23T18:15:16.036220] [DEBUG] [VALIDATOR ] CVX: Validating primary data. [2025-09-23T18:15:16.208078] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-06. [2025-09-23T18:15:16.460938] [DEBUG] [VALIDATOR ] CVX: All expected trading days are present. [2025-09-23T18:15:16.461102] [DEBUG] [VALIDATOR ] CVX: Primary data validation passed. [2025-09-23T18:15:16.462132] [INFO ] [MAIN ] CVX: Fetched primary data is valid. [2025-09-23T18:15:16.462216] [DEBUG] [LOCAL ] CVX: Saving primary data. [2025-09-23T18:15:16.464445] [DEBUG] [LOCAL ] CVX: Trimmed 77845 records to 53760 (keeping 200 days of data) [2025-09-23T18:15:16.731586] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-23T18:15:16.866015] [DEBUG] [LOCAL ] CVX: Primary data saved (53760 records). [2025-09-23T18:15:16.866165] [INFO ] [MAIN ] CVX: Full history saved. [2025-09-23T18:15:16.867990] [INFO ] [MAIN ] Update Progress: 570/2372 symbols completed. CVX took 38.7s. Estimated remaining: 3h 57m 49s. Rate: 7.6 symbols/min [2025-09-23T18:15:17.012700] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-05. [2025-09-23T18:15:17.044627] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:15:17.073409] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-23T18:15:17.132870] [DEBUG] [LOCAL ] CWK: Loaded 49391 existing records from primary storage. [2025-09-23T18:15:17.133020] [INFO ] [MAIN ] CWK: Loaded 49391 existing records. [2025-09-23T18:15:17.313819] [WARN ] [MAIN ] CWK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:15:17.314102] [INFO ] [MAIN ] CWK: Wiping existing primary data before full refresh. [2025-09-23T18:15:17.314163] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-09-23T18:15:17.315855] [DEBUG] [LOCAL ] CWK: Deleted primary data file. [2025-09-23T18:15:17.315919] [INFO ] [MAIN ] CWK: Starting full primary refresh. [2025-09-23T18:15:17.678066] [INFO ] [REMOTE ] CWK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:15:17.802152] [INFO ] [REMOTE ] CWK: Fetching primary data for 2024-12. [2025-09-23T18:15:18.457121] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-23T18:15:18.602203] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-07. [2025-09-23T18:15:19.408587] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-02. [2025-09-23T18:15:19.411269] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-09-23T18:15:20.120468] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-09-23T18:15:20.202207] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-06. [2025-09-23T18:15:20.436162] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-23T18:15:20.551836] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-23T18:15:21.002187] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-08. [2025-09-23T18:15:21.346546] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-23T18:15:21.802250] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-03. [2025-09-23T18:15:22.397568] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-23T18:15:22.602218] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-09. [2025-09-23T18:15:23.137220] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-23T18:15:23.402194] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-04. [2025-09-23T18:15:23.979340] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-23T18:15:23.989504] [INFO ] [REMOTE ] CWAN: Full fetch complete (75103 records). [2025-09-23T18:15:23.989678] [DEBUG] [VALIDATOR ] CWAN: Validating primary data. [2025-09-23T18:15:24.207794] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-01. [2025-09-23T18:15:24.411609] [DEBUG] [VALIDATOR ] CWAN: All expected trading days are present. [2025-09-23T18:15:24.411738] [DEBUG] [VALIDATOR ] CWAN: Primary data validation passed. [2025-09-23T18:15:24.412545] [INFO ] [MAIN ] CWAN: Fetched primary data is valid. [2025-09-23T18:15:24.412682] [DEBUG] [LOCAL ] CWAN: Saving primary data. [2025-09-23T18:15:24.414500] [DEBUG] [LOCAL ] CWAN: Trimmed 75103 records to 52401 (keeping 200 days of data) [2025-09-23T18:15:24.753786] [DEBUG] [LOCAL ] CWAN: Primary data saved (52401 records). [2025-09-23T18:15:24.753933] [INFO ] [MAIN ] CWAN: Full history saved. [2025-09-23T18:15:24.754066] [INFO ] [MAIN ] Update Progress: 571/2372 symbols completed. CWAN took 32.6s. Estimated remaining: 3h 57m 41s. Rate: 7.6 symbols/min [2025-09-23T18:15:24.935914] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:15:24.969138] [DEBUG] [LOCAL ] CWT: Loaded 27803 existing records from primary storage. [2025-09-23T18:15:24.969372] [INFO ] [MAIN ] CWT: Loaded 27803 existing records. [2025-09-23T18:15:25.024446] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-07. [2025-09-23T18:15:25.185509] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-23T18:15:25.183216] [WARN ] [MAIN ] CWT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:15:25.196244] [INFO ] [MAIN ] CWT: Wiping existing primary data before full refresh. [2025-09-23T18:15:25.196376] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-09-23T18:15:25.198005] [DEBUG] [LOCAL ] CWT: Deleted primary data file. [2025-09-23T18:15:25.198071] [INFO ] [MAIN ] CWT: Starting full primary refresh. [2025-09-23T18:15:25.565305] [INFO ] [REMOTE ] CWT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:15:25.591159] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-23T18:15:25.802191] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-05. [2025-09-23T18:15:26.607333] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-02. [2025-09-23T18:15:26.623629] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-23T18:15:27.232789] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-23T18:15:27.402257] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-06. [2025-09-23T18:15:28.117785] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-23T18:15:28.202192] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-08. [2025-09-23T18:15:28.705831] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-23T18:15:29.002217] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-07. [2025-09-23T18:15:29.574897] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-23T18:15:29.802180] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-09. [2025-09-23T18:15:30.586215] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-23T18:15:30.602147] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-08. [2025-09-23T18:15:31.128949] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-23T18:15:31.136425] [INFO ] [REMOTE ] CWEN: Full fetch complete (64021 records). [2025-09-23T18:15:31.136582] [DEBUG] [VALIDATOR ] CWEN: Validating primary data. [2025-09-23T18:15:31.137512] [FATAL] [VALIDATOR ] CWEN: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:15:31.137627] [FATAL] [MAIN ] CWEN: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:15:31.137819] [WARN ] [MAIN ] CWEN: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:15:31.137903] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-09-23T18:15:31.138013] [DEBUG] [LOCAL ] CWEN: No primary data file found to delete. [2025-09-23T18:15:31.138081] [INFO ] [LOCAL ] CWEN: Starting deletion of derivative data. [2025-09-23T18:15:31.138618] [DEBUG] [LOCAL ] CWEN: Deleted derivative data file. [2025-09-23T18:15:31.138779] [INFO ] [MAIN ] Update Progress: 572/2372 symbols completed. CWEN took 30.5s. Estimated remaining: 3h 57m 29s. Rate: 7.6 symbols/min [2025-09-23T18:15:31.321922] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:15:31.322123] [DEBUG] [LOCAL ] CX: No existing data file found in primary storage. [2025-09-23T18:15:31.322159] [WARN ] [MAIN ] CX: No existing data found, performing full refresh instead. [2025-09-23T18:15:31.322303] [INFO ] [MAIN ] CX: Wiping existing primary data before full refresh. [2025-09-23T18:15:31.322344] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-09-23T18:15:31.322385] [DEBUG] [LOCAL ] CX: No primary data file found to delete. [2025-09-23T18:15:31.322417] [INFO ] [MAIN ] CX: Starting full primary refresh. [2025-09-23T18:15:31.410539] [INFO ] [REMOTE ] CWT: Fetching primary data for 2024-12. [2025-09-23T18:15:31.681925] [INFO ] [REMOTE ] CX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:15:31.949333] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-23T18:15:32.202249] [INFO ] [REMOTE ] CX: Fetching primary data for 2024-12. [2025-09-23T18:15:32.472186] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-23T18:15:33.002238] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-09. [2025-09-23T18:15:33.802202] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-01. [2025-09-23T18:15:33.853099] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-23T18:15:34.602194] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-01. [2025-09-23T18:15:34.668018] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-23T18:15:34.849892] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-23T18:15:34.859426] [INFO ] [REMOTE ] CWH: Full fetch complete (72710 records). [2025-09-23T18:15:34.859690] [DEBUG] [VALIDATOR ] CWH: Validating primary data. [2025-09-23T18:15:35.348884] [DEBUG] [VALIDATOR ] CWH: All expected trading days are present. [2025-09-23T18:15:35.349079] [DEBUG] [VALIDATOR ] CWH: Primary data validation passed. [2025-09-23T18:15:35.351111] [INFO ] [MAIN ] CWH: Fetched primary data is valid. [2025-09-23T18:15:35.351316] [DEBUG] [LOCAL ] CWH: Saving primary data. [2025-09-23T18:15:35.354388] [DEBUG] [LOCAL ] CWH: Trimmed 72710 records to 51415 (keeping 200 days of data) [2025-09-23T18:15:35.422062] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-03. [2025-09-23T18:15:35.824512] [DEBUG] [LOCAL ] CWH: Primary data saved (51415 records). [2025-09-23T18:15:35.824984] [INFO ] [MAIN ] CWH: Full history saved. [2025-09-23T18:15:35.825278] [INFO ] [MAIN ] Update Progress: 573/2372 symbols completed. CWH took 23.7s. Estimated remaining: 3h 57m 11s. Rate: 7.6 symbols/min [2025-09-23T18:15:36.096568] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:15:36.163904] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-23T18:15:36.187754] [DEBUG] [LOCAL ] CXE: Loaded 7246 existing records from primary storage. [2025-09-23T18:15:36.188597] [INFO ] [MAIN ] CXE: Loaded 7246 existing records. [2025-09-23T18:15:36.207619] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-02. [2025-09-23T18:15:36.505920] [WARN ] [MAIN ] CXE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:15:36.506209] [INFO ] [MAIN ] CXE: Wiping existing primary data before full refresh. [2025-09-23T18:15:36.506260] [INFO ] [LOCAL ] CXE: Starting deletion of primary data. [2025-09-23T18:15:36.506744] [DEBUG] [LOCAL ] CXE: Deleted primary data file. [2025-09-23T18:15:36.506805] [INFO ] [MAIN ] CXE: Starting full primary refresh. [2025-09-23T18:15:36.888292] [INFO ] [REMOTE ] CXE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:15:36.923665] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-23T18:15:37.002190] [INFO ] [REMOTE ] CXE: Fetching primary data for 2024-12. [2025-09-23T18:15:37.583766] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-23T18:15:37.802178] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-01. [2025-09-23T18:15:37.971497] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-23T18:15:38.282062] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-23T18:15:38.602210] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-02. [2025-09-23T18:15:39.402208] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-02. [2025-09-23T18:15:39.472004] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-23T18:15:40.202187] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-03. [2025-09-23T18:15:40.318503] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-23T18:15:41.002197] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-03. [2025-09-23T18:15:41.232204] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-23T18:15:41.802197] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-04. [2025-09-23T18:15:42.453187] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-23T18:15:42.602254] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-04. [2025-09-23T18:15:43.121169] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-23T18:15:43.402230] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-05. [2025-09-23T18:15:44.143398] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-23T18:15:44.202203] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-05. [2025-09-23T18:15:44.580927] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-23T18:15:45.002251] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-06. [2025-09-23T18:15:45.340274] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-23T18:15:45.802259] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-06. [2025-09-23T18:15:46.187366] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-23T18:15:46.602223] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-04. [2025-09-23T18:15:46.687313] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-23T18:15:47.402244] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-07. [2025-09-23T18:15:48.064125] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-23T18:15:48.198160] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-23T18:15:48.204033] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-07. [2025-09-23T18:15:49.002259] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-08. [2025-09-23T18:15:49.802258] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-03. [2025-09-23T18:15:50.117287] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-23T18:15:50.169293] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-23T18:15:50.602192] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-09. [2025-09-23T18:15:50.657983] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-23T18:15:51.402226] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-04. [2025-09-23T18:15:51.806147] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-23T18:15:51.860839] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-23T18:15:51.865484] [INFO ] [REMOTE ] CWT: Full fetch complete (40228 records). [2025-09-23T18:15:51.865602] [DEBUG] [VALIDATOR ] CWT: Validating primary data. [2025-09-23T18:15:52.207273] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-05. [2025-09-23T18:15:52.249424] [DEBUG] [VALIDATOR ] CWT: All expected trading days are present. [2025-09-23T18:15:52.249523] [DEBUG] [VALIDATOR ] CWT: Primary data validation passed. [2025-09-23T18:15:52.250239] [INFO ] [MAIN ] CWT: Fetched primary data is valid. [2025-09-23T18:15:52.250312] [DEBUG] [LOCAL ] CWT: Saving primary data. [2025-09-23T18:15:52.251848] [DEBUG] [LOCAL ] CWT: Trimmed 40228 records to 27855 (keeping 200 days of data) [2025-09-23T18:15:52.424895] [DEBUG] [LOCAL ] CWT: Primary data saved (27855 records). [2025-09-23T18:15:52.425044] [INFO ] [MAIN ] CWT: Full history saved. [2025-09-23T18:15:52.425168] [INFO ] [MAIN ] Update Progress: 574/2372 symbols completed. CWT took 27.7s. Estimated remaining: 3h 57m 30s. Rate: 7.6 symbols/min [2025-09-23T18:15:52.596322] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:15:52.602693] [DEBUG] [LOCAL ] CXH: Loaded 4404 existing records from primary storage. [2025-09-23T18:15:52.602827] [INFO ] [MAIN ] CXH: Loaded 4404 existing records. [2025-09-23T18:15:52.781092] [WARN ] [MAIN ] CXH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:15:52.781359] [INFO ] [MAIN ] CXH: Wiping existing primary data before full refresh. [2025-09-23T18:15:52.781409] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-09-23T18:15:52.781749] [DEBUG] [LOCAL ] CXH: Deleted primary data file. [2025-09-23T18:15:52.781810] [INFO ] [MAIN ] CXH: Starting full primary refresh. [2025-09-23T18:15:53.007152] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-08. [2025-09-23T18:15:53.208261] [INFO ] [REMOTE ] CXH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:15:53.209005] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-23T18:15:53.802223] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-06. [2025-09-23T18:15:54.431165] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-23T18:15:54.602159] [INFO ] [REMOTE ] CXH: Fetching primary data for 2024-12. [2025-09-23T18:15:54.666920] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-23T18:15:55.090555] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-23T18:15:55.402250] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-09. [2025-09-23T18:15:56.202245] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-01. [2025-09-23T18:15:56.644590] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-23T18:15:56.700160] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-23T18:15:56.708498] [INFO ] [REMOTE ] CWK: Full fetch complete (70830 records). [2025-09-23T18:15:56.708688] [DEBUG] [VALIDATOR ] CWK: Validating primary data. [2025-09-23T18:15:57.007278] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-05. [2025-09-23T18:15:57.129956] [DEBUG] [VALIDATOR ] CWK: All expected trading days are present. [2025-09-23T18:15:57.130040] [DEBUG] [VALIDATOR ] CWK: Primary data validation passed. [2025-09-23T18:15:57.130832] [INFO ] [MAIN ] CWK: Fetched primary data is valid. [2025-09-23T18:15:57.130899] [DEBUG] [LOCAL ] CWK: Saving primary data. [2025-09-23T18:15:57.132354] [DEBUG] [LOCAL ] CWK: Trimmed 70830 records to 49427 (keeping 200 days of data) [2025-09-23T18:15:57.450571] [DEBUG] [LOCAL ] CWK: Primary data saved (49427 records). [2025-09-23T18:15:57.450788] [INFO ] [MAIN ] CWK: Full history saved. [2025-09-23T18:15:57.450908] [INFO ] [MAIN ] Update Progress: 575/2372 symbols completed. CWK took 40.6s. Estimated remaining: 3h 57m 13s. Rate: 7.6 symbols/min [2025-09-23T18:15:57.630133] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:15:57.677526] [DEBUG] [LOCAL ] CXM: Loaded 47973 existing records from primary storage. [2025-09-23T18:15:57.677773] [INFO ] [MAIN ] CXM: Loaded 47973 existing records. [2025-09-23T18:15:57.807361] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-02. [2025-09-23T18:15:57.860930] [WARN ] [MAIN ] CXM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:15:57.861196] [INFO ] [MAIN ] CXM: Wiping existing primary data before full refresh. [2025-09-23T18:15:57.861245] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-09-23T18:15:57.862472] [DEBUG] [LOCAL ] CXM: Deleted primary data file. [2025-09-23T18:15:57.862534] [INFO ] [MAIN ] CXM: Starting full primary refresh. [2025-09-23T18:15:58.227845] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-23T18:15:58.233856] [INFO ] [REMOTE ] CXM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:15:58.602161] [INFO ] [REMOTE ] CXM: Fetching primary data for 2024-12. [2025-09-23T18:15:58.682188] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-23T18:15:59.402240] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-07. [2025-09-23T18:15:59.837950] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-23T18:15:59.989408] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-23T18:16:00.202188] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-08. [2025-09-23T18:16:01.002204] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-03. [2025-09-23T18:16:01.009443] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-23T18:16:01.428977] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-23T18:16:01.802248] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-06. [2025-09-23T18:16:02.602203] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-04. [2025-09-23T18:16:02.939152] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-23T18:16:03.329334] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-23T18:16:03.402180] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-09. [2025-09-23T18:16:04.035569] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-23T18:16:04.037572] [INFO ] [REMOTE ] CXE: Full fetch complete (11892 records). [2025-09-23T18:16:04.037683] [DEBUG] [VALIDATOR ] CXE: Validating primary data. [2025-09-23T18:16:04.210024] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-07. [2025-09-23T18:16:04.428821] [DEBUG] [VALIDATOR ] CXE: All expected trading days are present. [2025-09-23T18:16:04.428936] [DEBUG] [VALIDATOR ] CXE: Primary data validation passed. [2025-09-23T18:16:04.429227] [INFO ] [MAIN ] CXE: Fetched primary data is valid. [2025-09-23T18:16:04.429269] [DEBUG] [LOCAL ] CXE: Saving primary data. [2025-09-23T18:16:04.429833] [DEBUG] [LOCAL ] CXE: Trimmed 11892 records to 7248 (keeping 200 days of data) [2025-09-23T18:16:04.473946] [DEBUG] [LOCAL ] CXE: Primary data saved (7248 records). [2025-09-23T18:16:04.474098] [INFO ] [MAIN ] CXE: Full history saved. [2025-09-23T18:16:04.474193] [INFO ] [MAIN ] Update Progress: 576/2372 symbols completed. CXE took 28.6s. Estimated remaining: 3h 57m 2s. Rate: 7.6 symbols/min [2025-09-23T18:16:04.649368] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:16:04.681296] [DEBUG] [LOCAL ] CXT: Loaded 31010 existing records from primary storage. [2025-09-23T18:16:04.681460] [INFO ] [MAIN ] CXT: Loaded 31010 existing records. [2025-09-23T18:16:04.869885] [WARN ] [MAIN ] CXT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:16:04.870129] [INFO ] [MAIN ] CXT: Wiping existing primary data before full refresh. [2025-09-23T18:16:04.870178] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-09-23T18:16:04.871097] [DEBUG] [LOCAL ] CXT: Deleted primary data file. [2025-09-23T18:16:04.871161] [INFO ] [MAIN ] CXT: Starting full primary refresh. [2025-09-23T18:16:05.013621] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-05. [2025-09-23T18:16:05.243867] [INFO ] [REMOTE ] CXT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:16:05.657732] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-23T18:16:05.802189] [INFO ] [REMOTE ] CXT: Fetching primary data for 2024-12. [2025-09-23T18:16:06.088503] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-23T18:16:06.602216] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-06. [2025-09-23T18:16:06.754848] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-23T18:16:07.197384] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-23T18:16:07.402216] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-07. [2025-09-23T18:16:08.120067] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-23T18:16:08.202198] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-01. [2025-09-23T18:16:09.002240] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-08. [2025-09-23T18:16:09.402024] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-23T18:16:09.802243] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-01. [2025-09-23T18:16:09.992904] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-23T18:16:10.602204] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-09. [2025-09-23T18:16:11.200212] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-23T18:16:11.202116] [INFO ] [REMOTE ] CXH: Full fetch complete (5505 records). [2025-09-23T18:16:11.202207] [DEBUG] [VALIDATOR ] CXH: Validating primary data. [2025-09-23T18:16:11.407303] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-02. [2025-09-23T18:16:11.595166] [DEBUG] [VALIDATOR ] CXH: All expected trading days are present. [2025-09-23T18:16:11.595323] [DEBUG] [VALIDATOR ] CXH: Primary data validation passed. [2025-09-23T18:16:11.595534] [INFO ] [MAIN ] CXH: Fetched primary data is valid. [2025-09-23T18:16:11.595580] [DEBUG] [LOCAL ] CXH: Saving primary data. [2025-09-23T18:16:11.596067] [DEBUG] [LOCAL ] CXH: Trimmed 5505 records to 4406 (keeping 200 days of data) [2025-09-23T18:16:11.621980] [DEBUG] [LOCAL ] CXH: Primary data saved (4406 records). [2025-09-23T18:16:11.622101] [INFO ] [MAIN ] CXH: Full history saved. [2025-09-23T18:16:11.622198] [INFO ] [MAIN ] Update Progress: 577/2372 symbols completed. CXH took 19.2s. Estimated remaining: 3h 56m 52s. Rate: 7.6 symbols/min [2025-09-23T18:16:11.773805] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-23T18:16:11.837849] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:16:11.884449] [DEBUG] [LOCAL ] CXW: Loaded 44413 existing records from primary storage. [2025-09-23T18:16:11.884703] [INFO ] [MAIN ] CXW: Loaded 44413 existing records. [2025-09-23T18:16:12.083067] [WARN ] [MAIN ] CXW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:16:12.083356] [INFO ] [MAIN ] CXW: Wiping existing primary data before full refresh. [2025-09-23T18:16:12.083406] [INFO ] [LOCAL ] CXW: Starting deletion of primary data. [2025-09-23T18:16:12.084591] [DEBUG] [LOCAL ] CXW: Deleted primary data file. [2025-09-23T18:16:12.084681] [INFO ] [MAIN ] CXW: Starting full primary refresh. [2025-09-23T18:16:12.207359] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-02. [2025-09-23T18:16:12.464472] [INFO ] [REMOTE ] CXW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:16:12.742138] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-23T18:16:13.002225] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-03. [2025-09-23T18:16:13.202694] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-23T18:16:13.802206] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-08. [2025-09-23T18:16:14.261581] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-23T18:16:14.602207] [INFO ] [REMOTE ] CXW: Fetching primary data for 2024-12. [2025-09-23T18:16:15.402204] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-03. [2025-09-23T18:16:16.202214] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-04. [2025-09-23T18:16:16.286419] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-23T18:16:16.611838] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-08 (2.81 seconds). [2025-09-23T18:16:16.766859] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-23T18:16:17.002212] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-01. [2025-09-23T18:16:17.802208] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-09. [2025-09-23T18:16:18.520048] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-09-23T18:16:18.602162] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-05. [2025-09-23T18:16:19.402161] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-04. [2025-09-23T18:16:19.480897] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-01 (2.48 seconds). [2025-09-23T18:16:20.202167] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-02. [2025-09-23T18:16:20.304777] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-09-23T18:16:20.313577] [INFO ] [REMOTE ] CX: Full fetch complete (76369 records). [2025-09-23T18:16:20.313766] [DEBUG] [VALIDATOR ] CX: Validating primary data. [2025-09-23T18:16:20.730036] [DEBUG] [VALIDATOR ] CX: All expected trading days are present. [2025-09-23T18:16:20.730145] [DEBUG] [VALIDATOR ] CX: Primary data validation passed. [2025-09-23T18:16:20.731424] [INFO ] [MAIN ] CX: Fetched primary data is valid. [2025-09-23T18:16:20.731491] [DEBUG] [LOCAL ] CX: Saving primary data. [2025-09-23T18:16:20.733097] [DEBUG] [LOCAL ] CX: Trimmed 76369 records to 52840 (keeping 200 days of data) [2025-09-23T18:16:21.060915] [DEBUG] [LOCAL ] CX: Primary data saved (52840 records). [2025-09-23T18:16:21.061073] [INFO ] [MAIN ] CX: Full history saved. [2025-09-23T18:16:21.061156] [INFO ] [MAIN ] Update Progress: 578/2372 symbols completed. CX took 49.9s. Estimated remaining: 3h 56m 49s. Rate: 7.6 symbols/min [2025-09-23T18:16:21.280197] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:16:21.276827] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-05 (2.67 seconds). [2025-09-23T18:16:21.293534] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-06. [2025-09-23T18:16:21.319806] [DEBUG] [LOCAL ] CYD: Loaded 26609 existing records from primary storage. [2025-09-23T18:16:21.319997] [INFO ] [MAIN ] CYD: Loaded 26609 existing records. [2025-09-23T18:16:21.514457] [WARN ] [MAIN ] CYD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:16:21.515291] [INFO ] [MAIN ] CYD: Wiping existing primary data before full refresh. [2025-09-23T18:16:21.515379] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-09-23T18:16:21.516534] [DEBUG] [LOCAL ] CYD: Deleted primary data file. [2025-09-23T18:16:21.516602] [INFO ] [MAIN ] CYD: Starting full primary refresh. [2025-09-23T18:16:21.873848] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-23T18:16:21.931963] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-03. [2025-09-23T18:16:21.931519] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-04 (2.53 seconds). [2025-09-23T18:16:21.979612] [INFO ] [REMOTE ] CYD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:16:22.602162] [INFO ] [REMOTE ] CYD: Fetching primary data for 2024-12. [2025-09-23T18:16:22.659747] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-23T18:16:23.323288] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-23T18:16:23.402190] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-07. [2025-09-23T18:16:23.645061] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-23T18:16:24.202208] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-05. [2025-09-23T18:16:24.637552] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-23T18:16:25.002192] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-08. [2025-09-23T18:16:25.078557] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-23T18:16:25.802194] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-06. [2025-09-23T18:16:26.261078] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-23T18:16:26.602191] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-09. [2025-09-23T18:16:26.945891] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-23T18:16:27.402207] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-01. [2025-09-23T18:16:27.917981] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-23T18:16:27.920483] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-23T18:16:27.935528] [INFO ] [REMOTE ] CXM: Full fetch complete (69084 records). [2025-09-23T18:16:27.935809] [DEBUG] [VALIDATOR ] CXM: Validating primary data. [2025-09-23T18:16:28.210680] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-07. [2025-09-23T18:16:28.584538] [DEBUG] [VALIDATOR ] CXM: All expected trading days are present. [2025-09-23T18:16:28.584663] [DEBUG] [VALIDATOR ] CXM: Primary data validation passed. [2025-09-23T18:16:28.585629] [INFO ] [MAIN ] CXM: Fetched primary data is valid. [2025-09-23T18:16:28.585734] [DEBUG] [LOCAL ] CXM: Saving primary data. [2025-09-23T18:16:28.587559] [DEBUG] [LOCAL ] CXM: Trimmed 69084 records to 47985 (keeping 200 days of data) [2025-09-23T18:16:28.920936] [DEBUG] [LOCAL ] CXM: Primary data saved (47985 records). [2025-09-23T18:16:28.921098] [INFO ] [MAIN ] CXM: Full history saved. [2025-09-23T18:16:28.921205] [INFO ] [MAIN ] Update Progress: 579/2372 symbols completed. CXM took 31.5s. Estimated remaining: 3h 56m 41s. Rate: 7.6 symbols/min [2025-09-23T18:16:29.011257] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-04. [2025-09-23T18:16:29.097300] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:16:29.142207] [DEBUG] [LOCAL ] CYH: Loaded 47883 existing records from primary storage. [2025-09-23T18:16:29.142423] [INFO ] [MAIN ] CYH: Loaded 47883 existing records. [2025-09-23T18:16:29.328230] [WARN ] [MAIN ] CYH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:16:29.328577] [INFO ] [MAIN ] CYH: Wiping existing primary data before full refresh. [2025-09-23T18:16:29.328631] [INFO ] [LOCAL ] CYH: Starting deletion of primary data. [2025-09-23T18:16:29.329800] [DEBUG] [LOCAL ] CYH: Deleted primary data file. [2025-09-23T18:16:29.329865] [INFO ] [MAIN ] CYH: Starting full primary refresh. [2025-09-23T18:16:29.706440] [INFO ] [REMOTE ] CYH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:16:29.802283] [INFO ] [REMOTE ] CYH: Fetching primary data for 2024-12. [2025-09-23T18:16:29.835053] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-23T18:16:30.602240] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-08. [2025-09-23T18:16:31.169343] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-23T18:16:31.243016] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-23T18:16:31.402177] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-05. [2025-09-23T18:16:31.741076] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-23T18:16:32.202187] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-09. [2025-09-23T18:16:32.580908] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-23T18:16:33.002208] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-01. [2025-09-23T18:16:33.192947] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-23T18:16:33.198670] [INFO ] [REMOTE ] CXT: Full fetch complete (44909 records). [2025-09-23T18:16:33.198803] [DEBUG] [VALIDATOR ] CXT: Validating primary data. [2025-09-23T18:16:33.585600] [DEBUG] [VALIDATOR ] CXT: All expected trading days are present. [2025-09-23T18:16:33.585719] [DEBUG] [VALIDATOR ] CXT: Primary data validation passed. [2025-09-23T18:16:33.586402] [INFO ] [MAIN ] CXT: Fetched primary data is valid. [2025-09-23T18:16:33.586490] [DEBUG] [LOCAL ] CXT: Saving primary data. [2025-09-23T18:16:33.587791] [DEBUG] [LOCAL ] CXT: Trimmed 44909 records to 31082 (keeping 200 days of data) [2025-09-23T18:16:33.801454] [DEBUG] [LOCAL ] CXT: Primary data saved (31082 records). [2025-09-23T18:16:33.801620] [INFO ] [MAIN ] CXT: Full history saved. [2025-09-23T18:16:33.801748] [INFO ] [MAIN ] Update Progress: 580/2372 symbols completed. CXT took 29.3s. Estimated remaining: 3h 56m 23s. Rate: 7.6 symbols/min [2025-09-23T18:16:33.813702] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-02. [2025-09-23T18:16:34.002859] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:16:34.003095] [DEBUG] [LOCAL ] D: No existing data file found in primary storage. [2025-09-23T18:16:34.003140] [WARN ] [MAIN ] D: No existing data found, performing full refresh instead. [2025-09-23T18:16:34.003303] [INFO ] [MAIN ] D: Wiping existing primary data before full refresh. [2025-09-23T18:16:34.003347] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-09-23T18:16:34.003389] [DEBUG] [LOCAL ] D: No primary data file found to delete. [2025-09-23T18:16:34.003422] [INFO ] [MAIN ] D: Starting full primary refresh. [2025-09-23T18:16:34.433912] [INFO ] [REMOTE ] D: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:16:34.492333] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-23T18:16:34.602194] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-02. [2025-09-23T18:16:34.730434] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-23T18:16:35.402192] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-06. [2025-09-23T18:16:35.830485] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-23T18:16:36.202231] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-03. [2025-09-23T18:16:36.516160] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-23T18:16:37.002204] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-03. [2025-09-23T18:16:37.687690] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-23T18:16:37.802207] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-04. [2025-09-23T18:16:38.299830] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-23T18:16:38.602223] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-07. [2025-09-23T18:16:38.806029] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-23T18:16:39.402209] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-05. [2025-09-23T18:16:39.909764] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-23T18:16:40.202203] [INFO ] [REMOTE ] D: Fetching primary data for 2024-12. [2025-09-23T18:16:40.219231] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-23T18:16:41.002240] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-08. [2025-09-23T18:16:41.802234] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-06. [2025-09-23T18:16:42.512610] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-23T18:16:42.549105] [INFO ] [REMOTE ] D: Incremental fetch complete for 2024-12 (2.35 seconds). [2025-09-23T18:16:42.602174] [INFO ] [REMOTE ] D: Fetching primary data for 2025-01. [2025-09-23T18:16:42.627637] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-23T18:16:43.402218] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-07. [2025-09-23T18:16:44.202198] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-04. [2025-09-23T18:16:44.479866] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-23T18:16:44.507348] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-23T18:16:45.002204] [INFO ] [REMOTE ] D: Fetching primary data for 2025-02. [2025-09-23T18:16:45.629396] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-23T18:16:45.802260] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-09. [2025-09-23T18:16:46.602180] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-05. [2025-09-23T18:16:46.925539] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-23T18:16:46.932854] [INFO ] [REMOTE ] CXW: Full fetch complete (64990 records). [2025-09-23T18:16:46.933025] [DEBUG] [VALIDATOR ] CXW: Validating primary data. [2025-09-23T18:16:47.175693] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-09-23T18:16:47.386050] [DEBUG] [VALIDATOR ] CXW: All expected trading days are present. [2025-09-23T18:16:47.386144] [DEBUG] [VALIDATOR ] CXW: Primary data validation passed. [2025-09-23T18:16:47.386894] [INFO ] [MAIN ] CXW: Fetched primary data is valid. [2025-09-23T18:16:47.386961] [DEBUG] [LOCAL ] CXW: Saving primary data. [2025-09-23T18:16:47.388291] [DEBUG] [LOCAL ] CXW: Trimmed 64990 records to 44386 (keeping 200 days of data) [2025-09-23T18:16:47.436830] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-08. [2025-09-23T18:16:47.661206] [DEBUG] [LOCAL ] CXW: Primary data saved (44386 records). [2025-09-23T18:16:47.661340] [INFO ] [MAIN ] CXW: Full history saved. [2025-09-23T18:16:47.661427] [INFO ] [MAIN ] Update Progress: 581/2372 symbols completed. CXW took 36.0s. Estimated remaining: 3h 56m 34s. Rate: 7.6 symbols/min [2025-09-23T18:16:47.834681] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:16:47.848875] [DEBUG] [LOCAL ] DAC: Loaded 12616 existing records from primary storage. [2025-09-23T18:16:47.849006] [INFO ] [MAIN ] DAC: Loaded 12616 existing records. [2025-09-23T18:16:48.034943] [WARN ] [MAIN ] DAC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:16:48.035494] [INFO ] [MAIN ] DAC: Wiping existing primary data before full refresh. [2025-09-23T18:16:48.035572] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-09-23T18:16:48.036270] [DEBUG] [LOCAL ] DAC: Deleted primary data file. [2025-09-23T18:16:48.036374] [INFO ] [MAIN ] DAC: Starting full primary refresh. [2025-09-23T18:16:48.205223] [INFO ] [REMOTE ] D: Fetching primary data for 2025-03. [2025-09-23T18:16:48.244676] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-23T18:16:48.443039] [INFO ] [REMOTE ] DAC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:16:48.878895] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-23T18:16:49.002218] [INFO ] [REMOTE ] DAC: Fetching primary data for 2024-12. [2025-09-23T18:16:49.814576] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-06. [2025-09-23T18:16:49.839884] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-23T18:16:50.262341] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-23T18:16:50.602215] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-09. [2025-09-23T18:16:51.402216] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-01. [2025-09-23T18:16:51.530085] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-23T18:16:52.011340] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-23T18:16:52.194323] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-23T18:16:52.200898] [INFO ] [REMOTE ] CYD: Full fetch complete (32032 records). [2025-09-23T18:16:52.200995] [DEBUG] [VALIDATOR ] CYD: Validating primary data. [2025-09-23T18:16:52.207357] [INFO ] [REMOTE ] D: Fetching primary data for 2025-04. [2025-09-23T18:16:52.605682] [DEBUG] [VALIDATOR ] CYD: All expected trading days are present. [2025-09-23T18:16:52.605783] [DEBUG] [VALIDATOR ] CYD: Primary data validation passed. [2025-09-23T18:16:52.606256] [INFO ] [MAIN ] CYD: Fetched primary data is valid. [2025-09-23T18:16:52.606296] [DEBUG] [LOCAL ] CYD: Saving primary data. [2025-09-23T18:16:52.608754] [DEBUG] [LOCAL ] CYD: Trimmed 32032 records to 26605 (keeping 200 days of data) [2025-09-23T18:16:52.766294] [DEBUG] [LOCAL ] CYD: Primary data saved (26605 records). [2025-09-23T18:16:52.766435] [INFO ] [MAIN ] CYD: Full history saved. [2025-09-23T18:16:52.766535] [INFO ] [MAIN ] Update Progress: 582/2372 symbols completed. CYD took 31.7s. Estimated remaining: 3h 56m 17s. Rate: 7.6 symbols/min [2025-09-23T18:16:52.939350] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:16:52.995253] [DEBUG] [LOCAL ] DAL: Loaded 53753 existing records from primary storage. [2025-09-23T18:16:52.995430] [INFO ] [MAIN ] DAL: Loaded 53753 existing records. [2025-09-23T18:16:53.008271] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-02. [2025-09-23T18:16:53.178419] [WARN ] [MAIN ] DAL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:16:53.178707] [INFO ] [MAIN ] DAL: Wiping existing primary data before full refresh. [2025-09-23T18:16:53.178763] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-09-23T18:16:53.180201] [DEBUG] [LOCAL ] DAL: Deleted primary data file. [2025-09-23T18:16:53.180263] [INFO ] [MAIN ] DAL: Starting full primary refresh. [2025-09-23T18:16:53.532420] [INFO ] [REMOTE ] DAL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:16:53.750906] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-23T18:16:53.802150] [INFO ] [REMOTE ] DAL: Fetching primary data for 2024-12. [2025-09-23T18:16:53.957275] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-23T18:16:54.602192] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-07. [2025-09-23T18:16:55.402216] [INFO ] [REMOTE ] D: Fetching primary data for 2025-05. [2025-09-23T18:16:56.052809] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-09-23T18:16:56.117842] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-23T18:16:56.202219] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-08. [2025-09-23T18:16:56.990614] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-23T18:16:57.002408] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-03. [2025-09-23T18:16:57.402800] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-23T18:16:57.802241] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-09. [2025-09-23T18:16:57.897217] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-23T18:16:58.602409] [INFO ] [REMOTE ] D: Fetching primary data for 2025-06. [2025-09-23T18:16:59.255864] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-23T18:16:59.264412] [INFO ] [REMOTE ] CYH: Full fetch complete (70428 records). [2025-09-23T18:16:59.264579] [DEBUG] [VALIDATOR ] CYH: Validating primary data. [2025-09-23T18:16:59.407314] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-04. [2025-09-23T18:16:59.678157] [DEBUG] [VALIDATOR ] CYH: All expected trading days are present. [2025-09-23T18:16:59.678250] [DEBUG] [VALIDATOR ] CYH: Primary data validation passed. [2025-09-23T18:16:59.679059] [INFO ] [MAIN ] CYH: Fetched primary data is valid. [2025-09-23T18:16:59.679127] [DEBUG] [LOCAL ] CYH: Saving primary data. [2025-09-23T18:16:59.680570] [DEBUG] [LOCAL ] CYH: Trimmed 70428 records to 47841 (keeping 200 days of data) [2025-09-23T18:16:59.969252] [DEBUG] [LOCAL ] CYH: Primary data saved (47841 records). [2025-09-23T18:16:59.969489] [INFO ] [MAIN ] CYH: Full history saved. [2025-09-23T18:16:59.969684] [INFO ] [MAIN ] Update Progress: 583/2372 symbols completed. CYH took 31.0s. Estimated remaining: 3h 56m 7s. Rate: 7.6 symbols/min [2025-09-23T18:17:00.150913] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:17:00.202160] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-01. [2025-09-23T18:17:00.204232] [DEBUG] [LOCAL ] DAN: Loaded 49005 existing records from primary storage. [2025-09-23T18:17:00.204421] [INFO ] [MAIN ] DAN: Loaded 49005 existing records. [2025-09-23T18:17:00.438764] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-23T18:17:00.443443] [WARN ] [MAIN ] DAN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:17:00.454703] [INFO ] [MAIN ] DAN: Wiping existing primary data before full refresh. [2025-09-23T18:17:00.454901] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-09-23T18:17:00.456584] [DEBUG] [LOCAL ] DAN: Deleted primary data file. [2025-09-23T18:17:00.456691] [INFO ] [MAIN ] DAN: Starting full primary refresh. [2025-09-23T18:17:00.573207] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-23T18:17:00.900028] [INFO ] [REMOTE ] DAN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:17:01.002287] [INFO ] [REMOTE ] DAN: Fetching primary data for 2024-12. [2025-09-23T18:17:01.802263] [INFO ] [REMOTE ] D: Fetching primary data for 2025-07. [2025-09-23T18:17:02.257271] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-23T18:17:02.456807] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-23T18:17:02.602250] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-05. [2025-09-23T18:17:03.142230] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-23T18:17:03.365844] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-23T18:17:03.402149] [INFO ] [REMOTE ] D: Fetching primary data for 2025-08. [2025-09-23T18:17:04.202188] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-06. [2025-09-23T18:17:05.002172] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-01. [2025-09-23T18:17:05.034485] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-23T18:17:05.333515] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-23T18:17:05.802196] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-02. [2025-09-23T18:17:06.180963] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-23T18:17:06.602201] [INFO ] [REMOTE ] D: Fetching primary data for 2025-09. [2025-09-23T18:17:07.402158] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-07. [2025-09-23T18:17:07.890806] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-23T18:17:08.002412] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-23T18:17:08.101765] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-23T18:17:08.115741] [INFO ] [REMOTE ] D: Full fetch complete (77656 records). [2025-09-23T18:17:08.115997] [DEBUG] [VALIDATOR ] D: Validating primary data. [2025-09-23T18:17:08.207479] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-03. [2025-09-23T18:17:08.560214] [DEBUG] [VALIDATOR ] D: All expected trading days are present. [2025-09-23T18:17:08.560348] [DEBUG] [VALIDATOR ] D: Primary data validation passed. [2025-09-23T18:17:08.562150] [INFO ] [MAIN ] D: Fetched primary data is valid. [2025-09-23T18:17:08.562278] [DEBUG] [LOCAL ] D: Saving primary data. [2025-09-23T18:17:08.566866] [DEBUG] [LOCAL ] D: Trimmed 77656 records to 53647 (keeping 200 days of data) [2025-09-23T18:17:08.931253] [DEBUG] [LOCAL ] D: Primary data saved (53647 records). [2025-09-23T18:17:08.931408] [INFO ] [MAIN ] D: Full history saved. [2025-09-23T18:17:08.931568] [INFO ] [MAIN ] Update Progress: 584/2372 symbols completed. D took 35.1s. Estimated remaining: 3h 56m 2s. Rate: 7.6 symbols/min [2025-09-23T18:17:09.007950] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-02. [2025-09-23T18:17:09.106813] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:17:09.131018] [DEBUG] [LOCAL ] DAO: Loaded 21421 existing records from primary storage. [2025-09-23T18:17:09.131165] [INFO ] [MAIN ] DAO: Loaded 21421 existing records. [2025-09-23T18:17:09.334012] [WARN ] [MAIN ] DAO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:17:09.334319] [INFO ] [MAIN ] DAO: Wiping existing primary data before full refresh. [2025-09-23T18:17:09.334386] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-09-23T18:17:09.335046] [DEBUG] [LOCAL ] DAO: Deleted primary data file. [2025-09-23T18:17:09.335145] [INFO ] [MAIN ] DAO: Starting full primary refresh. [2025-09-23T18:17:09.707611] [INFO ] [REMOTE ] DAO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:17:09.802186] [INFO ] [REMOTE ] DAO: Fetching primary data for 2024-12. [2025-09-23T18:17:10.194473] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-23T18:17:10.324742] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-23T18:17:10.602206] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-08. [2025-09-23T18:17:10.691381] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-23T18:17:11.203155] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-23T18:17:11.402227] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-09. [2025-09-23T18:17:12.202214] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-03. [2025-09-23T18:17:12.495975] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-23T18:17:12.498861] [INFO ] [REMOTE ] DAC: Full fetch complete (19747 records). [2025-09-23T18:17:12.498958] [DEBUG] [VALIDATOR ] DAC: Validating primary data. [2025-09-23T18:17:12.499491] [FATAL] [VALIDATOR ] DAC: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:17:12.499579] [FATAL] [MAIN ] DAC: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:17:12.499664] [WARN ] [MAIN ] DAC: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:17:12.499732] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-09-23T18:17:12.499793] [DEBUG] [LOCAL ] DAC: No primary data file found to delete. [2025-09-23T18:17:12.499840] [INFO ] [LOCAL ] DAC: Starting deletion of derivative data. [2025-09-23T18:17:12.500311] [DEBUG] [LOCAL ] DAC: Deleted derivative data file. [2025-09-23T18:17:12.500431] [INFO ] [MAIN ] Update Progress: 585/2372 symbols completed. DAC took 24.8s. Estimated remaining: 3h 55m 41s. Rate: 7.6 symbols/min [2025-09-23T18:17:12.683010] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:17:12.757554] [DEBUG] [LOCAL ] DAR: Loaded 51861 existing records from primary storage. [2025-09-23T18:17:12.757763] [INFO ] [MAIN ] DAR: Loaded 51861 existing records. [2025-09-23T18:17:12.956967] [WARN ] [MAIN ] DAR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:17:12.957246] [INFO ] [MAIN ] DAR: Wiping existing primary data before full refresh. [2025-09-23T18:17:12.957296] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-09-23T18:17:12.958354] [DEBUG] [LOCAL ] DAR: Deleted primary data file. [2025-09-23T18:17:12.958421] [INFO ] [MAIN ] DAR: Starting full primary refresh. [2025-09-23T18:17:13.007469] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-04. [2025-09-23T18:17:13.346864] [INFO ] [REMOTE ] DAR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:17:13.640127] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-23T18:17:13.802217] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-04. [2025-09-23T18:17:14.602271] [INFO ] [REMOTE ] DAR: Fetching primary data for 2024-12. [2025-09-23T18:17:15.402251] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-01. [2025-09-23T18:17:15.536046] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-23T18:17:15.840062] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-04 (2.83 seconds). [2025-09-23T18:17:16.140298] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-23T18:17:16.161540] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-23T18:17:16.202151] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-01. [2025-09-23T18:17:17.002195] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-05. [2025-09-23T18:17:17.377289] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-23T18:17:17.802206] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-02. [2025-09-23T18:17:18.241279] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-23T18:17:18.602224] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-02. [2025-09-23T18:17:18.999682] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-23T18:17:19.402197] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-05. [2025-09-23T18:17:19.942593] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-23T18:17:20.202186] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-03. [2025-09-23T18:17:21.002269] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-06. [2025-09-23T18:17:21.383884] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-23T18:17:21.783196] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-09-23T18:17:21.802263] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-03. [2025-09-23T18:17:22.370770] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-23T18:17:22.602252] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-04. [2025-09-23T18:17:23.162061] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-23T18:17:23.402232] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-07. [2025-09-23T18:17:23.797784] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-23T18:17:24.202248] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-06. [2025-09-23T18:17:25.002162] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-04. [2025-09-23T18:17:25.193863] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-23T18:17:25.802195] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-05. [2025-09-23T18:17:25.942415] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-23T18:17:26.483633] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-23T18:17:26.602201] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-05. [2025-09-23T18:17:26.897509] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-23T18:17:27.402215] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-07. [2025-09-23T18:17:27.899436] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-23T18:17:28.202250] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-08. [2025-09-23T18:17:29.002205] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-06. [2025-09-23T18:17:29.537761] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-23T18:17:29.568542] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-23T18:17:29.802211] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-08. [2025-09-23T18:17:30.354117] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-23T18:17:30.602203] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-07. [2025-09-23T18:17:31.402203] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-06. [2025-09-23T18:17:31.720674] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-23T18:17:32.202226] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-09. [2025-09-23T18:17:32.485557] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-23T18:17:32.508243] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-23T18:17:33.002209] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-08. [2025-09-23T18:17:33.540900] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-23T18:17:33.549937] [INFO ] [REMOTE ] DAN: Full fetch complete (70872 records). [2025-09-23T18:17:33.550128] [DEBUG] [VALIDATOR ] DAN: Validating primary data. [2025-09-23T18:17:33.807305] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-07. [2025-09-23T18:17:33.963629] [DEBUG] [VALIDATOR ] DAN: All expected trading days are present. [2025-09-23T18:17:33.963749] [DEBUG] [VALIDATOR ] DAN: Primary data validation passed. [2025-09-23T18:17:33.964517] [INFO ] [MAIN ] DAN: Fetched primary data is valid. [2025-09-23T18:17:33.964561] [DEBUG] [LOCAL ] DAN: Saving primary data. [2025-09-23T18:17:33.966252] [DEBUG] [LOCAL ] DAN: Trimmed 70872 records to 49032 (keeping 200 days of data) [2025-09-23T18:17:34.296291] [DEBUG] [LOCAL ] DAN: Primary data saved (49032 records). [2025-09-23T18:17:34.296471] [INFO ] [MAIN ] DAN: Full history saved. [2025-09-23T18:17:34.296806] [INFO ] [MAIN ] Update Progress: 586/2372 symbols completed. DAN took 34.3s. Estimated remaining: 3h 56m 15s. Rate: 7.6 symbols/min [2025-09-23T18:17:34.491032] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:17:34.525256] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-23T18:17:34.573624] [DEBUG] [LOCAL ] DAVA: Loaded 40440 existing records from primary storage. [2025-09-23T18:17:34.573799] [INFO ] [MAIN ] DAVA: Loaded 40440 existing records. [2025-09-23T18:17:34.607347] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-09. [2025-09-23T18:17:34.686338] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-23T18:17:34.780413] [WARN ] [MAIN ] DAVA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:17:34.780777] [INFO ] [MAIN ] DAVA: Wiping existing primary data before full refresh. [2025-09-23T18:17:34.780854] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-09-23T18:17:34.782203] [DEBUG] [LOCAL ] DAVA: Deleted primary data file. [2025-09-23T18:17:34.782290] [INFO ] [MAIN ] DAVA: Starting full primary refresh. [2025-09-23T18:17:35.137000] [INFO ] [REMOTE ] DAVA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:17:35.402200] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-09. [2025-09-23T18:17:36.202194] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2024-12. [2025-09-23T18:17:36.354999] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-23T18:17:36.367570] [INFO ] [REMOTE ] DAL: Full fetch complete (77823 records). [2025-09-23T18:17:36.367741] [DEBUG] [VALIDATOR ] DAL: Validating primary data. [2025-09-23T18:17:36.769812] [DEBUG] [VALIDATOR ] DAL: All expected trading days are present. [2025-09-23T18:17:36.769900] [DEBUG] [VALIDATOR ] DAL: Primary data validation passed. [2025-09-23T18:17:36.770736] [INFO ] [MAIN ] DAL: Fetched primary data is valid. [2025-09-23T18:17:36.770806] [DEBUG] [LOCAL ] DAL: Saving primary data. [2025-09-23T18:17:36.772433] [DEBUG] [LOCAL ] DAL: Trimmed 77823 records to 53753 (keeping 200 days of data) [2025-09-23T18:17:37.007200] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-08. [2025-09-23T18:17:37.136289] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-23T18:17:37.148566] [INFO ] [REMOTE ] DAR: Full fetch complete (74556 records). [2025-09-23T18:17:37.149279] [DEBUG] [VALIDATOR ] DAR: Validating primary data. [2025-09-23T18:17:37.636232] [DEBUG] [VALIDATOR ] DAR: All expected trading days are present. [2025-09-23T18:17:37.636569] [DEBUG] [LOCAL ] DAL: Primary data saved (53753 records). [2025-09-23T18:17:37.636682] [DEBUG] [VALIDATOR ] DAR: Primary data validation passed. [2025-09-23T18:17:37.656773] [INFO ] [MAIN ] DAR: Fetched primary data is valid. [2025-09-23T18:17:37.659535] [DEBUG] [LOCAL ] DAR: Saving primary data. [2025-09-23T18:17:37.659413] [INFO ] [MAIN ] DAL: Full history saved. [2025-09-23T18:17:37.660025] [INFO ] [MAIN ] Update Progress: 587/2372 symbols completed. DAL took 44.9s. Estimated remaining: 3h 55m 54s. Rate: 7.6 symbols/min [2025-09-23T18:17:37.696626] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-23T18:17:37.711045] [DEBUG] [LOCAL ] DAR: Trimmed 74556 records to 51855 (keeping 200 days of data) [2025-09-23T18:17:37.818842] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-01. [2025-09-23T18:17:37.968443] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-23T18:17:37.967050] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:17:38.127793] [DEBUG] [LOCAL ] DAY: Loaded 49932 existing records from primary storage. [2025-09-23T18:17:38.129414] [INFO ] [MAIN ] DAY: Loaded 49932 existing records. [2025-09-23T18:17:38.323945] [WARN ] [MAIN ] DAY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:17:38.324459] [INFO ] [MAIN ] DAY: Wiping existing primary data before full refresh. [2025-09-23T18:17:38.324518] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-09-23T18:17:38.325903] [DEBUG] [LOCAL ] DAY: Deleted primary data file. [2025-09-23T18:17:38.326207] [INFO ] [MAIN ] DAY: Starting full primary refresh. [2025-09-23T18:17:38.607036] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-09. [2025-09-23T18:17:38.779670] [INFO ] [REMOTE ] DAY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:17:38.814289] [DEBUG] [LOCAL ] DAR: Primary data saved (51855 records). [2025-09-23T18:17:38.814510] [INFO ] [MAIN ] DAR: Full history saved. [2025-09-23T18:17:38.814678] [INFO ] [MAIN ] Update Progress: 588/2372 symbols completed. DAR took 26.3s. Estimated remaining: 3h 55m 25s. Rate: 7.6 symbols/min [2025-09-23T18:17:38.988904] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:17:39.007323] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-23T18:17:39.060351] [DEBUG] [LOCAL ] DB: Loaded 52637 existing records from primary storage. [2025-09-23T18:17:39.060499] [INFO ] [MAIN ] DB: Loaded 52637 existing records. [2025-09-23T18:17:39.244856] [WARN ] [MAIN ] DB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:17:39.245177] [INFO ] [MAIN ] DB: Wiping existing primary data before full refresh. [2025-09-23T18:17:39.245235] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-09-23T18:17:39.246391] [DEBUG] [LOCAL ] DB: Deleted primary data file. [2025-09-23T18:17:39.246452] [INFO ] [MAIN ] DB: Starting full primary refresh. [2025-09-23T18:17:39.411671] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-02. [2025-09-23T18:17:39.632218] [INFO ] [REMOTE ] DB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:17:39.628465] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-23T18:17:39.636338] [INFO ] [REMOTE ] DAO: Full fetch complete (32581 records). [2025-09-23T18:17:39.636444] [DEBUG] [VALIDATOR ] DAO: Validating primary data. [2025-09-23T18:17:40.032740] [DEBUG] [VALIDATOR ] DAO: All expected trading days are present. [2025-09-23T18:17:40.032825] [DEBUG] [VALIDATOR ] DAO: Primary data validation passed. [2025-09-23T18:17:40.033301] [INFO ] [MAIN ] DAO: Fetched primary data is valid. [2025-09-23T18:17:40.033362] [DEBUG] [LOCAL ] DAO: Saving primary data. [2025-09-23T18:17:40.034504] [DEBUG] [LOCAL ] DAO: Trimmed 32581 records to 21242 (keeping 200 days of data) [2025-09-23T18:17:40.157212] [DEBUG] [LOCAL ] DAO: Primary data saved (21242 records). [2025-09-23T18:17:40.157346] [INFO ] [MAIN ] DAO: Full history saved. [2025-09-23T18:17:40.157432] [INFO ] [MAIN ] Update Progress: 589/2372 symbols completed. DAO took 31.2s. Estimated remaining: 3h 54m 57s. Rate: 7.6 symbols/min [2025-09-23T18:17:40.211771] [INFO ] [REMOTE ] DB: Fetching primary data for 2024-12. [2025-09-23T18:17:40.327902] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:17:40.328100] [DEBUG] [LOCAL ] DBD: No existing data file found in primary storage. [2025-09-23T18:17:40.328155] [WARN ] [MAIN ] DBD: No existing data found, performing full refresh instead. [2025-09-23T18:17:40.328296] [INFO ] [MAIN ] DBD: Wiping existing primary data before full refresh. [2025-09-23T18:17:40.328338] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-09-23T18:17:40.328378] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-09-23T18:17:40.328411] [INFO ] [MAIN ] DBD: Starting full primary refresh. [2025-09-23T18:17:40.746129] [INFO ] [REMOTE ] DBD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:17:40.951352] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-23T18:17:41.002165] [INFO ] [REMOTE ] DBD: Fetching primary data for 2024-12. [2025-09-23T18:17:41.603130] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-23T18:17:41.802239] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-03. [2025-09-23T18:17:41.933352] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-23T18:17:42.602256] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-01. [2025-09-23T18:17:42.824373] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-23T18:17:43.355838] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-23T18:17:43.402140] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-02. [2025-09-23T18:17:43.972708] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-23T18:17:44.202181] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-01. [2025-09-23T18:17:45.002235] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-04. [2025-09-23T18:17:45.616886] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-23T18:17:45.802171] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-02. [2025-09-23T18:17:46.033737] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-23T18:17:46.602209] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-03. [2025-09-23T18:17:47.154222] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-23T18:17:47.337029] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-23T18:17:47.402154] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-04. [2025-09-23T18:17:48.202205] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-03. [2025-09-23T18:17:48.293305] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-23T18:17:49.002275] [INFO ] [REMOTE ] DAY: Fetching primary data for 2024-12. [2025-09-23T18:17:49.802220] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-05. [2025-09-23T18:17:50.006269] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-23T18:17:50.523289] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-23T18:17:50.602157] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-01. [2025-09-23T18:17:51.155859] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-23T18:17:51.402228] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-04. [2025-09-23T18:17:51.970378] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-23T18:17:52.202235] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-05. [2025-09-23T18:17:53.002174] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-06. [2025-09-23T18:17:53.136817] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-23T18:17:53.339217] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-23T18:17:53.802251] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-06. [2025-09-23T18:17:54.048876] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-23T18:17:54.602252] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-02. [2025-09-23T18:17:54.866387] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-23T18:17:55.402195] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-07. [2025-09-23T18:17:55.900603] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-23T18:17:56.202232] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-03. [2025-09-23T18:17:56.555974] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-23T18:17:57.002218] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-07. [2025-09-23T18:17:57.738629] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-23T18:17:57.802201] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-04. [2025-09-23T18:17:58.132356] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-23T18:17:58.602217] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-08. [2025-09-23T18:17:59.402209] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-08. [2025-09-23T18:17:59.694821] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-23T18:17:59.771935] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-23T18:18:00.202219] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-05. [2025-09-23T18:18:00.573591] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-23T18:18:01.002216] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-09. [2025-09-23T18:18:01.802210] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-09. [2025-09-23T18:18:01.971749] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-23T18:18:01.975971] [INFO ] [REMOTE ] DBD: Full fetch complete (30384 records). [2025-09-23T18:18:01.976067] [DEBUG] [VALIDATOR ] DBD: Validating primary data. [2025-09-23T18:18:01.976746] [FATAL] [VALIDATOR ] DBD: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:18:01.976861] [FATAL] [MAIN ] DBD: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:18:01.976944] [WARN ] [MAIN ] DBD: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:18:01.977051] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-09-23T18:18:01.977147] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-09-23T18:18:01.977193] [INFO ] [LOCAL ] DBD: Starting deletion of derivative data. [2025-09-23T18:18:01.977263] [DEBUG] [LOCAL ] DBD: No derivative data file found to delete. [2025-09-23T18:18:01.977349] [INFO ] [MAIN ] Update Progress: 590/2372 symbols completed. DBD took 21.8s. Estimated remaining: 3h 55m 31s. Rate: 7.6 symbols/min [2025-09-23T18:18:02.166555] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:18:02.210982] [DEBUG] [LOCAL ] DBI: Loaded 45104 existing records from primary storage. [2025-09-23T18:18:02.211188] [INFO ] [MAIN ] DBI: Loaded 45104 existing records. [2025-09-23T18:18:02.410045] [WARN ] [MAIN ] DBI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:18:02.429877] [INFO ] [MAIN ] DBI: Wiping existing primary data before full refresh. [2025-09-23T18:18:02.430013] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-09-23T18:18:02.432563] [DEBUG] [LOCAL ] DBI: Deleted primary data file. [2025-09-23T18:18:02.432477] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-23T18:18:02.432841] [INFO ] [MAIN ] DBI: Starting full primary refresh. [2025-09-23T18:18:02.609822] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-06. [2025-09-23T18:18:02.809867] [INFO ] [REMOTE ] DBI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:18:03.402262] [INFO ] [REMOTE ] DBI: Fetching primary data for 2024-12. [2025-09-23T18:18:04.202207] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-05. [2025-09-23T18:18:06.226470] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-09 (4.42 seconds). [2025-09-23T18:18:06.234620] [INFO ] [REMOTE ] DAVA: Full fetch complete (55265 records). [2025-09-23T18:18:06.234805] [DEBUG] [VALIDATOR ] DAVA: Validating primary data. [2025-09-23T18:18:06.633172] [DEBUG] [VALIDATOR ] DAVA: All expected trading days are present. [2025-09-23T18:18:06.633358] [DEBUG] [VALIDATOR ] DAVA: Primary data validation passed. [2025-09-23T18:18:06.634225] [INFO ] [MAIN ] DAVA: Fetched primary data is valid. [2025-09-23T18:18:06.634312] [DEBUG] [LOCAL ] DAVA: Saving primary data. [2025-09-23T18:18:06.645204] [DEBUG] [LOCAL ] DAVA: Trimmed 55265 records to 40534 (keeping 200 days of data) [2025-09-23T18:18:06.664313] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2024-12 (3.26 seconds). [2025-09-23T18:18:06.731701] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-01. [2025-09-23T18:18:06.798895] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-06 (4.19 seconds). [2025-09-23T18:18:06.815997] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-07. [2025-09-23T18:18:06.955716] [DEBUG] [LOCAL ] DAVA: Primary data saved (40534 records). [2025-09-23T18:18:06.955853] [INFO ] [MAIN ] DAVA: Full history saved. [2025-09-23T18:18:06.955936] [INFO ] [MAIN ] Update Progress: 591/2372 symbols completed. DAVA took 32.7s. Estimated remaining: 3h 55m 15s. Rate: 7.6 symbols/min [2025-09-23T18:18:07.146277] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:18:07.157209] [DEBUG] [LOCAL ] DBL: Loaded 9064 existing records from primary storage. [2025-09-23T18:18:07.157323] [INFO ] [MAIN ] DBL: Loaded 9064 existing records. [2025-09-23T18:18:07.345792] [WARN ] [MAIN ] DBL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:18:07.346082] [INFO ] [MAIN ] DBL: Wiping existing primary data before full refresh. [2025-09-23T18:18:07.346235] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-09-23T18:18:07.346722] [DEBUG] [LOCAL ] DBL: Deleted primary data file. [2025-09-23T18:18:07.346885] [INFO ] [MAIN ] DBL: Starting full primary refresh. [2025-09-23T18:18:07.568515] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-05 (3.37 seconds). [2025-09-23T18:18:07.664119] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-06. [2025-09-23T18:18:07.763023] [INFO ] [REMOTE ] DBL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:18:07.763326] [INFO ] [REMOTE ] DBL: Fetching primary data for 2024-12. [2025-09-23T18:18:08.030823] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-23T18:18:08.131268] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-23T18:18:08.202151] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-08. [2025-09-23T18:18:08.314972] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-23T18:18:09.002206] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-02. [2025-09-23T18:18:09.183615] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-23T18:18:09.807382] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-07. [2025-09-23T18:18:09.820145] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-23T18:18:10.143064] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-23T18:18:10.602202] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-03. [2025-09-23T18:18:11.402239] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-01. [2025-09-23T18:18:11.781686] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-23T18:18:12.132504] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-23T18:18:12.202175] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-08. [2025-09-23T18:18:12.302688] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-23T18:18:13.002217] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-04. [2025-09-23T18:18:13.743487] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-23T18:18:13.802276] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-09. [2025-09-23T18:18:14.602335] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-09. [2025-09-23T18:18:14.704621] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-23T18:18:15.287825] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-23T18:18:15.296378] [INFO ] [REMOTE ] DAY: Full fetch complete (71732 records). [2025-09-23T18:18:15.296584] [DEBUG] [VALIDATOR ] DAY: Validating primary data. [2025-09-23T18:18:15.407385] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-02. [2025-09-23T18:18:15.739077] [DEBUG] [VALIDATOR ] DAY: All expected trading days are present. [2025-09-23T18:18:15.739218] [DEBUG] [VALIDATOR ] DAY: Primary data validation passed. [2025-09-23T18:18:15.740286] [INFO ] [MAIN ] DAY: Fetched primary data is valid. [2025-09-23T18:18:15.740380] [DEBUG] [LOCAL ] DAY: Saving primary data. [2025-09-23T18:18:15.742603] [DEBUG] [LOCAL ] DAY: Trimmed 71732 records to 49894 (keeping 200 days of data) [2025-09-23T18:18:15.984706] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-23T18:18:16.072524] [DEBUG] [LOCAL ] DAY: Primary data saved (49894 records). [2025-09-23T18:18:16.072768] [INFO ] [MAIN ] DAY: Full history saved. [2025-09-23T18:18:16.072894] [INFO ] [MAIN ] Update Progress: 592/2372 symbols completed. DAY took 38.4s. Estimated remaining: 3h 55m 10s. Rate: 7.6 symbols/min [2025-09-23T18:18:16.202890] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-05. [2025-09-23T18:18:16.296153] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:18:16.296578] [DEBUG] [LOCAL ] DBRG: No existing data file found in primary storage. [2025-09-23T18:18:16.297226] [WARN ] [MAIN ] DBRG: No existing data found, performing full refresh instead. [2025-09-23T18:18:16.297607] [INFO ] [MAIN ] DBRG: Wiping existing primary data before full refresh. [2025-09-23T18:18:16.297688] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-09-23T18:18:16.297753] [DEBUG] [LOCAL ] DBRG: No primary data file found to delete. [2025-09-23T18:18:16.297791] [INFO ] [MAIN ] DBRG: Starting full primary refresh. [2025-09-23T18:18:16.716883] [INFO ] [REMOTE ] DBRG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:18:16.739810] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-23T18:18:16.748259] [INFO ] [REMOTE ] DB: Full fetch complete (73706 records). [2025-09-23T18:18:16.748429] [DEBUG] [VALIDATOR ] DB: Validating primary data. [2025-09-23T18:18:16.749238] [FATAL] [VALIDATOR ] DB: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:18:16.749337] [FATAL] [MAIN ] DB: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:18:16.749380] [WARN ] [MAIN ] DB: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:18:16.749421] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-09-23T18:18:16.749481] [DEBUG] [LOCAL ] DB: No primary data file found to delete. [2025-09-23T18:18:16.749516] [INFO ] [LOCAL ] DB: Starting deletion of derivative data. [2025-09-23T18:18:16.749949] [DEBUG] [LOCAL ] DB: Deleted derivative data file. [2025-09-23T18:18:16.750054] [INFO ] [MAIN ] Update Progress: 593/2372 symbols completed. DB took 37.9s. Estimated remaining: 3h 54m 41s. Rate: 7.6 symbols/min [2025-09-23T18:18:16.916958] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:18:16.955298] [DEBUG] [LOCAL ] DCI: Loaded 37609 existing records from primary storage. [2025-09-23T18:18:16.955463] [INFO ] [MAIN ] DCI: Loaded 37609 existing records. [2025-09-23T18:18:17.010936] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2024-12. [2025-09-23T18:18:17.158551] [WARN ] [MAIN ] DCI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:18:17.158857] [INFO ] [MAIN ] DCI: Wiping existing primary data before full refresh. [2025-09-23T18:18:17.158909] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-09-23T18:18:17.159827] [DEBUG] [LOCAL ] DCI: Deleted primary data file. [2025-09-23T18:18:17.159891] [INFO ] [MAIN ] DCI: Starting full primary refresh. [2025-09-23T18:18:17.522803] [INFO ] [REMOTE ] DCI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:18:17.642920] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-23T18:18:17.802227] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-06. [2025-09-23T18:18:18.332777] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-23T18:18:18.602253] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-01. [2025-09-23T18:18:19.411733] [INFO ] [REMOTE ] DCI: Fetching primary data for 2024-12. [2025-09-23T18:18:19.416824] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-23T18:18:20.033241] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-23T18:18:20.202170] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-07. [2025-09-23T18:18:20.735634] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-23T18:18:21.002196] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-01. [2025-09-23T18:18:21.361488] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-23T18:18:21.802238] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-02. [2025-09-23T18:18:22.092441] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-23T18:18:22.602199] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-02. [2025-09-23T18:18:22.990958] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-23T18:18:23.402235] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-03. [2025-09-23T18:18:23.927541] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-23T18:18:24.196482] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-23T18:18:24.202135] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-04. [2025-09-23T18:18:24.670172] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-23T18:18:25.002210] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-08. [2025-09-23T18:18:25.802209] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-03. [2025-09-23T18:18:26.071762] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-23T18:18:26.602207] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-09. [2025-09-23T18:18:27.158845] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-23T18:18:27.402201] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-03. [2025-09-23T18:18:28.202176] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-04. [2025-09-23T18:18:28.505773] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-23T18:18:28.513267] [INFO ] [REMOTE ] DBI: Full fetch complete (66494 records). [2025-09-23T18:18:28.513408] [DEBUG] [VALIDATOR ] DBI: Validating primary data. [2025-09-23T18:18:28.916305] [DEBUG] [VALIDATOR ] DBI: All expected trading days are present. [2025-09-23T18:18:28.916392] [DEBUG] [VALIDATOR ] DBI: Primary data validation passed. [2025-09-23T18:18:28.917133] [INFO ] [MAIN ] DBI: Fetched primary data is valid. [2025-09-23T18:18:28.917197] [DEBUG] [LOCAL ] DBI: Saving primary data. [2025-09-23T18:18:28.918570] [DEBUG] [LOCAL ] DBI: Trimmed 66494 records to 45060 (keeping 200 days of data) [2025-09-23T18:18:29.007525] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-05. [2025-09-23T18:18:29.192729] [DEBUG] [LOCAL ] DBI: Primary data saved (45060 records). [2025-09-23T18:18:29.192896] [INFO ] [MAIN ] DBI: Full history saved. [2025-09-23T18:18:29.193004] [INFO ] [MAIN ] Update Progress: 594/2372 symbols completed. DBI took 27.2s. Estimated remaining: 3h 54m 46s. Rate: 7.6 symbols/min [2025-09-23T18:18:29.385615] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-23T18:18:29.430353] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:18:29.445844] [DEBUG] [LOCAL ] DCO: Loaded 13666 existing records from primary storage. [2025-09-23T18:18:29.445968] [INFO ] [MAIN ] DCO: Loaded 13666 existing records. [2025-09-23T18:18:29.602376] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-23T18:18:29.641119] [WARN ] [MAIN ] DCO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:18:29.644912] [INFO ] [MAIN ] DCO: Wiping existing primary data before full refresh. [2025-09-23T18:18:29.644983] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-09-23T18:18:29.645473] [DEBUG] [LOCAL ] DCO: Deleted primary data file. [2025-09-23T18:18:29.645539] [INFO ] [MAIN ] DCO: Starting full primary refresh. [2025-09-23T18:18:29.804888] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-06. [2025-09-23T18:18:30.045153] [INFO ] [REMOTE ] DCO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:18:30.047608] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-23T18:18:30.602177] [INFO ] [REMOTE ] DCO: Fetching primary data for 2024-12. [2025-09-23T18:18:30.695058] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-23T18:18:31.402197] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-05. [2025-09-23T18:18:31.436598] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-23T18:18:32.202242] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-04. [2025-09-23T18:18:33.002185] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-01. [2025-09-23T18:18:33.081813] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-23T18:18:33.720902] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-23T18:18:33.802158] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-06. [2025-09-23T18:18:33.823754] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-23T18:18:34.602189] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-02. [2025-09-23T18:18:35.351498] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-23T18:18:35.390305] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-23T18:18:35.402153] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-03. [2025-09-23T18:18:36.198563] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-23T18:18:36.202141] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-04. [2025-09-23T18:18:36.812150] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-23T18:18:37.002212] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-05. [2025-09-23T18:18:37.630574] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-23T18:18:37.802213] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-05. [2025-09-23T18:18:38.602192] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-07. [2025-09-23T18:18:39.188733] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-23T18:18:39.259318] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-23T18:18:39.402201] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-06. [2025-09-23T18:18:40.202232] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-08. [2025-09-23T18:18:40.478578] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-23T18:18:41.002274] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-06. [2025-09-23T18:18:41.180684] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-23T18:18:41.802207] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-09. [2025-09-23T18:18:42.602283] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-07. [2025-09-23T18:18:43.074995] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-23T18:18:43.402300] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-07. [2025-09-23T18:18:43.541312] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-23T18:18:43.543331] [INFO ] [REMOTE ] DBL: Full fetch complete (12441 records). [2025-09-23T18:18:43.543403] [DEBUG] [VALIDATOR ] DBL: Validating primary data. [2025-09-23T18:18:43.912245] [DEBUG] [VALIDATOR ] DBL: All expected trading days are present. [2025-09-23T18:18:43.912332] [DEBUG] [VALIDATOR ] DBL: Primary data validation passed. [2025-09-23T18:18:43.912727] [INFO ] [MAIN ] DBL: Fetched primary data is valid. [2025-09-23T18:18:43.912790] [DEBUG] [LOCAL ] DBL: Saving primary data. [2025-09-23T18:18:43.913315] [DEBUG] [LOCAL ] DBL: Trimmed 12441 records to 9081 (keeping 200 days of data) [2025-09-23T18:18:43.969204] [DEBUG] [LOCAL ] DBL: Primary data saved (9081 records). [2025-09-23T18:18:43.969335] [INFO ] [MAIN ] DBL: Full history saved. [2025-09-23T18:18:43.969425] [INFO ] [MAIN ] Update Progress: 595/2372 symbols completed. DBL took 37.0s. Estimated remaining: 3h 54m 59s. Rate: 7.6 symbols/min [2025-09-23T18:18:44.149425] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:18:44.202443] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-07. [2025-09-23T18:18:44.204764] [DEBUG] [LOCAL ] DD: Loaded 52821 existing records from primary storage. [2025-09-23T18:18:44.205172] [INFO ] [MAIN ] DD: Loaded 52821 existing records. [2025-09-23T18:18:44.445225] [WARN ] [MAIN ] DD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:18:44.415781] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-23T18:18:44.446266] [INFO ] [MAIN ] DD: Wiping existing primary data before full refresh. [2025-09-23T18:18:44.446524] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-09-23T18:18:44.453580] [DEBUG] [LOCAL ] DD: Deleted primary data file. [2025-09-23T18:18:44.453692] [INFO ] [MAIN ] DD: Starting full primary refresh. [2025-09-23T18:18:44.671690] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-23T18:18:44.868629] [INFO ] [REMOTE ] DD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:18:45.002159] [INFO ] [REMOTE ] DD: Fetching primary data for 2024-12. [2025-09-23T18:18:45.746836] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-23T18:18:45.802180] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-08. [2025-09-23T18:18:46.602214] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-08. [2025-09-23T18:18:46.853769] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-23T18:18:46.894514] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-23T18:18:47.402190] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-01. [2025-09-23T18:18:48.032573] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-23T18:18:48.202185] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-08. [2025-09-23T18:18:48.839619] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-23T18:18:49.002158] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-02. [2025-09-23T18:18:49.240525] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-23T18:18:49.802194] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-09. [2025-09-23T18:18:50.360561] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-23T18:18:50.602185] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-03. [2025-09-23T18:18:51.128810] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-23T18:18:51.136873] [INFO ] [REMOTE ] DBRG: Full fetch complete (71829 records). [2025-09-23T18:18:51.137003] [DEBUG] [VALIDATOR ] DBRG: Validating primary data. [2025-09-23T18:18:51.137861] [FATAL] [VALIDATOR ] DBRG: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:18:51.137955] [FATAL] [MAIN ] DBRG: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:18:51.137999] [WARN ] [MAIN ] DBRG: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:18:51.138046] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-09-23T18:18:51.138139] [DEBUG] [LOCAL ] DBRG: No primary data file found to delete. [2025-09-23T18:18:51.138197] [INFO ] [LOCAL ] DBRG: Starting deletion of derivative data. [2025-09-23T18:18:51.138258] [DEBUG] [LOCAL ] DBRG: No derivative data file found to delete. [2025-09-23T18:18:51.138340] [INFO ] [MAIN ] Update Progress: 596/2372 symbols completed. DBRG took 35.1s. Estimated remaining: 3h 54m 49s. Rate: 7.6 symbols/min [2025-09-23T18:18:51.327372] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:18:51.327709] [DEBUG] [LOCAL ] DDD: No existing data file found in primary storage. [2025-09-23T18:18:51.327765] [WARN ] [MAIN ] DDD: No existing data found, performing full refresh instead. [2025-09-23T18:18:51.327978] [INFO ] [MAIN ] DDD: Wiping existing primary data before full refresh. [2025-09-23T18:18:51.328027] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-09-23T18:18:51.328072] [DEBUG] [LOCAL ] DDD: No primary data file found to delete. [2025-09-23T18:18:51.328105] [INFO ] [MAIN ] DDD: Starting full primary refresh. [2025-09-23T18:18:51.411040] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-09. [2025-09-23T18:18:51.712891] [INFO ] [REMOTE ] DDD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:18:52.202197] [INFO ] [REMOTE ] DDD: Fetching primary data for 2024-12. [2025-09-23T18:18:52.441694] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-23T18:18:52.615885] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-23T18:18:52.622613] [INFO ] [REMOTE ] DCI: Full fetch complete (54348 records). [2025-09-23T18:18:52.622794] [DEBUG] [VALIDATOR ] DCI: Validating primary data. [2025-09-23T18:18:52.998685] [DEBUG] [VALIDATOR ] DCI: All expected trading days are present. [2025-09-23T18:18:52.998775] [DEBUG] [VALIDATOR ] DCI: Primary data validation passed. [2025-09-23T18:18:52.999398] [INFO ] [MAIN ] DCI: Fetched primary data is valid. [2025-09-23T18:18:52.999438] [DEBUG] [LOCAL ] DCI: Saving primary data. [2025-09-23T18:18:53.000528] [DEBUG] [LOCAL ] DCI: Trimmed 54348 records to 37606 (keeping 200 days of data) [2025-09-23T18:18:53.002244] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-09. [2025-09-23T18:18:53.231993] [DEBUG] [LOCAL ] DCI: Primary data saved (37606 records). [2025-09-23T18:18:53.232133] [INFO ] [MAIN ] DCI: Full history saved. [2025-09-23T18:18:53.232218] [INFO ] [MAIN ] Update Progress: 597/2372 symbols completed. DCI took 36.5s. Estimated remaining: 3h 54m 23s. Rate: 7.6 symbols/min [2025-09-23T18:18:53.802169] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-04. [2025-09-23T18:18:53.910141] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-23T18:18:53.928829] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-23T18:18:53.931988] [INFO ] [REMOTE ] DCO: Full fetch complete (19567 records). [2025-09-23T18:18:53.932064] [DEBUG] [VALIDATOR ] DCO: Validating primary data. [2025-09-23T18:18:54.294849] [DEBUG] [VALIDATOR ] DCO: All expected trading days are present. [2025-09-23T18:18:54.294925] [DEBUG] [VALIDATOR ] DCO: Primary data validation passed. [2025-09-23T18:18:54.295326] [INFO ] [MAIN ] DCO: Fetched primary data is valid. [2025-09-23T18:18:54.295386] [DEBUG] [LOCAL ] DCO: Saving primary data. [2025-09-23T18:18:54.295988] [DEBUG] [LOCAL ] DCO: Trimmed 19567 records to 13718 (keeping 200 days of data) [2025-09-23T18:18:54.379739] [DEBUG] [LOCAL ] DCO: Primary data saved (13718 records). [2025-09-23T18:18:54.379874] [INFO ] [MAIN ] DCO: Full history saved. [2025-09-23T18:18:54.379958] [INFO ] [MAIN ] Update Progress: 598/2372 symbols completed. DCO took 25.2s. Estimated remaining: 3h 53m 55s. Rate: 7.6 symbols/min [2025-09-23T18:18:54.602268] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-01. [2025-09-23T18:18:55.364806] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-23T18:18:55.402153] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-05. [2025-09-23T18:18:56.025752] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-23T18:18:56.202188] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-02. [2025-09-23T18:18:57.381925] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-23T18:18:57.393255] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-06. [2025-09-23T18:18:57.467727] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-23T18:18:57.802232] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-03. [2025-09-23T18:18:58.758240] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-23T18:18:58.768940] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-07. [2025-09-23T18:18:59.304435] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-23T18:18:59.402208] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-04. [2025-09-23T18:19:00.827157] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-23T18:19:00.839203] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-08. [2025-09-23T18:19:01.414835] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-23T18:19:01.426019] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-05. [2025-09-23T18:19:02.348063] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-23T18:19:02.360401] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-09. [2025-09-23T18:19:03.441551] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-23T18:19:03.452411] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-06. [2025-09-23T18:19:04.143722] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-23T18:19:04.152524] [INFO ] [REMOTE ] DD: Full fetch complete (76268 records). [2025-09-23T18:19:04.152697] [DEBUG] [VALIDATOR ] DD: Validating primary data. [2025-09-23T18:19:04.549746] [DEBUG] [VALIDATOR ] DD: All expected trading days are present. [2025-09-23T18:19:04.549839] [DEBUG] [VALIDATOR ] DD: Primary data validation passed. [2025-09-23T18:19:04.550672] [INFO ] [MAIN ] DD: Fetched primary data is valid. [2025-09-23T18:19:04.550737] [DEBUG] [LOCAL ] DD: Saving primary data. [2025-09-23T18:19:04.552234] [DEBUG] [LOCAL ] DD: Trimmed 76268 records to 52827 (keeping 200 days of data) [2025-09-23T18:19:04.889086] [DEBUG] [LOCAL ] DD: Primary data saved (52827 records). [2025-09-23T18:19:04.889256] [INFO ] [MAIN ] DD: Full history saved. [2025-09-23T18:19:04.889402] [INFO ] [MAIN ] Update Progress: 599/2372 symbols completed. DD took 20.9s. Estimated remaining: 3h 53m 55s. Rate: 7.6 symbols/min [2025-09-23T18:19:04.935841] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-23T18:19:04.947127] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-07. [2025-09-23T18:19:06.355709] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-23T18:19:06.366609] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-08. [2025-09-23T18:19:07.858624] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-23T18:19:07.870180] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-09. [2025-09-23T18:19:09.740193] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-23T18:19:09.749234] [INFO ] [REMOTE ] DDD: Full fetch complete (73655 records). [2025-09-23T18:19:09.749421] [DEBUG] [VALIDATOR ] DDD: Validating primary data. [2025-09-23T18:19:10.146535] [DEBUG] [VALIDATOR ] DDD: All expected trading days are present. [2025-09-23T18:19:10.146636] [DEBUG] [VALIDATOR ] DDD: Primary data validation passed. [2025-09-23T18:19:10.147492] [INFO ] [MAIN ] DDD: Fetched primary data is valid. [2025-09-23T18:19:10.147546] [DEBUG] [LOCAL ] DDD: Saving primary data. [2025-09-23T18:19:10.149078] [DEBUG] [LOCAL ] DDD: Trimmed 73655 records to 50863 (keeping 200 days of data) [2025-09-23T18:19:10.454278] [DEBUG] [LOCAL ] DDD: Primary data saved (50863 records). [2025-09-23T18:19:10.454566] [INFO ] [MAIN ] DDD: Full history saved. [2025-09-23T18:19:10.454775] [INFO ] [MAIN ] Update Progress: 600/2372 symbols completed. DDD took 19.3s. Estimated remaining: 3h 53m 40s. Rate: 7.6 symbols/min [2025-09-23T18:19:11.101763] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:19:11.274325] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:19:11.254025] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:19:11.273048] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:19:11.275544] [DEBUG] [LOCAL ] DDL: No existing data file found in primary storage. [2025-09-23T18:19:11.275604] [WARN ] [MAIN ] DDL: No existing data found, performing full refresh instead. [2025-09-23T18:19:11.275792] [INFO ] [MAIN ] DDL: Wiping existing primary data before full refresh. [2025-09-23T18:19:11.275847] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-09-23T18:19:11.276969] [DEBUG] [LOCAL ] DDL: No primary data file found to delete. [2025-09-23T18:19:11.277027] [INFO ] [MAIN ] DDL: Starting full primary refresh. [2025-09-23T18:19:11.343104] [DEBUG] [LOCAL ] DDT: Loaded 2092 existing records from primary storage. [2025-09-23T18:19:11.368563] [INFO ] [MAIN ] DDT: Loaded 2092 existing records. [2025-09-23T18:19:11.430338] [DEBUG] [LOCAL ] DDS: Loaded 13317 existing records from primary storage. [2025-09-23T18:19:11.452214] [INFO ] [MAIN ] DDS: Loaded 13317 existing records. [2025-09-23T18:19:11.809936] [DEBUG] [LOCAL ] DE: Loaded 47776 existing records from primary storage. [2025-09-23T18:19:11.851213] [INFO ] [MAIN ] DE: Loaded 47776 existing records. [2025-09-23T18:19:12.030795] [WARN ] [MAIN ] DDS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:19:12.120636] [INFO ] [MAIN ] DDS: Wiping existing primary data before full refresh. [2025-09-23T18:19:12.115371] [WARN ] [MAIN ] DDT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:19:12.144472] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-09-23T18:19:12.174514] [INFO ] [MAIN ] DDT: Wiping existing primary data before full refresh. [2025-09-23T18:19:12.174615] [DEBUG] [LOCAL ] DDS: Deleted primary data file. [2025-09-23T18:19:12.178843] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-09-23T18:19:12.189221] [INFO ] [MAIN ] DDS: Starting full primary refresh. [2025-09-23T18:19:12.178740] [INFO ] [REMOTE ] DDL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:19:12.215783] [DEBUG] [LOCAL ] DDT: Deleted primary data file. [2025-09-23T18:19:12.216187] [INFO ] [REMOTE ] DDL: Fetching primary data for 2024-12. [2025-09-23T18:19:12.221921] [INFO ] [MAIN ] DDT: Starting full primary refresh. [2025-09-23T18:19:12.397290] [WARN ] [MAIN ] DE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:19:12.470729] [INFO ] [MAIN ] DE: Wiping existing primary data before full refresh. [2025-09-23T18:19:12.492155] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-09-23T18:19:12.517343] [DEBUG] [LOCAL ] DE: Deleted primary data file. [2025-09-23T18:19:12.537070] [INFO ] [MAIN ] DE: Starting full primary refresh. [2025-09-23T18:19:13.173266] [INFO ] [REMOTE ] DDS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:19:13.244933] [INFO ] [REMOTE ] DDS: Fetching primary data for 2024-12. [2025-09-23T18:19:13.308313] [INFO ] [REMOTE ] DDT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:19:13.335511] [INFO ] [REMOTE ] DDT: Fetching primary data for 2024-12. [2025-09-23T18:19:13.446424] [INFO ] [REMOTE ] DE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:19:13.446851] [INFO ] [REMOTE ] DE: Fetching primary data for 2024-12. [2025-09-23T18:19:13.729208] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-23T18:19:13.740354] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-01. [2025-09-23T18:19:13.827213] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-23T18:19:13.828572] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-01. [2025-09-23T18:19:14.268292] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-23T18:19:14.270159] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-02. [2025-09-23T18:19:14.425534] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-23T18:19:14.428935] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-01. [2025-09-23T18:19:14.578335] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-09-23T18:19:14.579406] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-03. [2025-09-23T18:19:14.709168] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-23T18:19:14.717607] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-02. [2025-09-23T18:19:14.923204] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-23T18:19:14.925585] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-04. [2025-09-23T18:19:14.926907] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-23T18:19:14.937876] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-01. [2025-09-23T18:19:15.037793] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-23T18:19:15.402230] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-02. [2025-09-23T18:19:15.504574] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-23T18:19:15.630142] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-23T18:19:16.202180] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-05. [2025-09-23T18:19:16.281566] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-23T18:19:16.391738] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-23T18:19:16.541845] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-23T18:19:17.002225] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-03. [2025-09-23T18:19:17.802246] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-02. [2025-09-23T18:19:18.430026] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-23T18:19:18.602261] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-06. [2025-09-23T18:19:18.994621] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-23T18:19:19.230973] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-23T18:19:19.402181] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-03. [2025-09-23T18:19:20.202191] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-03. [2025-09-23T18:19:20.978125] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-23T18:19:21.002154] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-04. [2025-09-23T18:19:21.217542] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-23T18:19:21.802213] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-04. [2025-09-23T18:19:22.602224] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-07. [2025-09-23T18:19:22.871195] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-23T18:19:22.934902] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-23T18:19:22.942984] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-23T18:19:23.402198] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-08. [2025-09-23T18:19:23.838612] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-23T18:19:24.202211] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-04. [2025-09-23T18:19:25.002251] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-05. [2025-09-23T18:19:25.802356] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-05. [2025-09-23T18:19:26.191958] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-23T18:19:26.591704] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-23T18:19:26.602189] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-09. [2025-09-23T18:19:27.083925] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-23T18:19:27.368412] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-23T18:19:27.370125] [INFO ] [REMOTE ] DDT: Full fetch complete (2893 records). [2025-09-23T18:19:27.370298] [DEBUG] [VALIDATOR ] DDT: Validating primary data. [2025-09-23T18:19:27.371575] [FATAL] [VALIDATOR ] DDT: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:19:27.371751] [FATAL] [MAIN ] DDT: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:19:27.371836] [WARN ] [MAIN ] DDT: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:19:27.371981] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-09-23T18:19:27.372113] [DEBUG] [LOCAL ] DDT: No primary data file found to delete. [2025-09-23T18:19:27.372218] [INFO ] [LOCAL ] DDT: Starting deletion of derivative data. [2025-09-23T18:19:27.372764] [DEBUG] [LOCAL ] DDT: Deleted derivative data file. [2025-09-23T18:19:27.372989] [INFO ] [MAIN ] Update Progress: 601/2372 symbols completed. DDT took 16.9s. Estimated remaining: 3h 53m 59s. Rate: 7.6 symbols/min [2025-09-23T18:19:27.407819] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-06. [2025-09-23T18:19:27.597577] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:19:27.676807] [DEBUG] [LOCAL ] DEA: Loaded 41546 existing records from primary storage. [2025-09-23T18:19:27.677017] [INFO ] [MAIN ] DEA: Loaded 41546 existing records. [2025-09-23T18:19:27.873812] [WARN ] [MAIN ] DEA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:19:27.874060] [INFO ] [MAIN ] DEA: Wiping existing primary data before full refresh. [2025-09-23T18:19:27.874110] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-09-23T18:19:27.875493] [DEBUG] [LOCAL ] DEA: Deleted primary data file. [2025-09-23T18:19:27.875566] [INFO ] [MAIN ] DEA: Starting full primary refresh. [2025-09-23T18:19:28.203087] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-06. [2025-09-23T18:19:28.270585] [INFO ] [REMOTE ] DEA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:19:28.272225] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-23T18:19:29.002206] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-05. [2025-09-23T18:19:29.619463] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-23T18:19:29.802198] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-07. [2025-09-23T18:19:30.055544] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-23T18:19:30.602205] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-07. [2025-09-23T18:19:31.187983] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-23T18:19:31.402161] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-06. [2025-09-23T18:19:31.627342] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-23T18:19:32.202166] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-08. [2025-09-23T18:19:32.341347] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-23T18:19:32.880779] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-23T18:19:33.002220] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-08. [2025-09-23T18:19:33.802211] [INFO ] [REMOTE ] DEA: Fetching primary data for 2024-12. [2025-09-23T18:19:34.402873] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-23T18:19:34.602197] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-09. [2025-09-23T18:19:35.171438] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-23T18:19:35.402169] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-09. [2025-09-23T18:19:35.543600] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-23T18:19:35.546878] [INFO ] [REMOTE ] DDS: Full fetch complete (19254 records). [2025-09-23T18:19:35.546952] [DEBUG] [VALIDATOR ] DDS: Validating primary data. [2025-09-23T18:19:35.913586] [DEBUG] [VALIDATOR ] DDS: All expected trading days are present. [2025-09-23T18:19:35.913710] [DEBUG] [VALIDATOR ] DDS: Primary data validation passed. [2025-09-23T18:19:35.914091] [INFO ] [MAIN ] DDS: Fetched primary data is valid. [2025-09-23T18:19:35.914158] [DEBUG] [LOCAL ] DDS: Saving primary data. [2025-09-23T18:19:35.914772] [DEBUG] [LOCAL ] DDS: Trimmed 19254 records to 13255 (keeping 200 days of data) [2025-09-23T18:19:36.008343] [DEBUG] [LOCAL ] DDS: Primary data saved (13255 records). [2025-09-23T18:19:36.008474] [INFO ] [MAIN ] DDS: Full history saved. [2025-09-23T18:19:36.008590] [INFO ] [MAIN ] Update Progress: 602/2372 symbols completed. DDS took 25.6s. Estimated remaining: 3h 53m 53s. Rate: 7.6 symbols/min [2025-09-23T18:19:36.177109] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:19:36.203268] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-01. [2025-09-23T18:19:36.219963] [DEBUG] [LOCAL ] DEC: Loaded 30832 existing records from primary storage. [2025-09-23T18:19:36.220108] [INFO ] [MAIN ] DEC: Loaded 30832 existing records. [2025-09-23T18:19:36.396356] [WARN ] [MAIN ] DEC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:19:36.396604] [INFO ] [MAIN ] DEC: Wiping existing primary data before full refresh. [2025-09-23T18:19:36.396702] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-09-23T18:19:36.397834] [DEBUG] [LOCAL ] DEC: Deleted primary data file. [2025-09-23T18:19:36.397896] [INFO ] [MAIN ] DEC: Starting full primary refresh. [2025-09-23T18:19:36.755136] [INFO ] [REMOTE ] DEC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:19:37.002213] [INFO ] [REMOTE ] DEC: Fetching primary data for 2024-12. [2025-09-23T18:19:37.082585] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-23T18:19:37.092098] [INFO ] [REMOTE ] DE: Full fetch complete (69603 records). [2025-09-23T18:19:37.092225] [DEBUG] [VALIDATOR ] DE: Validating primary data. [2025-09-23T18:19:37.140850] [DEBUG] [REMOTE ] DEC: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-09-23T18:19:37.168471] [WARN ] [REMOTE ] DEC: No data returned for month 2024-12 [2025-09-23T18:19:37.505523] [DEBUG] [VALIDATOR ] DE: All expected trading days are present. [2025-09-23T18:19:37.505700] [DEBUG] [VALIDATOR ] DE: Primary data validation passed. [2025-09-23T18:19:37.506760] [INFO ] [MAIN ] DE: Fetched primary data is valid. [2025-09-23T18:19:37.506828] [DEBUG] [LOCAL ] DE: Saving primary data. [2025-09-23T18:19:37.508466] [DEBUG] [LOCAL ] DE: Trimmed 69603 records to 47738 (keeping 200 days of data) [2025-09-23T18:19:37.776871] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-23T18:19:37.802254] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-02. [2025-09-23T18:19:37.876364] [DEBUG] [LOCAL ] DE: Primary data saved (47738 records). [2025-09-23T18:19:37.876545] [INFO ] [MAIN ] DE: Full history saved. [2025-09-23T18:19:37.876698] [INFO ] [MAIN ] Update Progress: 603/2372 symbols completed. DE took 27.4s. Estimated remaining: 3h 53m 27s. Rate: 7.6 symbols/min [2025-09-23T18:19:38.054789] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:19:38.055000] [DEBUG] [LOCAL ] DECK: No existing data file found in primary storage. [2025-09-23T18:19:38.055054] [WARN ] [MAIN ] DECK: No existing data found, performing full refresh instead. [2025-09-23T18:19:38.055230] [INFO ] [MAIN ] DECK: Wiping existing primary data before full refresh. [2025-09-23T18:19:38.055273] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-09-23T18:19:38.055313] [DEBUG] [LOCAL ] DECK: No primary data file found to delete. [2025-09-23T18:19:38.055345] [INFO ] [MAIN ] DECK: Starting full primary refresh. [2025-09-23T18:19:38.438874] [INFO ] [REMOTE ] DECK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:19:38.602195] [INFO ] [REMOTE ] DECK: Fetching primary data for 2024-12. [2025-09-23T18:19:39.365192] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-23T18:19:39.402151] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-03. [2025-09-23T18:19:40.202208] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-07. [2025-09-23T18:19:40.253235] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-23T18:19:41.002173] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-01. [2025-09-23T18:19:41.101705] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-23T18:19:41.167827] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-23T18:19:41.802207] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-04. [2025-09-23T18:19:42.101115] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-23T18:19:42.602218] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-02. [2025-09-23T18:19:43.278244] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-23T18:19:43.402191] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-05. [2025-09-23T18:19:44.062310] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-23T18:19:44.202217] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-01. [2025-09-23T18:19:44.587167] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-23T18:19:45.002263] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-08. [2025-09-23T18:19:45.802190] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-03. [2025-09-23T18:19:45.855547] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-23T18:19:46.133249] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-23T18:19:46.602294] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-02. [2025-09-23T18:19:46.957504] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-23T18:19:47.402229] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-09. [2025-09-23T18:19:48.202184] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-04. [2025-09-23T18:19:48.273699] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-23T18:19:48.881876] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-23T18:19:48.890313] [INFO ] [REMOTE ] DDL: Full fetch complete (53312 records). [2025-09-23T18:19:48.890467] [DEBUG] [VALIDATOR ] DDL: Validating primary data. [2025-09-23T18:19:49.007417] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-06. [2025-09-23T18:19:49.289160] [DEBUG] [VALIDATOR ] DDL: All expected trading days are present. [2025-09-23T18:19:49.289277] [DEBUG] [VALIDATOR ] DDL: Primary data validation passed. [2025-09-23T18:19:49.290145] [INFO ] [MAIN ] DDL: Fetched primary data is valid. [2025-09-23T18:19:49.290210] [DEBUG] [LOCAL ] DDL: Saving primary data. [2025-09-23T18:19:49.291477] [DEBUG] [LOCAL ] DDL: Trimmed 53312 records to 36276 (keeping 200 days of data) [2025-09-23T18:19:49.504699] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-23T18:19:49.538065] [DEBUG] [LOCAL ] DDL: Primary data saved (36276 records). [2025-09-23T18:19:49.538215] [INFO ] [MAIN ] DDL: Full history saved. [2025-09-23T18:19:49.538331] [INFO ] [MAIN ] Update Progress: 604/2372 symbols completed. DDL took 39.1s. Estimated remaining: 3h 53m 30s. Rate: 7.6 symbols/min [2025-09-23T18:19:49.709091] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:19:49.759683] [DEBUG] [LOCAL ] DEI: Loaded 48508 existing records from primary storage. [2025-09-23T18:19:49.759854] [INFO ] [MAIN ] DEI: Loaded 48508 existing records. [2025-09-23T18:19:49.813942] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-03. [2025-09-23T18:19:49.940376] [WARN ] [MAIN ] DEI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:19:49.940662] [INFO ] [MAIN ] DEI: Wiping existing primary data before full refresh. [2025-09-23T18:19:49.940724] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-09-23T18:19:49.942333] [DEBUG] [LOCAL ] DEI: Deleted primary data file. [2025-09-23T18:19:49.942395] [INFO ] [MAIN ] DEI: Starting full primary refresh. [2025-09-23T18:19:50.301423] [INFO ] [REMOTE ] DEI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:19:50.602275] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-05. [2025-09-23T18:19:50.649066] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-23T18:19:51.402234] [INFO ] [REMOTE ] DEI: Fetching primary data for 2024-12. [2025-09-23T18:19:51.610400] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-23T18:19:51.673866] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-23T18:19:52.202225] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-06. [2025-09-23T18:19:52.588568] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-23T18:19:53.002220] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-04. [2025-09-23T18:19:53.675740] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-23T18:19:53.802219] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-07. [2025-09-23T18:19:54.602179] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-01. [2025-09-23T18:19:54.692901] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-23T18:19:55.190235] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-23T18:19:55.402244] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-07. [2025-09-23T18:19:55.993399] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-23T18:19:56.202195] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-08. [2025-09-23T18:19:56.493512] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-23T18:19:56.950973] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-23T18:19:57.002159] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-09. [2025-09-23T18:19:57.802236] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-02. [2025-09-23T18:19:58.073412] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-23T18:19:58.079310] [INFO ] [REMOTE ] DEC: Full fetch complete (39953 records). [2025-09-23T18:19:58.079605] [DEBUG] [VALIDATOR ] DEC: Validating primary data. [2025-09-23T18:19:58.274800] [WARN ] [VALIDATOR ] DEC: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-23T18:19:58.275429] [FATAL] [MAIN ] DEC: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:19:58.275520] [WARN ] [MAIN ] DEC: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:19:58.275609] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-09-23T18:19:58.275754] [DEBUG] [LOCAL ] DEC: No primary data file found to delete. [2025-09-23T18:19:58.275837] [INFO ] [LOCAL ] DEC: Starting deletion of derivative data. [2025-09-23T18:19:58.276305] [DEBUG] [LOCAL ] DEC: Deleted derivative data file. [2025-09-23T18:19:58.276440] [INFO ] [MAIN ] Update Progress: 605/2372 symbols completed. DEC took 22.3s. Estimated remaining: 3h 53m 25s. Rate: 7.6 symbols/min [2025-09-23T18:19:58.449073] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:19:58.504913] [DEBUG] [LOCAL ] DELL: Loaded 53735 existing records from primary storage. [2025-09-23T18:19:58.505129] [INFO ] [MAIN ] DELL: Loaded 53735 existing records. [2025-09-23T18:19:58.604104] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-05. [2025-09-23T18:19:58.687875] [WARN ] [MAIN ] DELL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:19:58.688144] [INFO ] [MAIN ] DELL: Wiping existing primary data before full refresh. [2025-09-23T18:19:58.688194] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-09-23T18:19:58.690329] [DEBUG] [LOCAL ] DELL: Deleted primary data file. [2025-09-23T18:19:58.690393] [INFO ] [MAIN ] DELL: Starting full primary refresh. [2025-09-23T18:19:59.054551] [INFO ] [REMOTE ] DELL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:19:59.079300] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-23T18:19:59.402241] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-08. [2025-09-23T18:20:00.202241] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-03. [2025-09-23T18:20:00.616479] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-23T18:20:00.652450] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-23T18:20:01.002159] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-06. [2025-09-23T18:20:01.673629] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-23T18:20:01.802198] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-09. [2025-09-23T18:20:02.602216] [INFO ] [REMOTE ] DELL: Fetching primary data for 2024-12. [2025-09-23T18:20:02.931426] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-23T18:20:02.938140] [INFO ] [REMOTE ] DEA: Full fetch complete (63120 records). [2025-09-23T18:20:02.938249] [DEBUG] [VALIDATOR ] DEA: Validating primary data. [2025-09-23T18:20:03.353059] [DEBUG] [VALIDATOR ] DEA: All expected trading days are present. [2025-09-23T18:20:03.353211] [DEBUG] [VALIDATOR ] DEA: Primary data validation passed. [2025-09-23T18:20:03.353998] [INFO ] [MAIN ] DEA: Fetched primary data is valid. [2025-09-23T18:20:03.354116] [DEBUG] [LOCAL ] DEA: Saving primary data. [2025-09-23T18:20:03.384069] [DEBUG] [LOCAL ] DEA: Trimmed 63120 records to 41499 (keeping 200 days of data) [2025-09-23T18:20:03.385365] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-09-23T18:20:03.402148] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-07. [2025-09-23T18:20:03.664941] [DEBUG] [LOCAL ] DEA: Primary data saved (41499 records). [2025-09-23T18:20:03.665115] [INFO ] [MAIN ] DEA: Full history saved. [2025-09-23T18:20:03.665232] [INFO ] [MAIN ] Update Progress: 606/2372 symbols completed. DEA took 36.3s. Estimated remaining: 3h 53m 9s. Rate: 7.6 symbols/min [2025-09-23T18:20:03.845423] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:20:03.898712] [DEBUG] [LOCAL ] DEO: Loaded 49009 existing records from primary storage. [2025-09-23T18:20:03.898896] [INFO ] [MAIN ] DEO: Loaded 49009 existing records. [2025-09-23T18:20:04.080730] [WARN ] [MAIN ] DEO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:20:04.080979] [INFO ] [MAIN ] DEO: Wiping existing primary data before full refresh. [2025-09-23T18:20:04.081029] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-09-23T18:20:04.082473] [DEBUG] [LOCAL ] DEO: Deleted primary data file. [2025-09-23T18:20:04.082537] [INFO ] [MAIN ] DEO: Starting full primary refresh. [2025-09-23T18:20:04.207358] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-04. [2025-09-23T18:20:04.453199] [INFO ] [REMOTE ] DEO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:20:04.673340] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-23T18:20:05.002258] [INFO ] [REMOTE ] DEO: Fetching primary data for 2024-12. [2025-09-23T18:20:05.362624] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-23T18:20:05.692418] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-23T18:20:05.802158] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-05. [2025-09-23T18:20:06.556124] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-23T18:20:06.602153] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-01. [2025-09-23T18:20:07.335334] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-23T18:20:07.402175] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-06. [2025-09-23T18:20:07.946059] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-23T18:20:08.202243] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-08. [2025-09-23T18:20:09.002200] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-02. [2025-09-23T18:20:09.038411] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-23T18:20:09.808182] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-07. [2025-09-23T18:20:09.813774] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-23T18:20:10.518744] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-23T18:20:10.602165] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-09. [2025-09-23T18:20:11.006504] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-23T18:20:11.402207] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-01. [2025-09-23T18:20:12.202157] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-03. [2025-09-23T18:20:12.302966] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-23T18:20:12.311928] [INFO ] [REMOTE ] DECK: Full fetch complete (76591 records). [2025-09-23T18:20:12.312159] [DEBUG] [VALIDATOR ] DECK: Validating primary data. [2025-09-23T18:20:12.741144] [DEBUG] [VALIDATOR ] DECK: All expected trading days are present. [2025-09-23T18:20:12.741242] [DEBUG] [VALIDATOR ] DECK: Primary data validation passed. [2025-09-23T18:20:12.742092] [INFO ] [MAIN ] DECK: Fetched primary data is valid. [2025-09-23T18:20:12.742157] [DEBUG] [LOCAL ] DECK: Saving primary data. [2025-09-23T18:20:12.743661] [DEBUG] [LOCAL ] DECK: Trimmed 76591 records to 53303 (keeping 200 days of data) [2025-09-23T18:20:13.017622] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-08. [2025-09-23T18:20:13.067132] [DEBUG] [LOCAL ] DECK: Primary data saved (53303 records). [2025-09-23T18:20:13.067289] [INFO ] [MAIN ] DECK: Full history saved. [2025-09-23T18:20:13.067390] [INFO ] [MAIN ] Update Progress: 607/2372 symbols completed. DECK took 35.2s. Estimated remaining: 3h 53m 6s. Rate: 7.6 symbols/min [2025-09-23T18:20:13.243142] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:20:13.275220] [DEBUG] [LOCAL ] DFH: Loaded 32971 existing records from primary storage. [2025-09-23T18:20:13.275368] [INFO ] [MAIN ] DFH: Loaded 32971 existing records. [2025-09-23T18:20:13.461744] [WARN ] [MAIN ] DFH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:20:13.462131] [INFO ] [MAIN ] DFH: Wiping existing primary data before full refresh. [2025-09-23T18:20:13.462201] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-09-23T18:20:13.463924] [DEBUG] [LOCAL ] DFH: Deleted primary data file. [2025-09-23T18:20:13.463992] [INFO ] [MAIN ] DFH: Starting full primary refresh. [2025-09-23T18:20:13.862224] [INFO ] [REMOTE ] DFH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:20:13.862843] [INFO ] [REMOTE ] DFH: Fetching primary data for 2024-12. [2025-09-23T18:20:13.896110] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-01 (2.49 seconds). [2025-09-23T18:20:13.934878] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-23T18:20:14.298096] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-23T18:20:14.602322] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-02. [2025-09-23T18:20:15.402235] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-09. [2025-09-23T18:20:15.505135] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-23T18:20:16.202270] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-04. [2025-09-23T18:20:17.002181] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-01. [2025-09-23T18:20:17.076386] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-09-23T18:20:17.626772] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-23T18:20:17.802207] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-05. [2025-09-23T18:20:18.090792] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-23T18:20:18.602161] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-02. [2025-09-23T18:20:19.010480] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-09 (3.61 seconds). [2025-09-23T18:20:19.018512] [INFO ] [REMOTE ] DEI: Full fetch complete (69176 records). [2025-09-23T18:20:19.018671] [DEBUG] [VALIDATOR ] DEI: Validating primary data. [2025-09-23T18:20:19.019400] [FATAL] [VALIDATOR ] DEI: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:20:19.019470] [FATAL] [MAIN ] DEI: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:20:19.019519] [WARN ] [MAIN ] DEI: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:20:19.019631] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-09-23T18:20:19.019736] [DEBUG] [LOCAL ] DEI: No primary data file found to delete. [2025-09-23T18:20:19.019777] [INFO ] [LOCAL ] DEI: Starting deletion of derivative data. [2025-09-23T18:20:19.020345] [DEBUG] [LOCAL ] DEI: Deleted derivative data file. [2025-09-23T18:20:19.020443] [INFO ] [MAIN ] Update Progress: 608/2372 symbols completed. DEI took 29.5s. Estimated remaining: 3h 52m 52s. Rate: 7.6 symbols/min [2025-09-23T18:20:19.198502] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:20:19.224231] [DEBUG] [LOCAL ] DFIN: Loaded 23411 existing records from primary storage. [2025-09-23T18:20:19.224388] [INFO ] [MAIN ] DFIN: Loaded 23411 existing records. [2025-09-23T18:20:19.405931] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-03. [2025-09-23T18:20:19.455430] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-23T18:20:19.511800] [WARN ] [MAIN ] DFIN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:20:19.513902] [INFO ] [MAIN ] DFIN: Wiping existing primary data before full refresh. [2025-09-23T18:20:19.514057] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-09-23T18:20:19.515054] [DEBUG] [LOCAL ] DFIN: Deleted primary data file. [2025-09-23T18:20:19.515218] [INFO ] [MAIN ] DFIN: Starting full primary refresh. [2025-09-23T18:20:19.677534] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-23T18:20:20.092118] [INFO ] [REMOTE ] DFIN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:20:20.202260] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-06. [2025-09-23T18:20:21.002218] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-03. [2025-09-23T18:20:21.458335] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-23T18:20:21.675789] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-23T18:20:21.802202] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-07. [2025-09-23T18:20:21.964086] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-23T18:20:22.602197] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-04. [2025-09-23T18:20:23.402179] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2024-12. [2025-09-23T18:20:23.525204] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-23T18:20:23.809327] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-23T18:20:24.202243] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-08. [2025-09-23T18:20:24.508633] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-23T18:20:25.002205] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-05. [2025-09-23T18:20:25.802169] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-04. [2025-09-23T18:20:26.079526] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-23T18:20:26.323049] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-23T18:20:26.602194] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-06. [2025-09-23T18:20:27.402204] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-09. [2025-09-23T18:20:27.964050] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-23T18:20:28.139778] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-23T18:20:28.202204] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-07. [2025-09-23T18:20:28.930756] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-23T18:20:28.939291] [INFO ] [REMOTE ] DEO: Full fetch complete (71481 records). [2025-09-23T18:20:28.939453] [DEBUG] [VALIDATOR ] DEO: Validating primary data. [2025-09-23T18:20:29.007300] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-01. [2025-09-23T18:20:29.358603] [DEBUG] [VALIDATOR ] DEO: All expected trading days are present. [2025-09-23T18:20:29.358783] [DEBUG] [VALIDATOR ] DEO: Primary data validation passed. [2025-09-23T18:20:29.359733] [INFO ] [MAIN ] DEO: Fetched primary data is valid. [2025-09-23T18:20:29.359816] [DEBUG] [LOCAL ] DEO: Saving primary data. [2025-09-23T18:20:29.361406] [DEBUG] [LOCAL ] DEO: Trimmed 71481 records to 49010 (keeping 200 days of data) [2025-09-23T18:20:29.469066] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-23T18:20:29.684897] [DEBUG] [LOCAL ] DEO: Primary data saved (49010 records). [2025-09-23T18:20:29.685040] [INFO ] [MAIN ] DEO: Full history saved. [2025-09-23T18:20:29.685154] [INFO ] [MAIN ] Update Progress: 609/2372 symbols completed. DEO took 26.0s. Estimated remaining: 3h 52m 52s. Rate: 7.6 symbols/min [2025-09-23T18:20:29.805138] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-05. [2025-09-23T18:20:29.871212] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:20:29.885028] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-23T18:20:29.899929] [DEBUG] [LOCAL ] DFP: Loaded 11675 existing records from primary storage. [2025-09-23T18:20:29.900086] [INFO ] [MAIN ] DFP: Loaded 11675 existing records. [2025-09-23T18:20:30.086990] [WARN ] [MAIN ] DFP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:20:30.087282] [INFO ] [MAIN ] DFP: Wiping existing primary data before full refresh. [2025-09-23T18:20:30.087332] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-09-23T18:20:30.087945] [DEBUG] [LOCAL ] DFP: Deleted primary data file. [2025-09-23T18:20:30.088007] [INFO ] [MAIN ] DFP: Starting full primary refresh. [2025-09-23T18:20:30.441751] [INFO ] [REMOTE ] DFP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:20:30.602194] [INFO ] [REMOTE ] DFP: Fetching primary data for 2024-12. [2025-09-23T18:20:31.209600] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-23T18:20:31.402172] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-02. [2025-09-23T18:20:31.823042] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-23T18:20:32.202151] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-06. [2025-09-23T18:20:32.484534] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-23T18:20:33.002206] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-01. [2025-09-23T18:20:33.802175] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-08. [2025-09-23T18:20:33.999736] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-23T18:20:34.437991] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-23T18:20:34.602256] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-02. [2025-09-23T18:20:34.804800] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-23T18:20:35.122932] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-23T18:20:35.402204] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-03. [2025-09-23T18:20:36.202238] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-07. [2025-09-23T18:20:36.234103] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-23T18:20:37.002241] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-04. [2025-09-23T18:20:37.802231] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-03. [2025-09-23T18:20:37.856092] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-23T18:20:38.213024] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-23T18:20:38.602621] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-05. [2025-09-23T18:20:38.847726] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-23T18:20:39.128249] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-23T18:20:39.402225] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-08. [2025-09-23T18:20:40.202248] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-06. [2025-09-23T18:20:40.989315] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-23T18:20:41.002171] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-07. [2025-09-23T18:20:41.323801] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-23T18:20:41.802227] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-09. [2025-09-23T18:20:41.890824] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-23T18:20:42.602238] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-04. [2025-09-23T18:20:43.082857] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-23T18:20:43.088027] [INFO ] [REMOTE ] DFH: Full fetch complete (49172 records). [2025-09-23T18:20:43.088132] [DEBUG] [VALIDATOR ] DFH: Validating primary data. [2025-09-23T18:20:43.407377] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-09. [2025-09-23T18:20:43.479927] [DEBUG] [VALIDATOR ] DFH: All expected trading days are present. [2025-09-23T18:20:43.480075] [DEBUG] [VALIDATOR ] DFH: Primary data validation passed. [2025-09-23T18:20:43.480911] [INFO ] [MAIN ] DFH: Fetched primary data is valid. [2025-09-23T18:20:43.481125] [DEBUG] [LOCAL ] DFH: Saving primary data. [2025-09-23T18:20:43.482472] [DEBUG] [LOCAL ] DFH: Trimmed 49172 records to 32858 (keeping 200 days of data) [2025-09-23T18:20:43.707717] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-23T18:20:43.723000] [DEBUG] [LOCAL ] DFH: Primary data saved (32858 records). [2025-09-23T18:20:43.723159] [INFO ] [MAIN ] DFH: Full history saved. [2025-09-23T18:20:43.723250] [INFO ] [MAIN ] Update Progress: 610/2372 symbols completed. DFH took 30.7s. Estimated remaining: 3h 53m 2s. Rate: 7.6 symbols/min [2025-09-23T18:20:43.895051] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:20:43.895281] [DEBUG] [LOCAL ] DG: No existing data file found in primary storage. [2025-09-23T18:20:43.895322] [WARN ] [MAIN ] DG: No existing data found, performing full refresh instead. [2025-09-23T18:20:43.895473] [INFO ] [MAIN ] DG: Wiping existing primary data before full refresh. [2025-09-23T18:20:43.895517] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-09-23T18:20:43.895558] [DEBUG] [LOCAL ] DG: No primary data file found to delete. [2025-09-23T18:20:43.895591] [INFO ] [MAIN ] DG: Starting full primary refresh. [2025-09-23T18:20:44.225632] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-05. [2025-09-23T18:20:44.278409] [INFO ] [REMOTE ] DG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:20:45.002213] [INFO ] [REMOTE ] DG: Fetching primary data for 2024-12. [2025-09-23T18:20:45.273831] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-23T18:20:45.768914] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-09-23T18:20:45.777769] [INFO ] [REMOTE ] DELL: Full fetch complete (77820 records). [2025-09-23T18:20:45.777901] [DEBUG] [VALIDATOR ] DELL: Validating primary data. [2025-09-23T18:20:45.813765] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-06. [2025-09-23T18:20:46.183053] [DEBUG] [VALIDATOR ] DELL: All expected trading days are present. [2025-09-23T18:20:46.183141] [DEBUG] [VALIDATOR ] DELL: Primary data validation passed. [2025-09-23T18:20:46.183984] [INFO ] [MAIN ] DELL: Fetched primary data is valid. [2025-09-23T18:20:46.184049] [DEBUG] [LOCAL ] DELL: Saving primary data. [2025-09-23T18:20:46.185683] [DEBUG] [LOCAL ] DELL: Trimmed 77820 records to 53735 (keeping 200 days of data) [2025-09-23T18:20:46.533616] [DEBUG] [LOCAL ] DELL: Primary data saved (53735 records). [2025-09-23T18:20:46.533792] [INFO ] [MAIN ] DELL: Full history saved. [2025-09-23T18:20:46.533892] [INFO ] [MAIN ] Update Progress: 611/2372 symbols completed. DELL took 48.3s. Estimated remaining: 3h 52m 39s. Rate: 7.6 symbols/min [2025-09-23T18:20:46.610113] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-08. [2025-09-23T18:20:46.715109] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:20:46.729545] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-23T18:20:46.776719] [DEBUG] [LOCAL ] DGX: Loaded 45280 existing records from primary storage. [2025-09-23T18:20:46.776856] [INFO ] [MAIN ] DGX: Loaded 45280 existing records. [2025-09-23T18:20:46.989121] [WARN ] [MAIN ] DGX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:20:46.992747] [INFO ] [MAIN ] DGX: Wiping existing primary data before full refresh. [2025-09-23T18:20:46.992999] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-09-23T18:20:46.995127] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-23T18:20:46.995185] [DEBUG] [LOCAL ] DGX: Deleted primary data file. [2025-09-23T18:20:46.999560] [INFO ] [MAIN ] DGX: Starting full primary refresh. [2025-09-23T18:20:47.374677] [INFO ] [REMOTE ] DGX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:20:47.402140] [INFO ] [REMOTE ] DGX: Fetching primary data for 2024-12. [2025-09-23T18:20:47.481288] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-23T18:20:48.202217] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-09. [2025-09-23T18:20:48.799737] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-23T18:20:48.825726] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-23T18:20:48.828451] [INFO ] [REMOTE ] DFP: Full fetch complete (16210 records). [2025-09-23T18:20:48.828536] [DEBUG] [VALIDATOR ] DFP: Validating primary data. [2025-09-23T18:20:49.009062] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-01. [2025-09-23T18:20:49.217698] [DEBUG] [VALIDATOR ] DFP: All expected trading days are present. [2025-09-23T18:20:49.217800] [DEBUG] [VALIDATOR ] DFP: Primary data validation passed. [2025-09-23T18:20:49.218214] [INFO ] [MAIN ] DFP: Fetched primary data is valid. [2025-09-23T18:20:49.218276] [DEBUG] [LOCAL ] DFP: Saving primary data. [2025-09-23T18:20:49.218889] [DEBUG] [LOCAL ] DFP: Trimmed 16210 records to 11666 (keeping 200 days of data) [2025-09-23T18:20:49.295775] [DEBUG] [LOCAL ] DFP: Primary data saved (11666 records). [2025-09-23T18:20:49.295967] [INFO ] [MAIN ] DFP: Full history saved. [2025-09-23T18:20:49.296063] [INFO ] [MAIN ] Update Progress: 612/2372 symbols completed. DFP took 19.6s. Estimated remaining: 3h 52m 16s. Rate: 7.6 symbols/min [2025-09-23T18:20:49.463783] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:20:49.483827] [DEBUG] [LOCAL ] DHF: Loaded 20893 existing records from primary storage. [2025-09-23T18:20:49.483971] [INFO ] [MAIN ] DHF: Loaded 20893 existing records. [2025-09-23T18:20:49.659177] [WARN ] [MAIN ] DHF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:20:49.659438] [INFO ] [MAIN ] DHF: Wiping existing primary data before full refresh. [2025-09-23T18:20:49.659485] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-09-23T18:20:49.660153] [DEBUG] [LOCAL ] DHF: Deleted primary data file. [2025-09-23T18:20:49.660214] [INFO ] [MAIN ] DHF: Starting full primary refresh. [2025-09-23T18:20:49.807427] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-01. [2025-09-23T18:20:50.056326] [INFO ] [REMOTE ] DHF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:20:50.602213] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-07. [2025-09-23T18:20:50.685872] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-23T18:20:51.386502] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-23T18:20:51.402158] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-02. [2025-09-23T18:20:51.680792] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-23T18:20:52.202301] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-08. [2025-09-23T18:20:52.890626] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-23T18:20:53.002252] [INFO ] [REMOTE ] DHF: Fetching primary data for 2024-12. [2025-09-23T18:20:53.198981] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-23T18:20:53.802218] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-03. [2025-09-23T18:20:54.363710] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-23T18:20:54.602225] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-01. [2025-09-23T18:20:55.402237] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-09. [2025-09-23T18:20:56.068576] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-23T18:20:56.202249] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-02. [2025-09-23T18:20:56.352493] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-23T18:20:56.356923] [INFO ] [REMOTE ] DFIN: Full fetch complete (33380 records). [2025-09-23T18:20:56.357004] [DEBUG] [VALIDATOR ] DFIN: Validating primary data. [2025-09-23T18:20:56.770698] [DEBUG] [VALIDATOR ] DFIN: All expected trading days are present. [2025-09-23T18:20:56.770839] [DEBUG] [VALIDATOR ] DFIN: Primary data validation passed. [2025-09-23T18:20:56.771359] [INFO ] [MAIN ] DFIN: Fetched primary data is valid. [2025-09-23T18:20:56.771443] [DEBUG] [LOCAL ] DFIN: Saving primary data. [2025-09-23T18:20:56.772517] [DEBUG] [LOCAL ] DFIN: Trimmed 33380 records to 23344 (keeping 200 days of data) [2025-09-23T18:20:56.937747] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-03 (3.14 seconds). [2025-09-23T18:20:56.978439] [DEBUG] [LOCAL ] DFIN: Primary data saved (23344 records). [2025-09-23T18:20:56.978633] [INFO ] [MAIN ] DFIN: Full history saved. [2025-09-23T18:20:56.978776] [INFO ] [MAIN ] Update Progress: 613/2372 symbols completed. DFIN took 38.0s. Estimated remaining: 3h 52m 8s. Rate: 7.6 symbols/min [2025-09-23T18:20:57.010160] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-02. [2025-09-23T18:20:57.167163] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:20:57.180708] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-23T18:20:57.241789] [DEBUG] [LOCAL ] DHI: Loaded 53377 existing records from primary storage. [2025-09-23T18:20:57.242007] [INFO ] [MAIN ] DHI: Loaded 53377 existing records. [2025-09-23T18:20:57.453966] [WARN ] [MAIN ] DHI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:20:57.454308] [INFO ] [MAIN ] DHI: Wiping existing primary data before full refresh. [2025-09-23T18:20:57.454357] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-09-23T18:20:57.455959] [DEBUG] [LOCAL ] DHI: Deleted primary data file. [2025-09-23T18:20:57.456021] [INFO ] [MAIN ] DHI: Starting full primary refresh. [2025-09-23T18:20:57.810929] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-04. [2025-09-23T18:20:57.815969] [INFO ] [REMOTE ] DHI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:20:58.602163] [INFO ] [REMOTE ] DHI: Fetching primary data for 2024-12. [2025-09-23T18:20:58.757325] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-23T18:20:59.407293] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-03. [2025-09-23T18:20:59.426572] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-23T18:21:00.086701] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-23T18:21:00.156000] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-23T18:21:00.202171] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-05. [2025-09-23T18:21:01.002240] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-03. [2025-09-23T18:21:01.802243] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-04. [2025-09-23T18:21:02.274752] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-23T18:21:02.432266] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-23T18:21:02.607260] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-01. [2025-09-23T18:21:02.615952] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-23T18:21:03.402433] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-04. [2025-09-23T18:21:04.202191] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-06. [2025-09-23T18:21:05.002241] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-05. [2025-09-23T18:21:05.793986] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-09-23T18:21:05.810740] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-01 (3.20 seconds). [2025-09-23T18:21:05.822851] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-05. [2025-09-23T18:21:05.837066] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-23T18:21:06.561186] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-09-23T18:21:06.602225] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-07. [2025-09-23T18:21:07.222304] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-23T18:21:07.402243] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-06. [2025-09-23T18:21:08.099936] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-23T18:21:08.204122] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-07. [2025-09-23T18:21:08.212691] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-23T18:21:09.002289] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-08. [2025-09-23T18:21:09.376617] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-23T18:21:09.802367] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-02. [2025-09-23T18:21:10.602229] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-08. [2025-09-23T18:21:10.918109] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-23T18:21:11.347699] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-23T18:21:11.394575] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-23T18:21:11.404346] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-09. [2025-09-23T18:21:12.106503] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-23T18:21:12.109904] [INFO ] [REMOTE ] DHF: Full fetch complete (29501 records). [2025-09-23T18:21:12.109990] [DEBUG] [VALIDATOR ] DHF: Validating primary data. [2025-09-23T18:21:12.207304] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-03. [2025-09-23T18:21:12.500421] [DEBUG] [VALIDATOR ] DHF: All expected trading days are present. [2025-09-23T18:21:12.500521] [DEBUG] [VALIDATOR ] DHF: Primary data validation passed. [2025-09-23T18:21:12.501148] [INFO ] [MAIN ] DHF: Fetched primary data is valid. [2025-09-23T18:21:12.501213] [DEBUG] [LOCAL ] DHF: Saving primary data. [2025-09-23T18:21:12.502472] [DEBUG] [LOCAL ] DHF: Trimmed 29501 records to 20704 (keeping 200 days of data) [2025-09-23T18:21:12.644513] [DEBUG] [LOCAL ] DHF: Primary data saved (20704 records). [2025-09-23T18:21:12.644718] [INFO ] [MAIN ] DHF: Full history saved. [2025-09-23T18:21:12.644885] [INFO ] [MAIN ] Update Progress: 614/2372 symbols completed. DHF took 23.3s. Estimated remaining: 3h 52m 22s. Rate: 7.6 symbols/min [2025-09-23T18:21:12.935440] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:21:12.935701] [DEBUG] [LOCAL ] DHR: No existing data file found in primary storage. [2025-09-23T18:21:12.935759] [WARN ] [MAIN ] DHR: No existing data found, performing full refresh instead. [2025-09-23T18:21:12.935950] [INFO ] [MAIN ] DHR: Wiping existing primary data before full refresh. [2025-09-23T18:21:12.936006] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-09-23T18:21:12.936061] [DEBUG] [LOCAL ] DHR: No primary data file found to delete. [2025-09-23T18:21:12.936105] [INFO ] [MAIN ] DHR: Starting full primary refresh. [2025-09-23T18:21:13.007510] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-09. [2025-09-23T18:21:13.541675] [INFO ] [REMOTE ] DHR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:21:13.802236] [INFO ] [REMOTE ] DHR: Fetching primary data for 2024-12. [2025-09-23T18:21:13.908324] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-23T18:21:14.602198] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-06. [2025-09-23T18:21:14.778155] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-23T18:21:14.790986] [INFO ] [REMOTE ] DG: Full fetch complete (77235 records). [2025-09-23T18:21:14.791211] [DEBUG] [VALIDATOR ] DG: Validating primary data. [2025-09-23T18:21:15.257291] [DEBUG] [VALIDATOR ] DG: All expected trading days are present. [2025-09-23T18:21:15.257390] [DEBUG] [VALIDATOR ] DG: Primary data validation passed. [2025-09-23T18:21:15.258459] [INFO ] [MAIN ] DG: Fetched primary data is valid. [2025-09-23T18:21:15.258550] [DEBUG] [LOCAL ] DG: Saving primary data. [2025-09-23T18:21:15.260900] [DEBUG] [LOCAL ] DG: Trimmed 77235 records to 53308 (keeping 200 days of data) [2025-09-23T18:21:15.403712] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-04. [2025-09-23T18:21:15.674290] [DEBUG] [LOCAL ] DG: Primary data saved (53308 records). [2025-09-23T18:21:15.674954] [INFO ] [MAIN ] DG: Full history saved. [2025-09-23T18:21:15.675495] [INFO ] [MAIN ] Update Progress: 615/2372 symbols completed. DG took 32.0s. Estimated remaining: 3h 52m 0s. Rate: 7.6 symbols/min [2025-09-23T18:21:15.891555] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:21:15.950714] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-23T18:21:16.041606] [DEBUG] [LOCAL ] DHT: Loaded 47958 existing records from primary storage. [2025-09-23T18:21:16.041844] [INFO ] [MAIN ] DHT: Loaded 47958 existing records. [2025-09-23T18:21:16.118543] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-23T18:21:16.207518] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-07. [2025-09-23T18:21:16.250002] [WARN ] [MAIN ] DHT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:21:16.250269] [INFO ] [MAIN ] DHT: Wiping existing primary data before full refresh. [2025-09-23T18:21:16.250332] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-09-23T18:21:16.251747] [DEBUG] [LOCAL ] DHT: Deleted primary data file. [2025-09-23T18:21:16.251811] [INFO ] [MAIN ] DHT: Starting full primary refresh. [2025-09-23T18:21:16.630924] [INFO ] [REMOTE ] DHT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:21:17.015367] [INFO ] [REMOTE ] DHT: Fetching primary data for 2024-12. [2025-09-23T18:21:17.040322] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-23T18:21:17.682076] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-23T18:21:17.802254] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-08. [2025-09-23T18:21:18.602201] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-05. [2025-09-23T18:21:19.095886] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-23T18:21:19.188372] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-23T18:21:19.402242] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-01. [2025-09-23T18:21:19.996440] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-23T18:21:20.202206] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-09. [2025-09-23T18:21:20.746506] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-23T18:21:21.002393] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-01. [2025-09-23T18:21:21.747896] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-23T18:21:21.757338] [INFO ] [REMOTE ] DGX: Full fetch complete (65166 records). [2025-09-23T18:21:21.757491] [DEBUG] [VALIDATOR ] DGX: Validating primary data. [2025-09-23T18:21:21.807373] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-06. [2025-09-23T18:21:22.161475] [DEBUG] [VALIDATOR ] DGX: All expected trading days are present. [2025-09-23T18:21:22.161559] [DEBUG] [VALIDATOR ] DGX: Primary data validation passed. [2025-09-23T18:21:22.162367] [INFO ] [MAIN ] DGX: Fetched primary data is valid. [2025-09-23T18:21:22.162436] [DEBUG] [LOCAL ] DGX: Saving primary data. [2025-09-23T18:21:22.163941] [DEBUG] [LOCAL ] DGX: Trimmed 65166 records to 45287 (keeping 200 days of data) [2025-09-23T18:21:22.474403] [DEBUG] [LOCAL ] DGX: Primary data saved (45287 records). [2025-09-23T18:21:22.474589] [INFO ] [MAIN ] DGX: Full history saved. [2025-09-23T18:21:22.474835] [INFO ] [MAIN ] Update Progress: 616/2372 symbols completed. DGX took 35.9s. Estimated remaining: 3h 51m 49s. Rate: 7.6 symbols/min [2025-09-23T18:21:22.603873] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-02. [2025-09-23T18:21:22.663827] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:21:22.664111] [DEBUG] [LOCAL ] DHX: No existing data file found in primary storage. [2025-09-23T18:21:22.664181] [WARN ] [MAIN ] DHX: No existing data found, performing full refresh instead. [2025-09-23T18:21:22.664802] [INFO ] [MAIN ] DHX: Wiping existing primary data before full refresh. [2025-09-23T18:21:22.664869] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-09-23T18:21:22.664931] [DEBUG] [LOCAL ] DHX: No primary data file found to delete. [2025-09-23T18:21:22.665049] [INFO ] [MAIN ] DHX: Starting full primary refresh. [2025-09-23T18:21:22.992263] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-23T18:21:23.114114] [INFO ] [REMOTE ] DHX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:21:23.402159] [INFO ] [REMOTE ] DHX: Fetching primary data for 2024-12. [2025-09-23T18:21:23.445639] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-23T18:21:24.202150] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-02. [2025-09-23T18:21:24.244697] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-23T18:21:24.262811] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-23T18:21:25.002426] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-01. [2025-09-23T18:21:25.807686] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-07. [2025-09-23T18:21:25.839495] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-23T18:21:25.997820] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-23T18:21:26.602193] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-03. [2025-09-23T18:21:27.402191] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-03. [2025-09-23T18:21:27.833938] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-23T18:21:28.202199] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-08. [2025-09-23T18:21:28.642532] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-23T18:21:29.002238] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-02. [2025-09-23T18:21:29.163662] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-23T18:21:29.802234] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-04. [2025-09-23T18:21:30.059668] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-23T18:21:30.274016] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-23T18:21:30.602233] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-03. [2025-09-23T18:21:31.402289] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-09. [2025-09-23T18:21:31.593872] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-23T18:21:31.838904] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-23T18:21:32.202220] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-04. [2025-09-23T18:21:32.998078] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-23T18:21:33.002257] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-04. [2025-09-23T18:21:33.539969] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-23T18:21:33.549612] [INFO ] [REMOTE ] DHI: Full fetch complete (77221 records). [2025-09-23T18:21:33.549783] [DEBUG] [VALIDATOR ] DHI: Validating primary data. [2025-09-23T18:21:33.807696] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-05. [2025-09-23T18:21:33.953396] [DEBUG] [VALIDATOR ] DHI: All expected trading days are present. [2025-09-23T18:21:33.953497] [DEBUG] [VALIDATOR ] DHI: Primary data validation passed. [2025-09-23T18:21:33.954427] [INFO ] [MAIN ] DHI: Fetched primary data is valid. [2025-09-23T18:21:33.954923] [DEBUG] [LOCAL ] DHI: Saving primary data. [2025-09-23T18:21:33.959578] [DEBUG] [LOCAL ] DHI: Trimmed 77221 records to 53376 (keeping 200 days of data) [2025-09-23T18:21:34.321757] [DEBUG] [LOCAL ] DHI: Primary data saved (53376 records). [2025-09-23T18:21:34.321900] [INFO ] [MAIN ] DHI: Full history saved. [2025-09-23T18:21:34.322031] [INFO ] [MAIN ] Update Progress: 617/2372 symbols completed. DHI took 37.3s. Estimated remaining: 3h 51m 52s. Rate: 7.6 symbols/min [2025-09-23T18:21:34.536536] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:21:34.539623] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-23T18:21:34.566796] [DEBUG] [LOCAL ] DIAX: Loaded 12386 existing records from primary storage. [2025-09-23T18:21:34.566940] [INFO ] [MAIN ] DIAX: Loaded 12386 existing records. [2025-09-23T18:21:34.607350] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-05. [2025-09-23T18:21:34.777091] [WARN ] [MAIN ] DIAX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:21:34.777768] [INFO ] [MAIN ] DIAX: Wiping existing primary data before full refresh. [2025-09-23T18:21:34.777860] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-09-23T18:21:34.792597] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-23T18:21:34.791888] [DEBUG] [LOCAL ] DIAX: Deleted primary data file. [2025-09-23T18:21:34.792855] [INFO ] [MAIN ] DIAX: Starting full primary refresh. [2025-09-23T18:21:35.200967] [INFO ] [REMOTE ] DIAX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:21:35.402196] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2024-12. [2025-09-23T18:21:35.935404] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-23T18:21:36.097062] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-23T18:21:36.202215] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-06. [2025-09-23T18:21:37.002272] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-05. [2025-09-23T18:21:37.802200] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-01. [2025-09-23T18:21:37.986288] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-23T18:21:38.566195] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-23T18:21:38.602216] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-06. [2025-09-23T18:21:38.767869] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-23T18:21:39.090380] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-23T18:21:39.402232] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-02. [2025-09-23T18:21:40.122337] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-23T18:21:40.202249] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-07. [2025-09-23T18:21:40.686822] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-23T18:21:41.002244] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-08. [2025-09-23T18:21:41.807375] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-07. [2025-09-23T18:21:41.810864] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-23T18:21:42.602224] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-09. [2025-09-23T18:21:43.247064] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-23T18:21:43.252021] [INFO ] [REMOTE ] DHX: Full fetch complete (20873 records). [2025-09-23T18:21:43.252233] [DEBUG] [VALIDATOR ] DHX: Validating primary data. [2025-09-23T18:21:43.253112] [FATAL] [VALIDATOR ] DHX: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:21:43.253450] [FATAL] [MAIN ] DHX: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:21:43.253539] [WARN ] [MAIN ] DHX: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:21:43.253627] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-09-23T18:21:43.253756] [DEBUG] [LOCAL ] DHX: No primary data file found to delete. [2025-09-23T18:21:43.253855] [INFO ] [LOCAL ] DHX: Starting deletion of derivative data. [2025-09-23T18:21:43.253945] [DEBUG] [LOCAL ] DHX: No derivative data file found to delete. [2025-09-23T18:21:43.254078] [INFO ] [MAIN ] Update Progress: 618/2372 symbols completed. DHX took 20.8s. Estimated remaining: 3h 51m 47s. Rate: 7.6 symbols/min [2025-09-23T18:21:43.411043] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-03. [2025-09-23T18:21:43.479852] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:21:43.528907] [DEBUG] [LOCAL ] DIN: Loaded 37289 existing records from primary storage. [2025-09-23T18:21:43.529321] [INFO ] [MAIN ] DIN: Loaded 37289 existing records. [2025-09-23T18:21:43.762224] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-23T18:21:43.769046] [WARN ] [MAIN ] DIN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:21:43.782889] [INFO ] [MAIN ] DIN: Wiping existing primary data before full refresh. [2025-09-23T18:21:43.783044] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-09-23T18:21:43.785384] [DEBUG] [LOCAL ] DIN: Deleted primary data file. [2025-09-23T18:21:43.785464] [INFO ] [MAIN ] DIN: Starting full primary refresh. [2025-09-23T18:21:44.025938] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-23T18:21:44.207301] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-08. [2025-09-23T18:21:44.261768] [INFO ] [REMOTE ] DIN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:21:45.002250] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-04. [2025-09-23T18:21:45.564119] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-23T18:21:45.802186] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-06. [2025-09-23T18:21:45.949486] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-23T18:21:46.602207] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-05. [2025-09-23T18:21:47.223077] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-23T18:21:47.341276] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-23T18:21:47.402161] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-06. [2025-09-23T18:21:47.944295] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-23T18:21:48.202190] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-07. [2025-09-23T18:21:49.002191] [INFO ] [REMOTE ] DIN: Fetching primary data for 2024-12. [2025-09-23T18:21:49.802165] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-09. [2025-09-23T18:21:49.888807] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-23T18:21:50.607302] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-08. [2025-09-23T18:21:50.623467] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-23T18:21:51.067514] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-23T18:21:51.076578] [INFO ] [REMOTE ] DHT: Full fetch complete (70080 records). [2025-09-23T18:21:51.076839] [DEBUG] [VALIDATOR ] DHT: Validating primary data. [2025-09-23T18:21:51.409622] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-01. [2025-09-23T18:21:51.518664] [DEBUG] [VALIDATOR ] DHT: All expected trading days are present. [2025-09-23T18:21:51.518769] [DEBUG] [VALIDATOR ] DHT: Primary data validation passed. [2025-09-23T18:21:51.519600] [INFO ] [MAIN ] DHT: Fetched primary data is valid. [2025-09-23T18:21:51.519667] [DEBUG] [LOCAL ] DHT: Saving primary data. [2025-09-23T18:21:51.521284] [DEBUG] [LOCAL ] DHT: Trimmed 70080 records to 47960 (keeping 200 days of data) [2025-09-23T18:21:51.826145] [DEBUG] [LOCAL ] DHT: Primary data saved (47960 records). [2025-09-23T18:21:51.826286] [INFO ] [MAIN ] DHT: Full history saved. [2025-09-23T18:21:51.826390] [INFO ] [MAIN ] Update Progress: 619/2372 symbols completed. DHT took 36.2s. Estimated remaining: 3h 51m 41s. Rate: 7.6 symbols/min [2025-09-23T18:21:52.001259] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:21:52.059631] [DEBUG] [LOCAL ] DINO: Loaded 52964 existing records from primary storage. [2025-09-23T18:21:52.059799] [INFO ] [MAIN ] DINO: Loaded 52964 existing records. [2025-09-23T18:21:52.220476] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-07. [2025-09-23T18:21:52.251835] [WARN ] [MAIN ] DINO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:21:52.252870] [INFO ] [MAIN ] DINO: Wiping existing primary data before full refresh. [2025-09-23T18:21:52.252944] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-09-23T18:21:52.263412] [DEBUG] [LOCAL ] DINO: Deleted primary data file. [2025-09-23T18:21:52.278217] [INFO ] [MAIN ] DINO: Starting full primary refresh. [2025-09-23T18:21:52.386069] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-23T18:21:52.727398] [INFO ] [REMOTE ] DINO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:21:52.762843] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-23T18:21:52.895842] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-23T18:21:53.002247] [INFO ] [REMOTE ] DINO: Fetching primary data for 2024-12. [2025-09-23T18:21:53.802227] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-02. [2025-09-23T18:21:54.536623] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-23T18:21:54.602246] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-01. [2025-09-23T18:21:55.155854] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-23T18:21:55.402264] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-03. [2025-09-23T18:21:56.040559] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-23T18:21:56.202185] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-02. [2025-09-23T18:21:56.890485] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-23T18:21:57.002252] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-08. [2025-09-23T18:21:57.729989] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-23T18:21:57.760742] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-23T18:21:57.802180] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-03. [2025-09-23T18:21:58.602206] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-04. [2025-09-23T18:21:59.262638] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-23T18:21:59.402180] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-09. [2025-09-23T18:21:59.880128] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-23T18:22:00.202198] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-05. [2025-09-23T18:22:01.002251] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-04. [2025-09-23T18:22:01.368738] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-23T18:22:01.379476] [INFO ] [REMOTE ] DHR: Full fetch complete (76877 records). [2025-09-23T18:22:01.379693] [DEBUG] [VALIDATOR ] DHR: Validating primary data. [2025-09-23T18:22:01.380792] [FATAL] [VALIDATOR ] DHR: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:22:01.380952] [FATAL] [MAIN ] DHR: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:22:01.381035] [WARN ] [MAIN ] DHR: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:22:01.381124] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-09-23T18:22:01.381208] [DEBUG] [LOCAL ] DHR: No primary data file found to delete. [2025-09-23T18:22:01.381262] [INFO ] [LOCAL ] DHR: Starting deletion of derivative data. [2025-09-23T18:22:01.381338] [DEBUG] [LOCAL ] DHR: No derivative data file found to delete. [2025-09-23T18:22:01.381456] [INFO ] [MAIN ] Update Progress: 620/2372 symbols completed. DHR took 48.7s. Estimated remaining: 3h 51m 38s. Rate: 7.6 symbols/min [2025-09-23T18:22:01.579710] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:22:01.639501] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-23T18:22:01.688411] [DEBUG] [LOCAL ] DIS: Loaded 53788 existing records from primary storage. [2025-09-23T18:22:01.688573] [INFO ] [MAIN ] DIS: Loaded 53788 existing records. [2025-09-23T18:22:01.807301] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-06. [2025-09-23T18:22:01.879259] [WARN ] [MAIN ] DIS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:22:01.879503] [INFO ] [MAIN ] DIS: Wiping existing primary data before full refresh. [2025-09-23T18:22:01.879552] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-09-23T18:22:01.881035] [DEBUG] [LOCAL ] DIS: Deleted primary data file. [2025-09-23T18:22:01.881097] [INFO ] [MAIN ] DIS: Starting full primary refresh. [2025-09-23T18:22:02.257145] [INFO ] [REMOTE ] DIS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:22:02.602206] [INFO ] [REMOTE ] DIS: Fetching primary data for 2024-12. [2025-09-23T18:22:02.665541] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-23T18:22:02.831832] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-23T18:22:03.402205] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-09. [2025-09-23T18:22:04.070307] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-23T18:22:04.073067] [INFO ] [REMOTE ] DIAX: Full fetch complete (17163 records). [2025-09-23T18:22:04.073148] [DEBUG] [VALIDATOR ] DIAX: Validating primary data. [2025-09-23T18:22:04.207326] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-05. [2025-09-23T18:22:04.467229] [DEBUG] [VALIDATOR ] DIAX: All expected trading days are present. [2025-09-23T18:22:04.467315] [DEBUG] [VALIDATOR ] DIAX: Primary data validation passed. [2025-09-23T18:22:04.467703] [INFO ] [MAIN ] DIAX: Fetched primary data is valid. [2025-09-23T18:22:04.467765] [DEBUG] [LOCAL ] DIAX: Saving primary data. [2025-09-23T18:22:04.468325] [DEBUG] [LOCAL ] DIAX: Trimmed 17163 records to 12421 (keeping 200 days of data) [2025-09-23T18:22:04.549252] [DEBUG] [LOCAL ] DIAX: Primary data saved (12421 records). [2025-09-23T18:22:04.549398] [INFO ] [MAIN ] DIAX: Full history saved. [2025-09-23T18:22:04.549497] [INFO ] [MAIN ] Update Progress: 621/2372 symbols completed. DIAX took 30.2s. Estimated remaining: 3h 51m 16s. Rate: 7.6 symbols/min [2025-09-23T18:22:04.718269] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:22:04.718427] [DEBUG] [LOCAL ] DIVY: No existing data file found in primary storage. [2025-09-23T18:22:04.718463] [WARN ] [MAIN ] DIVY: No existing data found, performing full refresh instead. [2025-09-23T18:22:04.718609] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-09-23T18:22:04.718723] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-09-23T18:22:04.718788] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-09-23T18:22:04.718822] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-09-23T18:22:05.007297] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-07. [2025-09-23T18:22:05.098315] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:22:05.133924] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2024-12 (2.53 seconds). [2025-09-23T18:22:05.799285] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-23T18:22:05.810878] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2024-12. [2025-09-23T18:22:06.057564] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-23T18:22:06.303845] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-23T18:22:06.602223] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-01. [2025-09-23T18:22:07.402190] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-06. [2025-09-23T18:22:08.202188] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-01. [2025-09-23T18:22:08.491821] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-01 (0.29 seconds). [2025-09-23T18:22:08.963892] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-09-23T18:22:09.002206] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-09-23T18:22:09.112609] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-23T18:22:09.331348] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-23T18:22:09.802213] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-08. [2025-09-23T18:22:10.602189] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-09-23T18:22:10.921412] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-23T18:22:10.923145] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-23T18:22:11.402195] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-09-23T18:22:11.678161] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-09-23T18:22:12.202188] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-09. [2025-09-23T18:22:13.002208] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-09-23T18:22:13.284666] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-09-23T18:22:13.525523] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-23T18:22:13.532243] [INFO ] [REMOTE ] DIN: Full fetch complete (55064 records). [2025-09-23T18:22:13.532351] [DEBUG] [VALIDATOR ] DIN: Validating primary data. [2025-09-23T18:22:13.807305] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-07. [2025-09-23T18:22:13.944041] [DEBUG] [VALIDATOR ] DIN: All expected trading days are present. [2025-09-23T18:22:13.944131] [DEBUG] [VALIDATOR ] DIN: Primary data validation passed. [2025-09-23T18:22:13.944878] [INFO ] [MAIN ] DIN: Fetched primary data is valid. [2025-09-23T18:22:13.944945] [DEBUG] [LOCAL ] DIN: Saving primary data. [2025-09-23T18:22:13.946326] [DEBUG] [LOCAL ] DIN: Trimmed 55064 records to 37264 (keeping 200 days of data) [2025-09-23T18:22:14.189234] [DEBUG] [LOCAL ] DIN: Primary data saved (37264 records). [2025-09-23T18:22:14.189403] [INFO ] [MAIN ] DIN: Full history saved. [2025-09-23T18:22:14.189498] [INFO ] [MAIN ] Update Progress: 622/2372 symbols completed. DIN took 30.9s. Estimated remaining: 3h 51m 13s. Rate: 7.6 symbols/min [2025-09-23T18:22:14.369637] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:22:14.369939] [DEBUG] [LOCAL ] DK: No existing data file found in primary storage. [2025-09-23T18:22:14.370047] [WARN ] [MAIN ] DK: No existing data found, performing full refresh instead. [2025-09-23T18:22:14.370210] [INFO ] [MAIN ] DK: Wiping existing primary data before full refresh. [2025-09-23T18:22:14.370255] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-09-23T18:22:14.370299] [DEBUG] [LOCAL ] DK: No primary data file found to delete. [2025-09-23T18:22:14.370333] [INFO ] [MAIN ] DK: Starting full primary refresh. [2025-09-23T18:22:14.608558] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-09-23T18:22:14.741957] [INFO ] [REMOTE ] DK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:22:14.941179] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-23T18:22:15.350660] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-23T18:22:15.402192] [INFO ] [REMOTE ] DK: Fetching primary data for 2024-12. [2025-09-23T18:22:16.202198] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-02. [2025-09-23T18:22:17.002193] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-08. [2025-09-23T18:22:17.169197] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-23T18:22:17.802199] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-07. [2025-09-23T18:22:18.198888] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-23T18:22:18.349606] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-09-23T18:22:18.443956] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-23T18:22:18.602197] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-03. [2025-09-23T18:22:19.402195] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-08. [2025-09-23T18:22:19.669381] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-09-23T18:22:20.202218] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-09-23T18:22:20.922981] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-23T18:22:20.923986] [INFO ] [REMOTE ] DIVY: Full fetch complete (1716 records). [2025-09-23T18:22:20.924071] [DEBUG] [VALIDATOR ] DIVY: Validating primary data. [2025-09-23T18:22:21.008291] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-09. [2025-09-23T18:22:21.093554] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-03 (2.49 seconds). [2025-09-23T18:22:21.174249] [WARN ] [VALIDATOR ] DIVY: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-23T18:22:21.174958] [FATAL] [MAIN ] DIVY: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:22:21.175032] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:22:21.175124] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-09-23T18:22:21.175190] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-09-23T18:22:21.175226] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-09-23T18:22:21.175265] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-09-23T18:22:21.175350] [INFO ] [MAIN ] Update Progress: 623/2372 symbols completed. DIVY took 16.6s. Estimated remaining: 3h 51m 3s. Rate: 7.6 symbols/min [2025-09-23T18:22:21.349569] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:22:21.371330] [DEBUG] [LOCAL ] DKL: Loaded 19282 existing records from primary storage. [2025-09-23T18:22:21.371506] [INFO ] [MAIN ] DKL: Loaded 19282 existing records. [2025-09-23T18:22:21.614764] [WARN ] [MAIN ] DKL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:22:21.615113] [INFO ] [MAIN ] DKL: Wiping existing primary data before full refresh. [2025-09-23T18:22:21.615173] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-09-23T18:22:21.615905] [DEBUG] [LOCAL ] DKL: Deleted primary data file. [2025-09-23T18:22:21.615966] [INFO ] [MAIN ] DKL: Starting full primary refresh. [2025-09-23T18:22:21.806460] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-04. [2025-09-23T18:22:22.068015] [INFO ] [REMOTE ] DKL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:22:22.529486] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-23T18:22:22.539043] [INFO ] [REMOTE ] DINO: Full fetch complete (76672 records). [2025-09-23T18:22:22.539255] [DEBUG] [VALIDATOR ] DINO: Validating primary data. [2025-09-23T18:22:22.609913] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-01. [2025-09-23T18:22:22.990976] [DEBUG] [VALIDATOR ] DINO: All expected trading days are present. [2025-09-23T18:22:22.991084] [DEBUG] [VALIDATOR ] DINO: Primary data validation passed. [2025-09-23T18:22:22.992024] [INFO ] [MAIN ] DINO: Fetched primary data is valid. [2025-09-23T18:22:22.992096] [DEBUG] [LOCAL ] DINO: Saving primary data. [2025-09-23T18:22:22.993922] [DEBUG] [LOCAL ] DINO: Trimmed 76672 records to 52963 (keeping 200 days of data) [2025-09-23T18:22:23.350075] [DEBUG] [LOCAL ] DINO: Primary data saved (52963 records). [2025-09-23T18:22:23.350234] [INFO ] [MAIN ] DINO: Full history saved. [2025-09-23T18:22:23.350327] [INFO ] [MAIN ] Update Progress: 624/2372 symbols completed. DINO took 31.5s. Estimated remaining: 3h 50m 39s. Rate: 7.6 symbols/min [2025-09-23T18:22:23.412428] [INFO ] [REMOTE ] DKL: Fetching primary data for 2024-12. [2025-09-23T18:22:23.540317] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:22:23.540534] [DEBUG] [LOCAL ] DKS: No existing data file found in primary storage. [2025-09-23T18:22:23.540590] [WARN ] [MAIN ] DKS: No existing data found, performing full refresh instead. [2025-09-23T18:22:23.540792] [INFO ] [MAIN ] DKS: Wiping existing primary data before full refresh. [2025-09-23T18:22:23.540835] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-09-23T18:22:23.540875] [DEBUG] [LOCAL ] DKS: No primary data file found to delete. [2025-09-23T18:22:23.540908] [INFO ] [MAIN ] DKS: Starting full primary refresh. [2025-09-23T18:22:23.931386] [INFO ] [REMOTE ] DKS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:22:24.202274] [INFO ] [REMOTE ] DKS: Fetching primary data for 2024-12. [2025-09-23T18:22:24.272249] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-23T18:22:24.400321] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-09-23T18:22:24.427221] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-23T18:22:25.002237] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-02. [2025-09-23T18:22:25.723254] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-23T18:22:25.802204] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-05. [2025-09-23T18:22:26.238361] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-23T18:22:26.602233] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-01. [2025-09-23T18:22:27.402200] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-03. [2025-09-23T18:22:27.455883] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-23T18:22:28.113327] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-09-23T18:22:28.202179] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-06. [2025-09-23T18:22:28.794330] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-23T18:22:29.002203] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-01. [2025-09-23T18:22:29.802203] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-04. [2025-09-23T18:22:30.355566] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-23T18:22:30.474043] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-09-23T18:22:30.602241] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-02. [2025-09-23T18:22:31.373763] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-23T18:22:31.402166] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-03. [2025-09-23T18:22:31.512250] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-23T18:22:32.152221] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-23T18:22:32.202169] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-04. [2025-09-23T18:22:33.002249] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-02. [2025-09-23T18:22:33.128044] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-23T18:22:33.802195] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-05. [2025-09-23T18:22:34.322119] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-23T18:22:34.602228] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-05. [2025-09-23T18:22:34.853303] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-23T18:22:35.402233] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-06. [2025-09-23T18:22:36.011854] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-23T18:22:36.202187] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-06. [2025-09-23T18:22:36.368131] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-23T18:22:37.002203] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-07. [2025-09-23T18:22:37.381299] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-23T18:22:37.604730] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-23T18:22:37.802193] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-08. [2025-09-23T18:22:38.602210] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-07. [2025-09-23T18:22:38.739487] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-23T18:22:39.402244] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-03. [2025-09-23T18:22:40.202224] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-09. [2025-09-23T18:22:41.002200] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-07. [2025-09-23T18:22:41.077634] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-09-23T18:22:41.096542] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-23T18:22:41.101552] [INFO ] [REMOTE ] DKL: Full fetch complete (29342 records). [2025-09-23T18:22:41.101723] [DEBUG] [VALIDATOR ] DKL: Validating primary data. [2025-09-23T18:22:41.102451] [FATAL] [VALIDATOR ] DKL: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:22:41.102553] [FATAL] [MAIN ] DKL: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:22:41.102605] [WARN ] [MAIN ] DKL: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:22:41.102704] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-09-23T18:22:41.102789] [DEBUG] [LOCAL ] DKL: No primary data file found to delete. [2025-09-23T18:22:41.102837] [INFO ] [LOCAL ] DKL: Starting deletion of derivative data. [2025-09-23T18:22:41.103366] [DEBUG] [LOCAL ] DKL: Deleted derivative data file. [2025-09-23T18:22:41.103517] [INFO ] [MAIN ] Update Progress: 625/2372 symbols completed. DKL took 19.9s. Estimated remaining: 3h 50m 58s. Rate: 7.6 symbols/min [2025-09-23T18:22:41.296540] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:22:41.296937] [DEBUG] [LOCAL ] DLB: No existing data file found in primary storage. [2025-09-23T18:22:41.297003] [WARN ] [MAIN ] DLB: No existing data found, performing full refresh instead. [2025-09-23T18:22:41.297153] [INFO ] [MAIN ] DLB: Wiping existing primary data before full refresh. [2025-09-23T18:22:41.297210] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-09-23T18:22:41.297286] [DEBUG] [LOCAL ] DLB: No primary data file found to delete. [2025-09-23T18:22:41.297338] [INFO ] [MAIN ] DLB: Starting full primary refresh. [2025-09-23T18:22:41.674295] [INFO ] [REMOTE ] DLB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:22:41.706356] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-09-23T18:22:41.802178] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-04. [2025-09-23T18:22:42.422129] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-23T18:22:42.602185] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-08. [2025-09-23T18:22:43.402166] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-08. [2025-09-23T18:22:43.574028] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-23T18:22:43.885575] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-23T18:22:44.202183] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-05. [2025-09-23T18:22:45.002224] [INFO ] [REMOTE ] DLB: Fetching primary data for 2024-12. [2025-09-23T18:22:45.430908] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-23T18:22:45.802262] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-09. [2025-09-23T18:22:46.033818] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-23T18:22:46.228000] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-23T18:22:46.602215] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-09. [2025-09-23T18:22:47.180194] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-23T18:22:47.188981] [INFO ] [REMOTE ] DK: Full fetch complete (70652 records). [2025-09-23T18:22:47.189174] [DEBUG] [VALIDATOR ] DK: Validating primary data. [2025-09-23T18:22:47.412451] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-01. [2025-09-23T18:22:47.624044] [DEBUG] [VALIDATOR ] DK: All expected trading days are present. [2025-09-23T18:22:47.624132] [DEBUG] [VALIDATOR ] DK: Primary data validation passed. [2025-09-23T18:22:47.625588] [INFO ] [MAIN ] DK: Fetched primary data is valid. [2025-09-23T18:22:47.625683] [DEBUG] [LOCAL ] DK: Saving primary data. [2025-09-23T18:22:47.629786] [DEBUG] [LOCAL ] DK: Trimmed 70652 records to 49391 (keeping 200 days of data) [2025-09-23T18:22:47.952635] [DEBUG] [LOCAL ] DK: Primary data saved (49391 records). [2025-09-23T18:22:47.952980] [INFO ] [MAIN ] DK: Full history saved. [2025-09-23T18:22:47.953077] [INFO ] [MAIN ] Update Progress: 626/2372 symbols completed. DK took 33.8s. Estimated remaining: 3h 50m 47s. Rate: 7.6 symbols/min [2025-09-23T18:22:48.131380] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:22:48.139341] [DEBUG] [LOCAL ] DLNG: Loaded 6220 existing records from primary storage. [2025-09-23T18:22:48.139447] [INFO ] [MAIN ] DLNG: Loaded 6220 existing records. [2025-09-23T18:22:48.211749] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-06. [2025-09-23T18:22:48.326322] [WARN ] [MAIN ] DLNG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:22:48.326636] [INFO ] [MAIN ] DLNG: Wiping existing primary data before full refresh. [2025-09-23T18:22:48.326717] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-09-23T18:22:48.327047] [DEBUG] [LOCAL ] DLNG: Deleted primary data file. [2025-09-23T18:22:48.327110] [INFO ] [MAIN ] DLNG: Starting full primary refresh. [2025-09-23T18:22:48.696758] [INFO ] [REMOTE ] DLNG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:22:48.763983] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-23T18:22:48.794136] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-23T18:22:48.803935] [INFO ] [REMOTE ] DIS: Full fetch complete (77944 records). [2025-09-23T18:22:48.804152] [DEBUG] [VALIDATOR ] DIS: Validating primary data. [2025-09-23T18:22:49.012046] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2024-12. [2025-09-23T18:22:49.223727] [DEBUG] [VALIDATOR ] DIS: All expected trading days are present. [2025-09-23T18:22:49.223836] [DEBUG] [VALIDATOR ] DIS: Primary data validation passed. [2025-09-23T18:22:49.224767] [INFO ] [MAIN ] DIS: Fetched primary data is valid. [2025-09-23T18:22:49.224846] [DEBUG] [LOCAL ] DIS: Saving primary data. [2025-09-23T18:22:49.226814] [DEBUG] [LOCAL ] DIS: Trimmed 77944 records to 53788 (keeping 200 days of data) [2025-09-23T18:22:49.596707] [DEBUG] [LOCAL ] DIS: Primary data saved (53788 records). [2025-09-23T18:22:49.596887] [INFO ] [MAIN ] DIS: Full history saved. [2025-09-23T18:22:49.598462] [INFO ] [MAIN ] Update Progress: 627/2372 symbols completed. DIS took 48.2s. Estimated remaining: 3h 50m 22s. Rate: 7.6 symbols/min [2025-09-23T18:22:49.803065] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-23T18:22:49.806802] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:22:49.802534] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-02. [2025-09-23T18:22:49.811465] [DEBUG] [LOCAL ] DLR: No existing data file found in primary storage. [2025-09-23T18:22:49.811586] [WARN ] [MAIN ] DLR: No existing data found, performing full refresh instead. [2025-09-23T18:22:49.811928] [INFO ] [MAIN ] DLR: Wiping existing primary data before full refresh. [2025-09-23T18:22:49.811984] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-09-23T18:22:49.812030] [DEBUG] [LOCAL ] DLR: No primary data file found to delete. [2025-09-23T18:22:49.812067] [INFO ] [MAIN ] DLR: Starting full primary refresh. [2025-09-23T18:22:50.229053] [INFO ] [REMOTE ] DLR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:22:50.256713] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-23T18:22:50.602203] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-07. [2025-09-23T18:22:50.851122] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-23T18:22:51.402217] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-03. [2025-09-23T18:22:52.202183] [INFO ] [REMOTE ] DLR: Fetching primary data for 2024-12. [2025-09-23T18:22:52.444215] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-23T18:22:52.755637] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-23T18:22:53.002265] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-04. [2025-09-23T18:22:53.802195] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-08. [2025-09-23T18:22:54.602231] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-01. [2025-09-23T18:23:05.103088] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-01 (10.50 seconds). [2025-09-23T18:23:05.109341] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-02. [2025-09-23T18:23:05.961801] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2024-12 (13.76 seconds). [2025-09-23T18:23:05.973213] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-01. [2025-09-23T18:23:05.982980] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-23T18:23:05.986255] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-03. [2025-09-23T18:23:06.916347] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-23T18:23:06.918467] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-04. [2025-09-23T18:23:07.228952] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-08 (13.43 seconds). [2025-09-23T18:23:07.240587] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-09. [2025-09-23T18:23:07.404052] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-23T18:23:07.408092] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-05. [2025-09-23T18:23:07.739264] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-23T18:23:07.749808] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-02. [2025-09-23T18:23:07.861298] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-23T18:23:07.863948] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-06. [2025-09-23T18:23:08.262442] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-23T18:23:08.264353] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-07. [2025-09-23T18:23:08.644015] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-23T18:23:08.646113] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-08. [2025-09-23T18:23:08.799226] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-23T18:23:08.807890] [INFO ] [REMOTE ] DKS: Full fetch complete (71623 records). [2025-09-23T18:23:08.808058] [DEBUG] [VALIDATOR ] DKS: Validating primary data. [2025-09-23T18:23:09.046879] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-04 (16.04 seconds). [2025-09-23T18:23:09.136847] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-05. [2025-09-23T18:23:09.136449] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-23T18:23:09.162140] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-09. [2025-09-23T18:23:09.289833] [DEBUG] [VALIDATOR ] DKS: All expected trading days are present. [2025-09-23T18:23:09.290158] [DEBUG] [VALIDATOR ] DKS: Primary data validation passed. [2025-09-23T18:23:09.291361] [INFO ] [MAIN ] DKS: Fetched primary data is valid. [2025-09-23T18:23:09.291453] [DEBUG] [LOCAL ] DKS: Saving primary data. [2025-09-23T18:23:09.293602] [DEBUG] [LOCAL ] DKS: Trimmed 71623 records to 49949 (keeping 200 days of data) [2025-09-23T18:23:09.437505] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-23T18:23:09.453307] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-03. [2025-09-23T18:23:09.715597] [DEBUG] [LOCAL ] DKS: Primary data saved (49949 records). [2025-09-23T18:23:09.715783] [INFO ] [MAIN ] DKS: Full history saved. [2025-09-23T18:23:09.715870] [INFO ] [MAIN ] Update Progress: 628/2372 symbols completed. DKS took 46.4s. Estimated remaining: 3h 50m 48s. Rate: 7.6 symbols/min [2025-09-23T18:23:09.900878] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:23:09.901774] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-23T18:23:09.903803] [INFO ] [REMOTE ] DLNG: Full fetch complete (12060 records). [2025-09-23T18:23:09.903883] [DEBUG] [VALIDATOR ] DLNG: Validating primary data. [2025-09-23T18:23:10.216530] [DEBUG] [LOCAL ] DLX: Loaded 29127 existing records from primary storage. [2025-09-23T18:23:10.230019] [INFO ] [MAIN ] DLX: Loaded 29127 existing records. [2025-09-23T18:23:10.433435] [DEBUG] [VALIDATOR ] DLNG: All expected trading days are present. [2025-09-23T18:23:10.439387] [DEBUG] [VALIDATOR ] DLNG: Primary data validation passed. [2025-09-23T18:23:10.450319] [INFO ] [MAIN ] DLNG: Fetched primary data is valid. [2025-09-23T18:23:10.455582] [DEBUG] [LOCAL ] DLNG: Saving primary data. [2025-09-23T18:23:10.522785] [DEBUG] [LOCAL ] DLNG: Trimmed 12060 records to 6188 (keeping 200 days of data) [2025-09-23T18:23:10.528194] [WARN ] [MAIN ] DLX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:23:10.529685] [INFO ] [MAIN ] DLX: Wiping existing primary data before full refresh. [2025-09-23T18:23:10.529847] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-09-23T18:23:10.551212] [DEBUG] [LOCAL ] DLX: Deleted primary data file. [2025-09-23T18:23:10.569433] [INFO ] [MAIN ] DLX: Starting full primary refresh. [2025-09-23T18:23:10.789142] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-23T18:23:10.864519] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-06. [2025-09-23T18:23:10.877856] [DEBUG] [LOCAL ] DLNG: Primary data saved (6188 records). [2025-09-23T18:23:10.878737] [INFO ] [MAIN ] DLNG: Full history saved. [2025-09-23T18:23:10.885085] [INFO ] [MAIN ] Update Progress: 629/2372 symbols completed. DLNG took 22.9s. Estimated remaining: 3h 50m 21s. Rate: 7.6 symbols/min [2025-09-23T18:23:11.159505] [INFO ] [REMOTE ] DLX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:23:11.186053] [INFO ] [REMOTE ] DLX: Fetching primary data for 2024-12. [2025-09-23T18:23:11.235041] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:23:11.280164] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-23T18:23:11.298966] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-04. [2025-09-23T18:23:11.298679] [DEBUG] [LOCAL ] DLY: Loaded 19427 existing records from primary storage. [2025-09-23T18:23:11.299882] [INFO ] [MAIN ] DLY: Loaded 19427 existing records. [2025-09-23T18:23:11.483131] [WARN ] [MAIN ] DLY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:23:11.483394] [INFO ] [MAIN ] DLY: Wiping existing primary data before full refresh. [2025-09-23T18:23:11.483444] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-09-23T18:23:11.484228] [DEBUG] [LOCAL ] DLY: Deleted primary data file. [2025-09-23T18:23:11.484291] [INFO ] [MAIN ] DLY: Starting full primary refresh. [2025-09-23T18:23:11.887435] [INFO ] [REMOTE ] DLY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:23:11.887909] [INFO ] [REMOTE ] DLY: Fetching primary data for 2024-12. [2025-09-23T18:23:12.176110] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-23T18:23:12.181784] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-01. [2025-09-23T18:23:12.292476] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-23T18:23:12.299631] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-07. [2025-09-23T18:23:12.693730] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-23T18:23:12.699353] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-01. [2025-09-23T18:23:12.870251] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-23T18:23:12.881667] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-05. [2025-09-23T18:23:12.971132] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-23T18:23:12.978336] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-02. [2025-09-23T18:23:13.403014] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-23T18:23:13.409586] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-08. [2025-09-23T18:23:13.451385] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-23T18:23:13.802225] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-02. [2025-09-23T18:23:14.067551] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-23T18:23:14.380146] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-23T18:23:14.442986] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-23T18:23:14.602189] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-03. [2025-09-23T18:23:14.655906] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-23T18:23:15.402199] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-09. [2025-09-23T18:23:15.538609] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-23T18:23:16.202198] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-06. [2025-09-23T18:23:16.412102] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-23T18:23:16.417535] [INFO ] [REMOTE ] DLB: Full fetch complete (46752 records). [2025-09-23T18:23:16.417681] [DEBUG] [VALIDATOR ] DLB: Validating primary data. [2025-09-23T18:23:16.418356] [FATAL] [VALIDATOR ] DLB: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:23:16.418448] [FATAL] [MAIN ] DLB: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:23:16.418491] [WARN ] [MAIN ] DLB: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:23:16.418531] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-09-23T18:23:16.418589] [DEBUG] [LOCAL ] DLB: No primary data file found to delete. [2025-09-23T18:23:16.418624] [INFO ] [LOCAL ] DLB: Starting deletion of derivative data. [2025-09-23T18:23:16.418724] [DEBUG] [LOCAL ] DLB: No derivative data file found to delete. [2025-09-23T18:23:16.418806] [INFO ] [MAIN ] Update Progress: 630/2372 symbols completed. DLB took 35.3s. Estimated remaining: 3h 50m 7s. Rate: 7.6 symbols/min [2025-09-23T18:23:16.592139] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:23:16.598870] [DEBUG] [LOCAL ] DMA: Loaded 4495 existing records from primary storage. [2025-09-23T18:23:16.599040] [INFO ] [MAIN ] DMA: Loaded 4495 existing records. [2025-09-23T18:23:16.811038] [WARN ] [MAIN ] DMA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:23:16.811389] [INFO ] [MAIN ] DMA: Wiping existing primary data before full refresh. [2025-09-23T18:23:16.811453] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-09-23T18:23:16.811792] [DEBUG] [LOCAL ] DMA: Deleted primary data file. [2025-09-23T18:23:16.811865] [INFO ] [MAIN ] DMA: Starting full primary refresh. [2025-09-23T18:23:17.023990] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-04. [2025-09-23T18:23:17.369770] [INFO ] [REMOTE ] DMA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:23:17.606744] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-23T18:23:17.802216] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-03. [2025-09-23T18:23:18.500885] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-23T18:23:18.580054] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-23T18:23:18.602154] [INFO ] [REMOTE ] DMA: Fetching primary data for 2024-12. [2025-09-23T18:23:18.968228] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-09-23T18:23:19.402198] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-01. [2025-09-23T18:23:19.784227] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-23T18:23:20.202201] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-04. [2025-09-23T18:23:21.002192] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-05. [2025-09-23T18:23:21.034443] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-23T18:23:21.802219] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-07. [2025-09-23T18:23:22.595809] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-23T18:23:22.602374] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-02. [2025-09-23T18:23:23.092759] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-23T18:23:23.250443] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-23T18:23:23.402230] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-08. [2025-09-23T18:23:24.202202] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-05. [2025-09-23T18:23:25.002236] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-03. [2025-09-23T18:23:25.111603] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-23T18:23:25.398409] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-23T18:23:25.401907] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-23T18:23:25.802219] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-04. [2025-09-23T18:23:26.138492] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-23T18:23:26.602253] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-06. [2025-09-23T18:23:27.402156] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-09. [2025-09-23T18:23:27.493939] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-23T18:23:28.202244] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-07. [2025-09-23T18:23:29.014724] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-05. [2025-09-23T18:23:29.017159] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-23T18:23:29.025752] [INFO ] [REMOTE ] DLR: Full fetch complete (74244 records). [2025-09-23T18:23:29.025872] [DEBUG] [VALIDATOR ] DLR: Validating primary data. [2025-09-23T18:23:29.476718] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-23T18:23:29.477772] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-23T18:23:29.468857] [DEBUG] [VALIDATOR ] DLR: All expected trading days are present. [2025-09-23T18:23:29.485022] [DEBUG] [VALIDATOR ] DLR: Primary data validation passed. [2025-09-23T18:23:29.486389] [INFO ] [MAIN ] DLR: Fetched primary data is valid. [2025-09-23T18:23:29.486867] [DEBUG] [LOCAL ] DLR: Saving primary data. [2025-09-23T18:23:29.491775] [DEBUG] [LOCAL ] DLR: Trimmed 74244 records to 51180 (keeping 200 days of data) [2025-09-23T18:23:29.805442] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-08. [2025-09-23T18:23:29.818905] [DEBUG] [LOCAL ] DLR: Primary data saved (51180 records). [2025-09-23T18:23:29.819067] [INFO ] [MAIN ] DLR: Full history saved. [2025-09-23T18:23:29.819145] [INFO ] [MAIN ] Update Progress: 631/2372 symbols completed. DLR took 40.2s. Estimated remaining: 3h 50m 14s. Rate: 7.6 symbols/min [2025-09-23T18:23:30.006462] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:23:30.021325] [DEBUG] [LOCAL ] DMB: Loaded 10109 existing records from primary storage. [2025-09-23T18:23:30.021505] [INFO ] [MAIN ] DMB: Loaded 10109 existing records. [2025-09-23T18:23:30.203687] [WARN ] [MAIN ] DMB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:23:30.204026] [INFO ] [MAIN ] DMB: Wiping existing primary data before full refresh. [2025-09-23T18:23:30.204112] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-09-23T18:23:30.204592] [DEBUG] [LOCAL ] DMB: Deleted primary data file. [2025-09-23T18:23:30.204699] [INFO ] [MAIN ] DMB: Starting full primary refresh. [2025-09-23T18:23:30.569707] [INFO ] [REMOTE ] DMB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:23:30.583240] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-23T18:23:30.602150] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-09. [2025-09-23T18:23:31.402215] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-06. [2025-09-23T18:23:31.507805] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-23T18:23:31.512178] [INFO ] [REMOTE ] DLY: Full fetch complete (28146 records). [2025-09-23T18:23:31.512255] [DEBUG] [VALIDATOR ] DLY: Validating primary data. [2025-09-23T18:23:31.785585] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-23T18:23:31.903141] [DEBUG] [VALIDATOR ] DLY: All expected trading days are present. [2025-09-23T18:23:31.903251] [DEBUG] [VALIDATOR ] DLY: Primary data validation passed. [2025-09-23T18:23:31.903834] [INFO ] [MAIN ] DLY: Fetched primary data is valid. [2025-09-23T18:23:31.903912] [DEBUG] [LOCAL ] DLY: Saving primary data. [2025-09-23T18:23:31.904963] [DEBUG] [LOCAL ] DLY: Trimmed 28146 records to 19442 (keeping 200 days of data) [2025-09-23T18:23:32.042319] [DEBUG] [LOCAL ] DLY: Primary data saved (19442 records). [2025-09-23T18:23:32.042677] [INFO ] [MAIN ] DLY: Full history saved. [2025-09-23T18:23:32.043025] [INFO ] [MAIN ] Update Progress: 632/2372 symbols completed. DLY took 21.1s. Estimated remaining: 3h 49m 50s. Rate: 7.6 symbols/min [2025-09-23T18:23:32.216034] [INFO ] [REMOTE ] DMB: Fetching primary data for 2024-12. [2025-09-23T18:23:32.220998] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:23:32.235843] [DEBUG] [LOCAL ] DMO: Loaded 9863 existing records from primary storage. [2025-09-23T18:23:32.236187] [INFO ] [MAIN ] DMO: Loaded 9863 existing records. [2025-09-23T18:23:32.416757] [WARN ] [MAIN ] DMO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:23:32.417071] [INFO ] [MAIN ] DMO: Wiping existing primary data before full refresh. [2025-09-23T18:23:32.417125] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-09-23T18:23:32.417595] [DEBUG] [LOCAL ] DMO: Deleted primary data file. [2025-09-23T18:23:32.417690] [INFO ] [MAIN ] DMO: Starting full primary refresh. [2025-09-23T18:23:32.770924] [INFO ] [REMOTE ] DMO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:23:33.002171] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-06. [2025-09-23T18:23:33.142333] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-23T18:23:33.802233] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-07. [2025-09-23T18:23:34.166675] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-23T18:23:34.283472] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-23T18:23:34.602227] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-01. [2025-09-23T18:23:35.160521] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-23T18:23:35.402208] [INFO ] [REMOTE ] DMO: Fetching primary data for 2024-12. [2025-09-23T18:23:36.158515] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-23T18:23:36.202152] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-01. [2025-09-23T18:23:37.002189] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-02. [2025-09-23T18:23:37.095271] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-23T18:23:37.506100] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-23T18:23:37.802207] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-03. [2025-09-23T18:23:38.495960] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-23T18:23:38.602211] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-07. [2025-09-23T18:23:39.402245] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-04. [2025-09-23T18:23:39.989909] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-23T18:23:40.195752] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-23T18:23:40.202154] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-08. [2025-09-23T18:23:41.002389] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-08. [2025-09-23T18:23:41.147712] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-23T18:23:41.423062] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-23T18:23:41.802263] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-05. [2025-09-23T18:23:42.257419] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-23T18:23:42.602254] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-09. [2025-09-23T18:23:43.402273] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-09. [2025-09-23T18:23:43.578829] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-23T18:23:43.585451] [INFO ] [REMOTE ] DLX: Full fetch complete (41270 records). [2025-09-23T18:23:43.585619] [DEBUG] [VALIDATOR ] DLX: Validating primary data. [2025-09-23T18:23:43.980011] [DEBUG] [VALIDATOR ] DLX: All expected trading days are present. [2025-09-23T18:23:43.980109] [DEBUG] [VALIDATOR ] DLX: Primary data validation passed. [2025-09-23T18:23:43.980772] [INFO ] [MAIN ] DLX: Fetched primary data is valid. [2025-09-23T18:23:43.980869] [DEBUG] [LOCAL ] DLX: Saving primary data. [2025-09-23T18:23:43.981990] [DEBUG] [LOCAL ] DLX: Trimmed 41270 records to 29096 (keeping 200 days of data) [2025-09-23T18:23:44.091821] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-23T18:23:44.115949] [INFO ] [REMOTE ] DMA: Full fetch complete (6527 records). [2025-09-23T18:23:44.116325] [DEBUG] [VALIDATOR ] DMA: Validating primary data. [2025-09-23T18:23:44.209905] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-06. [2025-09-23T18:23:44.590121] [DEBUG] [VALIDATOR ] DMA: All expected trading days are present. [2025-09-23T18:23:44.589998] [DEBUG] [LOCAL ] DLX: Primary data saved (29096 records). [2025-09-23T18:23:44.590299] [DEBUG] [VALIDATOR ] DMA: Primary data validation passed. [2025-09-23T18:23:44.590407] [INFO ] [MAIN ] DLX: Full history saved. [2025-09-23T18:23:44.590705] [INFO ] [MAIN ] DMA: Fetched primary data is valid. [2025-09-23T18:23:44.590911] [INFO ] [MAIN ] Update Progress: 633/2372 symbols completed. DLX took 34.9s. Estimated remaining: 3h 49m 55s. Rate: 7.6 symbols/min [2025-09-23T18:23:44.590999] [DEBUG] [LOCAL ] DMA: Saving primary data. [2025-09-23T18:23:44.597246] [DEBUG] [LOCAL ] DMA: Trimmed 6527 records to 4506 (keeping 200 days of data) [2025-09-23T18:23:44.806814] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:23:44.813139] [DEBUG] [LOCAL ] DMA: Primary data saved (4506 records). [2025-09-23T18:23:44.813364] [INFO ] [MAIN ] DMA: Full history saved. [2025-09-23T18:23:44.813757] [INFO ] [MAIN ] Update Progress: 634/2372 symbols completed. DMA took 28.4s. Estimated remaining: 3h 49m 26s. Rate: 7.6 symbols/min [2025-09-23T18:23:44.999934] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:23:45.012134] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-02. [2025-09-23T18:23:45.039088] [DEBUG] [LOCAL ] DNA: Loaded 48411 existing records from primary storage. [2025-09-23T18:23:45.039276] [INFO ] [MAIN ] DNA: Loaded 48411 existing records. [2025-09-23T18:23:45.135249] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-23T18:23:45.263349] [WARN ] [MAIN ] DNA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:23:45.275719] [INFO ] [MAIN ] DNA: Wiping existing primary data before full refresh. [2025-09-23T18:23:45.276938] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-09-23T18:23:45.278302] [DEBUG] [LOCAL ] DNA: Deleted primary data file. [2025-09-23T18:23:45.278390] [INFO ] [MAIN ] DNA: Starting full primary refresh. [2025-09-23T18:23:45.312810] [DEBUG] [LOCAL ] DNOW: Loaded 43495 existing records from primary storage. [2025-09-23T18:23:45.338925] [INFO ] [MAIN ] DNOW: Loaded 43495 existing records. [2025-09-23T18:23:45.739252] [WARN ] [MAIN ] DNOW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:23:45.772050] [INFO ] [MAIN ] DNOW: Wiping existing primary data before full refresh. [2025-09-23T18:23:45.771990] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-23T18:23:45.788612] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-09-23T18:23:45.798274] [DEBUG] [LOCAL ] DNOW: Deleted primary data file. [2025-09-23T18:23:45.798390] [INFO ] [MAIN ] DNOW: Starting full primary refresh. [2025-09-23T18:23:45.814585] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-07. [2025-09-23T18:23:45.982705] [INFO ] [REMOTE ] DNA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:23:46.253002] [INFO ] [REMOTE ] DNOW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:23:46.602192] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-03. [2025-09-23T18:23:46.621600] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-23T18:23:47.192777] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-23T18:23:47.402198] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2024-12. [2025-09-23T18:23:48.202228] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-08. [2025-09-23T18:23:48.953688] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-23T18:23:49.002155] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-01. [2025-09-23T18:23:49.260765] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-23T18:23:49.802206] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-09. [2025-09-23T18:23:50.195849] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-23T18:23:50.465199] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-23T18:23:50.467803] [INFO ] [REMOTE ] DMB: Full fetch complete (15050 records). [2025-09-23T18:23:50.467884] [DEBUG] [VALIDATOR ] DMB: Validating primary data. [2025-09-23T18:23:50.613786] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-04. [2025-09-23T18:23:50.851468] [DEBUG] [VALIDATOR ] DMB: All expected trading days are present. [2025-09-23T18:23:50.851555] [DEBUG] [VALIDATOR ] DMB: Primary data validation passed. [2025-09-23T18:23:50.851985] [INFO ] [MAIN ] DMB: Fetched primary data is valid. [2025-09-23T18:23:50.852047] [DEBUG] [LOCAL ] DMB: Saving primary data. [2025-09-23T18:23:50.853099] [DEBUG] [LOCAL ] DMB: Trimmed 15050 records to 10158 (keeping 200 days of data) [2025-09-23T18:23:50.919149] [DEBUG] [LOCAL ] DMB: Primary data saved (10158 records). [2025-09-23T18:23:50.919286] [INFO ] [MAIN ] DMB: Full history saved. [2025-09-23T18:23:50.919385] [INFO ] [MAIN ] Update Progress: 635/2372 symbols completed. DMB took 21.1s. Estimated remaining: 3h 49m 13s. Rate: 7.6 symbols/min [2025-09-23T18:23:51.086262] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:23:51.086457] [DEBUG] [LOCAL ] DNP: No existing data file found in primary storage. [2025-09-23T18:23:51.086495] [WARN ] [MAIN ] DNP: No existing data found, performing full refresh instead. [2025-09-23T18:23:51.086639] [INFO ] [MAIN ] DNP: Wiping existing primary data before full refresh. [2025-09-23T18:23:51.086715] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-09-23T18:23:51.086762] [DEBUG] [LOCAL ] DNP: No primary data file found to delete. [2025-09-23T18:23:51.086795] [INFO ] [MAIN ] DNP: Starting full primary refresh. [2025-09-23T18:23:51.395347] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-23T18:23:51.411089] [INFO ] [REMOTE ] DNA: Fetching primary data for 2024-12. [2025-09-23T18:23:51.474268] [INFO ] [REMOTE ] DNP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:23:52.202187] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-05. [2025-09-23T18:23:52.958812] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-23T18:23:53.007279] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-02. [2025-09-23T18:23:53.026789] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-23T18:23:53.802250] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-06. [2025-09-23T18:23:54.113554] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-23T18:23:54.234180] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-23T18:23:54.602304] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-07. [2025-09-23T18:23:55.402211] [INFO ] [REMOTE ] DNP: Fetching primary data for 2024-12. [2025-09-23T18:23:55.644503] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-23T18:23:56.202234] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-08. [2025-09-23T18:23:56.787688] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-23T18:23:56.805540] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-23T18:23:57.002253] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-09. [2025-09-23T18:23:57.802235] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-01. [2025-09-23T18:23:57.953057] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-23T18:23:57.956001] [INFO ] [REMOTE ] DMO: Full fetch complete (14487 records). [2025-09-23T18:23:57.956111] [DEBUG] [VALIDATOR ] DMO: Validating primary data. [2025-09-23T18:23:58.335515] [DEBUG] [VALIDATOR ] DMO: All expected trading days are present. [2025-09-23T18:23:58.335606] [DEBUG] [VALIDATOR ] DMO: Primary data validation passed. [2025-09-23T18:23:58.335947] [INFO ] [MAIN ] DMO: Fetched primary data is valid. [2025-09-23T18:23:58.336008] [DEBUG] [LOCAL ] DMO: Saving primary data. [2025-09-23T18:23:58.336544] [DEBUG] [LOCAL ] DMO: Trimmed 14487 records to 9855 (keeping 200 days of data) [2025-09-23T18:23:58.405724] [DEBUG] [LOCAL ] DMO: Primary data saved (9855 records). [2025-09-23T18:23:58.405866] [INFO ] [MAIN ] DMO: Full history saved. [2025-09-23T18:23:58.405993] [INFO ] [MAIN ] Update Progress: 636/2372 symbols completed. DMO took 26.4s. Estimated remaining: 3h 49m 4s. Rate: 7.6 symbols/min [2025-09-23T18:23:58.576358] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:23:58.576548] [DEBUG] [LOCAL ] DOC: No existing data file found in primary storage. [2025-09-23T18:23:58.576585] [WARN ] [MAIN ] DOC: No existing data found, performing full refresh instead. [2025-09-23T18:23:58.576786] [INFO ] [MAIN ] DOC: Wiping existing primary data before full refresh. [2025-09-23T18:23:58.576828] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-09-23T18:23:58.576868] [DEBUG] [LOCAL ] DOC: No primary data file found to delete. [2025-09-23T18:23:58.576900] [INFO ] [MAIN ] DOC: Starting full primary refresh. [2025-09-23T18:23:58.607433] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-03. [2025-09-23T18:23:58.960920] [INFO ] [REMOTE ] DOC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:23:58.985018] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-23T18:23:59.402215] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-02. [2025-09-23T18:24:00.081740] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-23T18:24:00.202140] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-04. [2025-09-23T18:24:00.247031] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-23T18:24:01.002214] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-03. [2025-09-23T18:24:01.716492] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-23T18:24:01.802218] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-05. [2025-09-23T18:24:02.602238] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-01. [2025-09-23T18:24:02.736172] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-23T18:24:03.402205] [INFO ] [REMOTE ] DOC: Fetching primary data for 2024-12. [2025-09-23T18:24:04.202203] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-04. [2025-09-23T18:24:04.984314] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-05 (3.18 seconds). [2025-09-23T18:24:05.002146] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-06. [2025-09-23T18:24:05.354880] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-23T18:24:05.802168] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-05. [2025-09-23T18:24:05.850268] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-09-23T18:24:05.996193] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-23T18:24:06.114839] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-01 (3.51 seconds). [2025-09-23T18:24:06.602251] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-07. [2025-09-23T18:24:07.343840] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-23T18:24:07.402193] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-06. [2025-09-23T18:24:08.202199] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-01. [2025-09-23T18:24:08.271424] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-23T18:24:08.334094] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-23T18:24:09.002210] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-02. [2025-09-23T18:24:09.635523] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-23T18:24:09.802304] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-08. [2025-09-23T18:24:10.602278] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-07. [2025-09-23T18:24:10.937155] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-23T18:24:11.181755] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-23T18:24:11.402211] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-09. [2025-09-23T18:24:11.664539] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-23T18:24:12.202182] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-02. [2025-09-23T18:24:12.697193] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-23T18:24:12.704528] [INFO ] [REMOTE ] DNOW: Full fetch complete (62384 records). [2025-09-23T18:24:12.704725] [DEBUG] [VALIDATOR ] DNOW: Validating primary data. [2025-09-23T18:24:13.009138] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-08. [2025-09-23T18:24:13.114913] [DEBUG] [VALIDATOR ] DNOW: All expected trading days are present. [2025-09-23T18:24:13.114994] [DEBUG] [VALIDATOR ] DNOW: Primary data validation passed. [2025-09-23T18:24:13.115800] [INFO ] [MAIN ] DNOW: Fetched primary data is valid. [2025-09-23T18:24:13.115867] [DEBUG] [LOCAL ] DNOW: Saving primary data. [2025-09-23T18:24:13.117176] [DEBUG] [LOCAL ] DNOW: Trimmed 62384 records to 43520 (keeping 200 days of data) [2025-09-23T18:24:13.379864] [DEBUG] [LOCAL ] DNOW: Primary data saved (43520 records). [2025-09-23T18:24:13.380013] [INFO ] [MAIN ] DNOW: Full history saved. [2025-09-23T18:24:13.380107] [INFO ] [MAIN ] Update Progress: 637/2372 symbols completed. DNOW took 28.6s. Estimated remaining: 3h 49m 15s. Rate: 7.6 symbols/min [2025-09-23T18:24:13.544682] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-23T18:24:13.802203] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-03. [2025-09-23T18:24:14.379205] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-23T18:24:14.602208] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-03. [2025-09-23T18:24:15.402257] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-09. [2025-09-23T18:24:15.707634] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-23T18:24:16.202202] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-04. [2025-09-23T18:24:16.373793] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-23T18:24:16.421354] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-23T18:24:16.431780] [INFO ] [REMOTE ] DNP: Full fetch complete (49451 records). [2025-09-23T18:24:16.432005] [DEBUG] [VALIDATOR ] DNP: Validating primary data. [2025-09-23T18:24:16.829632] [DEBUG] [VALIDATOR ] DNP: All expected trading days are present. [2025-09-23T18:24:16.829754] [DEBUG] [VALIDATOR ] DNP: Primary data validation passed. [2025-09-23T18:24:16.830377] [INFO ] [MAIN ] DNP: Fetched primary data is valid. [2025-09-23T18:24:16.830421] [DEBUG] [LOCAL ] DNP: Saving primary data. [2025-09-23T18:24:16.831617] [DEBUG] [LOCAL ] DNP: Trimmed 49451 records to 33340 (keeping 200 days of data) [2025-09-23T18:24:17.014375] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-04. [2025-09-23T18:24:17.039381] [DEBUG] [LOCAL ] DNP: Primary data saved (33340 records). [2025-09-23T18:24:17.039543] [INFO ] [MAIN ] DNP: Full history saved. [2025-09-23T18:24:17.039674] [INFO ] [MAIN ] Update Progress: 638/2372 symbols completed. DNP took 26.1s. Estimated remaining: 3h 48m 56s. Rate: 7.6 symbols/min [2025-09-23T18:24:17.927423] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-23T18:24:17.938241] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-05. [2025-09-23T18:24:18.555524] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-23T18:24:18.602227] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-05. [2025-09-23T18:24:20.204774] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-09-23T18:24:20.215455] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-06. [2025-09-23T18:24:20.374824] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-23T18:24:20.387243] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-06. [2025-09-23T18:24:22.290971] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-23T18:24:22.301110] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-07. [2025-09-23T18:24:23.352851] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-06 (2.97 seconds). [2025-09-23T18:24:23.366144] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-07. [2025-09-23T18:24:24.545192] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-23T18:24:24.556159] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-08. [2025-09-23T18:24:25.000185] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-23T18:24:25.011978] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-08. [2025-09-23T18:24:26.119724] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-23T18:24:26.130291] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-09. [2025-09-23T18:24:26.681780] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-23T18:24:26.693244] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-09. [2025-09-23T18:24:27.627537] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-23T18:24:27.635562] [INFO ] [REMOTE ] DNA: Full fetch complete (70993 records). [2025-09-23T18:24:27.635734] [DEBUG] [VALIDATOR ] DNA: Validating primary data. [2025-09-23T18:24:28.102813] [DEBUG] [VALIDATOR ] DNA: All expected trading days are present. [2025-09-23T18:24:28.102906] [DEBUG] [VALIDATOR ] DNA: Primary data validation passed. [2025-09-23T18:24:28.103722] [INFO ] [MAIN ] DNA: Fetched primary data is valid. [2025-09-23T18:24:28.103786] [DEBUG] [LOCAL ] DNA: Saving primary data. [2025-09-23T18:24:28.105316] [DEBUG] [LOCAL ] DNA: Trimmed 70993 records to 48395 (keeping 200 days of data) [2025-09-23T18:24:28.404674] [DEBUG] [LOCAL ] DNA: Primary data saved (48395 records). [2025-09-23T18:24:28.404845] [INFO ] [MAIN ] DNA: Full history saved. [2025-09-23T18:24:28.404948] [INFO ] [MAIN ] Update Progress: 639/2372 symbols completed. DNA took 43.8s. Estimated remaining: 3h 48m 57s. Rate: 7.6 symbols/min [2025-09-23T18:24:28.479224] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-23T18:24:28.487544] [INFO ] [REMOTE ] DOC: Full fetch complete (76981 records). [2025-09-23T18:24:28.487717] [DEBUG] [VALIDATOR ] DOC: Validating primary data. [2025-09-23T18:24:28.488551] [FATAL] [VALIDATOR ] DOC: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:24:28.488667] [FATAL] [MAIN ] DOC: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:24:28.488726] [WARN ] [MAIN ] DOC: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:24:28.488765] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-09-23T18:24:28.488824] [DEBUG] [LOCAL ] DOC: No primary data file found to delete. [2025-09-23T18:24:28.488859] [INFO ] [LOCAL ] DOC: Starting deletion of derivative data. [2025-09-23T18:24:28.488897] [DEBUG] [LOCAL ] DOC: No derivative data file found to delete. [2025-09-23T18:24:28.488956] [INFO ] [MAIN ] Update Progress: 640/2372 symbols completed. DOC took 30.1s. Estimated remaining: 3h 48m 28s. Rate: 7.6 symbols/min [2025-09-23T18:24:29.018235] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:24:29.206547] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:24:29.252534] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:24:29.254636] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:24:29.259403] [DEBUG] [LOCAL ] DOLE: No existing data file found in primary storage. [2025-09-23T18:24:29.259461] [WARN ] [MAIN ] DOLE: No existing data found, performing full refresh instead. [2025-09-23T18:24:29.259585] [INFO ] [MAIN ] DOLE: Wiping existing primary data before full refresh. [2025-09-23T18:24:29.259623] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-09-23T18:24:29.259703] [DEBUG] [LOCAL ] DOLE: No primary data file found to delete. [2025-09-23T18:24:29.260256] [INFO ] [MAIN ] DOLE: Starting full primary refresh. [2025-09-23T18:24:29.510118] [DEBUG] [LOCAL ] DOCN: Loaded 50462 existing records from primary storage. [2025-09-23T18:24:29.530704] [DEBUG] [LOCAL ] DOUG: Loaded 34760 existing records from primary storage. [2025-09-23T18:24:29.539261] [INFO ] [MAIN ] DOCN: Loaded 50462 existing records. [2025-09-23T18:24:29.560029] [INFO ] [MAIN ] DOUG: Loaded 34760 existing records. [2025-09-23T18:24:29.883066] [DEBUG] [LOCAL ] DOCS: Loaded 51285 existing records from primary storage. [2025-09-23T18:24:29.921241] [INFO ] [MAIN ] DOCS: Loaded 51285 existing records. [2025-09-23T18:24:30.149870] [WARN ] [MAIN ] DOUG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:24:30.149750] [INFO ] [REMOTE ] DOLE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:24:30.182311] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2024-12. [2025-09-23T18:24:30.197046] [INFO ] [MAIN ] DOUG: Wiping existing primary data before full refresh. [2025-09-23T18:24:30.236705] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-09-23T18:24:30.236512] [WARN ] [MAIN ] DOCN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:24:30.249964] [INFO ] [MAIN ] DOCN: Wiping existing primary data before full refresh. [2025-09-23T18:24:30.250419] [INFO ] [LOCAL ] DOCN: Starting deletion of primary data. [2025-09-23T18:24:30.271567] [DEBUG] [LOCAL ] DOUG: Deleted primary data file. [2025-09-23T18:24:30.271914] [INFO ] [MAIN ] DOUG: Starting full primary refresh. [2025-09-23T18:24:30.316813] [DEBUG] [LOCAL ] DOCN: Deleted primary data file. [2025-09-23T18:24:30.337048] [INFO ] [MAIN ] DOCN: Starting full primary refresh. [2025-09-23T18:24:30.383303] [WARN ] [MAIN ] DOCS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:24:30.447913] [INFO ] [MAIN ] DOCS: Wiping existing primary data before full refresh. [2025-09-23T18:24:30.468717] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-09-23T18:24:30.517410] [DEBUG] [LOCAL ] DOCS: Deleted primary data file. [2025-09-23T18:24:30.544830] [INFO ] [MAIN ] DOCS: Starting full primary refresh. [2025-09-23T18:24:31.417115] [INFO ] [REMOTE ] DOUG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:24:31.434165] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2024-12. [2025-09-23T18:24:31.474479] [INFO ] [REMOTE ] DOCN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:24:31.480679] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2024-12. [2025-09-23T18:24:31.559704] [INFO ] [REMOTE ] DOCS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:24:31.560119] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2024-12. [2025-09-23T18:24:31.583543] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-23T18:24:31.591132] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-01. [2025-09-23T18:24:32.704482] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-23T18:24:32.714132] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-01. [2025-09-23T18:24:32.751832] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-23T18:24:32.761031] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-01. [2025-09-23T18:24:32.972449] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-23T18:24:32.979860] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-02. [2025-09-23T18:24:33.166662] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-23T18:24:33.177600] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-01. [2025-09-23T18:24:33.726826] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-23T18:24:33.736458] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-02. [2025-09-23T18:24:34.111564] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-23T18:24:34.118378] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-03. [2025-09-23T18:24:34.608103] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-23T18:24:34.617315] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-02. [2025-09-23T18:24:35.398500] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-09-23T18:24:35.408852] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-02. [2025-09-23T18:24:35.452613] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-23T18:24:35.821315] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-23T18:24:36.202238] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-03. [2025-09-23T18:24:36.918683] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-09-23T18:24:37.002205] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-03. [2025-09-23T18:24:37.168725] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-23T18:24:37.289378] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-23T18:24:37.802240] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-04. [2025-09-23T18:24:38.602209] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-03. [2025-09-23T18:24:38.786832] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-23T18:24:39.013582] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-23T18:24:39.402210] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-04. [2025-09-23T18:24:40.097516] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-23T18:24:40.202199] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-04. [2025-09-23T18:24:40.852771] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-23T18:24:41.002227] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-05. [2025-09-23T18:24:41.681369] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-23T18:24:41.802211] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-05. [2025-09-23T18:24:42.112861] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-23T18:24:42.602221] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-06. [2025-09-23T18:24:43.094037] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-23T18:24:43.402219] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-04. [2025-09-23T18:24:43.707035] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-23T18:24:44.202184] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-07. [2025-09-23T18:24:44.947581] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-23T18:24:45.002251] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-05. [2025-09-23T18:24:45.122922] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-23T18:24:45.802205] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-08. [2025-09-23T18:24:46.602206] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-05. [2025-09-23T18:24:46.939960] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-23T18:24:47.069789] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-23T18:24:47.402208] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-06. [2025-09-23T18:24:48.080091] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-23T18:24:48.202167] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-06. [2025-09-23T18:24:48.793227] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-23T18:24:49.002227] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-07. [2025-09-23T18:24:49.802181] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-06. [2025-09-23T18:24:49.900447] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-23T18:24:50.372567] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-23T18:24:50.602191] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-08. [2025-09-23T18:24:50.853414] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-23T18:24:51.402202] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-09. [2025-09-23T18:24:52.202228] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-07. [2025-09-23T18:24:52.346312] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-23T18:24:52.519722] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-23T18:24:52.525601] [INFO ] [REMOTE ] DOUG: Full fetch complete (51583 records). [2025-09-23T18:24:52.525813] [DEBUG] [VALIDATOR ] DOUG: Validating primary data. [2025-09-23T18:24:52.918874] [DEBUG] [VALIDATOR ] DOUG: All expected trading days are present. [2025-09-23T18:24:52.918998] [DEBUG] [VALIDATOR ] DOUG: Primary data validation passed. [2025-09-23T18:24:52.919664] [INFO ] [MAIN ] DOUG: Fetched primary data is valid. [2025-09-23T18:24:52.919726] [DEBUG] [LOCAL ] DOUG: Saving primary data. [2025-09-23T18:24:52.920806] [DEBUG] [LOCAL ] DOUG: Trimmed 51583 records to 34780 (keeping 200 days of data) [2025-09-23T18:24:53.005761] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-09. [2025-09-23T18:24:53.122280] [DEBUG] [LOCAL ] DOUG: Primary data saved (34780 records). [2025-09-23T18:24:53.122436] [INFO ] [MAIN ] DOUG: Full history saved. [2025-09-23T18:24:53.122524] [INFO ] [MAIN ] Update Progress: 641/2372 symbols completed. DOUG took 24.6s. Estimated remaining: 3h 49m 5s. Rate: 7.6 symbols/min [2025-09-23T18:24:53.291872] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:24:53.344407] [DEBUG] [LOCAL ] DOV: Loaded 45742 existing records from primary storage. [2025-09-23T18:24:53.344579] [INFO ] [MAIN ] DOV: Loaded 45742 existing records. [2025-09-23T18:24:53.530462] [WARN ] [MAIN ] DOV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:24:53.531075] [INFO ] [MAIN ] DOV: Wiping existing primary data before full refresh. [2025-09-23T18:24:53.531252] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-09-23T18:24:53.540916] [DEBUG] [LOCAL ] DOV: Deleted primary data file. [2025-09-23T18:24:53.554746] [INFO ] [MAIN ] DOV: Starting full primary refresh. [2025-09-23T18:24:53.561896] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-23T18:24:53.807334] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-08. [2025-09-23T18:24:53.973079] [INFO ] [REMOTE ] DOV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:24:54.409813] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-23T18:24:54.423143] [INFO ] [REMOTE ] DOCS: Full fetch complete (74225 records). [2025-09-23T18:24:54.423415] [DEBUG] [VALIDATOR ] DOCS: Validating primary data. [2025-09-23T18:24:54.603713] [INFO ] [REMOTE ] DOV: Fetching primary data for 2024-12. [2025-09-23T18:24:54.827338] [DEBUG] [VALIDATOR ] DOCS: All expected trading days are present. [2025-09-23T18:24:54.827430] [DEBUG] [VALIDATOR ] DOCS: Primary data validation passed. [2025-09-23T18:24:54.828340] [INFO ] [MAIN ] DOCS: Fetched primary data is valid. [2025-09-23T18:24:54.828407] [DEBUG] [LOCAL ] DOCS: Saving primary data. [2025-09-23T18:24:54.830173] [DEBUG] [LOCAL ] DOCS: Trimmed 74225 records to 51264 (keeping 200 days of data) [2025-09-23T18:24:55.078227] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-23T18:24:55.168512] [DEBUG] [LOCAL ] DOCS: Primary data saved (51264 records). [2025-09-23T18:24:55.168693] [INFO ] [MAIN ] DOCS: Full history saved. [2025-09-23T18:24:55.168851] [INFO ] [MAIN ] Update Progress: 642/2372 symbols completed. DOCS took 26.7s. Estimated remaining: 3h 48m 41s. Rate: 7.6 symbols/min [2025-09-23T18:24:55.347486] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:24:55.400459] [DEBUG] [LOCAL ] DOW: Loaded 53733 existing records from primary storage. [2025-09-23T18:24:55.400626] [INFO ] [MAIN ] DOW: Loaded 53733 existing records. [2025-09-23T18:24:55.412156] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-09. [2025-09-23T18:24:55.587210] [WARN ] [MAIN ] DOW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:24:55.587497] [INFO ] [MAIN ] DOW: Wiping existing primary data before full refresh. [2025-09-23T18:24:55.587554] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-09-23T18:24:55.589094] [DEBUG] [LOCAL ] DOW: Deleted primary data file. [2025-09-23T18:24:55.589156] [INFO ] [MAIN ] DOW: Starting full primary refresh. [2025-09-23T18:24:55.954386] [INFO ] [REMOTE ] DOW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:24:56.202174] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-07. [2025-09-23T18:24:56.410090] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-23T18:24:57.002209] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-01. [2025-09-23T18:24:57.080578] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-23T18:24:57.088154] [INFO ] [REMOTE ] DOLE: Full fetch complete (53140 records). [2025-09-23T18:24:57.088283] [DEBUG] [VALIDATOR ] DOLE: Validating primary data. [2025-09-23T18:24:57.474705] [DEBUG] [VALIDATOR ] DOLE: All expected trading days are present. [2025-09-23T18:24:57.474809] [DEBUG] [VALIDATOR ] DOLE: Primary data validation passed. [2025-09-23T18:24:57.475578] [INFO ] [MAIN ] DOLE: Fetched primary data is valid. [2025-09-23T18:24:57.475663] [DEBUG] [LOCAL ] DOLE: Saving primary data. [2025-09-23T18:24:57.477008] [DEBUG] [LOCAL ] DOLE: Trimmed 53140 records to 37844 (keeping 200 days of data) [2025-09-23T18:24:57.712217] [DEBUG] [LOCAL ] DOLE: Primary data saved (37844 records). [2025-09-23T18:24:57.712503] [INFO ] [MAIN ] DOLE: Full history saved. [2025-09-23T18:24:57.712730] [INFO ] [MAIN ] Update Progress: 643/2372 symbols completed. DOLE took 29.2s. Estimated remaining: 3h 48m 19s. Rate: 7.6 symbols/min [2025-09-23T18:24:57.807328] [INFO ] [REMOTE ] DOW: Fetching primary data for 2024-12. [2025-09-23T18:24:57.926769] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:24:57.932442] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-23T18:24:57.961712] [DEBUG] [LOCAL ] DPG: Loaded 13309 existing records from primary storage. [2025-09-23T18:24:57.961899] [INFO ] [MAIN ] DPG: Loaded 13309 existing records. [2025-09-23T18:24:58.158189] [WARN ] [MAIN ] DPG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:24:58.158428] [INFO ] [MAIN ] DPG: Wiping existing primary data before full refresh. [2025-09-23T18:24:58.158476] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-09-23T18:24:58.158973] [DEBUG] [LOCAL ] DPG: Deleted primary data file. [2025-09-23T18:24:58.159032] [INFO ] [MAIN ] DPG: Starting full primary refresh. [2025-09-23T18:24:58.536247] [INFO ] [REMOTE ] DPG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:24:58.565170] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-23T18:24:58.602226] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-02. [2025-09-23T18:24:59.402208] [INFO ] [REMOTE ] DPG: Fetching primary data for 2024-12. [2025-09-23T18:24:59.721836] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-23T18:24:59.762027] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-23T18:25:00.029290] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-23T18:25:00.202183] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-01. [2025-09-23T18:25:01.002255] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-08. [2025-09-23T18:25:01.802308] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-03. [2025-09-23T18:25:02.218674] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-23T18:25:02.536559] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-23T18:25:02.602245] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-09. [2025-09-23T18:25:03.344420] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-23T18:25:03.402251] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-02. [2025-09-23T18:25:04.202202] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-01. [2025-09-23T18:25:04.278590] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-23T18:25:04.287599] [INFO ] [REMOTE ] DOCN: Full fetch complete (71190 records). [2025-09-23T18:25:04.287839] [DEBUG] [VALIDATOR ] DOCN: Validating primary data. [2025-09-23T18:25:04.686116] [DEBUG] [VALIDATOR ] DOCN: All expected trading days are present. [2025-09-23T18:25:04.686235] [DEBUG] [VALIDATOR ] DOCN: Primary data validation passed. [2025-09-23T18:25:04.687171] [INFO ] [MAIN ] DOCN: Fetched primary data is valid. [2025-09-23T18:25:04.687245] [DEBUG] [LOCAL ] DOCN: Saving primary data. [2025-09-23T18:25:04.688828] [DEBUG] [LOCAL ] DOCN: Trimmed 71190 records to 50488 (keeping 200 days of data) [2025-09-23T18:25:04.812745] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-23T18:25:05.002195] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-04. [2025-09-23T18:25:05.010892] [DEBUG] [LOCAL ] DOCN: Primary data saved (50488 records). [2025-09-23T18:25:05.011214] [INFO ] [MAIN ] DOCN: Full history saved. [2025-09-23T18:25:05.011350] [INFO ] [MAIN ] Update Progress: 644/2372 symbols completed. DOCN took 36.5s. Estimated remaining: 3h 48m 9s. Rate: 7.6 symbols/min [2025-09-23T18:25:05.216950] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:25:05.217401] [DEBUG] [LOCAL ] DQ: No existing data file found in primary storage. [2025-09-23T18:25:05.217766] [WARN ] [MAIN ] DQ: No existing data found, performing full refresh instead. [2025-09-23T18:25:05.219713] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-23T18:25:05.220015] [INFO ] [MAIN ] DQ: Wiping existing primary data before full refresh. [2025-09-23T18:25:05.230649] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-09-23T18:25:05.230732] [DEBUG] [LOCAL ] DQ: No primary data file found to delete. [2025-09-23T18:25:05.230776] [INFO ] [MAIN ] DQ: Starting full primary refresh. [2025-09-23T18:25:05.591077] [INFO ] [REMOTE ] DQ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:25:05.802192] [INFO ] [REMOTE ] DQ: Fetching primary data for 2024-12. [2025-09-23T18:25:06.602238] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-03. [2025-09-23T18:25:06.919132] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-23T18:25:07.036570] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-23T18:25:07.402192] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-05. [2025-09-23T18:25:08.113738] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-23T18:25:08.202171] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-04. [2025-09-23T18:25:08.667776] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-23T18:25:09.002199] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-06. [2025-09-23T18:25:09.802206] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-02. [2025-09-23T18:25:10.366561] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-23T18:25:10.391480] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-23T18:25:10.427922] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-23T18:25:10.602207] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-05. [2025-09-23T18:25:11.402194] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-01. [2025-09-23T18:25:12.202184] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-07. [2025-09-23T18:25:12.686370] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-23T18:25:12.750470] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-23T18:25:13.002195] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-03. [2025-09-23T18:25:13.582272] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-23T18:25:13.802153] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-02. [2025-09-23T18:25:13.828700] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-23T18:25:14.602193] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-08. [2025-09-23T18:25:15.358252] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-23T18:25:15.402183] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-04. [2025-09-23T18:25:15.855030] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-23T18:25:16.016930] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-23T18:25:16.202195] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-05. [2025-09-23T18:25:16.793282] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-23T18:25:17.002206] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-06. [2025-09-23T18:25:17.802190] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-03. [2025-09-23T18:25:17.818247] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-23T18:25:18.602197] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-06. [2025-09-23T18:25:19.379266] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-23T18:25:19.402158] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-04. [2025-09-23T18:25:20.202200] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-07. [2025-09-23T18:25:20.334271] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-23T18:25:20.604781] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-23T18:25:20.887175] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-23T18:25:21.002232] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-07. [2025-09-23T18:25:21.802194] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-05. [2025-09-23T18:25:22.602201] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-09. [2025-09-23T18:25:22.819821] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-23T18:25:22.962696] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-23T18:25:23.402191] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-06. [2025-09-23T18:25:24.202170] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-08. [2025-09-23T18:25:24.349996] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-23T18:25:24.474188] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-23T18:25:24.483453] [INFO ] [REMOTE ] DOV: Full fetch complete (64852 records). [2025-09-23T18:25:24.483579] [DEBUG] [VALIDATOR ] DOV: Validating primary data. [2025-09-23T18:25:24.867903] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-23T18:25:24.888957] [DEBUG] [VALIDATOR ] DOV: All expected trading days are present. [2025-09-23T18:25:24.892309] [DEBUG] [VALIDATOR ] DOV: Primary data validation passed. [2025-09-23T18:25:24.893895] [INFO ] [MAIN ] DOV: Fetched primary data is valid. [2025-09-23T18:25:24.893984] [DEBUG] [LOCAL ] DOV: Saving primary data. [2025-09-23T18:25:24.895811] [DEBUG] [LOCAL ] DOV: Trimmed 64852 records to 45742 (keeping 200 days of data) [2025-09-23T18:25:25.002512] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-08. [2025-09-23T18:25:25.191467] [DEBUG] [LOCAL ] DOV: Primary data saved (45742 records). [2025-09-23T18:25:25.191615] [INFO ] [MAIN ] DOV: Full history saved. [2025-09-23T18:25:25.191731] [INFO ] [MAIN ] Update Progress: 645/2372 symbols completed. DOV took 32.1s. Estimated remaining: 3h 48m 34s. Rate: 7.6 symbols/min [2025-09-23T18:25:25.368207] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:25:25.368442] [DEBUG] [LOCAL ] DRD: No existing data file found in primary storage. [2025-09-23T18:25:25.368498] [WARN ] [MAIN ] DRD: No existing data found, performing full refresh instead. [2025-09-23T18:25:25.368692] [INFO ] [MAIN ] DRD: Wiping existing primary data before full refresh. [2025-09-23T18:25:25.368746] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-09-23T18:25:25.368791] [DEBUG] [LOCAL ] DRD: No primary data file found to delete. [2025-09-23T18:25:25.368825] [INFO ] [MAIN ] DRD: Starting full primary refresh. [2025-09-23T18:25:25.738142] [INFO ] [REMOTE ] DRD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:25:25.802160] [INFO ] [REMOTE ] DRD: Fetching primary data for 2024-12. [2025-09-23T18:25:26.602239] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-07. [2025-09-23T18:25:27.091428] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-23T18:25:27.129530] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-23T18:25:27.402274] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-01. [2025-09-23T18:25:28.202169] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-09. [2025-09-23T18:25:28.242958] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-23T18:25:28.324815] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-23T18:25:29.002230] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-02. [2025-09-23T18:25:29.802211] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-09. [2025-09-23T18:25:29.973858] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-23T18:25:30.031828] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-23T18:25:30.040524] [INFO ] [REMOTE ] DOW: Full fetch complete (77791 records). [2025-09-23T18:25:30.040729] [DEBUG] [VALIDATOR ] DOW: Validating primary data. [2025-09-23T18:25:30.434214] [DEBUG] [VALIDATOR ] DOW: All expected trading days are present. [2025-09-23T18:25:30.434429] [DEBUG] [VALIDATOR ] DOW: Primary data validation passed. [2025-09-23T18:25:30.435587] [INFO ] [MAIN ] DOW: Fetched primary data is valid. [2025-09-23T18:25:30.435757] [DEBUG] [LOCAL ] DOW: Saving primary data. [2025-09-23T18:25:30.443688] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-23T18:25:30.446779] [INFO ] [REMOTE ] DPG: Full fetch complete (18961 records). [2025-09-23T18:25:30.446892] [DEBUG] [VALIDATOR ] DPG: Validating primary data. [2025-09-23T18:25:30.447086] [DEBUG] [LOCAL ] DOW: Trimmed 77791 records to 53733 (keeping 200 days of data) [2025-09-23T18:25:30.612400] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-03. [2025-09-23T18:25:30.932161] [DEBUG] [VALIDATOR ] DPG: All expected trading days are present. [2025-09-23T18:25:30.932566] [DEBUG] [VALIDATOR ] DPG: Primary data validation passed. [2025-09-23T18:25:30.933087] [INFO ] [MAIN ] DPG: Fetched primary data is valid. [2025-09-23T18:25:30.933668] [DEBUG] [LOCAL ] DPG: Saving primary data. [2025-09-23T18:25:30.936576] [DEBUG] [LOCAL ] DPG: Trimmed 18961 records to 13368 (keeping 200 days of data) [2025-09-23T18:25:31.134193] [DEBUG] [LOCAL ] DPG: Primary data saved (13368 records). [2025-09-23T18:25:31.135180] [INFO ] [MAIN ] DPG: Full history saved. [2025-09-23T18:25:31.135531] [INFO ] [MAIN ] Update Progress: 646/2372 symbols completed. DPG took 33.4s. Estimated remaining: 3h 48m 21s. Rate: 7.6 symbols/min [2025-09-23T18:25:31.318986] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:25:31.410200] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-08. [2025-09-23T18:25:31.420875] [DEBUG] [LOCAL ] DRH: Loaded 50454 existing records from primary storage. [2025-09-23T18:25:31.439062] [INFO ] [MAIN ] DRH: Loaded 50454 existing records. [2025-09-23T18:25:31.638291] [WARN ] [MAIN ] DRH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:25:31.639352] [INFO ] [MAIN ] DRH: Wiping existing primary data before full refresh. [2025-09-23T18:25:31.639409] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-09-23T18:25:31.641799] [DEBUG] [LOCAL ] DRH: Deleted primary data file. [2025-09-23T18:25:31.642375] [INFO ] [MAIN ] DRH: Starting full primary refresh. [2025-09-23T18:25:32.050551] [INFO ] [REMOTE ] DRH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:25:32.054477] [DEBUG] [LOCAL ] DOW: Primary data saved (53733 records). [2025-09-23T18:25:32.054732] [INFO ] [MAIN ] DOW: Full history saved. [2025-09-23T18:25:32.054841] [INFO ] [MAIN ] Update Progress: 647/2372 symbols completed. DOW took 36.9s. Estimated remaining: 3h 47m 54s. Rate: 7.6 symbols/min [2025-09-23T18:25:32.235231] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:25:32.214409] [INFO ] [REMOTE ] DRH: Fetching primary data for 2024-12. [2025-09-23T18:25:32.284610] [DEBUG] [LOCAL ] DRI: Loaded 47858 existing records from primary storage. [2025-09-23T18:25:32.284873] [INFO ] [MAIN ] DRI: Loaded 47858 existing records. [2025-09-23T18:25:32.410146] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-23T18:25:32.501022] [WARN ] [MAIN ] DRI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:25:32.501276] [INFO ] [MAIN ] DRI: Wiping existing primary data before full refresh. [2025-09-23T18:25:32.501324] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-09-23T18:25:32.502902] [DEBUG] [LOCAL ] DRI: Deleted primary data file. [2025-09-23T18:25:32.502968] [INFO ] [MAIN ] DRI: Starting full primary refresh. [2025-09-23T18:25:32.880704] [INFO ] [REMOTE ] DRI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:25:32.933845] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-23T18:25:33.002214] [INFO ] [REMOTE ] DRI: Fetching primary data for 2024-12. [2025-09-23T18:25:33.705091] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-23T18:25:33.802149] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-01. [2025-09-23T18:25:34.602166] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-04. [2025-09-23T18:25:34.717574] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-23T18:25:35.056927] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-23T18:25:35.402208] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-01. [2025-09-23T18:25:35.964102] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-23T18:25:36.202180] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-09. [2025-09-23T18:25:36.647856] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-23T18:25:37.002212] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-02. [2025-09-23T18:25:37.692121] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-23T18:25:37.699775] [INFO ] [REMOTE ] DQ: Full fetch complete (62547 records). [2025-09-23T18:25:37.699900] [DEBUG] [VALIDATOR ] DQ: Validating primary data. [2025-09-23T18:25:37.700605] [FATAL] [VALIDATOR ] DQ: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:25:37.700731] [FATAL] [MAIN ] DQ: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:25:37.700776] [WARN ] [MAIN ] DQ: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:25:37.700843] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-09-23T18:25:37.700909] [DEBUG] [LOCAL ] DQ: No primary data file found to delete. [2025-09-23T18:25:37.700945] [INFO ] [LOCAL ] DQ: Starting deletion of derivative data. [2025-09-23T18:25:37.701019] [DEBUG] [LOCAL ] DQ: No derivative data file found to delete. [2025-09-23T18:25:37.701098] [INFO ] [MAIN ] Update Progress: 648/2372 symbols completed. DQ took 32.7s. Estimated remaining: 3h 47m 40s. Rate: 7.6 symbols/min [2025-09-23T18:25:37.802179] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-05. [2025-09-23T18:25:37.873509] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:25:37.873753] [DEBUG] [LOCAL ] DRLL: No existing data file found in primary storage. [2025-09-23T18:25:37.873808] [WARN ] [MAIN ] DRLL: No existing data found, performing full refresh instead. [2025-09-23T18:25:37.873984] [INFO ] [MAIN ] DRLL: Wiping existing primary data before full refresh. [2025-09-23T18:25:37.874033] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-09-23T18:25:37.874076] [DEBUG] [LOCAL ] DRLL: No primary data file found to delete. [2025-09-23T18:25:37.874107] [INFO ] [MAIN ] DRLL: Starting full primary refresh. [2025-09-23T18:25:38.234080] [INFO ] [REMOTE ] DRLL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:25:38.266278] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-23T18:25:38.602246] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-03. [2025-09-23T18:25:38.944217] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-23T18:25:39.402201] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-06. [2025-09-23T18:25:39.888060] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-23T18:25:40.202220] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-02. [2025-09-23T18:25:40.538028] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-23T18:25:41.002219] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-07. [2025-09-23T18:25:41.743320] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-23T18:25:41.802238] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2024-12. [2025-09-23T18:25:42.414076] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-23T18:25:42.569247] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-23T18:25:42.602263] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-04. [2025-09-23T18:25:43.402205] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-01. [2025-09-23T18:25:44.191827] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-23T18:25:44.202139] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-02. [2025-09-23T18:25:44.361636] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-23T18:25:44.707256] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-23T18:25:45.002209] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-05. [2025-09-23T18:25:45.802199] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-03. [2025-09-23T18:25:46.276973] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-23T18:25:46.602238] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-06. [2025-09-23T18:25:47.402195] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-08. [2025-09-23T18:25:47.604692] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-23T18:25:48.102757] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-23T18:25:48.202237] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-03. [2025-09-23T18:25:48.633481] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-23T18:25:48.825204] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-23T18:25:49.002218] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-04. [2025-09-23T18:25:49.606411] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-23T18:25:49.802212] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-05. [2025-09-23T18:25:50.239630] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-23T18:25:50.602213] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-09. [2025-09-23T18:25:51.402246] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-04. [2025-09-23T18:25:52.120689] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-23T18:25:52.128605] [INFO ] [REMOTE ] DRD: Full fetch complete (48763 records). [2025-09-23T18:25:52.128759] [DEBUG] [VALIDATOR ] DRD: Validating primary data. [2025-09-23T18:25:52.207741] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-06. [2025-09-23T18:25:52.511008] [DEBUG] [VALIDATOR ] DRD: All expected trading days are present. [2025-09-23T18:25:52.511096] [DEBUG] [VALIDATOR ] DRD: Primary data validation passed. [2025-09-23T18:25:52.511747] [INFO ] [MAIN ] DRD: Fetched primary data is valid. [2025-09-23T18:25:52.511810] [DEBUG] [LOCAL ] DRD: Saving primary data. [2025-09-23T18:25:52.512996] [DEBUG] [LOCAL ] DRD: Trimmed 48763 records to 36687 (keeping 200 days of data) [2025-09-23T18:25:52.741201] [DEBUG] [LOCAL ] DRD: Primary data saved (36687 records). [2025-09-23T18:25:52.741355] [INFO ] [MAIN ] DRD: Full history saved. [2025-09-23T18:25:52.741435] [INFO ] [MAIN ] Update Progress: 649/2372 symbols completed. DRD took 27.5s. Estimated remaining: 3h 47m 51s. Rate: 7.6 symbols/min [2025-09-23T18:25:52.919528] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:25:52.949626] [DEBUG] [LOCAL ] DSL: Loaded 28194 existing records from primary storage. [2025-09-23T18:25:52.949810] [INFO ] [MAIN ] DSL: Loaded 28194 existing records. [2025-09-23T18:25:53.013042] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-07. [2025-09-23T18:25:53.140781] [WARN ] [MAIN ] DSL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:25:53.148920] [INFO ] [MAIN ] DSL: Wiping existing primary data before full refresh. [2025-09-23T18:25:53.149760] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-09-23T18:25:53.150200] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-23T18:25:53.152807] [DEBUG] [LOCAL ] DSL: Deleted primary data file. [2025-09-23T18:25:53.153618] [INFO ] [MAIN ] DSL: Starting full primary refresh. [2025-09-23T18:25:53.329520] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-23T18:25:53.568963] [INFO ] [REMOTE ] DSL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:25:53.802198] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-05. [2025-09-23T18:25:54.602327] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-07. [2025-09-23T18:25:54.834392] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-23T18:25:55.085333] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-23T18:25:55.402248] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-08. [2025-09-23T18:25:55.792183] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-23T18:25:56.202268] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-06. [2025-09-23T18:25:57.002203] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-08. [2025-09-23T18:25:57.037733] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-23T18:25:57.483533] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-23T18:25:57.723356] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-23T18:25:57.802153] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-07. [2025-09-23T18:25:58.602213] [INFO ] [REMOTE ] DSL: Fetching primary data for 2024-12. [2025-09-23T18:25:59.291422] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-23T18:25:59.402246] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-09. [2025-09-23T18:25:59.606162] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-23T18:26:00.202213] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-01. [2025-09-23T18:26:01.002171] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-08. [2025-09-23T18:26:01.038165] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-23T18:26:01.110777] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-23T18:26:01.118742] [INFO ] [REMOTE ] DRH: Full fetch complete (71458 records). [2025-09-23T18:26:01.118860] [DEBUG] [VALIDATOR ] DRH: Validating primary data. [2025-09-23T18:26:01.119634] [FATAL] [VALIDATOR ] DRH: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:26:01.119760] [FATAL] [MAIN ] DRH: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:26:01.119803] [WARN ] [MAIN ] DRH: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:26:01.119855] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-09-23T18:26:01.119969] [DEBUG] [LOCAL ] DRH: No primary data file found to delete. [2025-09-23T18:26:01.120029] [INFO ] [LOCAL ] DRH: Starting deletion of derivative data. [2025-09-23T18:26:01.120534] [DEBUG] [LOCAL ] DRH: Deleted derivative data file. [2025-09-23T18:26:01.120717] [INFO ] [MAIN ] Update Progress: 650/2372 symbols completed. DRH took 30.0s. Estimated remaining: 3h 47m 44s. Rate: 7.6 symbols/min [2025-09-23T18:26:01.294567] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:26:01.311574] [DEBUG] [LOCAL ] DSM: Loaded 15726 existing records from primary storage. [2025-09-23T18:26:01.311725] [INFO ] [MAIN ] DSM: Loaded 15726 existing records. [2025-09-23T18:26:01.502498] [WARN ] [MAIN ] DSM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:26:01.502816] [INFO ] [MAIN ] DSM: Wiping existing primary data before full refresh. [2025-09-23T18:26:01.502893] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-09-23T18:26:01.503379] [DEBUG] [LOCAL ] DSM: Deleted primary data file. [2025-09-23T18:26:01.503441] [INFO ] [MAIN ] DSM: Starting full primary refresh. [2025-09-23T18:26:01.807785] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-09. [2025-09-23T18:26:01.896077] [INFO ] [REMOTE ] DSM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:26:02.488119] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-23T18:26:02.491078] [INFO ] [REMOTE ] DRLL: Full fetch complete (16133 records). [2025-09-23T18:26:02.491153] [DEBUG] [VALIDATOR ] DRLL: Validating primary data. [2025-09-23T18:26:02.603989] [INFO ] [REMOTE ] DSM: Fetching primary data for 2024-12. [2025-09-23T18:26:02.831668] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-23T18:26:02.922026] [DEBUG] [VALIDATOR ] DRLL: All expected trading days are present. [2025-09-23T18:26:02.922104] [DEBUG] [VALIDATOR ] DRLL: Primary data validation passed. [2025-09-23T18:26:02.922479] [INFO ] [MAIN ] DRLL: Fetched primary data is valid. [2025-09-23T18:26:02.922581] [DEBUG] [LOCAL ] DRLL: Saving primary data. [2025-09-23T18:26:02.923738] [DEBUG] [LOCAL ] DRLL: Trimmed 16133 records to 9710 (keeping 200 days of data) [2025-09-23T18:26:02.986286] [DEBUG] [LOCAL ] DRLL: Primary data saved (9710 records). [2025-09-23T18:26:02.986423] [INFO ] [MAIN ] DRLL: Full history saved. [2025-09-23T18:26:02.986525] [INFO ] [MAIN ] Update Progress: 651/2372 symbols completed. DRLL took 25.3s. Estimated remaining: 3h 47m 20s. Rate: 7.6 symbols/min [2025-09-23T18:26:03.157577] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:26:03.161864] [DEBUG] [LOCAL ] DSMC: Loaded 1965 existing records from primary storage. [2025-09-23T18:26:03.161948] [INFO ] [MAIN ] DSMC: Loaded 1965 existing records. [2025-09-23T18:26:03.357070] [WARN ] [MAIN ] DSMC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:26:03.358065] [INFO ] [MAIN ] DSMC: Wiping existing primary data before full refresh. [2025-09-23T18:26:03.358257] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-09-23T18:26:03.358723] [DEBUG] [LOCAL ] DSMC: Deleted primary data file. [2025-09-23T18:26:03.358804] [INFO ] [MAIN ] DSMC: Starting full primary refresh. [2025-09-23T18:26:03.407393] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-09. [2025-09-23T18:26:03.433278] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-23T18:26:03.742983] [INFO ] [REMOTE ] DSMC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:26:04.202189] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-02. [2025-09-23T18:26:05.002178] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-01. [2025-09-23T18:26:05.081390] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-23T18:26:05.262150] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-23T18:26:05.270417] [INFO ] [REMOTE ] DRI: Full fetch complete (69564 records). [2025-09-23T18:26:05.270582] [DEBUG] [VALIDATOR ] DRI: Validating primary data. [2025-09-23T18:26:05.719330] [DEBUG] [VALIDATOR ] DRI: All expected trading days are present. [2025-09-23T18:26:05.719505] [DEBUG] [VALIDATOR ] DRI: Primary data validation passed. [2025-09-23T18:26:05.723202] [INFO ] [MAIN ] DRI: Fetched primary data is valid. [2025-09-23T18:26:05.724065] [DEBUG] [LOCAL ] DRI: Saving primary data. [2025-09-23T18:26:05.723838] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-23T18:26:05.732170] [DEBUG] [LOCAL ] DRI: Trimmed 69564 records to 47866 (keeping 200 days of data) [2025-09-23T18:26:05.810347] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-02. [2025-09-23T18:26:06.066732] [DEBUG] [LOCAL ] DRI: Primary data saved (47866 records). [2025-09-23T18:26:06.066876] [INFO ] [MAIN ] DRI: Full history saved. [2025-09-23T18:26:06.067027] [INFO ] [MAIN ] Update Progress: 652/2372 symbols completed. DRI took 34.0s. Estimated remaining: 3h 46m 60s. Rate: 7.6 symbols/min [2025-09-23T18:26:06.239168] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:26:06.263989] [DEBUG] [LOCAL ] DSU: Loaded 21791 existing records from primary storage. [2025-09-23T18:26:06.264137] [INFO ] [MAIN ] DSU: Loaded 21791 existing records. [2025-09-23T18:26:06.450399] [WARN ] [MAIN ] DSU: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:26:06.450742] [INFO ] [MAIN ] DSU: Wiping existing primary data before full refresh. [2025-09-23T18:26:06.450812] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-09-23T18:26:06.451741] [DEBUG] [LOCAL ] DSU: Deleted primary data file. [2025-09-23T18:26:06.451805] [INFO ] [MAIN ] DSU: Starting full primary refresh. [2025-09-23T18:26:06.608772] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-03. [2025-09-23T18:26:06.832035] [INFO ] [REMOTE ] DSU: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:26:06.960336] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-23T18:26:07.402208] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-03. [2025-09-23T18:26:07.651965] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-23T18:26:08.179106] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-23T18:26:08.202153] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-04. [2025-09-23T18:26:08.925444] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-23T18:26:09.002199] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-05. [2025-09-23T18:26:09.802169] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2024-12. [2025-09-23T18:26:09.866209] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-23T18:26:10.250518] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-23T18:26:10.602229] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-01. [2025-09-23T18:26:10.956012] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-23T18:26:11.402209] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-06. [2025-09-23T18:26:12.202193] [INFO ] [REMOTE ] DSU: Fetching primary data for 2024-12. [2025-09-23T18:26:12.233631] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-23T18:26:13.002212] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-07. [2025-09-23T18:26:13.661544] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-23T18:26:13.802180] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-01. [2025-09-23T18:26:14.027315] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-23T18:26:14.607821] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-02. [2025-09-23T18:26:14.612119] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-23T18:26:15.279395] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-23T18:26:15.402192] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-08. [2025-09-23T18:26:16.116835] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-23T18:26:16.202188] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-03. [2025-09-23T18:26:16.512554] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-23T18:26:17.002195] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-04. [2025-09-23T18:26:17.350290] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-23T18:26:17.802216] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-02. [2025-09-23T18:26:18.482780] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-23T18:26:18.602161] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-03. [2025-09-23T18:26:19.402190] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-09. [2025-09-23T18:26:19.650028] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-23T18:26:20.202191] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-04. [2025-09-23T18:26:20.349795] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-23T18:26:20.352824] [INFO ] [REMOTE ] DSM: Full fetch complete (24777 records). [2025-09-23T18:26:20.352929] [DEBUG] [VALIDATOR ] DSM: Validating primary data. [2025-09-23T18:26:20.759089] [DEBUG] [VALIDATOR ] DSM: All expected trading days are present. [2025-09-23T18:26:20.759246] [DEBUG] [VALIDATOR ] DSM: Primary data validation passed. [2025-09-23T18:26:20.759712] [INFO ] [MAIN ] DSM: Fetched primary data is valid. [2025-09-23T18:26:20.759790] [DEBUG] [LOCAL ] DSM: Saving primary data. [2025-09-23T18:26:20.760508] [DEBUG] [LOCAL ] DSM: Trimmed 24777 records to 15765 (keeping 200 days of data) [2025-09-23T18:26:20.870461] [DEBUG] [LOCAL ] DSM: Primary data saved (15765 records). [2025-09-23T18:26:20.870619] [INFO ] [MAIN ] DSM: Full history saved. [2025-09-23T18:26:20.870784] [INFO ] [MAIN ] Update Progress: 653/2372 symbols completed. DSM took 19.7s. Estimated remaining: 3h 47m 10s. Rate: 7.6 symbols/min [2025-09-23T18:26:21.007422] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-05. [2025-09-23T18:26:21.065238] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:26:21.093229] [DEBUG] [LOCAL ] DSX: Loaded 24550 existing records from primary storage. [2025-09-23T18:26:21.093398] [INFO ] [MAIN ] DSX: Loaded 24550 existing records. [2025-09-23T18:26:21.276890] [WARN ] [MAIN ] DSX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:26:21.277553] [INFO ] [MAIN ] DSX: Wiping existing primary data before full refresh. [2025-09-23T18:26:21.277887] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-09-23T18:26:21.278917] [DEBUG] [LOCAL ] DSX: Deleted primary data file. [2025-09-23T18:26:21.278980] [INFO ] [MAIN ] DSX: Starting full primary refresh. [2025-09-23T18:26:21.502199] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-23T18:26:21.617896] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-23T18:26:21.730975] [INFO ] [REMOTE ] DSX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:26:21.802175] [INFO ] [REMOTE ] DSX: Fetching primary data for 2024-12. [2025-09-23T18:26:22.602215] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-06. [2025-09-23T18:26:23.003148] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-23T18:26:23.127730] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-23T18:26:23.402229] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-01. [2025-09-23T18:26:24.202295] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-04. [2025-09-23T18:26:24.625032] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-23T18:26:25.002273] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-07. [2025-09-23T18:26:25.199806] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-23T18:26:25.266512] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-09-23T18:26:25.802198] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-08. [2025-09-23T18:26:26.258564] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-23T18:26:26.602205] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-05. [2025-09-23T18:26:27.402231] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-05. [2025-09-23T18:26:27.745290] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-23T18:26:28.102529] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-23T18:26:28.202293] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-06. [2025-09-23T18:26:28.913193] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-23T18:26:29.002173] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-07. [2025-09-23T18:26:29.802145] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-06. [2025-09-23T18:26:29.820434] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-23T18:26:30.607342] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-02. [2025-09-23T18:26:30.621561] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-23T18:26:31.402234] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-08. [2025-09-23T18:26:31.460239] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-23T18:26:32.202200] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-03. [2025-09-23T18:26:32.277539] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-23T18:26:33.002222] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-07. [2025-09-23T18:26:33.152467] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-23T18:26:33.802239] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-09. [2025-09-23T18:26:34.442967] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-23T18:26:34.602246] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-08. [2025-09-23T18:26:34.639686] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-23T18:26:34.644269] [INFO ] [REMOTE ] DSU: Full fetch complete (32193 records). [2025-09-23T18:26:34.644349] [DEBUG] [VALIDATOR ] DSU: Validating primary data. [2025-09-23T18:26:35.014386] [DEBUG] [VALIDATOR ] DSU: All expected trading days are present. [2025-09-23T18:26:35.014508] [DEBUG] [VALIDATOR ] DSU: Primary data validation passed. [2025-09-23T18:26:35.015032] [INFO ] [MAIN ] DSU: Fetched primary data is valid. [2025-09-23T18:26:35.015113] [DEBUG] [LOCAL ] DSU: Saving primary data. [2025-09-23T18:26:35.015918] [DEBUG] [LOCAL ] DSU: Trimmed 32193 records to 21929 (keeping 200 days of data) [2025-09-23T18:26:35.150037] [DEBUG] [LOCAL ] DSU: Primary data saved (21929 records). [2025-09-23T18:26:35.150166] [INFO ] [MAIN ] DSU: Full history saved. [2025-09-23T18:26:35.150246] [INFO ] [MAIN ] Update Progress: 654/2372 symbols completed. DSU took 29.1s. Estimated remaining: 3h 47m 19s. Rate: 7.6 symbols/min [2025-09-23T18:26:35.383721] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:26:35.408729] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-04. [2025-09-23T18:26:35.412170] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-23T18:26:35.458905] [DEBUG] [LOCAL ] DT: Loaded 52947 existing records from primary storage. [2025-09-23T18:26:35.459056] [INFO ] [MAIN ] DT: Loaded 52947 existing records. [2025-09-23T18:26:35.635190] [WARN ] [MAIN ] DT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:26:35.635426] [INFO ] [MAIN ] DT: Wiping existing primary data before full refresh. [2025-09-23T18:26:35.635473] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-09-23T18:26:35.636918] [DEBUG] [LOCAL ] DT: Deleted primary data file. [2025-09-23T18:26:35.636978] [INFO ] [MAIN ] DT: Starting full primary refresh. [2025-09-23T18:26:35.987173] [INFO ] [REMOTE ] DT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:26:36.202156] [INFO ] [REMOTE ] DT: Fetching primary data for 2024-12. [2025-09-23T18:26:36.625295] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-23T18:26:37.002203] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-05. [2025-09-23T18:26:37.799977] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-23T18:26:37.810075] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-09. [2025-09-23T18:26:38.088239] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-23T18:26:38.309523] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-23T18:26:38.310583] [INFO ] [REMOTE ] DSMC: Full fetch complete (2873 records). [2025-09-23T18:26:38.310698] [DEBUG] [VALIDATOR ] DSMC: Validating primary data. [2025-09-23T18:26:38.607322] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-01. [2025-09-23T18:26:38.684096] [DEBUG] [VALIDATOR ] DSMC: All expected trading days are present. [2025-09-23T18:26:38.684190] [DEBUG] [VALIDATOR ] DSMC: Primary data validation passed. [2025-09-23T18:26:38.684336] [INFO ] [MAIN ] DSMC: Fetched primary data is valid. [2025-09-23T18:26:38.684375] [DEBUG] [LOCAL ] DSMC: Saving primary data. [2025-09-23T18:26:38.684844] [DEBUG] [LOCAL ] DSMC: Trimmed 2873 records to 1954 (keeping 200 days of data) [2025-09-23T18:26:38.698688] [DEBUG] [LOCAL ] DSMC: Primary data saved (1954 records). [2025-09-23T18:26:38.698822] [INFO ] [MAIN ] DSMC: Full history saved. [2025-09-23T18:26:38.698934] [INFO ] [MAIN ] Update Progress: 655/2372 symbols completed. DSMC took 35.7s. Estimated remaining: 3h 46m 59s. Rate: 7.6 symbols/min [2025-09-23T18:26:38.874688] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:26:38.888935] [DEBUG] [LOCAL ] DTB: Loaded 4724 existing records from primary storage. [2025-09-23T18:26:38.889075] [INFO ] [MAIN ] DTB: Loaded 4724 existing records. [2025-09-23T18:26:39.073695] [WARN ] [MAIN ] DTB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:26:39.073943] [INFO ] [MAIN ] DTB: Wiping existing primary data before full refresh. [2025-09-23T18:26:39.073992] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-09-23T18:26:39.074305] [DEBUG] [LOCAL ] DTB: Deleted primary data file. [2025-09-23T18:26:39.074366] [INFO ] [MAIN ] DTB: Starting full primary refresh. [2025-09-23T18:26:39.409940] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-06. [2025-09-23T18:26:39.432760] [INFO ] [REMOTE ] DTB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:26:40.202240] [INFO ] [REMOTE ] DTB: Fetching primary data for 2024-12. [2025-09-23T18:26:40.411420] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-23T18:26:40.530394] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-23T18:26:40.779041] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-23T18:26:41.002212] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-07. [2025-09-23T18:26:41.802268] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-09. [2025-09-23T18:26:41.856023] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-23T18:26:42.602234] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-02. [2025-09-23T18:26:42.728827] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-23T18:26:42.735027] [INFO ] [REMOTE ] DSL: Full fetch complete (41331 records). [2025-09-23T18:26:42.735420] [DEBUG] [VALIDATOR ] DSL: Validating primary data. [2025-09-23T18:26:43.133197] [DEBUG] [VALIDATOR ] DSL: All expected trading days are present. [2025-09-23T18:26:43.133285] [DEBUG] [VALIDATOR ] DSL: Primary data validation passed. [2025-09-23T18:26:43.133938] [INFO ] [MAIN ] DSL: Fetched primary data is valid. [2025-09-23T18:26:43.134006] [DEBUG] [LOCAL ] DSL: Saving primary data. [2025-09-23T18:26:43.135111] [DEBUG] [LOCAL ] DSL: Trimmed 41331 records to 28179 (keeping 200 days of data) [2025-09-23T18:26:43.340120] [DEBUG] [LOCAL ] DSL: Primary data saved (28179 records). [2025-09-23T18:26:43.340267] [INFO ] [MAIN ] DSL: Full history saved. [2025-09-23T18:26:43.340358] [INFO ] [MAIN ] Update Progress: 656/2372 symbols completed. DSL took 50.6s. Estimated remaining: 3h 46m 43s. Rate: 7.6 symbols/min [2025-09-23T18:26:43.411245] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-01. [2025-09-23T18:26:43.527838] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:26:43.584213] [DEBUG] [LOCAL ] DTE: Loaded 48004 existing records from primary storage. [2025-09-23T18:26:43.584393] [INFO ] [MAIN ] DTE: Loaded 48004 existing records. [2025-09-23T18:26:43.765484] [WARN ] [MAIN ] DTE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:26:43.765802] [INFO ] [MAIN ] DTE: Wiping existing primary data before full refresh. [2025-09-23T18:26:43.765856] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-09-23T18:26:43.767524] [DEBUG] [LOCAL ] DTE: Deleted primary data file. [2025-09-23T18:26:43.767588] [INFO ] [MAIN ] DTE: Starting full primary refresh. [2025-09-23T18:26:43.951507] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-23T18:26:44.159504] [INFO ] [REMOTE ] DTE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:26:44.207292] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-08. [2025-09-23T18:26:44.226857] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-23T18:26:45.002300] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-03. [2025-09-23T18:26:45.115156] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-23T18:26:45.802265] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-02. [2025-09-23T18:26:46.347569] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-23T18:26:46.602224] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-03. [2025-09-23T18:26:46.686577] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-23T18:26:46.950452] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-23T18:26:47.402192] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-09. [2025-09-23T18:26:48.202191] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-04. [2025-09-23T18:26:48.291266] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-23T18:26:48.295961] [INFO ] [REMOTE ] DSX: Full fetch complete (37302 records). [2025-09-23T18:26:48.296092] [DEBUG] [VALIDATOR ] DSX: Validating primary data. [2025-09-23T18:26:48.700778] [DEBUG] [VALIDATOR ] DSX: All expected trading days are present. [2025-09-23T18:26:48.700943] [DEBUG] [VALIDATOR ] DSX: Primary data validation passed. [2025-09-23T18:26:48.701487] [INFO ] [MAIN ] DSX: Fetched primary data is valid. [2025-09-23T18:26:48.701531] [DEBUG] [LOCAL ] DSX: Saving primary data. [2025-09-23T18:26:48.702723] [DEBUG] [LOCAL ] DSX: Trimmed 37302 records to 24442 (keeping 200 days of data) [2025-09-23T18:26:48.795142] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-23T18:26:48.858560] [DEBUG] [LOCAL ] DSX: Primary data saved (24442 records). [2025-09-23T18:26:48.858723] [INFO ] [MAIN ] DSX: Full history saved. [2025-09-23T18:26:48.858821] [INFO ] [MAIN ] Update Progress: 657/2372 symbols completed. DSX took 28.0s. Estimated remaining: 3h 46m 29s. Rate: 7.6 symbols/min [2025-09-23T18:26:49.008708] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-04. [2025-09-23T18:26:49.042978] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:26:49.043127] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-09-23T18:26:49.043184] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-09-23T18:26:49.043327] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-09-23T18:26:49.043369] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-09-23T18:26:49.043412] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-09-23T18:26:49.043446] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-09-23T18:26:49.416666] [INFO ] [REMOTE ] DTF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:26:49.802192] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-05. [2025-09-23T18:26:50.139409] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-23T18:26:50.430523] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-23T18:26:50.602256] [INFO ] [REMOTE ] DTE: Fetching primary data for 2024-12. [2025-09-23T18:26:51.402200] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-05. [2025-09-23T18:26:51.975223] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-23T18:26:52.202221] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-06. [2025-09-23T18:26:52.703412] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-23T18:26:52.812918] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-23T18:26:53.002217] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-06. [2025-09-23T18:26:53.802227] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-07. [2025-09-23T18:26:54.450806] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-23T18:26:54.602221] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-01. [2025-09-23T18:26:54.687879] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-23T18:26:55.402209] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-08. [2025-09-23T18:26:55.833087] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-23T18:26:55.853355] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-23T18:26:56.202231] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-09. [2025-09-23T18:26:56.694094] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-23T18:26:56.695892] [INFO ] [REMOTE ] DTB: Full fetch complete (6796 records). [2025-09-23T18:26:56.695999] [DEBUG] [VALIDATOR ] DTB: Validating primary data. [2025-09-23T18:26:57.007381] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-02. [2025-09-23T18:26:57.066050] [DEBUG] [VALIDATOR ] DTB: All expected trading days are present. [2025-09-23T18:26:57.066137] [DEBUG] [VALIDATOR ] DTB: Primary data validation passed. [2025-09-23T18:26:57.066342] [INFO ] [MAIN ] DTB: Fetched primary data is valid. [2025-09-23T18:26:57.066416] [DEBUG] [LOCAL ] DTB: Saving primary data. [2025-09-23T18:26:57.066918] [DEBUG] [LOCAL ] DTB: Trimmed 6796 records to 4728 (keeping 200 days of data) [2025-09-23T18:26:57.098602] [DEBUG] [LOCAL ] DTB: Primary data saved (4728 records). [2025-09-23T18:26:57.098774] [INFO ] [MAIN ] DTB: Full history saved. [2025-09-23T18:26:57.098873] [INFO ] [MAIN ] Update Progress: 658/2372 symbols completed. DTB took 18.4s. Estimated remaining: 3h 46m 21s. Rate: 7.6 symbols/min [2025-09-23T18:26:57.271696] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:26:57.280140] [DEBUG] [LOCAL ] DTG: Loaded 5902 existing records from primary storage. [2025-09-23T18:26:57.280242] [INFO ] [MAIN ] DTG: Loaded 5902 existing records. [2025-09-23T18:26:57.456092] [WARN ] [MAIN ] DTG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:26:57.456359] [INFO ] [MAIN ] DTG: Wiping existing primary data before full refresh. [2025-09-23T18:26:57.456408] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-09-23T18:26:57.456720] [DEBUG] [LOCAL ] DTG: Deleted primary data file. [2025-09-23T18:26:57.456780] [INFO ] [MAIN ] DTG: Starting full primary refresh. [2025-09-23T18:26:57.807785] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-07. [2025-09-23T18:26:57.807661] [INFO ] [REMOTE ] DTG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:26:58.612491] [INFO ] [REMOTE ] DTG: Fetching primary data for 2024-12. [2025-09-23T18:26:58.615276] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-23T18:26:59.198078] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-23T18:26:59.402249] [INFO ] [REMOTE ] DTF: Fetching primary data for 2024-12. [2025-09-23T18:26:59.618365] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-23T18:27:00.017825] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-23T18:27:00.202201] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-03. [2025-09-23T18:27:01.002204] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-08. [2025-09-23T18:27:01.802200] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-01. [2025-09-23T18:27:02.343222] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-23T18:27:02.602244] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-01. [2025-09-23T18:27:03.136665] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-23T18:27:03.402253] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-09. [2025-09-23T18:27:03.948034] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-23T18:27:04.202202] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-09-23T18:27:04.507399] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-23T18:27:04.685720] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-23T18:27:05.002208] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-04. [2025-09-23T18:27:05.716966] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-09-23T18:27:05.726059] [INFO ] [REMOTE ] DT: Full fetch complete (76644 records). [2025-09-23T18:27:05.726251] [DEBUG] [VALIDATOR ] DT: Validating primary data. [2025-09-23T18:27:05.807388] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-02. [2025-09-23T18:27:06.138608] [DEBUG] [VALIDATOR ] DT: All expected trading days are present. [2025-09-23T18:27:06.138745] [DEBUG] [VALIDATOR ] DT: Primary data validation passed. [2025-09-23T18:27:06.139737] [INFO ] [MAIN ] DT: Fetched primary data is valid. [2025-09-23T18:27:06.139804] [DEBUG] [LOCAL ] DT: Saving primary data. [2025-09-23T18:27:06.141598] [DEBUG] [LOCAL ] DT: Trimmed 76644 records to 52944 (keeping 200 days of data) [2025-09-23T18:27:06.406708] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-23T18:27:06.573411] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-23T18:27:06.603984] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-09-23T18:27:06.604418] [DEBUG] [LOCAL ] DT: Primary data saved (52944 records). [2025-09-23T18:27:06.604539] [INFO ] [MAIN ] DT: Full history saved. [2025-09-23T18:27:06.604717] [INFO ] [MAIN ] Update Progress: 659/2372 symbols completed. DT took 31.5s. Estimated remaining: 3h 46m 18s. Rate: 7.6 symbols/min [2025-09-23T18:27:06.870262] [INFO ] [MAIN ] DTK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:27:06.870528] [DEBUG] [LOCAL ] DTK: No existing data file found in primary storage. [2025-09-23T18:27:06.870584] [WARN ] [MAIN ] DTK: No existing data found, performing full refresh instead. [2025-09-23T18:27:06.870813] [INFO ] [MAIN ] DTK: Wiping existing primary data before full refresh. [2025-09-23T18:27:06.870875] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-09-23T18:27:06.870939] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-09-23T18:27:06.870990] [INFO ] [MAIN ] DTK: Starting full primary refresh. [2025-09-23T18:27:07.030065] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-23T18:27:07.398486] [INFO ] [REMOTE ] DTK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:27:07.402171] [INFO ] [REMOTE ] DTK: Fetching primary data for 2024-12. [2025-09-23T18:27:07.597360] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:27:07.597901] [WARN ] [REMOTE ] DTK: No data returned for month 2024-12 [2025-09-23T18:27:08.202211] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-09-23T18:27:08.566286] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-23T18:27:09.002215] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-05. [2025-09-23T18:27:09.802206] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-09-23T18:27:10.219632] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-23T18:27:10.602165] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-09-23T18:27:10.644877] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-23T18:27:10.929961] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-23T18:27:11.402271] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-09-23T18:27:11.684744] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-09-23T18:27:12.202199] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-09-23T18:27:12.565145] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-23T18:27:13.002265] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-06. [2025-09-23T18:27:13.802240] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-03. [2025-09-23T18:27:14.401500] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-23T18:27:14.602263] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-01. [2025-09-23T18:27:14.622404] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-23T18:27:14.838983] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:27:14.839314] [WARN ] [REMOTE ] DTK: No data returned for month 2025-01 [2025-09-23T18:27:15.402201] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-02. [2025-09-23T18:27:15.636945] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:27:15.637265] [WARN ] [REMOTE ] DTK: No data returned for month 2025-02 [2025-09-23T18:27:16.202211] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-09-23T18:27:16.639262] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-23T18:27:16.640166] [INFO ] [REMOTE ] DTF: Full fetch complete (2159 records). [2025-09-23T18:27:16.640237] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-09-23T18:27:16.640587] [FATAL] [VALIDATOR ] DTF: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:27:16.640691] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:27:16.640742] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:27:16.640808] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-09-23T18:27:16.640872] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-09-23T18:27:16.640908] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-09-23T18:27:16.640964] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-09-23T18:27:16.641043] [INFO ] [MAIN ] Update Progress: 660/2372 symbols completed. DTF took 27.8s. Estimated remaining: 3h 46m 15s. Rate: 7.6 symbols/min [2025-09-23T18:27:16.813428] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:27:16.867018] [DEBUG] [LOCAL ] DTM: Loaded 44544 existing records from primary storage. [2025-09-23T18:27:16.867263] [INFO ] [MAIN ] DTM: Loaded 44544 existing records. [2025-09-23T18:27:17.008090] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-04. [2025-09-23T18:27:17.052202] [WARN ] [MAIN ] DTM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:27:17.052442] [INFO ] [MAIN ] DTM: Wiping existing primary data before full refresh. [2025-09-23T18:27:17.052491] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-09-23T18:27:17.053924] [DEBUG] [LOCAL ] DTM: Deleted primary data file. [2025-09-23T18:27:17.054017] [INFO ] [MAIN ] DTM: Starting full primary refresh. [2025-09-23T18:27:17.447874] [INFO ] [REMOTE ] DTM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:27:17.722532] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-23T18:27:17.802261] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-03. [2025-09-23T18:27:18.007850] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:27:18.008244] [WARN ] [REMOTE ] DTK: No data returned for month 2025-03 [2025-09-23T18:27:18.602193] [INFO ] [REMOTE ] DTM: Fetching primary data for 2024-12. [2025-09-23T18:27:19.402249] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-07. [2025-09-23T18:27:19.843639] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-23T18:27:20.202208] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-01. [2025-09-23T18:27:20.856001] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-23T18:27:21.002198] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-05. [2025-09-23T18:27:21.373611] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-23T18:27:21.405590] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-23T18:27:21.802232] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-06. [2025-09-23T18:27:22.439555] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-23T18:27:22.602247] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-08. [2025-09-23T18:27:23.402204] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-07. [2025-09-23T18:27:24.202220] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-04. [2025-09-23T18:27:24.504369] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:27:24.504757] [WARN ] [REMOTE ] DTK: No data returned for month 2025-04 [2025-09-23T18:27:25.002207] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-05. [2025-09-23T18:27:25.044929] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-23T18:27:25.260911] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-08 (2.66 seconds). [2025-09-23T18:27:25.270664] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:27:25.271247] [WARN ] [REMOTE ] DTK: No data returned for month 2025-05 [2025-09-23T18:27:25.802210] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-06. [2025-09-23T18:27:25.996764] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:27:25.997054] [WARN ] [REMOTE ] DTK: No data returned for month 2025-06 [2025-09-23T18:27:26.602199] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-07. [2025-09-23T18:27:26.801864] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:27:26.802182] [WARN ] [REMOTE ] DTK: No data returned for month 2025-07 [2025-09-23T18:27:27.402227] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-09. [2025-09-23T18:27:28.202223] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-08. [2025-09-23T18:27:28.611935] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-23T18:27:28.810956] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-23T18:27:28.819996] [INFO ] [REMOTE ] DTE: Full fetch complete (69231 records). [2025-09-23T18:27:28.820150] [DEBUG] [VALIDATOR ] DTE: Validating primary data. [2025-09-23T18:27:29.002291] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-02. [2025-09-23T18:27:29.225792] [DEBUG] [VALIDATOR ] DTE: All expected trading days are present. [2025-09-23T18:27:29.225890] [DEBUG] [VALIDATOR ] DTE: Primary data validation passed. [2025-09-23T18:27:29.226728] [INFO ] [MAIN ] DTE: Fetched primary data is valid. [2025-09-23T18:27:29.226798] [DEBUG] [LOCAL ] DTE: Saving primary data. [2025-09-23T18:27:29.228500] [DEBUG] [LOCAL ] DTE: Trimmed 69231 records to 47998 (keeping 200 days of data) [2025-09-23T18:27:29.540047] [DEBUG] [LOCAL ] DTE: Primary data saved (47998 records). [2025-09-23T18:27:29.540183] [INFO ] [MAIN ] DTE: Full history saved. [2025-09-23T18:27:29.540265] [INFO ] [MAIN ] Update Progress: 661/2372 symbols completed. DTE took 46.2s. Estimated remaining: 3h 46m 20s. Rate: 7.6 symbols/min [2025-09-23T18:27:29.720066] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:27:29.727184] [DEBUG] [LOCAL ] DTW: Loaded 4901 existing records from primary storage. [2025-09-23T18:27:29.727278] [INFO ] [MAIN ] DTW: Loaded 4901 existing records. [2025-09-23T18:27:29.807340] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-08. [2025-09-23T18:27:29.918698] [WARN ] [MAIN ] DTW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:27:29.919436] [INFO ] [MAIN ] DTW: Wiping existing primary data before full refresh. [2025-09-23T18:27:29.919494] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-09-23T18:27:29.919814] [DEBUG] [LOCAL ] DTW: Deleted primary data file. [2025-09-23T18:27:29.919875] [INFO ] [MAIN ] DTW: Starting full primary refresh. [2025-09-23T18:27:30.064851] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:27:30.091051] [WARN ] [REMOTE ] DTK: No data returned for month 2025-08 [2025-09-23T18:27:30.308724] [INFO ] [REMOTE ] DTW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:27:30.370708] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-23T18:27:30.602256] [INFO ] [REMOTE ] DTW: Fetching primary data for 2024-12. [2025-09-23T18:27:31.239380] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-23T18:27:31.402205] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-03. [2025-09-23T18:27:32.202248] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-09. [2025-09-23T18:27:32.536003] [INFO ] [REMOTE ] DTK: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-23T18:27:32.536984] [INFO ] [REMOTE ] DTK: Full fetch complete (232 records). [2025-09-23T18:27:32.537074] [DEBUG] [VALIDATOR ] DTK: Validating primary data. [2025-09-23T18:27:32.537405] [FATAL] [VALIDATOR ] DTK: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:27:32.537520] [FATAL] [MAIN ] DTK: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:27:32.537587] [WARN ] [MAIN ] DTK: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:27:32.537679] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-09-23T18:27:32.537753] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-09-23T18:27:32.537789] [INFO ] [LOCAL ] DTK: Starting deletion of derivative data. [2025-09-23T18:27:32.537854] [DEBUG] [LOCAL ] DTK: No derivative data file found to delete. [2025-09-23T18:27:32.537933] [INFO ] [MAIN ] Update Progress: 662/2372 symbols completed. DTK took 25.9s. Estimated remaining: 3h 45m 59s. Rate: 7.6 symbols/min [2025-09-23T18:27:32.712928] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:27:32.713084] [DEBUG] [LOCAL ] DUK: No existing data file found in primary storage. [2025-09-23T18:27:32.713120] [WARN ] [MAIN ] DUK: No existing data found, performing full refresh instead. [2025-09-23T18:27:32.713260] [INFO ] [MAIN ] DUK: Wiping existing primary data before full refresh. [2025-09-23T18:27:32.713339] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-09-23T18:27:32.713390] [DEBUG] [LOCAL ] DUK: No primary data file found to delete. [2025-09-23T18:27:32.713423] [INFO ] [MAIN ] DUK: Starting full primary refresh. [2025-09-23T18:27:33.009416] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-01. [2025-09-23T18:27:33.078703] [INFO ] [REMOTE ] DUK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:27:33.109701] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-23T18:27:33.733005] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-23T18:27:33.802219] [INFO ] [REMOTE ] DUK: Fetching primary data for 2024-12. [2025-09-23T18:27:34.602195] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-09. [2025-09-23T18:27:35.277280] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-23T18:27:35.279229] [INFO ] [REMOTE ] DTG: Full fetch complete (9027 records). [2025-09-23T18:27:35.279316] [DEBUG] [VALIDATOR ] DTG: Validating primary data. [2025-09-23T18:27:35.407321] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-04. [2025-09-23T18:27:35.664027] [DEBUG] [VALIDATOR ] DTG: All expected trading days are present. [2025-09-23T18:27:35.664118] [DEBUG] [VALIDATOR ] DTG: Primary data validation passed. [2025-09-23T18:27:35.664375] [INFO ] [MAIN ] DTG: Fetched primary data is valid. [2025-09-23T18:27:35.664416] [DEBUG] [LOCAL ] DTG: Saving primary data. [2025-09-23T18:27:35.664893] [DEBUG] [LOCAL ] DTG: Trimmed 9027 records to 5902 (keeping 200 days of data) [2025-09-23T18:27:35.704543] [DEBUG] [LOCAL ] DTG: Primary data saved (5902 records). [2025-09-23T18:27:35.704694] [INFO ] [MAIN ] DTG: Full history saved. [2025-09-23T18:27:35.704797] [INFO ] [MAIN ] Update Progress: 663/2372 symbols completed. DTG took 38.6s. Estimated remaining: 3h 45m 39s. Rate: 7.6 symbols/min [2025-09-23T18:27:35.888872] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:27:35.921706] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-23T18:27:35.925325] [DEBUG] [LOCAL ] DUKB: Loaded 6388 existing records from primary storage. [2025-09-23T18:27:35.936284] [INFO ] [MAIN ] DUKB: Loaded 6388 existing records. [2025-09-23T18:27:36.114762] [WARN ] [MAIN ] DUKB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:27:36.115028] [INFO ] [MAIN ] DUKB: Wiping existing primary data before full refresh. [2025-09-23T18:27:36.115135] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-09-23T18:27:36.115554] [DEBUG] [LOCAL ] DUKB: Deleted primary data file. [2025-09-23T18:27:36.115616] [INFO ] [MAIN ] DUKB: Starting full primary refresh. [2025-09-23T18:27:36.208629] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-01. [2025-09-23T18:27:36.498755] [INFO ] [REMOTE ] DUKB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:27:36.793440] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-23T18:27:37.002194] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-05. [2025-09-23T18:27:37.802179] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-02. [2025-09-23T18:27:38.066690] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-23T18:27:38.366996] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-23T18:27:38.602178] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-03. [2025-09-23T18:27:38.839065] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-23T18:27:39.016786] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-23T18:27:39.402191] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-06. [2025-09-23T18:27:40.202219] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-02. [2025-09-23T18:27:40.580605] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-23T18:27:41.002199] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-07. [2025-09-23T18:27:41.747929] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-23T18:27:41.802178] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-03. [2025-09-23T18:27:42.189272] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-23T18:27:42.602196] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2024-12. [2025-09-23T18:27:43.260235] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-23T18:27:43.300450] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-23T18:27:43.402187] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-04. [2025-09-23T18:27:44.202236] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-04. [2025-09-23T18:27:44.973234] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-23T18:27:45.002145] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-05. [2025-09-23T18:27:45.106987] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-23T18:27:45.375889] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-23T18:27:45.802225] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-01. [2025-09-23T18:27:46.226686] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-23T18:27:46.602208] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-02. [2025-09-23T18:27:47.024165] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-23T18:27:47.402202] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-06. [2025-09-23T18:27:48.202242] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-05. [2025-09-23T18:27:48.678896] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-23T18:27:49.002193] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-07. [2025-09-23T18:27:49.406009] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-23T18:27:49.802199] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-03. [2025-09-23T18:27:50.206926] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-23T18:27:50.490909] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-09-23T18:27:50.602221] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-08. [2025-09-23T18:27:50.952691] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-23T18:27:51.402215] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-09. [2025-09-23T18:27:51.923953] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-23T18:27:51.925366] [INFO ] [REMOTE ] DTW: Full fetch complete (7770 records). [2025-09-23T18:27:51.925437] [DEBUG] [VALIDATOR ] DTW: Validating primary data. [2025-09-23T18:27:52.209036] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-06. [2025-09-23T18:27:52.294525] [DEBUG] [VALIDATOR ] DTW: All expected trading days are present. [2025-09-23T18:27:52.294664] [DEBUG] [VALIDATOR ] DTW: Primary data validation passed. [2025-09-23T18:27:52.294905] [INFO ] [MAIN ] DTW: Fetched primary data is valid. [2025-09-23T18:27:52.294948] [DEBUG] [LOCAL ] DTW: Saving primary data. [2025-09-23T18:27:52.295385] [DEBUG] [LOCAL ] DTW: Trimmed 7770 records to 4899 (keeping 200 days of data) [2025-09-23T18:27:52.325601] [DEBUG] [LOCAL ] DTW: Primary data saved (4899 records). [2025-09-23T18:27:52.325711] [INFO ] [MAIN ] DTW: Full history saved. [2025-09-23T18:27:52.325801] [INFO ] [MAIN ] Update Progress: 664/2372 symbols completed. DTW took 22.8s. Estimated remaining: 3h 45m 54s. Rate: 7.6 symbols/min [2025-09-23T18:27:52.505574] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:27:52.560698] [DEBUG] [LOCAL ] DV: Loaded 51276 existing records from primary storage. [2025-09-23T18:27:52.560850] [INFO ] [MAIN ] DV: Loaded 51276 existing records. [2025-09-23T18:27:52.741378] [WARN ] [MAIN ] DV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:27:52.741665] [INFO ] [MAIN ] DV: Wiping existing primary data before full refresh. [2025-09-23T18:27:52.741727] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-09-23T18:27:52.743309] [DEBUG] [LOCAL ] DV: Deleted primary data file. [2025-09-23T18:27:52.743382] [INFO ] [MAIN ] DV: Starting full primary refresh. [2025-09-23T18:27:53.007399] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-04. [2025-09-23T18:27:53.109276] [INFO ] [REMOTE ] DV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:27:53.810887] [INFO ] [REMOTE ] DV: Fetching primary data for 2024-12. [2025-09-23T18:27:53.817794] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-23T18:27:53.846961] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-23T18:27:54.602226] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-05. [2025-09-23T18:27:54.934725] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-23T18:27:55.344628] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-23T18:27:55.402194] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-06. [2025-09-23T18:27:55.832482] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-23T18:27:56.202195] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-08. [2025-09-23T18:27:57.002201] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-01. [2025-09-23T18:27:57.802205] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-07. [2025-09-23T18:27:57.989162] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-23T18:27:58.201734] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-23T18:27:58.220979] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-23T18:27:58.602200] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-07. [2025-09-23T18:27:59.402271] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-02. [2025-09-23T18:28:00.202192] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-09. [2025-09-23T18:28:00.560240] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-23T18:28:01.004235] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-08. [2025-09-23T18:28:01.009796] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-23T18:28:01.802215] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-03. [2025-09-23T18:28:01.993907] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-23T18:28:02.001363] [INFO ] [REMOTE ] DTM: Full fetch complete (64866 records). [2025-09-23T18:28:02.001533] [DEBUG] [VALIDATOR ] DTM: Validating primary data. [2025-09-23T18:28:02.396665] [DEBUG] [VALIDATOR ] DTM: All expected trading days are present. [2025-09-23T18:28:02.396813] [DEBUG] [VALIDATOR ] DTM: Primary data validation passed. [2025-09-23T18:28:02.397621] [INFO ] [MAIN ] DTM: Fetched primary data is valid. [2025-09-23T18:28:02.397719] [DEBUG] [LOCAL ] DTM: Saving primary data. [2025-09-23T18:28:02.399220] [DEBUG] [LOCAL ] DTM: Trimmed 64866 records to 44507 (keeping 200 days of data) [2025-09-23T18:28:02.614875] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-08. [2025-09-23T18:28:02.683614] [DEBUG] [LOCAL ] DTM: Primary data saved (44507 records). [2025-09-23T18:28:02.683800] [INFO ] [MAIN ] DTM: Full history saved. [2025-09-23T18:28:02.684008] [INFO ] [MAIN ] Update Progress: 665/2372 symbols completed. DTM took 46.0s. Estimated remaining: 3h 45m 52s. Rate: 7.6 symbols/min [2025-09-23T18:28:02.855941] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:28:02.856198] [DEBUG] [LOCAL ] DVA: No existing data file found in primary storage. [2025-09-23T18:28:02.856414] [WARN ] [MAIN ] DVA: No existing data found, performing full refresh instead. [2025-09-23T18:28:02.856619] [INFO ] [MAIN ] DVA: Wiping existing primary data before full refresh. [2025-09-23T18:28:02.856815] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-09-23T18:28:02.856884] [DEBUG] [LOCAL ] DVA: No primary data file found to delete. [2025-09-23T18:28:02.857036] [INFO ] [MAIN ] DVA: Starting full primary refresh. [2025-09-23T18:28:03.056698] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-23T18:28:03.068804] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-23T18:28:03.307393] [INFO ] [REMOTE ] DVA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:28:03.369451] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-23T18:28:03.402176] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-09. [2025-09-23T18:28:04.202198] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-04. [2025-09-23T18:28:04.880160] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-23T18:28:04.889009] [INFO ] [REMOTE ] DUK: Full fetch complete (77400 records). [2025-09-23T18:28:04.889199] [DEBUG] [VALIDATOR ] DUK: Validating primary data. [2025-09-23T18:28:05.007294] [INFO ] [REMOTE ] DVA: Fetching primary data for 2024-12. [2025-09-23T18:28:05.290290] [DEBUG] [VALIDATOR ] DUK: All expected trading days are present. [2025-09-23T18:28:05.290387] [DEBUG] [VALIDATOR ] DUK: Primary data validation passed. [2025-09-23T18:28:05.291305] [INFO ] [MAIN ] DUK: Fetched primary data is valid. [2025-09-23T18:28:05.291371] [DEBUG] [LOCAL ] DUK: Saving primary data. [2025-09-23T18:28:05.292975] [DEBUG] [LOCAL ] DUK: Trimmed 77400 records to 53460 (keeping 200 days of data) [2025-09-23T18:28:05.650342] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-23T18:28:05.686723] [DEBUG] [LOCAL ] DUK: Primary data saved (53460 records). [2025-09-23T18:28:05.686864] [INFO ] [MAIN ] DUK: Full history saved. [2025-09-23T18:28:05.686940] [INFO ] [MAIN ] Update Progress: 666/2372 symbols completed. DUK took 33.1s. Estimated remaining: 3h 45m 31s. Rate: 7.6 symbols/min [2025-09-23T18:28:05.807250] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-05. [2025-09-23T18:28:05.860665] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:28:05.914234] [DEBUG] [LOCAL ] DVN: Loaded 53699 existing records from primary storage. [2025-09-23T18:28:05.914390] [INFO ] [MAIN ] DVN: Loaded 53699 existing records. [2025-09-23T18:28:06.092077] [WARN ] [MAIN ] DVN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:28:06.092373] [INFO ] [MAIN ] DVN: Wiping existing primary data before full refresh. [2025-09-23T18:28:06.092421] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-09-23T18:28:06.093992] [DEBUG] [LOCAL ] DVN: Deleted primary data file. [2025-09-23T18:28:06.094051] [INFO ] [MAIN ] DVN: Starting full primary refresh. [2025-09-23T18:28:06.452691] [INFO ] [REMOTE ] DVN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:28:06.515210] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-23T18:28:06.602195] [INFO ] [REMOTE ] DVN: Fetching primary data for 2024-12. [2025-09-23T18:28:07.402211] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-09. [2025-09-23T18:28:07.594398] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-23T18:28:07.960627] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-23T18:28:07.962089] [INFO ] [REMOTE ] DUKB: Full fetch complete (9541 records). [2025-09-23T18:28:07.962162] [DEBUG] [VALIDATOR ] DUKB: Validating primary data. [2025-09-23T18:28:08.214684] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-06. [2025-09-23T18:28:08.337911] [DEBUG] [VALIDATOR ] DUKB: All expected trading days are present. [2025-09-23T18:28:08.338094] [DEBUG] [VALIDATOR ] DUKB: Primary data validation passed. [2025-09-23T18:28:08.338347] [INFO ] [MAIN ] DUKB: Fetched primary data is valid. [2025-09-23T18:28:08.338389] [DEBUG] [LOCAL ] DUKB: Saving primary data. [2025-09-23T18:28:08.338881] [DEBUG] [LOCAL ] DUKB: Trimmed 9541 records to 6375 (keeping 200 days of data) [2025-09-23T18:28:08.382563] [DEBUG] [LOCAL ] DUKB: Primary data saved (6375 records). [2025-09-23T18:28:08.382731] [INFO ] [MAIN ] DUKB: Full history saved. [2025-09-23T18:28:08.382842] [INFO ] [MAIN ] Update Progress: 667/2372 symbols completed. DUKB took 32.7s. Estimated remaining: 3h 45m 10s. Rate: 7.6 symbols/min [2025-09-23T18:28:08.573103] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:28:08.639708] [DEBUG] [LOCAL ] DX: Loaded 52475 existing records from primary storage. [2025-09-23T18:28:08.639893] [INFO ] [MAIN ] DX: Loaded 52475 existing records. [2025-09-23T18:28:08.774954] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-09-23T18:28:08.867401] [WARN ] [MAIN ] DX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:28:08.867741] [INFO ] [MAIN ] DX: Wiping existing primary data before full refresh. [2025-09-23T18:28:08.867800] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-09-23T18:28:08.869343] [DEBUG] [LOCAL ] DX: Deleted primary data file. [2025-09-23T18:28:08.869406] [INFO ] [MAIN ] DX: Starting full primary refresh. [2025-09-23T18:28:09.012960] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-01. [2025-09-23T18:28:09.242234] [INFO ] [REMOTE ] DX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:28:09.701861] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-23T18:28:09.802245] [INFO ] [REMOTE ] DX: Fetching primary data for 2024-12. [2025-09-23T18:28:10.591070] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-23T18:28:10.602131] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-02. [2025-09-23T18:28:11.402211] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-07. [2025-09-23T18:28:11.701845] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-23T18:28:11.802269] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-23T18:28:12.202206] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-03. [2025-09-23T18:28:12.731924] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-23T18:28:13.002217] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-08. [2025-09-23T18:28:13.438358] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-23T18:28:13.802208] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-01. [2025-09-23T18:28:14.345023] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-23T18:28:14.602196] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-04. [2025-09-23T18:28:15.402210] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-01. [2025-09-23T18:28:15.587844] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-23T18:28:15.988488] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-23T18:28:16.202193] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-05. [2025-09-23T18:28:17.002173] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-09. [2025-09-23T18:28:17.040075] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-23T18:28:17.802240] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-02. [2025-09-23T18:28:17.848698] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-23T18:28:18.391993] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-23T18:28:18.400875] [INFO ] [REMOTE ] DV: Full fetch complete (73224 records). [2025-09-23T18:28:18.401028] [DEBUG] [VALIDATOR ] DV: Validating primary data. [2025-09-23T18:28:18.607388] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-06. [2025-09-23T18:28:18.823856] [DEBUG] [VALIDATOR ] DV: All expected trading days are present. [2025-09-23T18:28:18.823969] [DEBUG] [VALIDATOR ] DV: Primary data validation passed. [2025-09-23T18:28:18.824911] [INFO ] [MAIN ] DV: Fetched primary data is valid. [2025-09-23T18:28:18.824978] [DEBUG] [LOCAL ] DV: Saving primary data. [2025-09-23T18:28:18.826721] [DEBUG] [LOCAL ] DV: Trimmed 73224 records to 51272 (keeping 200 days of data) [2025-09-23T18:28:19.149135] [DEBUG] [LOCAL ] DV: Primary data saved (51272 records). [2025-09-23T18:28:19.149301] [INFO ] [MAIN ] DV: Full history saved. [2025-09-23T18:28:19.149437] [INFO ] [MAIN ] Update Progress: 668/2372 symbols completed. DV took 26.8s. Estimated remaining: 3h 45m 9s. Rate: 7.6 symbols/min [2025-09-23T18:28:19.336765] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:28:19.396216] [DEBUG] [LOCAL ] DXC: Loaded 49606 existing records from primary storage. [2025-09-23T18:28:19.396432] [INFO ] [MAIN ] DXC: Loaded 49606 existing records. [2025-09-23T18:28:19.431027] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-02. [2025-09-23T18:28:19.605253] [WARN ] [MAIN ] DXC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:28:19.605874] [INFO ] [MAIN ] DXC: Wiping existing primary data before full refresh. [2025-09-23T18:28:19.605987] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-09-23T18:28:19.607372] [DEBUG] [LOCAL ] DXC: Deleted primary data file. [2025-09-23T18:28:19.607435] [INFO ] [MAIN ] DXC: Starting full primary refresh. [2025-09-23T18:28:20.022540] [INFO ] [REMOTE ] DXC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:28:20.024831] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-09-23T18:28:20.090285] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-23T18:28:20.202166] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-03. [2025-09-23T18:28:20.823922] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-23T18:28:21.002189] [INFO ] [REMOTE ] DXC: Fetching primary data for 2024-12. [2025-09-23T18:28:21.802222] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-07. [2025-09-23T18:28:22.275717] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-23T18:28:22.519295] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-09-23T18:28:22.602259] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-04. [2025-09-23T18:28:22.984749] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-23T18:28:23.402245] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-08. [2025-09-23T18:28:24.202229] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-01. [2025-09-23T18:28:24.353008] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-23T18:28:24.907469] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-23T18:28:25.002201] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-03. [2025-09-23T18:28:25.314373] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-23T18:28:25.802268] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-09. [2025-09-23T18:28:26.607623] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-05. [2025-09-23T18:28:26.632413] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-23T18:28:27.003427] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-23T18:28:27.014049] [INFO ] [REMOTE ] DVA: Full fetch complete (59719 records). [2025-09-23T18:28:27.014286] [DEBUG] [VALIDATOR ] DVA: Validating primary data. [2025-09-23T18:28:27.404688] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-02. [2025-09-23T18:28:27.432962] [DEBUG] [VALIDATOR ] DVA: All expected trading days are present. [2025-09-23T18:28:27.433070] [DEBUG] [VALIDATOR ] DVA: Primary data validation passed. [2025-09-23T18:28:27.434060] [INFO ] [MAIN ] DVA: Fetched primary data is valid. [2025-09-23T18:28:27.434221] [DEBUG] [LOCAL ] DVA: Saving primary data. [2025-09-23T18:28:27.437409] [DEBUG] [LOCAL ] DVA: Trimmed 59719 records to 41451 (keeping 200 days of data) [2025-09-23T18:28:27.704219] [DEBUG] [LOCAL ] DVA: Primary data saved (41451 records). [2025-09-23T18:28:27.704359] [INFO ] [MAIN ] DVA: Full history saved. [2025-09-23T18:28:27.704495] [INFO ] [MAIN ] Update Progress: 669/2372 symbols completed. DVA took 25.0s. Estimated remaining: 3h 45m 3s. Rate: 7.6 symbols/min [2025-09-23T18:28:27.873052] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:28:27.918680] [DEBUG] [LOCAL ] DXYZ: Loaded 36760 existing records from primary storage. [2025-09-23T18:28:27.918837] [INFO ] [MAIN ] DXYZ: Loaded 36760 existing records. [2025-09-23T18:28:28.117972] [WARN ] [MAIN ] DXYZ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:28:28.118397] [INFO ] [MAIN ] DXYZ: Wiping existing primary data before full refresh. [2025-09-23T18:28:28.118461] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-09-23T18:28:28.119334] [DEBUG] [LOCAL ] DXYZ: Deleted primary data file. [2025-09-23T18:28:28.119415] [INFO ] [MAIN ] DXYZ: Starting full primary refresh. [2025-09-23T18:28:28.203811] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-04. [2025-09-23T18:28:28.494598] [INFO ] [REMOTE ] DXYZ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:28:28.559210] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-23T18:28:29.002199] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-06. [2025-09-23T18:28:29.037029] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-23T18:28:29.802191] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-03. [2025-09-23T18:28:29.882375] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-23T18:28:30.602240] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-05. [2025-09-23T18:28:30.928606] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-23T18:28:31.006056] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-23T18:28:31.402246] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2024-12. [2025-09-23T18:28:32.096677] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-23T18:28:32.202203] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-06. [2025-09-23T18:28:33.002242] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-04. [2025-09-23T18:28:33.609853] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-23T18:28:33.762236] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2024-12 (2.36 seconds). [2025-09-23T18:28:33.802192] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-01. [2025-09-23T18:28:34.602216] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-07. [2025-09-23T18:28:34.639925] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-23T18:28:35.402274] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-07. [2025-09-23T18:28:35.792712] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-23T18:28:36.202164] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-02. [2025-09-23T18:28:36.302740] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-23T18:28:37.009686] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-08. [2025-09-23T18:28:37.039138] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-23T18:28:37.802193] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-05. [2025-09-23T18:28:37.834575] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-23T18:28:38.572175] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-23T18:28:38.602151] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-09. [2025-09-23T18:28:39.092146] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-23T18:28:39.402226] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-03. [2025-09-23T18:28:40.202193] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-08. [2025-09-23T18:28:40.658019] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-23T18:28:40.667752] [INFO ] [REMOTE ] DVN: Full fetch complete (77766 records). [2025-09-23T18:28:40.667934] [DEBUG] [VALIDATOR ] DVN: Validating primary data. [2025-09-23T18:28:41.005931] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-06. [2025-09-23T18:28:41.098680] [DEBUG] [VALIDATOR ] DVN: All expected trading days are present. [2025-09-23T18:28:41.098895] [DEBUG] [VALIDATOR ] DVN: Primary data validation passed. [2025-09-23T18:28:41.100095] [INFO ] [MAIN ] DVN: Fetched primary data is valid. [2025-09-23T18:28:41.100195] [DEBUG] [LOCAL ] DVN: Saving primary data. [2025-09-23T18:28:41.102002] [DEBUG] [LOCAL ] DVN: Trimmed 77766 records to 53699 (keeping 200 days of data) [2025-09-23T18:28:41.256893] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-23T18:28:41.488982] [DEBUG] [LOCAL ] DVN: Primary data saved (53699 records). [2025-09-23T18:28:41.489126] [INFO ] [MAIN ] DVN: Full history saved. [2025-09-23T18:28:41.489259] [INFO ] [MAIN ] Update Progress: 670/2372 symbols completed. DVN took 35.8s. Estimated remaining: 3h 45m 10s. Rate: 7.6 symbols/min [2025-09-23T18:28:41.669093] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:28:41.704329] [DEBUG] [LOCAL ] DY: Loaded 29922 existing records from primary storage. [2025-09-23T18:28:41.704482] [INFO ] [MAIN ] DY: Loaded 29922 existing records. [2025-09-23T18:28:41.805318] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-04. [2025-09-23T18:28:41.849832] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-23T18:28:41.945220] [WARN ] [MAIN ] DY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:28:41.945515] [INFO ] [MAIN ] DY: Wiping existing primary data before full refresh. [2025-09-23T18:28:41.945585] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-09-23T18:28:41.946476] [DEBUG] [LOCAL ] DY: Deleted primary data file. [2025-09-23T18:28:41.946539] [INFO ] [MAIN ] DY: Starting full primary refresh. [2025-09-23T18:28:42.313208] [INFO ] [REMOTE ] DY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:28:42.602164] [INFO ] [REMOTE ] DY: Fetching primary data for 2024-12. [2025-09-23T18:28:42.695592] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-23T18:28:43.402188] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-07. [2025-09-23T18:28:43.433077] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-23T18:28:43.947765] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-23T18:28:44.202229] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-09. [2025-09-23T18:28:45.002168] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-05. [2025-09-23T18:28:45.173586] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-23T18:28:45.802233] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-08. [2025-09-23T18:28:45.943343] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-23T18:28:45.953627] [INFO ] [REMOTE ] DX: Full fetch complete (75315 records). [2025-09-23T18:28:45.953835] [DEBUG] [VALIDATOR ] DX: Validating primary data. [2025-09-23T18:28:46.364995] [DEBUG] [VALIDATOR ] DX: All expected trading days are present. [2025-09-23T18:28:46.365115] [DEBUG] [VALIDATOR ] DX: Primary data validation passed. [2025-09-23T18:28:46.365998] [INFO ] [MAIN ] DX: Fetched primary data is valid. [2025-09-23T18:28:46.366063] [DEBUG] [LOCAL ] DX: Saving primary data. [2025-09-23T18:28:46.368939] [DEBUG] [LOCAL ] DX: Trimmed 75315 records to 52482 (keeping 200 days of data) [2025-09-23T18:28:46.605190] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-01. [2025-09-23T18:28:46.699327] [DEBUG] [LOCAL ] DX: Primary data saved (52482 records). [2025-09-23T18:28:46.699473] [INFO ] [MAIN ] DX: Full history saved. [2025-09-23T18:28:46.699596] [INFO ] [MAIN ] Update Progress: 671/2372 symbols completed. DX took 38.3s. Estimated remaining: 3h 44m 55s. Rate: 7.6 symbols/min [2025-09-23T18:28:46.873564] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:28:46.909820] [DEBUG] [LOCAL ] E: Loaded 33511 existing records from primary storage. [2025-09-23T18:28:46.909978] [INFO ] [MAIN ] E: Loaded 33511 existing records. [2025-09-23T18:28:47.118919] [WARN ] [MAIN ] E: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:28:47.121773] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-23T18:28:47.129850] [INFO ] [MAIN ] E: Wiping existing primary data before full refresh. [2025-09-23T18:28:47.130258] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-09-23T18:28:47.131769] [DEBUG] [LOCAL ] E: Deleted primary data file. [2025-09-23T18:28:47.131835] [INFO ] [MAIN ] E: Starting full primary refresh. [2025-09-23T18:28:47.407354] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-06. [2025-09-23T18:28:47.446556] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-23T18:28:47.540784] [INFO ] [REMOTE ] E: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:28:47.584049] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-23T18:28:48.202225] [INFO ] [REMOTE ] E: Fetching primary data for 2024-12. [2025-09-23T18:28:48.959890] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-23T18:28:49.002155] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-07. [2025-09-23T18:28:49.787481] [INFO ] [REMOTE ] E: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-23T18:28:49.802151] [INFO ] [REMOTE ] E: Fetching primary data for 2025-01. [2025-09-23T18:28:50.602212] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-02. [2025-09-23T18:28:50.712042] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-23T18:28:50.768501] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-23T18:28:51.402194] [INFO ] [REMOTE ] E: Fetching primary data for 2025-02. [2025-09-23T18:28:51.943103] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-23T18:28:52.202205] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-08. [2025-09-23T18:28:52.447194] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-23T18:28:53.002261] [INFO ] [REMOTE ] E: Fetching primary data for 2025-03. [2025-09-23T18:28:53.638362] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-23T18:28:53.802202] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-09. [2025-09-23T18:28:54.475733] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-23T18:28:54.602190] [INFO ] [REMOTE ] E: Fetching primary data for 2025-04. [2025-09-23T18:28:55.402219] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-09. [2025-09-23T18:28:55.819744] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-23T18:28:55.844201] [INFO ] [REMOTE ] DXYZ: Full fetch complete (58200 records). [2025-09-23T18:28:55.854763] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-23T18:28:55.853556] [DEBUG] [VALIDATOR ] DXYZ: Validating primary data. [2025-09-23T18:28:56.209125] [INFO ] [REMOTE ] E: Fetching primary data for 2025-05. [2025-09-23T18:28:56.269309] [DEBUG] [VALIDATOR ] DXYZ: All expected trading days are present. [2025-09-23T18:28:56.269395] [DEBUG] [VALIDATOR ] DXYZ: Primary data validation passed. [2025-09-23T18:28:56.270233] [INFO ] [MAIN ] DXYZ: Fetched primary data is valid. [2025-09-23T18:28:56.270334] [DEBUG] [LOCAL ] DXYZ: Saving primary data. [2025-09-23T18:28:56.271605] [DEBUG] [LOCAL ] DXYZ: Trimmed 58200 records to 36762 (keeping 200 days of data) [2025-09-23T18:28:56.491422] [DEBUG] [LOCAL ] DXYZ: Primary data saved (36762 records). [2025-09-23T18:28:56.491566] [INFO ] [MAIN ] DXYZ: Full history saved. [2025-09-23T18:28:56.491672] [INFO ] [MAIN ] Update Progress: 672/2372 symbols completed. DXYZ took 28.8s. Estimated remaining: 3h 44m 52s. Rate: 7.6 symbols/min [2025-09-23T18:28:56.659739] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:28:56.700443] [DEBUG] [LOCAL ] EAF: Loaded 43968 existing records from primary storage. [2025-09-23T18:28:56.700604] [INFO ] [MAIN ] EAF: Loaded 43968 existing records. [2025-09-23T18:28:56.883109] [WARN ] [MAIN ] EAF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:28:56.883550] [INFO ] [MAIN ] EAF: Wiping existing primary data before full refresh. [2025-09-23T18:28:56.883614] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-09-23T18:28:56.884733] [DEBUG] [LOCAL ] EAF: Deleted primary data file. [2025-09-23T18:28:56.884806] [INFO ] [MAIN ] EAF: Starting full primary refresh. [2025-09-23T18:28:57.006893] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-03. [2025-09-23T18:28:57.019842] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-23T18:28:57.099724] [INFO ] [REMOTE ] DXC: Full fetch complete (68551 records). [2025-09-23T18:28:57.140115] [DEBUG] [VALIDATOR ] DXC: Validating primary data. [2025-09-23T18:28:57.420101] [INFO ] [REMOTE ] EAF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:28:57.712634] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-23T18:28:57.736424] [DEBUG] [VALIDATOR ] DXC: All expected trading days are present. [2025-09-23T18:28:57.736621] [DEBUG] [VALIDATOR ] DXC: Primary data validation passed. [2025-09-23T18:28:57.737510] [INFO ] [MAIN ] DXC: Fetched primary data is valid. [2025-09-23T18:28:57.737591] [DEBUG] [LOCAL ] DXC: Saving primary data. [2025-09-23T18:28:57.739997] [DEBUG] [LOCAL ] DXC: Trimmed 68551 records to 49661 (keeping 200 days of data) [2025-09-23T18:28:57.803088] [INFO ] [REMOTE ] EAF: Fetching primary data for 2024-12. [2025-09-23T18:28:58.047375] [DEBUG] [LOCAL ] DXC: Primary data saved (49661 records). [2025-09-23T18:28:58.047527] [INFO ] [MAIN ] DXC: Full history saved. [2025-09-23T18:28:58.047687] [INFO ] [MAIN ] Update Progress: 673/2372 symbols completed. DXC took 38.9s. Estimated remaining: 3h 44m 28s. Rate: 7.6 symbols/min [2025-09-23T18:28:58.218412] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:28:58.226227] [DEBUG] [LOCAL ] EAI: Loaded 3977 existing records from primary storage. [2025-09-23T18:28:58.226376] [INFO ] [MAIN ] EAI: Loaded 3977 existing records. [2025-09-23T18:28:58.417547] [WARN ] [MAIN ] EAI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:28:58.418134] [INFO ] [MAIN ] EAI: Wiping existing primary data before full refresh. [2025-09-23T18:28:58.418268] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-09-23T18:28:58.418571] [DEBUG] [LOCAL ] EAI: Deleted primary data file. [2025-09-23T18:28:58.418632] [INFO ] [MAIN ] EAI: Starting full primary refresh. [2025-09-23T18:28:58.621479] [INFO ] [REMOTE ] E: Fetching primary data for 2025-06. [2025-09-23T18:28:58.632825] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-23T18:28:58.820444] [INFO ] [REMOTE ] EAI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:28:59.260792] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-23T18:28:59.402188] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-01. [2025-09-23T18:28:59.808154] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-23T18:29:00.202196] [INFO ] [REMOTE ] E: Fetching primary data for 2025-07. [2025-09-23T18:29:00.642164] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-23T18:29:01.002231] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-04. [2025-09-23T18:29:01.625274] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-23T18:29:01.802223] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-02. [2025-09-23T18:29:02.513046] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-23T18:29:02.602206] [INFO ] [REMOTE ] EAI: Fetching primary data for 2024-12. [2025-09-23T18:29:02.985621] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-23T18:29:03.173088] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-23T18:29:03.402196] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-01. [2025-09-23T18:29:04.020626] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-23T18:29:04.202195] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-02. [2025-09-23T18:29:04.551046] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-23T18:29:05.002253] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-03. [2025-09-23T18:29:05.435142] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-23T18:29:05.802181] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-03. [2025-09-23T18:29:06.602212] [INFO ] [REMOTE ] E: Fetching primary data for 2025-08. [2025-09-23T18:29:07.390010] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-23T18:29:07.402152] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-04. [2025-09-23T18:29:07.587382] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-23T18:29:08.202203] [INFO ] [REMOTE ] E: Fetching primary data for 2025-09. [2025-09-23T18:29:08.956029] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-23T18:29:09.002232] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-05. [2025-09-23T18:29:09.125783] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-23T18:29:09.130976] [INFO ] [REMOTE ] E: Full fetch complete (48490 records). [2025-09-23T18:29:09.131088] [DEBUG] [VALIDATOR ] E: Validating primary data. [2025-09-23T18:29:09.558976] [DEBUG] [VALIDATOR ] E: All expected trading days are present. [2025-09-23T18:29:09.559067] [DEBUG] [VALIDATOR ] E: Primary data validation passed. [2025-09-23T18:29:09.559784] [INFO ] [MAIN ] E: Fetched primary data is valid. [2025-09-23T18:29:09.559848] [DEBUG] [LOCAL ] E: Saving primary data. [2025-09-23T18:29:09.560908] [DEBUG] [LOCAL ] E: Trimmed 48490 records to 33441 (keeping 200 days of data) [2025-09-23T18:29:09.787605] [DEBUG] [LOCAL ] E: Primary data saved (33441 records). [2025-09-23T18:29:09.787816] [INFO ] [MAIN ] E: Full history saved. [2025-09-23T18:29:09.787950] [INFO ] [MAIN ] Update Progress: 674/2372 symbols completed. E took 23.1s. Estimated remaining: 3h 44m 30s. Rate: 7.6 symbols/min [2025-09-23T18:29:09.812398] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-04. [2025-09-23T18:29:09.975218] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:29:10.006272] [DEBUG] [LOCAL ] EARN: Loaded 30462 existing records from primary storage. [2025-09-23T18:29:10.006445] [INFO ] [MAIN ] EARN: Loaded 30462 existing records. [2025-09-23T18:29:10.241257] [WARN ] [MAIN ] EARN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:29:10.241525] [INFO ] [MAIN ] EARN: Wiping existing primary data before full refresh. [2025-09-23T18:29:10.241624] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-09-23T18:29:10.242305] [DEBUG] [LOCAL ] EARN: Deleted primary data file. [2025-09-23T18:29:10.242365] [INFO ] [MAIN ] EARN: Starting full primary refresh. [2025-09-23T18:29:10.386804] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-23T18:29:10.604266] [INFO ] [REMOTE ] EARN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:29:10.604514] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-05. [2025-09-23T18:29:10.724957] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-23T18:29:11.001529] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-23T18:29:11.402211] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-06. [2025-09-23T18:29:11.756322] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-23T18:29:12.202250] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-06. [2025-09-23T18:29:13.002214] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-05. [2025-09-23T18:29:13.570771] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-23T18:29:13.802197] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-07. [2025-09-23T18:29:14.064006] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-23T18:29:14.602237] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-07. [2025-09-23T18:29:15.039453] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-23T18:29:15.402184] [INFO ] [REMOTE ] EARN: Fetching primary data for 2024-12. [2025-09-23T18:29:15.443461] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-23T18:29:16.202255] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-08. [2025-09-23T18:29:16.567512] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-23T18:29:16.638263] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-23T18:29:17.002216] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-08. [2025-09-23T18:29:17.802213] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-01. [2025-09-23T18:29:18.242047] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-23T18:29:18.602212] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-06. [2025-09-23T18:29:18.880446] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-23T18:29:19.402256] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-09. [2025-09-23T18:29:19.900854] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-23T18:29:20.202223] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-09. [2025-09-23T18:29:20.473314] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-23T18:29:20.481439] [INFO ] [REMOTE ] EAF: Full fetch complete (64893 records). [2025-09-23T18:29:20.481624] [DEBUG] [VALIDATOR ] EAF: Validating primary data. [2025-09-23T18:29:20.786192] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-23T18:29:20.798461] [INFO ] [REMOTE ] EAI: Full fetch complete (6143 records). [2025-09-23T18:29:20.808884] [DEBUG] [VALIDATOR ] EAI: Validating primary data. [2025-09-23T18:29:21.006511] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-02. [2025-09-23T18:29:21.011854] [DEBUG] [VALIDATOR ] EAF: All expected trading days are present. [2025-09-23T18:29:21.018015] [DEBUG] [VALIDATOR ] EAF: Primary data validation passed. [2025-09-23T18:29:21.023936] [INFO ] [MAIN ] EAF: Fetched primary data is valid. [2025-09-23T18:29:21.048569] [DEBUG] [LOCAL ] EAF: Saving primary data. [2025-09-23T18:29:21.085216] [DEBUG] [LOCAL ] EAF: Trimmed 64893 records to 43932 (keeping 200 days of data) [2025-09-23T18:29:21.353187] [DEBUG] [VALIDATOR ] EAI: All expected trading days are present. [2025-09-23T18:29:21.353872] [DEBUG] [VALIDATOR ] EAI: Primary data validation passed. [2025-09-23T18:29:21.354923] [INFO ] [MAIN ] EAI: Fetched primary data is valid. [2025-09-23T18:29:21.355253] [DEBUG] [LOCAL ] EAI: Saving primary data. [2025-09-23T18:29:21.356936] [DEBUG] [LOCAL ] EAI: Trimmed 6143 records to 3975 (keeping 200 days of data) [2025-09-23T18:29:21.384677] [DEBUG] [LOCAL ] EAI: Primary data saved (3975 records). [2025-09-23T18:29:21.388252] [INFO ] [MAIN ] EAI: Full history saved. [2025-09-23T18:29:21.388630] [INFO ] [MAIN ] Update Progress: 675/2372 symbols completed. EAI took 23.3s. Estimated remaining: 3h 44m 31s. Rate: 7.6 symbols/min [2025-09-23T18:29:21.572817] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:29:21.574010] [DEBUG] [LOCAL ] EAT: No existing data file found in primary storage. [2025-09-23T18:29:21.574398] [WARN ] [MAIN ] EAT: No existing data found, performing full refresh instead. [2025-09-23T18:29:21.574909] [INFO ] [MAIN ] EAT: Wiping existing primary data before full refresh. [2025-09-23T18:29:21.576304] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-09-23T18:29:21.577522] [DEBUG] [LOCAL ] EAT: No primary data file found to delete. [2025-09-23T18:29:21.578126] [INFO ] [MAIN ] EAT: Starting full primary refresh. [2025-09-23T18:29:21.806679] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-07. [2025-09-23T18:29:22.094205] [INFO ] [REMOTE ] EAT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:29:22.130164] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-23T18:29:22.173885] [DEBUG] [LOCAL ] EAF: Primary data saved (43932 records). [2025-09-23T18:29:22.174039] [INFO ] [MAIN ] EAF: Full history saved. [2025-09-23T18:29:22.174157] [INFO ] [MAIN ] Update Progress: 676/2372 symbols completed. EAF took 25.7s. Estimated remaining: 3h 44m 5s. Rate: 7.6 symbols/min [2025-09-23T18:29:22.345284] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:29:22.381568] [DEBUG] [LOCAL ] EB: Loaded 37957 existing records from primary storage. [2025-09-23T18:29:22.381763] [INFO ] [MAIN ] EB: Loaded 37957 existing records. [2025-09-23T18:29:22.561857] [WARN ] [MAIN ] EB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:29:22.562129] [INFO ] [MAIN ] EB: Wiping existing primary data before full refresh. [2025-09-23T18:29:22.562177] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-09-23T18:29:22.563020] [DEBUG] [LOCAL ] EB: Deleted primary data file. [2025-09-23T18:29:22.563082] [INFO ] [MAIN ] EB: Starting full primary refresh. [2025-09-23T18:29:22.608325] [INFO ] [REMOTE ] EAT: Fetching primary data for 2024-12. [2025-09-23T18:29:22.941063] [INFO ] [REMOTE ] EB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:29:22.967256] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-23T18:29:23.402261] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-08. [2025-09-23T18:29:24.175589] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-23T18:29:24.202169] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-03. [2025-09-23T18:29:24.940756] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-23T18:29:25.002234] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-09. [2025-09-23T18:29:25.749136] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-23T18:29:25.802161] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-04. [2025-09-23T18:29:26.135486] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-23T18:29:26.140759] [INFO ] [REMOTE ] DY: Full fetch complete (44968 records). [2025-09-23T18:29:26.140863] [DEBUG] [VALIDATOR ] DY: Validating primary data. [2025-09-23T18:29:26.550944] [DEBUG] [VALIDATOR ] DY: All expected trading days are present. [2025-09-23T18:29:26.551022] [DEBUG] [VALIDATOR ] DY: Primary data validation passed. [2025-09-23T18:29:26.551624] [INFO ] [MAIN ] DY: Fetched primary data is valid. [2025-09-23T18:29:26.551697] [DEBUG] [LOCAL ] DY: Saving primary data. [2025-09-23T18:29:26.552620] [DEBUG] [LOCAL ] DY: Trimmed 44968 records to 29868 (keeping 200 days of data) [2025-09-23T18:29:26.607280] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-01. [2025-09-23T18:29:26.743256] [DEBUG] [LOCAL ] DY: Primary data saved (29868 records). [2025-09-23T18:29:26.743397] [INFO ] [MAIN ] DY: Full history saved. [2025-09-23T18:29:26.743485] [INFO ] [MAIN ] Update Progress: 677/2372 symbols completed. DY took 45.3s. Estimated remaining: 3h 43m 49s. Rate: 7.6 symbols/min [2025-09-23T18:29:27.402168] [INFO ] [REMOTE ] EB: Fetching primary data for 2024-12. [2025-09-23T18:29:27.498133] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-23T18:29:28.202261] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-05. [2025-09-23T18:29:28.428523] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-23T18:29:28.542877] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-23T18:29:29.002251] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-01. [2025-09-23T18:29:29.209057] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-23T18:29:29.802203] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-06. [2025-09-23T18:29:30.092274] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-23T18:29:30.601669] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-23T18:29:30.606719] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-02. [2025-09-23T18:29:31.402210] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-07. [2025-09-23T18:29:32.202216] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-02. [2025-09-23T18:29:32.233947] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-23T18:29:32.433230] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-23T18:29:33.002194] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-08. [2025-09-23T18:29:33.797768] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-23T18:29:33.805156] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-03. [2025-09-23T18:29:33.855764] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-23T18:29:34.602194] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-03. [2025-09-23T18:29:35.333453] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-23T18:29:35.402227] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-09. [2025-09-23T18:29:35.838332] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-23T18:29:36.196821] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-23T18:29:36.201183] [INFO ] [REMOTE ] EARN: Full fetch complete (46505 records). [2025-09-23T18:29:36.201332] [DEBUG] [VALIDATOR ] EARN: Validating primary data. [2025-09-23T18:29:36.207426] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-04. [2025-09-23T18:29:36.614311] [DEBUG] [VALIDATOR ] EARN: All expected trading days are present. [2025-09-23T18:29:36.614399] [DEBUG] [VALIDATOR ] EARN: Primary data validation passed. [2025-09-23T18:29:36.615101] [INFO ] [MAIN ] EARN: Fetched primary data is valid. [2025-09-23T18:29:36.615167] [DEBUG] [LOCAL ] EARN: Saving primary data. [2025-09-23T18:29:36.616232] [DEBUG] [LOCAL ] EARN: Trimmed 46505 records to 30366 (keeping 200 days of data) [2025-09-23T18:29:36.790500] [DEBUG] [LOCAL ] EARN: Primary data saved (30366 records). [2025-09-23T18:29:36.790638] [INFO ] [MAIN ] EARN: Full history saved. [2025-09-23T18:29:36.790771] [INFO ] [MAIN ] Update Progress: 678/2372 symbols completed. EARN took 27.0s. Estimated remaining: 3h 43m 46s. Rate: 7.6 symbols/min [2025-09-23T18:29:37.002215] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-04. [2025-09-23T18:29:37.744327] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-23T18:29:37.802254] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-05. [2025-09-23T18:29:38.473441] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-23T18:29:38.602200] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-05. [2025-09-23T18:29:39.186483] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-23T18:29:39.402180] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-06. [2025-09-23T18:29:40.091195] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-23T18:29:40.202231] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-06. [2025-09-23T18:29:40.456057] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-23T18:29:41.002204] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-07. [2025-09-23T18:29:41.514302] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-23T18:29:41.802254] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-07. [2025-09-23T18:29:42.060138] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-23T18:29:42.602202] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-08. [2025-09-23T18:29:43.496055] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-23T18:29:43.507089] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-08. [2025-09-23T18:29:43.675185] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-23T18:29:44.202215] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-09. [2025-09-23T18:29:44.872339] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-23T18:29:45.002253] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-09. [2025-09-23T18:29:45.150976] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-23T18:29:45.158104] [INFO ] [REMOTE ] EB: Full fetch complete (57006 records). [2025-09-23T18:29:45.158316] [DEBUG] [VALIDATOR ] EB: Validating primary data. [2025-09-23T18:29:45.782340] [DEBUG] [VALIDATOR ] EB: All expected trading days are present. [2025-09-23T18:29:45.782467] [DEBUG] [VALIDATOR ] EB: Primary data validation passed. [2025-09-23T18:29:45.783760] [INFO ] [MAIN ] EB: Fetched primary data is valid. [2025-09-23T18:29:45.783846] [DEBUG] [LOCAL ] EB: Saving primary data. [2025-09-23T18:29:45.785690] [DEBUG] [LOCAL ] EB: Trimmed 57006 records to 37872 (keeping 200 days of data) [2025-09-23T18:29:46.089918] [DEBUG] [LOCAL ] EB: Primary data saved (37872 records). [2025-09-23T18:29:46.090127] [INFO ] [MAIN ] EB: Full history saved. [2025-09-23T18:29:46.090237] [INFO ] [MAIN ] Update Progress: 679/2372 symbols completed. EB took 23.9s. Estimated remaining: 3h 43m 41s. Rate: 7.6 symbols/min [2025-09-23T18:29:46.703195] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-23T18:29:46.712473] [INFO ] [REMOTE ] EAT: Full fetch complete (71389 records). [2025-09-23T18:29:46.712674] [DEBUG] [VALIDATOR ] EAT: Validating primary data. [2025-09-23T18:29:46.713639] [FATAL] [VALIDATOR ] EAT: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:29:46.713762] [FATAL] [MAIN ] EAT: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:29:46.713811] [WARN ] [MAIN ] EAT: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:29:46.713855] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-09-23T18:29:46.713950] [DEBUG] [LOCAL ] EAT: No primary data file found to delete. [2025-09-23T18:29:46.713997] [INFO ] [LOCAL ] EAT: Starting deletion of derivative data. [2025-09-23T18:29:46.714056] [DEBUG] [LOCAL ] EAT: No derivative data file found to delete. [2025-09-23T18:29:46.714142] [INFO ] [MAIN ] Update Progress: 680/2372 symbols completed. EAT took 25.3s. Estimated remaining: 3h 43m 15s. Rate: 7.6 symbols/min [2025-09-23T18:29:47.330865] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:29:47.476138] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:29:47.476454] [DEBUG] [LOCAL ] EBR: No existing data file found in primary storage. [2025-09-23T18:29:47.471150] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:29:47.476595] [WARN ] [MAIN ] EBR: No existing data found, performing full refresh instead. [2025-09-23T18:29:47.474880] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:29:47.476934] [INFO ] [MAIN ] EBR: Wiping existing primary data before full refresh. [2025-09-23T18:29:47.477305] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-09-23T18:29:47.477683] [DEBUG] [LOCAL ] EBS: No existing data file found in primary storage. [2025-09-23T18:29:47.477807] [DEBUG] [LOCAL ] EBR: No primary data file found to delete. [2025-09-23T18:29:47.477876] [WARN ] [MAIN ] EBS: No existing data found, performing full refresh instead. [2025-09-23T18:29:47.478198] [INFO ] [MAIN ] EBS: Wiping existing primary data before full refresh. [2025-09-23T18:29:47.478284] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-09-23T18:29:47.478369] [INFO ] [MAIN ] EBR: Starting full primary refresh. [2025-09-23T18:29:47.478540] [DEBUG] [LOCAL ] EBS: No primary data file found to delete. [2025-09-23T18:29:47.478749] [INFO ] [MAIN ] EBS: Starting full primary refresh. [2025-09-23T18:29:47.847736] [DEBUG] [LOCAL ] EBF: Loaded 19545 existing records from primary storage. [2025-09-23T18:29:47.919406] [INFO ] [MAIN ] EBF: Loaded 19545 existing records. [2025-09-23T18:29:48.035875] [DEBUG] [LOCAL ] EC: Loaded 49397 existing records from primary storage. [2025-09-23T18:29:48.138562] [INFO ] [MAIN ] EC: Loaded 49397 existing records. [2025-09-23T18:29:48.381134] [INFO ] [REMOTE ] EBR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:29:48.408227] [INFO ] [REMOTE ] EBR: Fetching primary data for 2024-12. [2025-09-23T18:29:48.578740] [INFO ] [REMOTE ] EBS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:29:48.629977] [INFO ] [REMOTE ] EBS: Fetching primary data for 2024-12. [2025-09-23T18:29:48.630175] [WARN ] [MAIN ] EBF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:29:48.649068] [INFO ] [MAIN ] EBF: Wiping existing primary data before full refresh. [2025-09-23T18:29:48.668963] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-09-23T18:29:48.676530] [WARN ] [MAIN ] EC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:29:48.676829] [INFO ] [MAIN ] EC: Wiping existing primary data before full refresh. [2025-09-23T18:29:48.676884] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-09-23T18:29:48.676976] [DEBUG] [LOCAL ] EBF: Deleted primary data file. [2025-09-23T18:29:48.677058] [INFO ] [MAIN ] EBF: Starting full primary refresh. [2025-09-23T18:29:48.712726] [DEBUG] [LOCAL ] EC: Deleted primary data file. [2025-09-23T18:29:48.740335] [INFO ] [MAIN ] EC: Starting full primary refresh. [2025-09-23T18:29:49.396569] [INFO ] [REMOTE ] EBF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:29:49.405228] [INFO ] [REMOTE ] EBF: Fetching primary data for 2024-12. [2025-09-23T18:29:49.433987] [INFO ] [REMOTE ] EC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:29:49.434300] [INFO ] [REMOTE ] EC: Fetching primary data for 2024-12. [2025-09-23T18:29:49.890410] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-23T18:29:49.900342] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-01. [2025-09-23T18:29:50.139909] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-23T18:29:50.143607] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-01. [2025-09-23T18:29:50.265262] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-23T18:29:50.602203] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-01. [2025-09-23T18:29:50.793858] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-23T18:29:50.933585] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-23T18:29:51.048731] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-23T18:29:51.402255] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-02. [2025-09-23T18:29:52.137733] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-23T18:29:52.202195] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-02. [2025-09-23T18:29:52.233536] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-23T18:29:53.002205] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-03. [2025-09-23T18:29:53.689766] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-23T18:29:53.765771] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-23T18:29:53.802225] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-02. [2025-09-23T18:29:54.602209] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-01. [2025-09-23T18:29:54.942554] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-23T18:29:55.402232] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-03. [2025-09-23T18:29:56.188973] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-23T18:29:56.202141] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-02. [2025-09-23T18:29:56.708464] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-23T18:29:57.002207] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-04. [2025-09-23T18:29:57.484193] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-23T18:29:57.802205] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-03. [2025-09-23T18:29:58.282080] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-23T18:29:58.602199] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-03. [2025-09-23T18:29:59.153246] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-23T18:29:59.402223] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-04. [2025-09-23T18:29:59.674624] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-23T18:30:00.202193] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-04. [2025-09-23T18:30:00.279438] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-23T18:30:01.002207] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-04. [2025-09-23T18:30:01.802280] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-05. [2025-09-23T18:30:02.364768] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-23T18:30:02.602238] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-05. [2025-09-23T18:30:03.402298] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-05. [2025-09-23T18:30:03.438116] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-09-23T18:30:04.202218] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-05. [2025-09-23T18:30:05.069835] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-05 (3.27 seconds). [2025-09-23T18:30:05.074267] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-06. [2025-09-23T18:30:06.438604] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-05 (3.04 seconds). [2025-09-23T18:30:06.447636] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-06. [2025-09-23T18:30:07.034364] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-23T18:30:07.039461] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-07. [2025-09-23T18:30:07.628982] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-05 (5.03 seconds). [2025-09-23T18:30:07.639979] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-06. [2025-09-23T18:30:07.729078] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-05 (3.53 seconds). [2025-09-23T18:30:07.801506] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-23T18:30:07.845893] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-23T18:30:08.202200] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-07. [2025-09-23T18:30:08.848288] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-23T18:30:09.002184] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-07. [2025-09-23T18:30:09.460848] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-23T18:30:09.802209] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-08. [2025-09-23T18:30:10.381259] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-23T18:30:10.602222] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-08. [2025-09-23T18:30:11.024268] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-23T18:30:11.293113] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-23T18:30:11.402233] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-09. [2025-09-23T18:30:12.202212] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-06. [2025-09-23T18:30:13.002201] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-09. [2025-09-23T18:30:13.756130] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-09-23T18:30:13.759489] [INFO ] [REMOTE ] EBF: Full fetch complete (27400 records). [2025-09-23T18:30:13.759612] [DEBUG] [VALIDATOR ] EBF: Validating primary data. [2025-09-23T18:30:13.825709] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-08. [2025-09-23T18:30:14.139375] [DEBUG] [VALIDATOR ] EBF: All expected trading days are present. [2025-09-23T18:30:14.139470] [DEBUG] [VALIDATOR ] EBF: Primary data validation passed. [2025-09-23T18:30:14.139951] [INFO ] [MAIN ] EBF: Fetched primary data is valid. [2025-09-23T18:30:14.140013] [DEBUG] [LOCAL ] EBF: Saving primary data. [2025-09-23T18:30:14.140892] [DEBUG] [LOCAL ] EBF: Trimmed 27400 records to 19531 (keeping 200 days of data) [2025-09-23T18:30:14.260371] [DEBUG] [LOCAL ] EBF: Primary data saved (19531 records). [2025-09-23T18:30:14.260566] [INFO ] [MAIN ] EBF: Full history saved. [2025-09-23T18:30:14.260695] [INFO ] [MAIN ] Update Progress: 681/2372 symbols completed. EBF took 27.5s. Estimated remaining: 3h 43m 56s. Rate: 7.6 symbols/min [2025-09-23T18:30:14.438272] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:30:14.469554] [DEBUG] [LOCAL ] ECAT: Loaded 29793 existing records from primary storage. [2025-09-23T18:30:14.469804] [INFO ] [MAIN ] ECAT: Loaded 29793 existing records. [2025-09-23T18:30:14.615118] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-09-23T18:30:14.677536] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-07. [2025-09-23T18:30:14.702303] [WARN ] [MAIN ] ECAT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:30:14.702614] [INFO ] [MAIN ] ECAT: Wiping existing primary data before full refresh. [2025-09-23T18:30:14.702699] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-09-23T18:30:14.703778] [DEBUG] [LOCAL ] ECAT: Deleted primary data file. [2025-09-23T18:30:14.703844] [INFO ] [MAIN ] ECAT: Starting full primary refresh. [2025-09-23T18:30:15.081942] [INFO ] [REMOTE ] ECAT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:30:15.402179] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2024-12. [2025-09-23T18:30:15.568458] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-09-23T18:30:15.576462] [INFO ] [REMOTE ] EBR: Full fetch complete (62800 records). [2025-09-23T18:30:15.576720] [DEBUG] [VALIDATOR ] EBR: Validating primary data. [2025-09-23T18:30:15.963964] [DEBUG] [VALIDATOR ] EBR: All expected trading days are present. [2025-09-23T18:30:15.964059] [DEBUG] [VALIDATOR ] EBR: Primary data validation passed. [2025-09-23T18:30:15.964823] [INFO ] [MAIN ] EBR: Fetched primary data is valid. [2025-09-23T18:30:15.964887] [DEBUG] [LOCAL ] EBR: Saving primary data. [2025-09-23T18:30:15.966311] [DEBUG] [LOCAL ] EBR: Trimmed 62800 records to 43083 (keeping 200 days of data) [2025-09-23T18:30:16.219048] [DEBUG] [LOCAL ] EBR: Primary data saved (43083 records). [2025-09-23T18:30:16.219184] [INFO ] [MAIN ] EBR: Full history saved. [2025-09-23T18:30:16.219262] [INFO ] [MAIN ] Update Progress: 682/2372 symbols completed. EBR took 29.5s. Estimated remaining: 3h 43m 33s. Rate: 7.6 symbols/min [2025-09-23T18:30:16.393203] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:30:16.393459] [DEBUG] [LOCAL ] ECC: No existing data file found in primary storage. [2025-09-23T18:30:16.393540] [WARN ] [MAIN ] ECC: No existing data found, performing full refresh instead. [2025-09-23T18:30:16.393780] [INFO ] [MAIN ] ECC: Wiping existing primary data before full refresh. [2025-09-23T18:30:16.393858] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-09-23T18:30:16.393949] [DEBUG] [LOCAL ] ECC: No primary data file found to delete. [2025-09-23T18:30:16.394026] [INFO ] [MAIN ] ECC: Starting full primary refresh. [2025-09-23T18:30:16.783095] [INFO ] [REMOTE ] ECC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:30:16.783853] [INFO ] [REMOTE ] ECC: Fetching primary data for 2024-12. [2025-09-23T18:30:16.827608] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-23T18:30:16.848428] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-23T18:30:16.907027] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-08 (3.08 seconds). [2025-09-23T18:30:17.002183] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-09. [2025-09-23T18:30:17.802197] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-01. [2025-09-23T18:30:18.171058] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-23T18:30:18.442818] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-23T18:30:18.450279] [INFO ] [REMOTE ] EBS: Full fetch complete (67383 records). [2025-09-23T18:30:18.450398] [DEBUG] [VALIDATOR ] EBS: Validating primary data. [2025-09-23T18:30:18.629570] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-08. [2025-09-23T18:30:18.856699] [DEBUG] [VALIDATOR ] EBS: All expected trading days are present. [2025-09-23T18:30:18.856809] [DEBUG] [VALIDATOR ] EBS: Primary data validation passed. [2025-09-23T18:30:18.858082] [INFO ] [MAIN ] EBS: Fetched primary data is valid. [2025-09-23T18:30:18.858148] [DEBUG] [LOCAL ] EBS: Saving primary data. [2025-09-23T18:30:18.861614] [DEBUG] [LOCAL ] EBS: Trimmed 67383 records to 46807 (keeping 200 days of data) [2025-09-23T18:30:19.072811] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-23T18:30:19.154215] [DEBUG] [LOCAL ] EBS: Primary data saved (46807 records). [2025-09-23T18:30:19.154371] [INFO ] [MAIN ] EBS: Full history saved. [2025-09-23T18:30:19.154459] [INFO ] [MAIN ] Update Progress: 683/2372 symbols completed. EBS took 32.4s. Estimated remaining: 3h 43m 13s. Rate: 7.6 symbols/min [2025-09-23T18:30:19.322919] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:30:19.323094] [DEBUG] [LOCAL ] ECCC: No existing data file found in primary storage. [2025-09-23T18:30:19.323149] [WARN ] [MAIN ] ECCC: No existing data found, performing full refresh instead. [2025-09-23T18:30:19.323302] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-09-23T18:30:19.323348] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-09-23T18:30:19.323388] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-09-23T18:30:19.323420] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-09-23T18:30:19.407450] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-01. [2025-09-23T18:30:19.686271] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:30:20.202249] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-02. [2025-09-23T18:30:20.392009] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-23T18:30:20.861514] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-23T18:30:21.002202] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-02. [2025-09-23T18:30:21.187053] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-23T18:30:21.802254] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-09. [2025-09-23T18:30:22.074173] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-23T18:30:22.602248] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2024-12. [2025-09-23T18:30:23.043327] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-23T18:30:23.070420] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-23T18:30:23.078353] [INFO ] [REMOTE ] EC: Full fetch complete (71988 records). [2025-09-23T18:30:23.078509] [DEBUG] [VALIDATOR ] EC: Validating primary data. [2025-09-23T18:30:23.407463] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-01. [2025-09-23T18:30:23.511899] [DEBUG] [VALIDATOR ] EC: All expected trading days are present. [2025-09-23T18:30:23.511989] [DEBUG] [VALIDATOR ] EC: Primary data validation passed. [2025-09-23T18:30:23.512855] [INFO ] [MAIN ] EC: Fetched primary data is valid. [2025-09-23T18:30:23.512964] [DEBUG] [LOCAL ] EC: Saving primary data. [2025-09-23T18:30:23.516516] [DEBUG] [LOCAL ] EC: Trimmed 71988 records to 49369 (keeping 200 days of data) [2025-09-23T18:30:23.805200] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-23T18:30:23.817305] [DEBUG] [LOCAL ] EC: Primary data saved (49369 records). [2025-09-23T18:30:23.817470] [INFO ] [MAIN ] EC: Full history saved. [2025-09-23T18:30:23.817602] [INFO ] [MAIN ] Update Progress: 684/2372 symbols completed. EC took 37.1s. Estimated remaining: 3h 42m 57s. Rate: 7.6 symbols/min [2025-09-23T18:30:24.005823] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:30:24.006245] [DEBUG] [LOCAL ] ECCU: No existing data file found in primary storage. [2025-09-23T18:30:24.006302] [WARN ] [MAIN ] ECCU: No existing data found, performing full refresh instead. [2025-09-23T18:30:24.006572] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-09-23T18:30:24.006663] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-09-23T18:30:24.006733] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-09-23T18:30:24.006778] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-09-23T18:30:24.209593] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-03. [2025-09-23T18:30:24.380384] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:30:25.002224] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2024-12. [2025-09-23T18:30:25.802208] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-09-23T18:30:25.815776] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-23T18:30:26.602194] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-03. [2025-09-23T18:30:26.928006] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-23T18:30:26.982507] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-03 (2.77 seconds). [2025-09-23T18:30:27.402345] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-01. [2025-09-23T18:30:28.017754] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-23T18:30:28.044582] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-23T18:30:28.202153] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-09-23T18:30:28.556311] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-23T18:30:29.002195] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-09-23T18:30:29.336598] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-23T18:30:29.802269] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-09-23T18:30:30.144287] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-23T18:30:30.602199] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-04. [2025-09-23T18:30:31.402193] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-04. [2025-09-23T18:30:31.533120] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-23T18:30:32.202186] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-09-23T18:30:32.776929] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-23T18:30:32.814216] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-23T18:30:33.002223] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-09-23T18:30:33.354251] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-23T18:30:33.802197] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-09-23T18:30:34.252814] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-23T18:30:34.602205] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-05. [2025-09-23T18:30:35.402191] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-05. [2025-09-23T18:30:36.202169] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-09-23T18:30:36.231235] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-23T18:30:36.292046] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-23T18:30:36.588866] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-23T18:30:37.002199] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-06. [2025-09-23T18:30:37.802206] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-06. [2025-09-23T18:30:38.043908] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-23T18:30:38.602250] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-09-23T18:30:39.070908] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-23T18:30:39.135584] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-23T18:30:39.402242] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-09-23T18:30:39.687941] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-09-23T18:30:40.202211] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-07. [2025-09-23T18:30:41.002220] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-09-23T18:30:41.371996] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-23T18:30:41.722508] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-23T18:30:41.802177] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-08. [2025-09-23T18:30:42.602195] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-07. [2025-09-23T18:30:42.664820] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-23T18:30:43.402196] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-09-23T18:30:43.813742] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-23T18:30:43.814710] [INFO ] [REMOTE ] ECCU: Full fetch complete (4415 records). [2025-09-23T18:30:43.814783] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-09-23T18:30:44.024860] [WARN ] [VALIDATOR ] ECCU: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-09-23T18:30:44.025285] [FATAL] [MAIN ] ECCU: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:30:44.025466] [WARN ] [MAIN ] ECCU: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:30:44.025548] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-09-23T18:30:44.025693] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-09-23T18:30:44.025750] [INFO ] [LOCAL ] ECCU: Starting deletion of derivative data. [2025-09-23T18:30:44.025809] [DEBUG] [LOCAL ] ECCU: No derivative data file found to delete. [2025-09-23T18:30:44.025964] [INFO ] [MAIN ] Update Progress: 685/2372 symbols completed. ECCU took 20.2s. Estimated remaining: 3h 43m 19s. Rate: 7.6 symbols/min [2025-09-23T18:30:44.200398] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:30:44.200774] [DEBUG] [LOCAL ] ECCW: No existing data file found in primary storage. [2025-09-23T18:30:44.200846] [WARN ] [MAIN ] ECCW: No existing data found, performing full refresh instead. [2025-09-23T18:30:44.201148] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-09-23T18:30:44.201216] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-09-23T18:30:44.201372] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-09-23T18:30:44.201482] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-09-23T18:30:44.206852] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-09. [2025-09-23T18:30:44.359282] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-23T18:30:44.640915] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:30:45.002221] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-08. [2025-09-23T18:30:45.627605] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-23T18:30:45.634336] [INFO ] [REMOTE ] ECAT: Full fetch complete (42519 records). [2025-09-23T18:30:45.634521] [DEBUG] [VALIDATOR ] ECAT: Validating primary data. [2025-09-23T18:30:45.802810] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2024-12. [2025-09-23T18:30:46.029511] [DEBUG] [VALIDATOR ] ECAT: All expected trading days are present. [2025-09-23T18:30:46.029624] [DEBUG] [VALIDATOR ] ECAT: Primary data validation passed. [2025-09-23T18:30:46.031202] [INFO ] [MAIN ] ECAT: Fetched primary data is valid. [2025-09-23T18:30:46.031318] [DEBUG] [LOCAL ] ECAT: Saving primary data. [2025-09-23T18:30:46.035972] [DEBUG] [LOCAL ] ECAT: Trimmed 42519 records to 29687 (keeping 200 days of data) [2025-09-23T18:30:46.239052] [DEBUG] [LOCAL ] ECAT: Primary data saved (29687 records). [2025-09-23T18:30:46.239197] [INFO ] [MAIN ] ECAT: Full history saved. [2025-09-23T18:30:46.239316] [INFO ] [MAIN ] Update Progress: 686/2372 symbols completed. ECAT took 32.0s. Estimated remaining: 3h 42m 57s. Rate: 7.6 symbols/min [2025-09-23T18:30:46.356463] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-23T18:30:46.427993] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:30:46.429530] [DEBUG] [LOCAL ] ECCX: No existing data file found in primary storage. [2025-09-23T18:30:46.429592] [WARN ] [MAIN ] ECCX: No existing data found, performing full refresh instead. [2025-09-23T18:30:46.429831] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-09-23T18:30:46.429885] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-09-23T18:30:46.429930] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-09-23T18:30:46.429985] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-09-23T18:30:46.586387] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-23T18:30:46.614438] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-01. [2025-09-23T18:30:46.870401] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:30:46.943288] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-23T18:30:47.402184] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-09-23T18:30:47.793329] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-23T18:30:48.202226] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-09. [2025-09-23T18:30:49.002207] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-09-23T18:30:49.318548] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-23T18:30:49.700713] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-23T18:30:49.708319] [INFO ] [REMOTE ] ECC: Full fetch complete (61022 records). [2025-09-23T18:30:49.708425] [DEBUG] [VALIDATOR ] ECC: Validating primary data. [2025-09-23T18:30:49.807384] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-09-23T18:30:50.095152] [DEBUG] [VALIDATOR ] ECC: All expected trading days are present. [2025-09-23T18:30:50.095285] [DEBUG] [VALIDATOR ] ECC: Primary data validation passed. [2025-09-23T18:30:50.096044] [INFO ] [MAIN ] ECC: Fetched primary data is valid. [2025-09-23T18:30:50.096105] [DEBUG] [LOCAL ] ECC: Saving primary data. [2025-09-23T18:30:50.097465] [DEBUG] [LOCAL ] ECC: Trimmed 61022 records to 43440 (keeping 200 days of data) [2025-09-23T18:30:50.169937] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-23T18:30:50.365162] [DEBUG] [LOCAL ] ECC: Primary data saved (43440 records). [2025-09-23T18:30:50.365309] [INFO ] [MAIN ] ECC: Full history saved. [2025-09-23T18:30:50.365450] [INFO ] [MAIN ] Update Progress: 687/2372 symbols completed. ECC took 34.1s. Estimated remaining: 3h 42m 40s. Rate: 7.6 symbols/min [2025-09-23T18:30:50.531447] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:30:50.568323] [DEBUG] [LOCAL ] ECG: Loaded 34377 existing records from primary storage. [2025-09-23T18:30:50.568489] [INFO ] [MAIN ] ECG: Loaded 34377 existing records. [2025-09-23T18:30:50.607324] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2024-12. [2025-09-23T18:30:50.761924] [WARN ] [MAIN ] ECG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:30:50.762314] [INFO ] [MAIN ] ECG: Wiping existing primary data before full refresh. [2025-09-23T18:30:50.762386] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-09-23T18:30:50.763530] [DEBUG] [LOCAL ] ECG: Deleted primary data file. [2025-09-23T18:30:50.763830] [INFO ] [MAIN ] ECG: Starting full primary refresh. [2025-09-23T18:30:51.126441] [INFO ] [REMOTE ] ECG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:30:51.277801] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-23T18:30:51.402218] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-01. [2025-09-23T18:30:51.732186] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-23T18:30:52.202246] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-09-23T18:30:52.538608] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-23T18:30:53.002205] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-09-23T18:30:53.337516] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-23T18:30:53.802214] [INFO ] [REMOTE ] ECG: Fetching primary data for 2024-12. [2025-09-23T18:30:54.602188] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-09-23T18:30:54.973762] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-23T18:30:55.007075] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-23T18:30:55.007841] [INFO ] [REMOTE ] ECCC: Full fetch complete (1286 records). [2025-09-23T18:30:55.007922] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-09-23T18:30:55.201234] [WARN ] [VALIDATOR ] ECCC: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-23T18:30:55.201698] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:30:55.201780] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:30:55.201855] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-09-23T18:30:55.201929] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-09-23T18:30:55.201997] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-09-23T18:30:55.202068] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-09-23T18:30:55.202172] [INFO ] [MAIN ] Update Progress: 688/2372 symbols completed. ECCC took 36.0s. Estimated remaining: 3h 42m 25s. Rate: 7.6 symbols/min [2025-09-23T18:30:55.376035] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:30:55.402214] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-09-23T18:30:55.462055] [DEBUG] [LOCAL ] ECL: Loaded 46762 existing records from primary storage. [2025-09-23T18:30:55.462247] [INFO ] [MAIN ] ECL: Loaded 46762 existing records. [2025-09-23T18:30:55.684043] [WARN ] [MAIN ] ECL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:30:55.684312] [INFO ] [MAIN ] ECL: Wiping existing primary data before full refresh. [2025-09-23T18:30:55.684361] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-09-23T18:30:55.685985] [DEBUG] [LOCAL ] ECL: Deleted primary data file. [2025-09-23T18:30:55.686047] [INFO ] [MAIN ] ECL: Starting full primary refresh. [2025-09-23T18:30:55.799476] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-23T18:30:56.081881] [INFO ] [REMOTE ] ECL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:30:56.202206] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-09-23T18:30:56.853232] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-23T18:30:57.002242] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-09-23T18:30:57.730278] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-23T18:30:57.802217] [INFO ] [REMOTE ] ECL: Fetching primary data for 2024-12. [2025-09-23T18:30:58.602254] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-09-23T18:30:58.936615] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-23T18:30:59.231958] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-23T18:30:59.402195] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-01. [2025-09-23T18:31:00.202194] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-01. [2025-09-23T18:31:01.002191] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-09-23T18:31:01.261873] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-09-23T18:31:01.318510] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-23T18:31:01.697489] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-23T18:31:01.802193] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-02. [2025-09-23T18:31:02.602207] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-02. [2025-09-23T18:31:03.402223] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-09-23T18:31:03.583436] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-23T18:31:03.702090] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-23T18:31:03.747688] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-23T18:31:04.202327] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-03. [2025-09-23T18:31:05.002223] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-09-23T18:31:05.356271] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-23T18:31:05.802180] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-09-23T18:31:05.902821] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-23T18:31:06.173816] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-23T18:31:06.602192] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-09-23T18:31:07.005070] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-23T18:31:07.402184] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-03. [2025-09-23T18:31:08.202247] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-09-23T18:31:08.782396] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-23T18:31:08.783337] [INFO ] [REMOTE ] ECCW: Full fetch complete (1421 records). [2025-09-23T18:31:08.783413] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-09-23T18:31:08.976696] [WARN ] [VALIDATOR ] ECCW: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-09-23T18:31:08.976980] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:31:08.977094] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:31:08.977235] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-09-23T18:31:08.977374] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-09-23T18:31:08.977468] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-09-23T18:31:08.977605] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-09-23T18:31:08.977722] [INFO ] [MAIN ] Update Progress: 689/2372 symbols completed. ECCW took 25.0s. Estimated remaining: 3h 42m 31s. Rate: 7.6 symbols/min [2025-09-23T18:31:09.003226] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-09-23T18:31:09.125634] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-23T18:31:09.207826] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:31:09.230864] [DEBUG] [LOCAL ] ECO: Loaded 18495 existing records from primary storage. [2025-09-23T18:31:09.231012] [INFO ] [MAIN ] ECO: Loaded 18495 existing records. [2025-09-23T18:31:09.381037] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-23T18:31:09.416279] [WARN ] [MAIN ] ECO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:31:09.416525] [INFO ] [MAIN ] ECO: Wiping existing primary data before full refresh. [2025-09-23T18:31:09.416573] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-09-23T18:31:09.417503] [DEBUG] [LOCAL ] ECO: Deleted primary data file. [2025-09-23T18:31:09.417563] [INFO ] [MAIN ] ECO: Starting full primary refresh. [2025-09-23T18:31:09.766978] [INFO ] [REMOTE ] ECO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:31:09.802165] [INFO ] [REMOTE ] ECO: Fetching primary data for 2024-12. [2025-09-23T18:31:10.602256] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-09-23T18:31:10.903327] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-23T18:31:11.049216] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-23T18:31:11.402293] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-04. [2025-09-23T18:31:12.202200] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-04. [2025-09-23T18:31:12.576393] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-23T18:31:13.002234] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-09-23T18:31:13.244130] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-09-23T18:31:13.802179] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-05. [2025-09-23T18:31:14.134800] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-23T18:31:14.602209] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-05. [2025-09-23T18:31:14.877332] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-23T18:31:15.402186] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-06. [2025-09-23T18:31:15.901619] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-23T18:31:16.202241] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-01. [2025-09-23T18:31:16.309828] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-23T18:31:17.002217] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-09-23T18:31:17.182585] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-23T18:31:17.547769] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-23T18:31:17.548707] [INFO ] [REMOTE ] ECCX: Full fetch complete (1490 records). [2025-09-23T18:31:17.548778] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-09-23T18:31:17.728575] [WARN ] [VALIDATOR ] ECCX: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-23T18:31:17.728793] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:31:17.728862] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:31:17.728935] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-09-23T18:31:17.728997] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-09-23T18:31:17.729033] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-09-23T18:31:17.729077] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-09-23T18:31:17.729152] [INFO ] [MAIN ] Update Progress: 690/2372 symbols completed. ECCX took 31.5s. Estimated remaining: 3h 42m 25s. Rate: 7.6 symbols/min [2025-09-23T18:31:17.807331] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-07. [2025-09-23T18:31:17.964529] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:31:18.016662] [DEBUG] [LOCAL ] ECVT: Loaded 43080 existing records from primary storage. [2025-09-23T18:31:18.016840] [INFO ] [MAIN ] ECVT: Loaded 43080 existing records. [2025-09-23T18:31:18.208881] [WARN ] [MAIN ] ECVT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:31:18.209127] [INFO ] [MAIN ] ECVT: Wiping existing primary data before full refresh. [2025-09-23T18:31:18.209175] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-09-23T18:31:18.210328] [DEBUG] [LOCAL ] ECVT: Deleted primary data file. [2025-09-23T18:31:18.210393] [INFO ] [MAIN ] ECVT: Starting full primary refresh. [2025-09-23T18:31:18.587316] [INFO ] [REMOTE ] ECVT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:31:18.602165] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2024-12. [2025-09-23T18:31:18.899274] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-23T18:31:19.402221] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-02. [2025-09-23T18:31:19.784847] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-23T18:31:20.202258] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-01. [2025-09-23T18:31:20.257286] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-23T18:31:21.002236] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-06. [2025-09-23T18:31:21.569850] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-23T18:31:21.802251] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-08. [2025-09-23T18:31:22.185557] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-23T18:31:22.602217] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-02. [2025-09-23T18:31:23.136147] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-23T18:31:23.402208] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-07. [2025-09-23T18:31:23.638108] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-23T18:31:24.202261] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-03. [2025-09-23T18:31:24.897746] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-23T18:31:25.002217] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-03. [2025-09-23T18:31:25.354764] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-23T18:31:25.802213] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-08. [2025-09-23T18:31:26.316812] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-23T18:31:26.602236] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-04. [2025-09-23T18:31:27.056149] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-23T18:31:27.402240] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-09. [2025-09-23T18:31:27.785958] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-23T18:31:28.202213] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-05. [2025-09-23T18:31:28.675352] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-23T18:31:28.680531] [INFO ] [REMOTE ] ECG: Full fetch complete (51564 records). [2025-09-23T18:31:28.680663] [DEBUG] [VALIDATOR ] ECG: Validating primary data. [2025-09-23T18:31:29.007311] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-04. [2025-09-23T18:31:29.109144] [DEBUG] [VALIDATOR ] ECG: All expected trading days are present. [2025-09-23T18:31:29.109244] [DEBUG] [VALIDATOR ] ECG: Primary data validation passed. [2025-09-23T18:31:29.109925] [INFO ] [MAIN ] ECG: Fetched primary data is valid. [2025-09-23T18:31:29.109988] [DEBUG] [LOCAL ] ECG: Saving primary data. [2025-09-23T18:31:29.111178] [DEBUG] [LOCAL ] ECG: Trimmed 51564 records to 34265 (keeping 200 days of data) [2025-09-23T18:31:29.328115] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-23T18:31:29.361359] [DEBUG] [LOCAL ] ECG: Primary data saved (34265 records). [2025-09-23T18:31:29.361521] [INFO ] [MAIN ] ECG: Full history saved. [2025-09-23T18:31:29.361619] [INFO ] [MAIN ] Update Progress: 691/2372 symbols completed. ECG took 39.0s. Estimated remaining: 3h 42m 26s. Rate: 7.6 symbols/min [2025-09-23T18:31:29.545683] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:31:29.609138] [DEBUG] [LOCAL ] ED: Loaded 52808 existing records from primary storage. [2025-09-23T18:31:29.609302] [INFO ] [MAIN ] ED: Loaded 52808 existing records. [2025-09-23T18:31:29.801815] [WARN ] [MAIN ] ED: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:31:29.802086] [INFO ] [MAIN ] ED: Wiping existing primary data before full refresh. [2025-09-23T18:31:29.802134] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-09-23T18:31:29.802221] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-09. [2025-09-23T18:31:29.804238] [DEBUG] [LOCAL ] ED: Deleted primary data file. [2025-09-23T18:31:29.804320] [INFO ] [MAIN ] ED: Starting full primary refresh. [2025-09-23T18:31:30.176361] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-23T18:31:30.214539] [INFO ] [REMOTE ] ED: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:31:30.602255] [INFO ] [REMOTE ] ED: Fetching primary data for 2024-12. [2025-09-23T18:31:31.123679] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-23T18:31:31.131243] [INFO ] [REMOTE ] ECL: Full fetch complete (67255 records). [2025-09-23T18:31:31.131384] [DEBUG] [VALIDATOR ] ECL: Validating primary data. [2025-09-23T18:31:31.132201] [FATAL] [VALIDATOR ] ECL: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:31:31.132310] [FATAL] [MAIN ] ECL: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:31:31.132363] [WARN ] [MAIN ] ECL: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:31:31.132442] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-09-23T18:31:31.132517] [DEBUG] [LOCAL ] ECL: No primary data file found to delete. [2025-09-23T18:31:31.132553] [INFO ] [LOCAL ] ECL: Starting deletion of derivative data. [2025-09-23T18:31:31.133035] [DEBUG] [LOCAL ] ECL: Deleted derivative data file. [2025-09-23T18:31:31.133132] [INFO ] [MAIN ] Update Progress: 692/2372 symbols completed. ECL took 35.9s. Estimated remaining: 3h 42m 3s. Rate: 7.6 symbols/min [2025-09-23T18:31:31.315766] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:31:31.315993] [DEBUG] [LOCAL ] EDD: No existing data file found in primary storage. [2025-09-23T18:31:31.316063] [WARN ] [MAIN ] EDD: No existing data found, performing full refresh instead. [2025-09-23T18:31:31.316219] [INFO ] [MAIN ] EDD: Wiping existing primary data before full refresh. [2025-09-23T18:31:31.316263] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-09-23T18:31:31.316306] [DEBUG] [LOCAL ] EDD: No primary data file found to delete. [2025-09-23T18:31:31.316338] [INFO ] [MAIN ] EDD: Starting full primary refresh. [2025-09-23T18:31:31.407396] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-06. [2025-09-23T18:31:31.702988] [INFO ] [REMOTE ] EDD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:31:32.122251] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-23T18:31:32.202173] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-01. [2025-09-23T18:31:32.665885] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-23T18:31:33.002205] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-07. [2025-09-23T18:31:33.802166] [INFO ] [REMOTE ] EDD: Fetching primary data for 2024-12. [2025-09-23T18:31:34.009015] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-23T18:31:34.178923] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-23T18:31:34.602213] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-02. [2025-09-23T18:31:34.711016] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-23T18:31:35.402199] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-01. [2025-09-23T18:31:35.988442] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-23T18:31:36.202167] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-03. [2025-09-23T18:31:36.543091] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-23T18:31:37.002229] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-08. [2025-09-23T18:31:37.645492] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-23T18:31:37.802191] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-04. [2025-09-23T18:31:38.578446] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-23T18:31:38.602161] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-09. [2025-09-23T18:31:39.293254] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-23T18:31:39.402201] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-02. [2025-09-23T18:31:39.849032] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-23T18:31:39.856766] [INFO ] [REMOTE ] ECVT: Full fetch complete (59884 records). [2025-09-23T18:31:39.856921] [DEBUG] [VALIDATOR ] ECVT: Validating primary data. [2025-09-23T18:31:40.211741] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-05. [2025-09-23T18:31:40.267604] [DEBUG] [VALIDATOR ] ECVT: All expected trading days are present. [2025-09-23T18:31:40.281715] [DEBUG] [VALIDATOR ] ECVT: Primary data validation passed. [2025-09-23T18:31:40.282615] [INFO ] [MAIN ] ECVT: Fetched primary data is valid. [2025-09-23T18:31:40.283859] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-23T18:31:40.283925] [DEBUG] [LOCAL ] ECVT: Saving primary data. [2025-09-23T18:31:40.290819] [DEBUG] [LOCAL ] ECVT: Trimmed 59884 records to 43046 (keeping 200 days of data) [2025-09-23T18:31:40.541805] [DEBUG] [LOCAL ] ECVT: Primary data saved (43046 records). [2025-09-23T18:31:40.541957] [INFO ] [MAIN ] ECVT: Full history saved. [2025-09-23T18:31:40.542044] [INFO ] [MAIN ] Update Progress: 693/2372 symbols completed. ECVT took 22.8s. Estimated remaining: 3h 41m 59s. Rate: 7.6 symbols/min [2025-09-23T18:31:40.717261] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:31:40.717463] [DEBUG] [LOCAL ] EDF: No existing data file found in primary storage. [2025-09-23T18:31:40.717517] [WARN ] [MAIN ] EDF: No existing data found, performing full refresh instead. [2025-09-23T18:31:40.717695] [INFO ] [MAIN ] EDF: Wiping existing primary data before full refresh. [2025-09-23T18:31:40.717745] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-09-23T18:31:40.717787] [DEBUG] [LOCAL ] EDF: No primary data file found to delete. [2025-09-23T18:31:40.717833] [INFO ] [MAIN ] EDF: Starting full primary refresh. [2025-09-23T18:31:41.007722] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-05. [2025-09-23T18:31:41.091168] [INFO ] [REMOTE ] EDF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:31:41.754509] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-23T18:31:41.802209] [INFO ] [REMOTE ] EDF: Fetching primary data for 2024-12. [2025-09-23T18:31:42.211048] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-23T18:31:42.602237] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-03. [2025-09-23T18:31:42.628091] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-23T18:31:43.402201] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-06. [2025-09-23T18:31:44.058606] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-23T18:31:44.202182] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-04. [2025-09-23T18:31:44.501346] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-23T18:31:45.005876] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-06. [2025-09-23T18:31:45.010311] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-23T18:31:45.802205] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-01. [2025-09-23T18:31:46.393734] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-23T18:31:46.602200] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-07. [2025-09-23T18:31:46.843717] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-23T18:31:47.402202] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-07. [2025-09-23T18:31:47.592236] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-23T18:31:48.202215] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-08. [2025-09-23T18:31:48.762571] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-23T18:31:49.002226] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-02. [2025-09-23T18:31:49.282996] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-23T18:31:49.637339] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-23T18:31:49.802261] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-08. [2025-09-23T18:31:50.602199] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-03. [2025-09-23T18:31:51.402211] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-09. [2025-09-23T18:31:51.475594] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-23T18:31:51.691215] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-23T18:31:52.202259] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-04. [2025-09-23T18:31:52.333767] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-23T18:31:52.337321] [INFO ] [REMOTE ] ECO: Full fetch complete (29434 records). [2025-09-23T18:31:52.337401] [DEBUG] [VALIDATOR ] ECO: Validating primary data. [2025-09-23T18:31:52.704423] [DEBUG] [VALIDATOR ] ECO: All expected trading days are present. [2025-09-23T18:31:52.704506] [DEBUG] [VALIDATOR ] ECO: Primary data validation passed. [2025-09-23T18:31:52.705170] [INFO ] [MAIN ] ECO: Fetched primary data is valid. [2025-09-23T18:31:52.705250] [DEBUG] [LOCAL ] ECO: Saving primary data. [2025-09-23T18:31:52.706601] [DEBUG] [LOCAL ] ECO: Trimmed 29434 records to 18531 (keeping 200 days of data) [2025-09-23T18:31:52.833079] [DEBUG] [LOCAL ] ECO: Primary data saved (18531 records). [2025-09-23T18:31:52.833229] [INFO ] [MAIN ] ECO: Full history saved. [2025-09-23T18:31:52.833316] [INFO ] [MAIN ] Update Progress: 694/2372 symbols completed. ECO took 43.9s. Estimated remaining: 3h 42m 2s. Rate: 7.6 symbols/min [2025-09-23T18:31:53.004896] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:31:53.003289] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-09. [2025-09-23T18:31:53.025919] [DEBUG] [LOCAL ] EDN: Loaded 18016 existing records from primary storage. [2025-09-23T18:31:53.026041] [INFO ] [MAIN ] EDN: Loaded 18016 existing records. [2025-09-23T18:31:53.220772] [WARN ] [MAIN ] EDN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:31:53.226329] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-23T18:31:53.226541] [INFO ] [MAIN ] EDN: Wiping existing primary data before full refresh. [2025-09-23T18:31:53.230575] [INFO ] [LOCAL ] EDN: Starting deletion of primary data. [2025-09-23T18:31:53.231639] [DEBUG] [LOCAL ] EDN: Deleted primary data file. [2025-09-23T18:31:53.231729] [INFO ] [MAIN ] EDN: Starting full primary refresh. [2025-09-23T18:31:53.584127] [INFO ] [REMOTE ] EDN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:31:53.802166] [INFO ] [REMOTE ] EDN: Fetching primary data for 2024-12. [2025-09-23T18:31:54.444162] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-23T18:31:54.452916] [INFO ] [REMOTE ] ED: Full fetch complete (76374 records). [2025-09-23T18:31:54.453065] [DEBUG] [VALIDATOR ] ED: Validating primary data. [2025-09-23T18:31:54.608011] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-05. [2025-09-23T18:31:54.877179] [DEBUG] [VALIDATOR ] ED: All expected trading days are present. [2025-09-23T18:31:54.877288] [DEBUG] [VALIDATOR ] ED: Primary data validation passed. [2025-09-23T18:31:54.878211] [INFO ] [MAIN ] ED: Fetched primary data is valid. [2025-09-23T18:31:54.878331] [DEBUG] [LOCAL ] ED: Saving primary data. [2025-09-23T18:31:54.880067] [DEBUG] [LOCAL ] ED: Trimmed 76374 records to 52803 (keeping 200 days of data) [2025-09-23T18:31:54.989300] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-23T18:31:55.235756] [DEBUG] [LOCAL ] ED: Primary data saved (52803 records). [2025-09-23T18:31:55.235901] [INFO ] [MAIN ] ED: Full history saved. [2025-09-23T18:31:55.238974] [INFO ] [MAIN ] Update Progress: 695/2372 symbols completed. ED took 25.9s. Estimated remaining: 3h 41m 40s. Rate: 7.6 symbols/min [2025-09-23T18:31:55.408505] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:31:55.406958] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-01. [2025-09-23T18:31:55.457119] [DEBUG] [LOCAL ] EDU: Loaded 45124 existing records from primary storage. [2025-09-23T18:31:55.457291] [INFO ] [MAIN ] EDU: Loaded 45124 existing records. [2025-09-23T18:31:55.660364] [WARN ] [MAIN ] EDU: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:31:55.660685] [INFO ] [MAIN ] EDU: Wiping existing primary data before full refresh. [2025-09-23T18:31:55.660745] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-09-23T18:31:55.661962] [DEBUG] [LOCAL ] EDU: Deleted primary data file. [2025-09-23T18:31:55.662030] [INFO ] [MAIN ] EDU: Starting full primary refresh. [2025-09-23T18:31:56.020914] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-23T18:31:56.086116] [INFO ] [REMOTE ] EDU: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:31:56.202213] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-05. [2025-09-23T18:31:56.499676] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-23T18:31:56.785528] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-23T18:31:57.002197] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-02. [2025-09-23T18:31:57.781631] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-23T18:31:57.802155] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-03. [2025-09-23T18:31:58.602237] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-06. [2025-09-23T18:31:58.885106] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-23T18:31:59.402213] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-06. [2025-09-23T18:31:59.545483] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-23T18:32:00.202240] [INFO ] [REMOTE ] EDU: Fetching primary data for 2024-12. [2025-09-23T18:32:00.527446] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-23T18:32:01.002208] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-04. [2025-09-23T18:32:01.749462] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-23T18:32:01.802200] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-05. [2025-09-23T18:32:01.906581] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-23T18:32:02.454407] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-23T18:32:02.602205] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-01. [2025-09-23T18:32:03.402196] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-07. [2025-09-23T18:32:04.202200] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-07. [2025-09-23T18:32:04.337704] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-23T18:32:04.413426] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-23T18:32:05.002209] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-08. [2025-09-23T18:32:05.219776] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-23T18:32:05.802311] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-02. [2025-09-23T18:32:06.062353] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-23T18:32:06.602199] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-08. [2025-09-23T18:32:07.105322] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-23T18:32:07.402172] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-09. [2025-09-23T18:32:07.789772] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-23T18:32:08.045781] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-23T18:32:08.048549] [INFO ] [REMOTE ] EDF: Full fetch complete (21094 records). [2025-09-23T18:32:08.048633] [DEBUG] [VALIDATOR ] EDF: Validating primary data. [2025-09-23T18:32:08.205687] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-09. [2025-09-23T18:32:08.415011] [DEBUG] [VALIDATOR ] EDF: All expected trading days are present. [2025-09-23T18:32:08.415112] [DEBUG] [VALIDATOR ] EDF: Primary data validation passed. [2025-09-23T18:32:08.415512] [INFO ] [MAIN ] EDF: Fetched primary data is valid. [2025-09-23T18:32:08.415550] [DEBUG] [LOCAL ] EDF: Saving primary data. [2025-09-23T18:32:08.416131] [DEBUG] [LOCAL ] EDF: Trimmed 21094 records to 13537 (keeping 200 days of data) [2025-09-23T18:32:08.495105] [DEBUG] [LOCAL ] EDF: Primary data saved (13537 records). [2025-09-23T18:32:08.495240] [INFO ] [MAIN ] EDF: Full history saved. [2025-09-23T18:32:08.495314] [INFO ] [MAIN ] Update Progress: 696/2372 symbols completed. EDF took 28.0s. Estimated remaining: 3h 41m 45s. Rate: 7.6 symbols/min [2025-09-23T18:32:08.665424] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:32:08.696879] [DEBUG] [LOCAL ] EE: Loaded 32535 existing records from primary storage. [2025-09-23T18:32:08.697023] [INFO ] [MAIN ] EE: Loaded 32535 existing records. [2025-09-23T18:32:08.873112] [WARN ] [MAIN ] EE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:32:08.873368] [INFO ] [MAIN ] EE: Wiping existing primary data before full refresh. [2025-09-23T18:32:08.873416] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-09-23T18:32:08.874389] [DEBUG] [LOCAL ] EE: Deleted primary data file. [2025-09-23T18:32:08.874451] [INFO ] [MAIN ] EE: Starting full primary refresh. [2025-09-23T18:32:09.011327] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-06. [2025-09-23T18:32:09.228787] [INFO ] [REMOTE ] EE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:32:09.624550] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-23T18:32:09.629623] [INFO ] [REMOTE ] EDD: Full fetch complete (39112 records). [2025-09-23T18:32:09.629747] [DEBUG] [VALIDATOR ] EDD: Validating primary data. [2025-09-23T18:32:09.813600] [INFO ] [REMOTE ] EE: Fetching primary data for 2024-12. [2025-09-23T18:32:09.959973] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-23T18:32:10.031362] [DEBUG] [VALIDATOR ] EDD: All expected trading days are present. [2025-09-23T18:32:10.031457] [DEBUG] [VALIDATOR ] EDD: Primary data validation passed. [2025-09-23T18:32:10.032103] [INFO ] [MAIN ] EDD: Fetched primary data is valid. [2025-09-23T18:32:10.032169] [DEBUG] [LOCAL ] EDD: Saving primary data. [2025-09-23T18:32:10.033289] [DEBUG] [LOCAL ] EDD: Trimmed 39112 records to 27154 (keeping 200 days of data) [2025-09-23T18:32:10.192036] [DEBUG] [LOCAL ] EDD: Primary data saved (27154 records). [2025-09-23T18:32:10.192167] [INFO ] [MAIN ] EDD: Full history saved. [2025-09-23T18:32:10.192240] [INFO ] [MAIN ] Update Progress: 697/2372 symbols completed. EDD took 39.1s. Estimated remaining: 3h 41m 22s. Rate: 7.6 symbols/min [2025-09-23T18:32:10.363478] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:32:10.368006] [DEBUG] [LOCAL ] EEA: Loaded 2752 existing records from primary storage. [2025-09-23T18:32:10.368085] [INFO ] [MAIN ] EEA: Loaded 2752 existing records. [2025-09-23T18:32:10.545590] [WARN ] [MAIN ] EEA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:32:10.545879] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-09-23T18:32:10.545925] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-09-23T18:32:10.546153] [DEBUG] [LOCAL ] EEA: Deleted primary data file. [2025-09-23T18:32:10.546211] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-09-23T18:32:10.608981] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-03. [2025-09-23T18:32:10.907557] [INFO ] [REMOTE ] EEA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:32:10.923734] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-23T18:32:11.402252] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-07. [2025-09-23T18:32:12.091006] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-23T18:32:12.170165] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-23T18:32:12.202192] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-01. [2025-09-23T18:32:13.002211] [INFO ] [REMOTE ] EEA: Fetching primary data for 2024-12. [2025-09-23T18:32:13.475940] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-23T18:32:13.802151] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-04. [2025-09-23T18:32:13.806593] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-23T18:32:14.602191] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-01. [2025-09-23T18:32:14.944697] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-23T18:32:15.179190] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-23T18:32:15.402189] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-05. [2025-09-23T18:32:16.202198] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-08. [2025-09-23T18:32:16.596084] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-23T18:32:16.973584] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-23T18:32:17.002183] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-09-23T18:32:17.478220] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-23T18:32:17.802263] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-02. [2025-09-23T18:32:18.602204] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-09. [2025-09-23T18:32:18.643930] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-23T18:32:19.402210] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-09-23T18:32:19.977637] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-23T18:32:19.978529] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-23T18:32:19.985485] [INFO ] [REMOTE ] EDN: Full fetch complete (30602 records). [2025-09-23T18:32:19.985698] [DEBUG] [VALIDATOR ] EDN: Validating primary data. [2025-09-23T18:32:20.212546] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-09-23T18:32:20.374824] [DEBUG] [VALIDATOR ] EDN: All expected trading days are present. [2025-09-23T18:32:20.374928] [DEBUG] [VALIDATOR ] EDN: Primary data validation passed. [2025-09-23T18:32:20.375480] [INFO ] [MAIN ] EDN: Fetched primary data is valid. [2025-09-23T18:32:20.375544] [DEBUG] [LOCAL ] EDN: Saving primary data. [2025-09-23T18:32:20.376330] [DEBUG] [LOCAL ] EDN: Trimmed 30602 records to 18115 (keeping 200 days of data) [2025-09-23T18:32:20.481780] [DEBUG] [LOCAL ] EDN: Primary data saved (18115 records). [2025-09-23T18:32:20.481938] [INFO ] [MAIN ] EDN: Full history saved. [2025-09-23T18:32:20.482053] [INFO ] [MAIN ] Update Progress: 698/2372 symbols completed. EDN took 27.6s. Estimated remaining: 3h 41m 20s. Rate: 7.6 symbols/min [2025-09-23T18:32:20.654566] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:32:20.654820] [DEBUG] [LOCAL ] EEX: No existing data file found in primary storage. [2025-09-23T18:32:20.654876] [WARN ] [MAIN ] EEX: No existing data found, performing full refresh instead. [2025-09-23T18:32:20.655026] [INFO ] [MAIN ] EEX: Wiping existing primary data before full refresh. [2025-09-23T18:32:20.655115] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-09-23T18:32:20.655202] [DEBUG] [LOCAL ] EEX: No primary data file found to delete. [2025-09-23T18:32:20.655275] [INFO ] [MAIN ] EEX: Starting full primary refresh. [2025-09-23T18:32:20.764121] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-23T18:32:21.003054] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-06. [2025-09-23T18:32:21.023245] [INFO ] [REMOTE ] EEX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:32:21.802230] [INFO ] [REMOTE ] EEX: Fetching primary data for 2024-12. [2025-09-23T18:32:22.316345] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-23T18:32:22.602159] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-09-23T18:32:22.987997] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-23T18:32:23.078183] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-23T18:32:23.402196] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-09-23T18:32:23.753546] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-23T18:32:24.202258] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-03. [2025-09-23T18:32:25.002236] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-01. [2025-09-23T18:32:25.680525] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-23T18:32:25.768503] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-23T18:32:25.802150] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-04. [2025-09-23T18:32:26.602186] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-07. [2025-09-23T18:32:26.923745] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-23T18:32:27.402263] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-09-23T18:32:28.027379] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-23T18:32:28.060815] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-23T18:32:28.202183] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-09-23T18:32:28.666889] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-23T18:32:29.002215] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-05. [2025-09-23T18:32:29.802231] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-08. [2025-09-23T18:32:30.474503] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-23T18:32:30.602189] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-06. [2025-09-23T18:32:31.351403] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-23T18:32:31.402192] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-09. [2025-09-23T18:32:31.525784] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-23T18:32:32.202196] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-07. [2025-09-23T18:32:32.921974] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-23T18:32:32.929715] [INFO ] [REMOTE ] EDU: Full fetch complete (66554 records). [2025-09-23T18:32:32.929884] [DEBUG] [VALIDATOR ] EDU: Validating primary data. [2025-09-23T18:32:33.009440] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-09-23T18:32:33.359399] [DEBUG] [VALIDATOR ] EDU: All expected trading days are present. [2025-09-23T18:32:33.359519] [DEBUG] [VALIDATOR ] EDU: Primary data validation passed. [2025-09-23T18:32:33.360540] [INFO ] [MAIN ] EDU: Fetched primary data is valid. [2025-09-23T18:32:33.360700] [DEBUG] [LOCAL ] EDU: Saving primary data. [2025-09-23T18:32:33.382204] [DEBUG] [LOCAL ] EDU: Trimmed 66554 records to 45060 (keeping 200 days of data) [2025-09-23T18:32:33.382885] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-23T18:32:33.513039] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-23T18:32:33.514992] [INFO ] [REMOTE ] EEA: Full fetch complete (3981 records). [2025-09-23T18:32:33.519198] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-09-23T18:32:33.808772] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-08. [2025-09-23T18:32:33.996576] [DEBUG] [VALIDATOR ] EEA: All expected trading days are present. [2025-09-23T18:32:33.996986] [DEBUG] [VALIDATOR ] EEA: Primary data validation passed. [2025-09-23T18:32:33.997464] [INFO ] [MAIN ] EEA: Fetched primary data is valid. [2025-09-23T18:32:33.997538] [DEBUG] [LOCAL ] EEA: Saving primary data. [2025-09-23T18:32:33.998718] [DEBUG] [LOCAL ] EEA: Trimmed 3981 records to 2710 (keeping 200 days of data) [2025-09-23T18:32:34.020628] [DEBUG] [LOCAL ] EEA: Primary data saved (2710 records). [2025-09-23T18:32:34.021270] [INFO ] [MAIN ] EEA: Full history saved. [2025-09-23T18:32:34.021620] [INFO ] [MAIN ] Update Progress: 699/2372 symbols completed. EEA took 23.8s. Estimated remaining: 3h 41m 25s. Rate: 7.6 symbols/min [2025-09-23T18:32:34.205697] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:32:34.239205] [DEBUG] [LOCAL ] EDU: Primary data saved (45060 records). [2025-09-23T18:32:34.239365] [INFO ] [MAIN ] EDU: Full history saved. [2025-09-23T18:32:34.239463] [INFO ] [MAIN ] Update Progress: 700/2372 symbols completed. EDU took 39.0s. Estimated remaining: 3h 40m 59s. Rate: 7.6 symbols/min [2025-09-23T18:32:34.469561] [DEBUG] [LOCAL ] EFC: Loaded 46187 existing records from primary storage. [2025-09-23T18:32:34.469730] [INFO ] [MAIN ] EFC: Loaded 46187 existing records. [2025-09-23T18:32:34.468463] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:32:34.607003] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-02. [2025-09-23T18:32:34.671746] [DEBUG] [LOCAL ] EFR: Loaded 14225 existing records from primary storage. [2025-09-23T18:32:34.676406] [INFO ] [MAIN ] EFR: Loaded 14225 existing records. [2025-09-23T18:32:34.689128] [WARN ] [MAIN ] EFC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:32:34.742546] [INFO ] [MAIN ] EFC: Wiping existing primary data before full refresh. [2025-09-23T18:32:34.754154] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-09-23T18:32:34.782374] [DEBUG] [LOCAL ] EFC: Deleted primary data file. [2025-09-23T18:32:34.782517] [INFO ] [MAIN ] EFC: Starting full primary refresh. [2025-09-23T18:32:34.972249] [WARN ] [MAIN ] EFR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:32:34.993352] [INFO ] [MAIN ] EFR: Wiping existing primary data before full refresh. [2025-09-23T18:32:35.026475] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-09-23T18:32:35.035566] [DEBUG] [LOCAL ] EFR: Deleted primary data file. [2025-09-23T18:32:35.053071] [INFO ] [MAIN ] EFR: Starting full primary refresh. [2025-09-23T18:32:35.467325] [INFO ] [REMOTE ] EFC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:32:35.487758] [INFO ] [REMOTE ] EFC: Fetching primary data for 2024-12. [2025-09-23T18:32:35.653600] [INFO ] [REMOTE ] EFR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:32:35.654721] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-23T18:32:35.679954] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-23T18:32:36.202179] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-03. [2025-09-23T18:32:37.002167] [INFO ] [REMOTE ] EFR: Fetching primary data for 2024-12. [2025-09-23T18:32:37.249948] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-23T18:32:37.590231] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-23T18:32:37.787633] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-23T18:32:37.802138] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-01. [2025-09-23T18:32:38.602211] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-09. [2025-09-23T18:32:38.644526] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-23T18:32:39.402236] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-04. [2025-09-23T18:32:39.985264] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-23T18:32:39.990674] [INFO ] [REMOTE ] EE: Full fetch complete (43617 records). [2025-09-23T18:32:39.990788] [DEBUG] [VALIDATOR ] EE: Validating primary data. [2025-09-23T18:32:40.208475] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-02. [2025-09-23T18:32:40.395637] [DEBUG] [VALIDATOR ] EE: All expected trading days are present. [2025-09-23T18:32:40.396042] [DEBUG] [VALIDATOR ] EE: Primary data validation passed. [2025-09-23T18:32:40.397006] [INFO ] [MAIN ] EE: Fetched primary data is valid. [2025-09-23T18:32:40.397148] [DEBUG] [LOCAL ] EE: Saving primary data. [2025-09-23T18:32:40.399887] [DEBUG] [LOCAL ] EE: Trimmed 43617 records to 32586 (keeping 200 days of data) [2025-09-23T18:32:40.511031] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-23T18:32:40.624422] [DEBUG] [LOCAL ] EE: Primary data saved (32586 records). [2025-09-23T18:32:40.624573] [INFO ] [MAIN ] EE: Full history saved. [2025-09-23T18:32:40.624713] [INFO ] [MAIN ] Update Progress: 701/2372 symbols completed. EE took 32.1s. Estimated remaining: 3h 40m 47s. Rate: 7.6 symbols/min [2025-09-23T18:32:40.793557] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:32:40.793802] [DEBUG] [LOCAL ] EFT: No existing data file found in primary storage. [2025-09-23T18:32:40.793858] [WARN ] [MAIN ] EFT: No existing data found, performing full refresh instead. [2025-09-23T18:32:40.794002] [INFO ] [MAIN ] EFT: Wiping existing primary data before full refresh. [2025-09-23T18:32:40.794058] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-09-23T18:32:40.794124] [DEBUG] [LOCAL ] EFT: No primary data file found to delete. [2025-09-23T18:32:40.794160] [INFO ] [MAIN ] EFT: Starting full primary refresh. [2025-09-23T18:32:41.012470] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-05. [2025-09-23T18:32:40.995023] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-23T18:32:41.192237] [INFO ] [REMOTE ] EFT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:32:41.634383] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-23T18:32:41.802277] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-03. [2025-09-23T18:32:42.338534] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-23T18:32:42.602263] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-04. [2025-09-23T18:32:43.402199] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-06. [2025-09-23T18:32:43.634889] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-23T18:32:44.202183] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-01. [2025-09-23T18:32:44.251037] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-23T18:32:44.310523] [DEBUG] [REMOTE ] EFC: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-09-23T18:32:44.310891] [WARN ] [REMOTE ] EFC: No data returned for month 2025-01 [2025-09-23T18:32:45.002210] [INFO ] [REMOTE ] EFT: Fetching primary data for 2024-12. [2025-09-23T18:32:45.747882] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-23T18:32:45.802240] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-07. [2025-09-23T18:32:46.602188] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-01. [2025-09-23T18:32:46.821765] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-23T18:32:47.198385] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-23T18:32:47.402228] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-02. [2025-09-23T18:32:48.115153] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-23T18:32:48.202202] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-08. [2025-09-23T18:32:48.703665] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-23T18:32:49.002194] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-02. [2025-09-23T18:32:49.802200] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-09. [2025-09-23T18:32:50.333018] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-23T18:32:50.336165] [INFO ] [REMOTE ] EEX: Full fetch complete (20090 records). [2025-09-23T18:32:50.336321] [DEBUG] [VALIDATOR ] EEX: Validating primary data. [2025-09-23T18:32:50.606404] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-03. [2025-09-23T18:32:50.753899] [DEBUG] [VALIDATOR ] EEX: All expected trading days are present. [2025-09-23T18:32:50.754579] [DEBUG] [VALIDATOR ] EEX: Primary data validation passed. [2025-09-23T18:32:50.755343] [INFO ] [MAIN ] EEX: Fetched primary data is valid. [2025-09-23T18:32:50.755853] [DEBUG] [LOCAL ] EEX: Saving primary data. [2025-09-23T18:32:50.757212] [DEBUG] [LOCAL ] EEX: Trimmed 20090 records to 12091 (keeping 200 days of data) [2025-09-23T18:32:50.844788] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-23T18:32:50.875161] [DEBUG] [LOCAL ] EEX: Primary data saved (12091 records). [2025-09-23T18:32:50.875324] [INFO ] [MAIN ] EEX: Full history saved. [2025-09-23T18:32:50.875437] [INFO ] [MAIN ] Update Progress: 702/2372 symbols completed. EEX took 30.4s. Estimated remaining: 3h 40m 45s. Rate: 7.6 symbols/min [2025-09-23T18:32:51.063856] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:32:51.124387] [DEBUG] [LOCAL ] EFX: Loaded 44961 existing records from primary storage. [2025-09-23T18:32:51.124744] [INFO ] [MAIN ] EFX: Loaded 44961 existing records. [2025-09-23T18:32:51.242841] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-23T18:32:51.328150] [WARN ] [MAIN ] EFX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:32:51.328467] [INFO ] [MAIN ] EFX: Wiping existing primary data before full refresh. [2025-09-23T18:32:51.328532] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-09-23T18:32:51.329937] [DEBUG] [LOCAL ] EFX: Deleted primary data file. [2025-09-23T18:32:51.330030] [INFO ] [MAIN ] EFX: Starting full primary refresh. [2025-09-23T18:32:51.407332] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-04. [2025-09-23T18:32:51.711973] [INFO ] [REMOTE ] EFX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:32:52.108699] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-23T18:32:52.202203] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-03. [2025-09-23T18:32:53.002194] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-05. [2025-09-23T18:32:53.575435] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-23T18:32:53.802168] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-06. [2025-09-23T18:32:54.078218] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-23T18:32:54.406716] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-23T18:32:54.602196] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-05. [2025-09-23T18:32:55.402169] [INFO ] [REMOTE ] EFX: Fetching primary data for 2024-12. [2025-09-23T18:32:55.550523] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-23T18:32:56.202205] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-04. [2025-09-23T18:32:57.002170] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-07. [2025-09-23T18:32:57.173981] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-23T18:32:57.588501] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-23T18:32:57.637306] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-23T18:32:57.802210] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-05. [2025-09-23T18:32:58.602210] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-06. [2025-09-23T18:32:59.211102] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-23T18:32:59.275245] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-23T18:32:59.402201] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-07. [2025-09-23T18:33:00.064907] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-23T18:33:00.202199] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-06. [2025-09-23T18:33:01.002194] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-08. [2025-09-23T18:33:01.802202] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-08. [2025-09-23T18:33:02.004531] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-23T18:33:02.232189] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-23T18:33:02.602183] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-07. [2025-09-23T18:33:03.402178] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-09. [2025-09-23T18:33:04.202193] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-01. [2025-09-23T18:33:04.445426] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-08 (2.64 seconds). [2025-09-23T18:33:04.687766] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-23T18:33:04.690040] [INFO ] [REMOTE ] EFT: Full fetch complete (17271 records). [2025-09-23T18:33:04.690114] [DEBUG] [VALIDATOR ] EFT: Validating primary data. [2025-09-23T18:33:04.690896] [FATAL] [VALIDATOR ] EFT: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:33:04.690982] [FATAL] [MAIN ] EFT: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:33:04.691036] [WARN ] [MAIN ] EFT: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:33:04.691159] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-09-23T18:33:04.691246] [DEBUG] [LOCAL ] EFT: No primary data file found to delete. [2025-09-23T18:33:04.691295] [INFO ] [LOCAL ] EFT: Starting deletion of derivative data. [2025-09-23T18:33:04.691375] [DEBUG] [LOCAL ] EFT: No derivative data file found to delete. [2025-09-23T18:33:04.691461] [INFO ] [MAIN ] Update Progress: 703/2372 symbols completed. EFT took 24.1s. Estimated remaining: 3h 40m 51s. Rate: 7.6 symbols/min [2025-09-23T18:33:04.866116] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:33:04.921915] [DEBUG] [LOCAL ] EFXT: Loaded 29392 existing records from primary storage. [2025-09-23T18:33:04.922086] [INFO ] [MAIN ] EFXT: Loaded 29392 existing records. [2025-09-23T18:33:05.007284] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-09. [2025-09-23T18:33:05.112321] [WARN ] [MAIN ] EFXT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:33:05.112591] [INFO ] [MAIN ] EFXT: Wiping existing primary data before full refresh. [2025-09-23T18:33:05.112637] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-09-23T18:33:05.114424] [DEBUG] [LOCAL ] EFXT: Deleted primary data file. [2025-09-23T18:33:05.114485] [INFO ] [MAIN ] EFXT: Starting full primary refresh. [2025-09-23T18:33:05.518484] [INFO ] [REMOTE ] EFXT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:33:05.539700] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-07 (2.94 seconds). [2025-09-23T18:33:05.576842] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-23T18:33:05.755610] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-23T18:33:05.758511] [INFO ] [REMOTE ] EFR: Full fetch complete (18485 records). [2025-09-23T18:33:05.758595] [DEBUG] [VALIDATOR ] EFR: Validating primary data. [2025-09-23T18:33:05.807333] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-02. [2025-09-23T18:33:06.151833] [DEBUG] [VALIDATOR ] EFR: All expected trading days are present. [2025-09-23T18:33:06.151950] [DEBUG] [VALIDATOR ] EFR: Primary data validation passed. [2025-09-23T18:33:06.152446] [INFO ] [MAIN ] EFR: Fetched primary data is valid. [2025-09-23T18:33:06.152489] [DEBUG] [LOCAL ] EFR: Saving primary data. [2025-09-23T18:33:06.153409] [DEBUG] [LOCAL ] EFR: Trimmed 18485 records to 14232 (keeping 200 days of data) [2025-09-23T18:33:06.259505] [DEBUG] [LOCAL ] EFR: Primary data saved (14232 records). [2025-09-23T18:33:06.259679] [INFO ] [MAIN ] EFR: Full history saved. [2025-09-23T18:33:06.259848] [INFO ] [MAIN ] Update Progress: 704/2372 symbols completed. EFR took 32.0s. Estimated remaining: 3h 40m 28s. Rate: 7.6 symbols/min [2025-09-23T18:33:06.435917] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:33:06.436111] [DEBUG] [LOCAL ] EG: No existing data file found in primary storage. [2025-09-23T18:33:06.436150] [WARN ] [MAIN ] EG: No existing data found, performing full refresh instead. [2025-09-23T18:33:06.436301] [INFO ] [MAIN ] EG: Wiping existing primary data before full refresh. [2025-09-23T18:33:06.436344] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-09-23T18:33:06.436386] [DEBUG] [LOCAL ] EG: No primary data file found to delete. [2025-09-23T18:33:06.436420] [INFO ] [MAIN ] EG: Starting full primary refresh. [2025-09-23T18:33:06.620222] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2024-12. [2025-09-23T18:33:06.805713] [INFO ] [REMOTE ] EG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:33:07.402209] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-08. [2025-09-23T18:33:07.697346] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-23T18:33:08.202189] [INFO ] [REMOTE ] EG: Fetching primary data for 2024-12. [2025-09-23T18:33:08.237237] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-23T18:33:09.002234] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-03. [2025-09-23T18:33:09.172753] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-23T18:33:09.476515] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-23T18:33:09.802226] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-09. [2025-09-23T18:33:10.408155] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-23T18:33:10.602237] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-04. [2025-09-23T18:33:11.211778] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-23T18:33:11.220022] [INFO ] [REMOTE ] EFC: Full fetch complete (59789 records). [2025-09-23T18:33:11.220183] [DEBUG] [VALIDATOR ] EFC: Validating primary data. [2025-09-23T18:33:11.413596] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-01. [2025-09-23T18:33:11.415777] [WARN ] [VALIDATOR ] EFC: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-23T18:33:11.417240] [FATAL] [MAIN ] EFC: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:33:11.417319] [WARN ] [MAIN ] EFC: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:33:11.417392] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-09-23T18:33:11.417465] [DEBUG] [LOCAL ] EFC: No primary data file found to delete. [2025-09-23T18:33:11.417624] [INFO ] [LOCAL ] EFC: Starting deletion of derivative data. [2025-09-23T18:33:11.418415] [DEBUG] [LOCAL ] EFC: Deleted derivative data file. [2025-09-23T18:33:11.418513] [INFO ] [MAIN ] Update Progress: 705/2372 symbols completed. EFC took 37.4s. Estimated remaining: 3h 40m 14s. Rate: 7.6 symbols/min [2025-09-23T18:33:11.589581] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:33:11.659674] [DEBUG] [LOCAL ] EGO: Loaded 51470 existing records from primary storage. [2025-09-23T18:33:11.659837] [INFO ] [MAIN ] EGO: Loaded 51470 existing records. [2025-09-23T18:33:11.841849] [WARN ] [MAIN ] EGO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:33:11.842171] [INFO ] [MAIN ] EGO: Wiping existing primary data before full refresh. [2025-09-23T18:33:11.842231] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-09-23T18:33:11.844046] [DEBUG] [LOCAL ] EGO: Deleted primary data file. [2025-09-23T18:33:11.844111] [INFO ] [MAIN ] EGO: Starting full primary refresh. [2025-09-23T18:33:12.213237] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-01. [2025-09-23T18:33:12.213080] [INFO ] [REMOTE ] EGO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:33:12.304241] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-23T18:33:12.612390] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-23T18:33:13.002182] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-02. [2025-09-23T18:33:13.155756] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-23T18:33:13.802194] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-05. [2025-09-23T18:33:14.218801] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-23T18:33:14.602231] [INFO ] [REMOTE ] EGO: Fetching primary data for 2024-12. [2025-09-23T18:33:15.060346] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-23T18:33:15.402197] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-03. [2025-09-23T18:33:16.123676] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-23T18:33:16.202156] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-01. [2025-09-23T18:33:16.679927] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-23T18:33:17.002210] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-06. [2025-09-23T18:33:17.802214] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-02. [2025-09-23T18:33:18.588973] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-01 (2.39 seconds). [2025-09-23T18:33:18.602137] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-02. [2025-09-23T18:33:18.954505] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-23T18:33:19.180409] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-23T18:33:19.402174] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-04. [2025-09-23T18:33:19.828179] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-23T18:33:20.202195] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-07. [2025-09-23T18:33:20.933348] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-23T18:33:21.002217] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-03. [2025-09-23T18:33:21.452736] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-23T18:33:21.802204] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-08. [2025-09-23T18:33:22.602187] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-03. [2025-09-23T18:33:22.807828] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-23T18:33:23.402200] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-04. [2025-09-23T18:33:23.472423] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-23T18:33:23.587811] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-23T18:33:24.202233] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-05. [2025-09-23T18:33:24.826509] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-23T18:33:25.002201] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-04. [2025-09-23T18:33:25.754867] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-23T18:33:25.802153] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-06. [2025-09-23T18:33:25.911943] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-23T18:33:26.602170] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-09. [2025-09-23T18:33:26.682838] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-23T18:33:27.402202] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-05. [2025-09-23T18:33:28.202254] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-07. [2025-09-23T18:33:28.467225] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-23T18:33:28.476561] [INFO ] [REMOTE ] EFX: Full fetch complete (64351 records). [2025-09-23T18:33:28.476714] [DEBUG] [VALIDATOR ] EFX: Validating primary data. [2025-09-23T18:33:28.910235] [DEBUG] [VALIDATOR ] EFX: All expected trading days are present. [2025-09-23T18:33:28.910361] [DEBUG] [VALIDATOR ] EFX: Primary data validation passed. [2025-09-23T18:33:28.911511] [INFO ] [MAIN ] EFX: Fetched primary data is valid. [2025-09-23T18:33:28.911585] [DEBUG] [LOCAL ] EFX: Saving primary data. [2025-09-23T18:33:28.915387] [DEBUG] [LOCAL ] EFX: Trimmed 64351 records to 44864 (keeping 200 days of data) [2025-09-23T18:33:29.015145] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-05. [2025-09-23T18:33:29.164086] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-23T18:33:29.234484] [DEBUG] [LOCAL ] EFX: Primary data saved (44864 records). [2025-09-23T18:33:29.234628] [INFO ] [MAIN ] EFX: Full history saved. [2025-09-23T18:33:29.234749] [INFO ] [MAIN ] Update Progress: 706/2372 symbols completed. EFX took 38.4s. Estimated remaining: 3h 40m 29s. Rate: 7.6 symbols/min [2025-09-23T18:33:29.427836] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:33:29.462236] [DEBUG] [LOCAL ] EGP: Loaded 31337 existing records from primary storage. [2025-09-23T18:33:29.462404] [INFO ] [MAIN ] EGP: Loaded 31337 existing records. [2025-09-23T18:33:29.643822] [WARN ] [MAIN ] EGP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:33:29.644067] [INFO ] [MAIN ] EGP: Wiping existing primary data before full refresh. [2025-09-23T18:33:29.644116] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-09-23T18:33:29.645197] [DEBUG] [LOCAL ] EGP: Deleted primary data file. [2025-09-23T18:33:29.645259] [INFO ] [MAIN ] EGP: Starting full primary refresh. [2025-09-23T18:33:29.822926] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-06. [2025-09-23T18:33:30.016970] [INFO ] [REMOTE ] EGP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:33:30.298542] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-23T18:33:30.602248] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-08. [2025-09-23T18:33:30.776182] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-23T18:33:31.402287] [INFO ] [REMOTE ] EGP: Fetching primary data for 2024-12. [2025-09-23T18:33:31.591172] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-05 (2.58 seconds). [2025-09-23T18:33:31.617322] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-23T18:33:32.202255] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-09. [2025-09-23T18:33:32.442799] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-23T18:33:33.002219] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-06. [2025-09-23T18:33:33.464488] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-23T18:33:33.471868] [INFO ] [REMOTE ] EG: Full fetch complete (43849 records). [2025-09-23T18:33:33.472028] [DEBUG] [VALIDATOR ] EG: Validating primary data. [2025-09-23T18:33:33.807446] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-01. [2025-09-23T18:33:33.860316] [DEBUG] [VALIDATOR ] EG: All expected trading days are present. [2025-09-23T18:33:33.860410] [DEBUG] [VALIDATOR ] EG: Primary data validation passed. [2025-09-23T18:33:33.861075] [INFO ] [MAIN ] EG: Fetched primary data is valid. [2025-09-23T18:33:33.861140] [DEBUG] [LOCAL ] EG: Saving primary data. [2025-09-23T18:33:33.863842] [DEBUG] [LOCAL ] EG: Trimmed 43849 records to 28707 (keeping 200 days of data) [2025-09-23T18:33:34.054231] [DEBUG] [LOCAL ] EG: Primary data saved (28707 records). [2025-09-23T18:33:34.054375] [INFO ] [MAIN ] EG: Full history saved. [2025-09-23T18:33:34.054466] [INFO ] [MAIN ] Update Progress: 707/2372 symbols completed. EG took 27.8s. Estimated remaining: 3h 40m 14s. Rate: 7.6 symbols/min [2025-09-23T18:33:34.251785] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:33:34.294952] [DEBUG] [LOCAL ] EGY: Loaded 42312 existing records from primary storage. [2025-09-23T18:33:34.295120] [INFO ] [MAIN ] EGY: Loaded 42312 existing records. [2025-09-23T18:33:34.472146] [WARN ] [MAIN ] EGY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:33:34.472381] [INFO ] [MAIN ] EGY: Wiping existing primary data before full refresh. [2025-09-23T18:33:34.472488] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-09-23T18:33:34.473433] [DEBUG] [LOCAL ] EGY: Deleted primary data file. [2025-09-23T18:33:34.473493] [INFO ] [MAIN ] EGY: Starting full primary refresh. [2025-09-23T18:33:34.613939] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-07. [2025-09-23T18:33:34.878638] [INFO ] [REMOTE ] EGY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:33:34.924731] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-23T18:33:35.259522] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-23T18:33:35.402275] [INFO ] [REMOTE ] EGY: Fetching primary data for 2024-12. [2025-09-23T18:33:35.480555] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-23T18:33:36.202243] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-07. [2025-09-23T18:33:36.731694] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-23T18:33:37.002272] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-01. [2025-09-23T18:33:37.802182] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-02. [2025-09-23T18:33:37.972686] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-23T18:33:38.128002] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-23T18:33:38.602197] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-08. [2025-09-23T18:33:38.883750] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-23T18:33:39.402202] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-02. [2025-09-23T18:33:39.506723] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-23T18:33:40.202230] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-03. [2025-09-23T18:33:40.511072] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-23T18:33:41.002256] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-03. [2025-09-23T18:33:41.304159] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-23T18:33:41.802270] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-04. [2025-09-23T18:33:42.407747] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-23T18:33:42.602211] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-04. [2025-09-23T18:33:43.067448] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-23T18:33:43.402211] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-08. [2025-09-23T18:33:43.764076] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-23T18:33:44.202208] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-05. [2025-09-23T18:33:45.010383] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-09. [2025-09-23T18:33:45.030433] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-23T18:33:45.471946] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-23T18:33:45.802202] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-06. [2025-09-23T18:33:46.264623] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-23T18:33:46.270336] [INFO ] [REMOTE ] EFXT: Full fetch complete (44213 records). [2025-09-23T18:33:46.270442] [DEBUG] [VALIDATOR ] EFXT: Validating primary data. [2025-09-23T18:33:46.606984] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-05. [2025-09-23T18:33:46.687769] [DEBUG] [VALIDATOR ] EFXT: All expected trading days are present. [2025-09-23T18:33:46.687917] [DEBUG] [VALIDATOR ] EFXT: Primary data validation passed. [2025-09-23T18:33:46.688812] [INFO ] [MAIN ] EFXT: Fetched primary data is valid. [2025-09-23T18:33:46.688950] [DEBUG] [LOCAL ] EFXT: Saving primary data. [2025-09-23T18:33:46.690214] [DEBUG] [LOCAL ] EFXT: Trimmed 44213 records to 29358 (keeping 200 days of data) [2025-09-23T18:33:46.798815] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-23T18:33:46.895451] [DEBUG] [LOCAL ] EFXT: Primary data saved (29358 records). [2025-09-23T18:33:46.895595] [INFO ] [MAIN ] EFXT: Full history saved. [2025-09-23T18:33:46.895704] [INFO ] [MAIN ] Update Progress: 708/2372 symbols completed. EFXT took 42.2s. Estimated remaining: 3h 40m 17s. Rate: 7.6 symbols/min [2025-09-23T18:33:47.076446] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:33:47.106460] [DEBUG] [LOCAL ] EHAB: Loaded 30099 existing records from primary storage. [2025-09-23T18:33:47.106602] [INFO ] [MAIN ] EHAB: Loaded 30099 existing records. [2025-09-23T18:33:47.294791] [WARN ] [MAIN ] EHAB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:33:47.295092] [INFO ] [MAIN ] EHAB: Wiping existing primary data before full refresh. [2025-09-23T18:33:47.295149] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-09-23T18:33:47.295973] [DEBUG] [LOCAL ] EHAB: Deleted primary data file. [2025-09-23T18:33:47.296035] [INFO ] [MAIN ] EHAB: Starting full primary refresh. [2025-09-23T18:33:47.407293] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-09. [2025-09-23T18:33:47.680286] [INFO ] [REMOTE ] EHAB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:33:48.202199] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2024-12. [2025-09-23T18:33:48.294704] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-23T18:33:48.857171] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-23T18:33:48.866010] [INFO ] [REMOTE ] EGO: Full fetch complete (73331 records). [2025-09-23T18:33:48.866175] [DEBUG] [VALIDATOR ] EGO: Validating primary data. [2025-09-23T18:33:49.007319] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-07. [2025-09-23T18:33:49.277812] [DEBUG] [VALIDATOR ] EGO: All expected trading days are present. [2025-09-23T18:33:49.277929] [DEBUG] [VALIDATOR ] EGO: Primary data validation passed. [2025-09-23T18:33:49.278940] [INFO ] [MAIN ] EGO: Fetched primary data is valid. [2025-09-23T18:33:49.279108] [DEBUG] [LOCAL ] EGO: Saving primary data. [2025-09-23T18:33:49.296709] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-23T18:33:49.302685] [DEBUG] [LOCAL ] EGO: Trimmed 73331 records to 51496 (keeping 200 days of data) [2025-09-23T18:33:49.616950] [DEBUG] [LOCAL ] EGO: Primary data saved (51496 records). [2025-09-23T18:33:49.617122] [INFO ] [MAIN ] EGO: Full history saved. [2025-09-23T18:33:49.617221] [INFO ] [MAIN ] Update Progress: 709/2372 symbols completed. EGO took 38.2s. Estimated remaining: 3h 39m 57s. Rate: 7.6 symbols/min [2025-09-23T18:33:49.808243] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:33:49.808354] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-01. [2025-09-23T18:33:49.853381] [DEBUG] [LOCAL ] EHC: Loaded 41502 existing records from primary storage. [2025-09-23T18:33:49.853561] [INFO ] [MAIN ] EHC: Loaded 41502 existing records. [2025-09-23T18:33:50.044866] [WARN ] [MAIN ] EHC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:33:50.045356] [INFO ] [MAIN ] EHC: Wiping existing primary data before full refresh. [2025-09-23T18:33:50.045411] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-09-23T18:33:50.047240] [DEBUG] [LOCAL ] EHC: Deleted primary data file. [2025-09-23T18:33:50.047339] [INFO ] [MAIN ] EHC: Starting full primary refresh. [2025-09-23T18:33:50.426702] [INFO ] [REMOTE ] EHC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:33:50.448075] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-23T18:33:50.602151] [INFO ] [REMOTE ] EHC: Fetching primary data for 2024-12. [2025-09-23T18:33:51.177011] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-23T18:33:51.402213] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-06. [2025-09-23T18:33:51.886957] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-23T18:33:52.202202] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-08. [2025-09-23T18:33:52.547791] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-23T18:33:53.002210] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-01. [2025-09-23T18:33:53.696599] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-23T18:33:53.802190] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-07. [2025-09-23T18:33:53.978320] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-23T18:33:54.602271] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-02. [2025-09-23T18:33:54.967955] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-23T18:33:55.402207] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-09. [2025-09-23T18:33:55.763180] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-23T18:33:56.202199] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-02. [2025-09-23T18:33:56.342830] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-23T18:33:56.348236] [INFO ] [REMOTE ] EGP: Full fetch complete (45104 records). [2025-09-23T18:33:56.348382] [DEBUG] [VALIDATOR ] EGP: Validating primary data. [2025-09-23T18:33:56.348998] [FATAL] [VALIDATOR ] EGP: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:33:56.349106] [FATAL] [MAIN ] EGP: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:33:56.349182] [WARN ] [MAIN ] EGP: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:33:56.349291] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-09-23T18:33:56.349375] [DEBUG] [LOCAL ] EGP: No primary data file found to delete. [2025-09-23T18:33:56.349415] [INFO ] [LOCAL ] EGP: Starting deletion of derivative data. [2025-09-23T18:33:56.349817] [DEBUG] [LOCAL ] EGP: Deleted derivative data file. [2025-09-23T18:33:56.349918] [INFO ] [MAIN ] Update Progress: 710/2372 symbols completed. EGP took 27.1s. Estimated remaining: 3h 39m 46s. Rate: 7.6 symbols/min [2025-09-23T18:33:56.532874] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:33:56.544205] [DEBUG] [LOCAL ] EHI: Loaded 10286 existing records from primary storage. [2025-09-23T18:33:56.544344] [INFO ] [MAIN ] EHI: Loaded 10286 existing records. [2025-09-23T18:33:56.731237] [WARN ] [MAIN ] EHI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:33:56.731543] [INFO ] [MAIN ] EHI: Wiping existing primary data before full refresh. [2025-09-23T18:33:56.731621] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-09-23T18:33:56.732096] [DEBUG] [LOCAL ] EHI: Deleted primary data file. [2025-09-23T18:33:56.732162] [INFO ] [MAIN ] EHI: Starting full primary refresh. [2025-09-23T18:33:57.008859] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-08. [2025-09-23T18:33:57.113145] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-23T18:33:57.139829] [INFO ] [REMOTE ] EHI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:33:57.802208] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-03. [2025-09-23T18:33:58.182533] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-23T18:33:58.602217] [INFO ] [REMOTE ] EHI: Fetching primary data for 2024-12. [2025-09-23T18:33:59.017215] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-23T18:33:59.402254] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-03. [2025-09-23T18:33:59.588469] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-23T18:34:00.202191] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-09. [2025-09-23T18:34:00.476739] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-23T18:34:01.002209] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-04. [2025-09-23T18:34:01.772992] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-23T18:34:01.780326] [INFO ] [REMOTE ] EGY: Full fetch complete (61846 records). [2025-09-23T18:34:01.780533] [DEBUG] [VALIDATOR ] EGY: Validating primary data. [2025-09-23T18:34:01.807297] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-04. [2025-09-23T18:34:02.182127] [DEBUG] [VALIDATOR ] EGY: All expected trading days are present. [2025-09-23T18:34:02.182224] [DEBUG] [VALIDATOR ] EGY: Primary data validation passed. [2025-09-23T18:34:02.183046] [INFO ] [MAIN ] EGY: Fetched primary data is valid. [2025-09-23T18:34:02.183114] [DEBUG] [LOCAL ] EGY: Saving primary data. [2025-09-23T18:34:02.184702] [DEBUG] [LOCAL ] EGY: Trimmed 61846 records to 42328 (keeping 200 days of data) [2025-09-23T18:34:02.436756] [DEBUG] [LOCAL ] EGY: Primary data saved (42328 records). [2025-09-23T18:34:02.436889] [INFO ] [MAIN ] EGY: Full history saved. [2025-09-23T18:34:02.436986] [INFO ] [MAIN ] Update Progress: 711/2372 symbols completed. EGY took 28.4s. Estimated remaining: 3h 39m 34s. Rate: 7.6 symbols/min [2025-09-23T18:34:02.603467] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-01. [2025-09-23T18:34:02.607019] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:34:02.633129] [DEBUG] [LOCAL ] EIC: Loaded 24344 existing records from primary storage. [2025-09-23T18:34:02.633266] [INFO ] [MAIN ] EIC: Loaded 24344 existing records. [2025-09-23T18:34:02.845719] [WARN ] [MAIN ] EIC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:34:02.846521] [INFO ] [MAIN ] EIC: Wiping existing primary data before full refresh. [2025-09-23T18:34:02.848321] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-23T18:34:02.847261] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-09-23T18:34:02.857628] [DEBUG] [LOCAL ] EIC: Deleted primary data file. [2025-09-23T18:34:02.858278] [INFO ] [MAIN ] EIC: Starting full primary refresh. [2025-09-23T18:34:03.022356] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-23T18:34:03.214550] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-23T18:34:03.257204] [INFO ] [REMOTE ] EIC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:34:03.402189] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-05. [2025-09-23T18:34:04.202184] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-05. [2025-09-23T18:34:04.679756] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-23T18:34:05.002232] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-06. [2025-09-23T18:34:05.134142] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-23T18:34:05.802204] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-06. [2025-09-23T18:34:06.223255] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-23T18:34:06.571528] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-23T18:34:06.602150] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-07. [2025-09-23T18:34:07.402248] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-07. [2025-09-23T18:34:07.653343] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-23T18:34:08.202202] [INFO ] [REMOTE ] EIC: Fetching primary data for 2024-12. [2025-09-23T18:34:08.957474] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-23T18:34:09.002168] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-08. [2025-09-23T18:34:09.390722] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-23T18:34:09.802195] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-08. [2025-09-23T18:34:10.468538] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-23T18:34:10.602258] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-02. [2025-09-23T18:34:11.319715] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-23T18:34:11.402153] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-09. [2025-09-23T18:34:11.602343] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-23T18:34:12.202199] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-03. [2025-09-23T18:34:12.234041] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-23T18:34:12.238624] [INFO ] [REMOTE ] EHAB: Full fetch complete (41407 records). [2025-09-23T18:34:12.238749] [DEBUG] [VALIDATOR ] EHAB: Validating primary data. [2025-09-23T18:34:12.239610] [FATAL] [VALIDATOR ] EHAB: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:34:12.239722] [FATAL] [MAIN ] EHAB: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:34:12.239788] [WARN ] [MAIN ] EHAB: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:34:12.239859] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-09-23T18:34:12.239950] [DEBUG] [LOCAL ] EHAB: No primary data file found to delete. [2025-09-23T18:34:12.240007] [INFO ] [LOCAL ] EHAB: Starting deletion of derivative data. [2025-09-23T18:34:12.240355] [DEBUG] [LOCAL ] EHAB: Deleted derivative data file. [2025-09-23T18:34:12.240449] [INFO ] [MAIN ] Update Progress: 712/2372 symbols completed. EHAB took 25.3s. Estimated remaining: 3h 39m 30s. Rate: 7.6 symbols/min [2025-09-23T18:34:12.409087] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:34:12.409263] [DEBUG] [LOCAL ] EICA: No existing data file found in primary storage. [2025-09-23T18:34:12.409299] [WARN ] [MAIN ] EICA: No existing data found, performing full refresh instead. [2025-09-23T18:34:12.409444] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-09-23T18:34:12.409485] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-09-23T18:34:12.409525] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-09-23T18:34:12.409556] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-09-23T18:34:12.764827] [INFO ] [REMOTE ] EICA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:34:12.772354] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-23T18:34:13.002212] [INFO ] [REMOTE ] EICA: Fetching primary data for 2024-12. [2025-09-23T18:34:13.261081] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2024-12 (0.26 seconds). [2025-09-23T18:34:13.802201] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-09. [2025-09-23T18:34:14.602195] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-04. [2025-09-23T18:34:14.977493] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-23T18:34:14.983734] [INFO ] [REMOTE ] EHC: Full fetch complete (58875 records). [2025-09-23T18:34:14.983842] [DEBUG] [VALIDATOR ] EHC: Validating primary data. [2025-09-23T18:34:15.393138] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-23T18:34:15.392895] [DEBUG] [VALIDATOR ] EHC: All expected trading days are present. [2025-09-23T18:34:15.393284] [DEBUG] [VALIDATOR ] EHC: Primary data validation passed. [2025-09-23T18:34:15.396379] [INFO ] [MAIN ] EHC: Fetched primary data is valid. [2025-09-23T18:34:15.396464] [DEBUG] [LOCAL ] EHC: Saving primary data. [2025-09-23T18:34:15.398482] [DEBUG] [LOCAL ] EHC: Trimmed 58875 records to 41442 (keeping 200 days of data) [2025-09-23T18:34:15.453571] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-05. [2025-09-23T18:34:15.661939] [DEBUG] [LOCAL ] EHC: Primary data saved (41442 records). [2025-09-23T18:34:15.662090] [INFO ] [MAIN ] EHC: Full history saved. [2025-09-23T18:34:15.662177] [INFO ] [MAIN ] Update Progress: 713/2372 symbols completed. EHC took 26.0s. Estimated remaining: 3h 39m 12s. Rate: 7.6 symbols/min [2025-09-23T18:34:15.836242] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:34:15.836558] [DEBUG] [LOCAL ] EICB: No existing data file found in primary storage. [2025-09-23T18:34:15.836614] [WARN ] [MAIN ] EICB: No existing data found, performing full refresh instead. [2025-09-23T18:34:15.836794] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-09-23T18:34:15.836837] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-09-23T18:34:15.836925] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-09-23T18:34:15.836966] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-09-23T18:34:16.209264] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-01. [2025-09-23T18:34:16.243025] [INFO ] [REMOTE ] EICB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:34:16.236930] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-23T18:34:16.657208] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-23T18:34:17.002217] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-06. [2025-09-23T18:34:17.798904] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-23T18:34:17.802153] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-07. [2025-09-23T18:34:18.389674] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-23T18:34:18.602231] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-09-23T18:34:18.930439] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-23T18:34:19.402189] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-01. [2025-09-23T18:34:20.202203] [INFO ] [REMOTE ] EICB: Fetching primary data for 2024-12. [2025-09-23T18:34:20.333324] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-23T18:34:20.571704] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-09-23T18:34:21.002208] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-09-23T18:34:21.277618] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-09-23T18:34:21.802224] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-08. [2025-09-23T18:34:22.602195] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-02. [2025-09-23T18:34:22.727127] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-23T18:34:23.402235] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-09-23T18:34:23.467442] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-23T18:34:23.826836] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-23T18:34:24.202216] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-01. [2025-09-23T18:34:24.916328] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-23T18:34:25.002177] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-09-23T18:34:25.408318] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-23T18:34:25.802207] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-09-23T18:34:26.115335] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-23T18:34:26.602194] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-09. [2025-09-23T18:34:27.370253] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-23T18:34:27.372947] [INFO ] [REMOTE ] EHI: Full fetch complete (16384 records). [2025-09-23T18:34:27.373044] [DEBUG] [VALIDATOR ] EHI: Validating primary data. [2025-09-23T18:34:27.407461] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-09-23T18:34:27.755996] [DEBUG] [VALIDATOR ] EHI: All expected trading days are present. [2025-09-23T18:34:27.756112] [DEBUG] [VALIDATOR ] EHI: Primary data validation passed. [2025-09-23T18:34:27.756502] [INFO ] [MAIN ] EHI: Fetched primary data is valid. [2025-09-23T18:34:27.756545] [DEBUG] [LOCAL ] EHI: Saving primary data. [2025-09-23T18:34:27.757093] [DEBUG] [LOCAL ] EHI: Trimmed 16384 records to 10315 (keeping 200 days of data) [2025-09-23T18:34:27.818337] [DEBUG] [LOCAL ] EHI: Primary data saved (10315 records). [2025-09-23T18:34:27.818546] [INFO ] [MAIN ] EHI: Full history saved. [2025-09-23T18:34:27.818691] [INFO ] [MAIN ] Update Progress: 714/2372 symbols completed. EHI took 31.5s. Estimated remaining: 3h 39m 14s. Rate: 7.6 symbols/min [2025-09-23T18:34:27.925624] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-23T18:34:27.997775] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:34:27.997970] [DEBUG] [LOCAL ] EICC: No existing data file found in primary storage. [2025-09-23T18:34:27.998028] [WARN ] [MAIN ] EICC: No existing data found, performing full refresh instead. [2025-09-23T18:34:27.998184] [INFO ] [MAIN ] EICC: Wiping existing primary data before full refresh. [2025-09-23T18:34:27.998227] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-09-23T18:34:27.998268] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-09-23T18:34:27.998301] [INFO ] [MAIN ] EICC: Starting full primary refresh. [2025-09-23T18:34:28.207373] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-09-23T18:34:28.375078] [INFO ] [REMOTE ] EICC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:34:28.555610] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-23T18:34:29.002217] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-03. [2025-09-23T18:34:29.802199] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-09-23T18:34:29.967475] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-23T18:34:30.247977] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-23T18:34:30.602230] [INFO ] [REMOTE ] EICC: Fetching primary data for 2024-12. [2025-09-23T18:34:31.056333] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-23T18:34:31.402205] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-09-23T18:34:31.733752] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-23T18:34:32.202197] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-04. [2025-09-23T18:34:33.002228] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-01. [2025-09-23T18:34:33.210445] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-23T18:34:33.575838] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-23T18:34:33.802203] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-09-23T18:34:34.251319] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-23T18:34:34.602249] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-09-23T18:34:34.921744] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-23T18:34:35.402193] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-02. [2025-09-23T18:34:36.024171] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-23T18:34:36.202220] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-09-23T18:34:36.808577] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-23T18:34:37.002206] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-09-23T18:34:37.322424] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-23T18:34:37.802204] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-05. [2025-09-23T18:34:38.602223] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-03. [2025-09-23T18:34:38.984816] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-23T18:34:39.033835] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-23T18:34:39.402195] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-09-23T18:34:39.964248] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-23T18:34:39.965711] [INFO ] [REMOTE ] EICB: Full fetch complete (2662 records). [2025-09-23T18:34:39.965797] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-09-23T18:34:40.174676] [WARN ] [VALIDATOR ] EICB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-23T18:34:40.174900] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:34:40.174959] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:34:40.175039] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-09-23T18:34:40.175142] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-09-23T18:34:40.175196] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-09-23T18:34:40.175239] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-09-23T18:34:40.175336] [INFO ] [MAIN ] Update Progress: 715/2372 symbols completed. EICB took 24.5s. Estimated remaining: 3h 39m 16s. Rate: 7.6 symbols/min [2025-09-23T18:34:40.205758] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-04. [2025-09-23T18:34:40.356439] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:34:40.382527] [DEBUG] [LOCAL ] EIG: Loaded 20316 existing records from primary storage. [2025-09-23T18:34:40.382691] [INFO ] [MAIN ] EIG: Loaded 20316 existing records. [2025-09-23T18:34:40.560136] [WARN ] [MAIN ] EIG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:34:40.560429] [INFO ] [MAIN ] EIG: Wiping existing primary data before full refresh. [2025-09-23T18:34:40.560519] [INFO ] [LOCAL ] EIG: Starting deletion of primary data. [2025-09-23T18:34:40.561290] [DEBUG] [LOCAL ] EIG: Deleted primary data file. [2025-09-23T18:34:40.561351] [INFO ] [MAIN ] EIG: Starting full primary refresh. [2025-09-23T18:34:40.794333] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-23T18:34:40.955226] [INFO ] [REMOTE ] EIG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:34:41.002226] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-06. [2025-09-23T18:34:41.802241] [INFO ] [REMOTE ] EIG: Fetching primary data for 2024-12. [2025-09-23T18:34:42.144226] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-23T18:34:42.542665] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-23T18:34:42.602188] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-01. [2025-09-23T18:34:43.386440] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-23T18:34:43.402161] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-02. [2025-09-23T18:34:44.202258] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-07. [2025-09-23T18:34:44.399202] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-23T18:34:45.002199] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-03. [2025-09-23T18:34:45.173461] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-23T18:34:45.744507] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-23T18:34:45.802232] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-04. [2025-09-23T18:34:46.602396] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-09-23T18:34:46.920042] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-23T18:34:47.061734] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-23T18:34:47.402219] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-05. [2025-09-23T18:34:47.830609] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-23T18:34:48.202207] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-08. [2025-09-23T18:34:48.938634] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-23T18:34:49.002177] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-09. [2025-09-23T18:34:49.802206] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-09-23T18:34:49.927100] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-23T18:34:49.930615] [INFO ] [REMOTE ] EIC: Full fetch complete (35483 records). [2025-09-23T18:34:49.930780] [DEBUG] [VALIDATOR ] EIC: Validating primary data. [2025-09-23T18:34:50.187774] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-23T18:34:50.227570] [INFO ] [REMOTE ] EICA: Full fetch complete (1263 records). [2025-09-23T18:34:50.227713] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-09-23T18:34:50.576906] [WARN ] [VALIDATOR ] EICA: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-23T18:34:50.577304] [DEBUG] [VALIDATOR ] EIC: All expected trading days are present. [2025-09-23T18:34:50.577419] [DEBUG] [VALIDATOR ] EIC: Primary data validation passed. [2025-09-23T18:34:50.578176] [INFO ] [MAIN ] EIC: Fetched primary data is valid. [2025-09-23T18:34:50.578385] [DEBUG] [LOCAL ] EIC: Saving primary data. [2025-09-23T18:34:50.578282] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:34:50.578638] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:34:50.578741] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-09-23T18:34:50.578932] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-09-23T18:34:50.579005] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-09-23T18:34:50.579089] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-09-23T18:34:50.579186] [INFO ] [MAIN ] Update Progress: 716/2372 symbols completed. EICA took 38.3s. Estimated remaining: 3h 39m 14s. Rate: 7.6 symbols/min [2025-09-23T18:34:50.610747] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-06. [2025-09-23T18:34:50.675006] [DEBUG] [LOCAL ] EIC: Trimmed 35483 records to 24236 (keeping 200 days of data) [2025-09-23T18:34:50.875946] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:34:50.952797] [DEBUG] [LOCAL ] EIC: Primary data saved (24236 records). [2025-09-23T18:34:50.953084] [INFO ] [MAIN ] EIC: Full history saved. [2025-09-23T18:34:50.953187] [INFO ] [MAIN ] Update Progress: 717/2372 symbols completed. EIC took 48.5s. Estimated remaining: 3h 38m 49s. Rate: 7.6 symbols/min [2025-09-23T18:34:50.979824] [DEBUG] [LOCAL ] EIX: Loaded 53346 existing records from primary storage. [2025-09-23T18:34:50.980055] [INFO ] [MAIN ] EIX: Loaded 53346 existing records. [2025-09-23T18:34:51.189247] [WARN ] [MAIN ] EIX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:34:51.189895] [INFO ] [MAIN ] EIX: Wiping existing primary data before full refresh. [2025-09-23T18:34:51.189967] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-09-23T18:34:51.191216] [DEBUG] [LOCAL ] EIX: Deleted primary data file. [2025-09-23T18:34:51.191278] [INFO ] [MAIN ] EIX: Starting full primary refresh. [2025-09-23T18:34:51.410018] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-05. [2025-09-23T18:34:51.480697] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-23T18:34:51.601854] [INFO ] [REMOTE ] EIX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:34:52.202197] [INFO ] [REMOTE ] EIX: Fetching primary data for 2024-12. [2025-09-23T18:34:52.548779] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-23T18:34:53.002239] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-07. [2025-09-23T18:34:53.802193] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-06. [2025-09-23T18:34:53.844905] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-23T18:34:54.553254] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2024-12 (2.35 seconds). [2025-09-23T18:34:54.602203] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-08. [2025-09-23T18:34:55.037143] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-23T18:34:55.052391] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-23T18:34:55.402268] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-09. [2025-09-23T18:34:55.962953] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-23T18:34:55.965317] [INFO ] [REMOTE ] EICC: Full fetch complete (7866 records). [2025-09-23T18:34:55.965407] [DEBUG] [VALIDATOR ] EICC: Validating primary data. [2025-09-23T18:34:55.965960] [FATAL] [VALIDATOR ] EICC: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:34:55.966060] [FATAL] [MAIN ] EICC: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:34:55.966114] [WARN ] [MAIN ] EICC: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:34:55.966164] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-09-23T18:34:55.966266] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-09-23T18:34:55.966318] [INFO ] [LOCAL ] EICC: Starting deletion of derivative data. [2025-09-23T18:34:55.966404] [DEBUG] [LOCAL ] EICC: No derivative data file found to delete. [2025-09-23T18:34:55.966563] [INFO ] [MAIN ] Update Progress: 718/2372 symbols completed. EICC took 28.1s. Estimated remaining: 3h 38m 34s. Rate: 7.6 symbols/min [2025-09-23T18:34:56.202250] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-07. [2025-09-23T18:34:57.007399] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-01. [2025-09-23T18:34:57.009318] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-23T18:34:57.802210] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-08. [2025-09-23T18:34:58.601523] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-23T18:34:58.612744] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-02. [2025-09-23T18:34:58.665603] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-23T18:34:59.402300] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-09. [2025-09-23T18:35:00.068502] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-23T18:35:00.202195] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-03. [2025-09-23T18:35:00.278732] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-23T18:35:00.283041] [INFO ] [REMOTE ] EIG: Full fetch complete (26946 records). [2025-09-23T18:35:00.283160] [DEBUG] [VALIDATOR ] EIG: Validating primary data. [2025-09-23T18:35:00.676147] [DEBUG] [VALIDATOR ] EIG: All expected trading days are present. [2025-09-23T18:35:00.676280] [DEBUG] [VALIDATOR ] EIG: Primary data validation passed. [2025-09-23T18:35:00.677084] [INFO ] [MAIN ] EIG: Fetched primary data is valid. [2025-09-23T18:35:00.677210] [DEBUG] [LOCAL ] EIG: Saving primary data. [2025-09-23T18:35:00.678341] [DEBUG] [LOCAL ] EIG: Trimmed 26946 records to 20345 (keeping 200 days of data) [2025-09-23T18:35:00.823622] [DEBUG] [LOCAL ] EIG: Primary data saved (20345 records). [2025-09-23T18:35:00.823828] [INFO ] [MAIN ] EIG: Full history saved. [2025-09-23T18:35:00.823966] [INFO ] [MAIN ] Update Progress: 719/2372 symbols completed. EIG took 20.6s. Estimated remaining: 3h 38m 19s. Rate: 7.6 symbols/min [2025-09-23T18:35:01.815920] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-23T18:35:01.832482] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-04. [2025-09-23T18:35:03.549726] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-23T18:35:03.561056] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-05. [2025-09-23T18:35:05.215729] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-23T18:35:05.227408] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-06. [2025-09-23T18:35:06.729447] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-23T18:35:06.741819] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-07. [2025-09-23T18:35:08.358840] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-23T18:35:08.371548] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-08. [2025-09-23T18:35:10.240686] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-23T18:35:10.252312] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-09. [2025-09-23T18:35:11.946338] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-23T18:35:11.955217] [INFO ] [REMOTE ] EIX: Full fetch complete (76953 records). [2025-09-23T18:35:11.955398] [DEBUG] [VALIDATOR ] EIX: Validating primary data. [2025-09-23T18:35:12.387348] [DEBUG] [VALIDATOR ] EIX: All expected trading days are present. [2025-09-23T18:35:12.387491] [DEBUG] [VALIDATOR ] EIX: Primary data validation passed. [2025-09-23T18:35:12.389147] [INFO ] [MAIN ] EIX: Fetched primary data is valid. [2025-09-23T18:35:12.389220] [DEBUG] [LOCAL ] EIX: Saving primary data. [2025-09-23T18:35:12.391424] [DEBUG] [LOCAL ] EIX: Trimmed 76953 records to 53345 (keeping 200 days of data) [2025-09-23T18:35:12.736942] [DEBUG] [LOCAL ] EIX: Primary data saved (53345 records). [2025-09-23T18:35:12.737118] [INFO ] [MAIN ] EIX: Full history saved. [2025-09-23T18:35:12.737324] [INFO ] [MAIN ] Update Progress: 720/2372 symbols completed. EIX took 22.2s. Estimated remaining: 3h 38m 20s. Rate: 7.6 symbols/min [2025-09-23T18:35:13.293273] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:35:13.448146] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:35:13.467680] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:35:13.446250] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:35:13.482539] [DEBUG] [LOCAL ] ELC: Loaded 3492 existing records from primary storage. [2025-09-23T18:35:13.482771] [INFO ] [MAIN ] ELC: Loaded 3492 existing records. [2025-09-23T18:35:13.706898] [WARN ] [MAIN ] ELC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:35:13.729686] [INFO ] [MAIN ] ELC: Wiping existing primary data before full refresh. [2025-09-23T18:35:13.729888] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-09-23T18:35:13.744255] [DEBUG] [LOCAL ] ELC: Deleted primary data file. [2025-09-23T18:35:13.744459] [INFO ] [MAIN ] ELC: Starting full primary refresh. [2025-09-23T18:35:13.750788] [DEBUG] [LOCAL ] ELF: Loaded 52315 existing records from primary storage. [2025-09-23T18:35:13.811093] [INFO ] [MAIN ] ELF: Loaded 52315 existing records. [2025-09-23T18:35:13.924677] [DEBUG] [LOCAL ] EL: Loaded 53412 existing records from primary storage. [2025-09-23T18:35:13.966087] [INFO ] [MAIN ] EL: Loaded 53412 existing records. [2025-09-23T18:35:14.027681] [DEBUG] [LOCAL ] ELAN: Loaded 53187 existing records from primary storage. [2025-09-23T18:35:14.065969] [INFO ] [MAIN ] ELAN: Loaded 53187 existing records. [2025-09-23T18:35:14.567700] [WARN ] [MAIN ] ELF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:35:14.686003] [INFO ] [MAIN ] ELF: Wiping existing primary data before full refresh. [2025-09-23T18:35:14.754331] [WARN ] [MAIN ] EL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:35:14.746195] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-09-23T18:35:14.802893] [DEBUG] [LOCAL ] ELF: Deleted primary data file. [2025-09-23T18:35:14.802783] [INFO ] [MAIN ] EL: Wiping existing primary data before full refresh. [2025-09-23T18:35:14.803187] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-09-23T18:35:14.803290] [INFO ] [MAIN ] ELF: Starting full primary refresh. [2025-09-23T18:35:14.797436] [INFO ] [REMOTE ] ELC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:35:14.808919] [INFO ] [REMOTE ] ELC: Fetching primary data for 2024-12. [2025-09-23T18:35:14.843432] [WARN ] [MAIN ] ELAN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:35:14.832190] [DEBUG] [LOCAL ] EL: Deleted primary data file. [2025-09-23T18:35:14.854188] [INFO ] [MAIN ] EL: Starting full primary refresh. [2025-09-23T18:35:14.909208] [INFO ] [MAIN ] ELAN: Wiping existing primary data before full refresh. [2025-09-23T18:35:14.936748] [INFO ] [LOCAL ] ELAN: Starting deletion of primary data. [2025-09-23T18:35:15.036264] [DEBUG] [LOCAL ] ELAN: Deleted primary data file. [2025-09-23T18:35:15.062833] [INFO ] [MAIN ] ELAN: Starting full primary refresh. [2025-09-23T18:35:15.721153] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-23T18:35:15.812615] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-01. [2025-09-23T18:35:15.888050] [INFO ] [REMOTE ] EL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:35:15.885154] [INFO ] [REMOTE ] ELF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:35:15.909969] [INFO ] [REMOTE ] EL: Fetching primary data for 2024-12. [2025-09-23T18:35:15.929555] [INFO ] [REMOTE ] ELF: Fetching primary data for 2024-12. [2025-09-23T18:35:15.972193] [INFO ] [REMOTE ] ELAN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:35:15.972786] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2024-12. [2025-09-23T18:35:16.553465] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-23T18:35:16.555911] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-02. [2025-09-23T18:35:16.904716] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-23T18:35:16.906152] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-03. [2025-09-23T18:35:17.319989] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-23T18:35:17.331287] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-01. [2025-09-23T18:35:17.357039] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-23T18:35:17.358470] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-04. [2025-09-23T18:35:17.652175] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-23T18:35:17.662305] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-01. [2025-09-23T18:35:17.791261] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-23T18:35:17.792842] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-05. [2025-09-23T18:35:18.238937] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-09-23T18:35:18.249954] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-01. [2025-09-23T18:35:18.349718] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-23T18:35:18.351262] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-06. [2025-09-23T18:35:18.560885] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-23T18:35:18.571537] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-02. [2025-09-23T18:35:18.779562] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-23T18:35:18.781074] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-07. [2025-09-23T18:35:19.307103] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-23T18:35:19.308700] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-08. [2025-09-23T18:35:19.340151] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-23T18:35:19.350179] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-02. [2025-09-23T18:35:19.825872] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-23T18:35:19.829867] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-09. [2025-09-23T18:35:19.828976] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-23T18:35:19.872586] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-23T18:35:20.202191] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-03. [2025-09-23T18:35:20.362511] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-23T18:35:20.363682] [INFO ] [REMOTE ] ELC: Full fetch complete (5147 records). [2025-09-23T18:35:20.363755] [DEBUG] [VALIDATOR ] ELC: Validating primary data. [2025-09-23T18:35:20.745004] [DEBUG] [VALIDATOR ] ELC: All expected trading days are present. [2025-09-23T18:35:20.745108] [DEBUG] [VALIDATOR ] ELC: Primary data validation passed. [2025-09-23T18:35:20.745275] [INFO ] [MAIN ] ELC: Fetched primary data is valid. [2025-09-23T18:35:20.745314] [DEBUG] [LOCAL ] ELC: Saving primary data. [2025-09-23T18:35:20.745717] [DEBUG] [LOCAL ] ELC: Trimmed 5147 records to 3497 (keeping 200 days of data) [2025-09-23T18:35:20.768700] [DEBUG] [LOCAL ] ELC: Primary data saved (3497 records). [2025-09-23T18:35:20.768805] [INFO ] [MAIN ] ELC: Full history saved. [2025-09-23T18:35:20.768888] [INFO ] [MAIN ] Update Progress: 721/2372 symbols completed. ELC took 8.0s. Estimated remaining: 3h 38m 12s. Rate: 7.6 symbols/min [2025-09-23T18:35:20.955434] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:35:21.018108] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-02. [2025-09-23T18:35:21.021790] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-23T18:35:21.045009] [DEBUG] [LOCAL ] ELME: Loaded 39258 existing records from primary storage. [2025-09-23T18:35:21.045465] [INFO ] [MAIN ] ELME: Loaded 39258 existing records. [2025-09-23T18:35:21.240080] [WARN ] [MAIN ] ELME: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:35:21.240320] [INFO ] [MAIN ] ELME: Wiping existing primary data before full refresh. [2025-09-23T18:35:21.240369] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-09-23T18:35:21.241722] [DEBUG] [LOCAL ] ELME: Deleted primary data file. [2025-09-23T18:35:21.241790] [INFO ] [MAIN ] ELME: Starting full primary refresh. [2025-09-23T18:35:21.619681] [INFO ] [REMOTE ] ELME: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:35:21.688398] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-23T18:35:21.802177] [INFO ] [REMOTE ] ELME: Fetching primary data for 2024-12. [2025-09-23T18:35:22.602155] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-03. [2025-09-23T18:35:23.015535] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-23T18:35:23.097835] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-23T18:35:23.402210] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-03. [2025-09-23T18:35:24.202205] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-01. [2025-09-23T18:35:24.437249] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-23T18:35:25.002217] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-04. [2025-09-23T18:35:25.094778] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-23T18:35:25.802212] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-04. [2025-09-23T18:35:25.935591] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-23T18:35:26.602155] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-02. [2025-09-23T18:35:26.770177] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-23T18:35:27.402160] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-04. [2025-09-23T18:35:27.749444] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-23T18:35:28.001152] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-23T18:35:28.202201] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-05. [2025-09-23T18:35:29.002207] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-03. [2025-09-23T18:35:29.260747] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-23T18:35:29.617376] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-23T18:35:29.802202] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-06. [2025-09-23T18:35:30.195282] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-23T18:35:30.602211] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-05. [2025-09-23T18:35:31.115213] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-23T18:35:31.402201] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-07. [2025-09-23T18:35:32.202210] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-05. [2025-09-23T18:35:32.638886] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-23T18:35:32.723852] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-23T18:35:33.002241] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-04. [2025-09-23T18:35:33.802220] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-08. [2025-09-23T18:35:34.209726] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-23T18:35:34.275147] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-23T18:35:34.602196] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-05. [2025-09-23T18:35:35.402177] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-06. [2025-09-23T18:35:35.665520] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-23T18:35:35.705722] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-23T18:35:36.202242] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-06. [2025-09-23T18:35:37.008721] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-09. [2025-09-23T18:35:37.011309] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-23T18:35:37.208566] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-23T18:35:37.802206] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-07. [2025-09-23T18:35:38.604077] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-07. [2025-09-23T18:35:38.890443] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-23T18:35:38.902529] [INFO ] [REMOTE ] ELAN: Full fetch complete (76858 records). [2025-09-23T18:35:38.902883] [DEBUG] [VALIDATOR ] ELAN: Validating primary data. [2025-09-23T18:35:39.152729] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-23T18:35:39.407699] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-06. [2025-09-23T18:35:39.438255] [DEBUG] [VALIDATOR ] ELAN: All expected trading days are present. [2025-09-23T18:35:39.438373] [DEBUG] [VALIDATOR ] ELAN: Primary data validation passed. [2025-09-23T18:35:39.439390] [INFO ] [MAIN ] ELAN: Fetched primary data is valid. [2025-09-23T18:35:39.439558] [DEBUG] [LOCAL ] ELAN: Saving primary data. [2025-09-23T18:35:39.441171] [DEBUG] [LOCAL ] ELAN: Trimmed 76858 records to 53196 (keeping 200 days of data) [2025-09-23T18:35:39.786599] [DEBUG] [LOCAL ] ELAN: Primary data saved (53196 records). [2025-09-23T18:35:39.786788] [INFO ] [MAIN ] ELAN: Full history saved. [2025-09-23T18:35:39.786886] [INFO ] [MAIN ] Update Progress: 722/2372 symbols completed. ELAN took 27.0s. Estimated remaining: 3h 38m 30s. Rate: 7.6 symbols/min [2025-09-23T18:35:39.961440] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:35:39.961639] [DEBUG] [LOCAL ] ELP: No existing data file found in primary storage. [2025-09-23T18:35:39.961766] [WARN ] [MAIN ] ELP: No existing data found, performing full refresh instead. [2025-09-23T18:35:39.961919] [INFO ] [MAIN ] ELP: Wiping existing primary data before full refresh. [2025-09-23T18:35:39.961963] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-09-23T18:35:39.962005] [DEBUG] [LOCAL ] ELP: No primary data file found to delete. [2025-09-23T18:35:39.962039] [INFO ] [MAIN ] ELP: Starting full primary refresh. [2025-09-23T18:35:40.215916] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-08. [2025-09-23T18:35:40.342002] [INFO ] [REMOTE ] ELP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:35:40.406260] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-23T18:35:41.002196] [INFO ] [REMOTE ] ELP: Fetching primary data for 2024-12. [2025-09-23T18:35:41.656586] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-23T18:35:41.802239] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-07. [2025-09-23T18:35:41.914606] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-23T18:35:42.048572] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-23T18:35:42.602217] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-01. [2025-09-23T18:35:43.402201] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-08. [2025-09-23T18:35:43.855574] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-23T18:35:43.904796] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-23T18:35:44.202203] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-08. [2025-09-23T18:35:45.002228] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-02. [2025-09-23T18:35:45.693589] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-09-23T18:35:45.776392] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-23T18:35:45.811273] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-09. [2025-09-23T18:35:45.814804] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-23T18:35:46.602205] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-09. [2025-09-23T18:35:47.402199] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-09. [2025-09-23T18:35:47.801395] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-23T18:35:47.810304] [INFO ] [REMOTE ] ELF: Full fetch complete (75378 records). [2025-09-23T18:35:47.810452] [DEBUG] [VALIDATOR ] ELF: Validating primary data. [2025-09-23T18:35:48.262973] [DEBUG] [VALIDATOR ] ELF: All expected trading days are present. [2025-09-23T18:35:48.239612] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-03. [2025-09-23T18:35:48.264153] [DEBUG] [VALIDATOR ] ELF: Primary data validation passed. [2025-09-23T18:35:48.265306] [INFO ] [MAIN ] ELF: Fetched primary data is valid. [2025-09-23T18:35:48.265527] [DEBUG] [LOCAL ] ELF: Saving primary data. [2025-09-23T18:35:48.267502] [DEBUG] [LOCAL ] ELF: Trimmed 75378 records to 52288 (keeping 200 days of data) [2025-09-23T18:35:48.376301] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-23T18:35:48.394303] [INFO ] [REMOTE ] EL: Full fetch complete (77334 records). [2025-09-23T18:35:48.395787] [DEBUG] [VALIDATOR ] EL: Validating primary data. [2025-09-23T18:35:48.922943] [DEBUG] [VALIDATOR ] EL: All expected trading days are present. [2025-09-23T18:35:48.925883] [DEBUG] [VALIDATOR ] EL: Primary data validation passed. [2025-09-23T18:35:48.928848] [INFO ] [MAIN ] EL: Fetched primary data is valid. [2025-09-23T18:35:48.929499] [DEBUG] [LOCAL ] EL: Saving primary data. [2025-09-23T18:35:48.951438] [DEBUG] [LOCAL ] EL: Trimmed 77334 records to 53403 (keeping 200 days of data) [2025-09-23T18:35:48.954528] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-23T18:35:48.963706] [INFO ] [REMOTE ] ELME: Full fetch complete (55752 records). [2025-09-23T18:35:48.964588] [DEBUG] [VALIDATOR ] ELME: Validating primary data. [2025-09-23T18:35:49.365455] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-23T18:35:49.466525] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-04. [2025-09-23T18:35:49.711501] [DEBUG] [VALIDATOR ] ELME: All expected trading days are present. [2025-09-23T18:35:49.712464] [DEBUG] [VALIDATOR ] ELME: Primary data validation passed. [2025-09-23T18:35:49.713868] [INFO ] [MAIN ] ELME: Fetched primary data is valid. [2025-09-23T18:35:49.714782] [DEBUG] [LOCAL ] ELME: Saving primary data. [2025-09-23T18:35:49.720937] [DEBUG] [LOCAL ] ELME: Trimmed 55752 records to 39265 (keeping 200 days of data) [2025-09-23T18:35:49.826459] [DEBUG] [LOCAL ] ELF: Primary data saved (52288 records). [2025-09-23T18:35:49.827991] [INFO ] [MAIN ] ELF: Full history saved. [2025-09-23T18:35:49.828673] [INFO ] [MAIN ] Update Progress: 723/2372 symbols completed. ELF took 37.1s. Estimated remaining: 3h 38m 27s. Rate: 7.5 symbols/min [2025-09-23T18:35:50.025111] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:35:50.026451] [DEBUG] [LOCAL ] ELPC: No existing data file found in primary storage. [2025-09-23T18:35:50.028221] [WARN ] [MAIN ] ELPC: No existing data found, performing full refresh instead. [2025-09-23T18:35:50.029307] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-09-23T18:35:50.029937] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-09-23T18:35:50.030800] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-09-23T18:35:50.031150] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-09-23T18:35:50.539418] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:35:50.540557] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2024-12. [2025-09-23T18:35:50.672878] [DEBUG] [LOCAL ] EL: Primary data saved (53403 records). [2025-09-23T18:35:50.673507] [INFO ] [MAIN ] EL: Full history saved. [2025-09-23T18:35:50.674133] [INFO ] [MAIN ] Update Progress: 724/2372 symbols completed. EL took 37.9s. Estimated remaining: 3h 38m 3s. Rate: 7.6 symbols/min [2025-09-23T18:35:50.862982] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:35:50.864315] [DEBUG] [LOCAL ] ELS: No existing data file found in primary storage. [2025-09-23T18:35:50.864902] [WARN ] [MAIN ] ELS: No existing data found, performing full refresh instead. [2025-09-23T18:35:50.866743] [DEBUG] [LOCAL ] ELME: Primary data saved (39265 records). [2025-09-23T18:35:50.867068] [INFO ] [MAIN ] ELME: Full history saved. [2025-09-23T18:35:50.866980] [INFO ] [MAIN ] ELS: Wiping existing primary data before full refresh. [2025-09-23T18:35:50.867185] [INFO ] [MAIN ] Update Progress: 725/2372 symbols completed. ELME took 30.1s. Estimated remaining: 3h 37m 37s. Rate: 7.6 symbols/min [2025-09-23T18:35:50.892995] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-09-23T18:35:50.938169] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-23T18:35:50.947119] [DEBUG] [LOCAL ] ELS: No primary data file found to delete. [2025-09-23T18:35:50.976242] [INFO ] [MAIN ] ELS: Starting full primary refresh. [2025-09-23T18:35:50.986788] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-23T18:35:50.998345] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-01. [2025-09-23T18:35:51.193330] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:35:51.209184] [DEBUG] [LOCAL ] ELV: No existing data file found in primary storage. [2025-09-23T18:35:51.219616] [WARN ] [MAIN ] ELV: No existing data found, performing full refresh instead. [2025-09-23T18:35:51.253064] [INFO ] [MAIN ] ELV: Wiping existing primary data before full refresh. [2025-09-23T18:35:51.253455] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-09-23T18:35:51.269053] [DEBUG] [LOCAL ] ELV: No primary data file found to delete. [2025-09-23T18:35:51.340974] [INFO ] [MAIN ] ELV: Starting full primary refresh. [2025-09-23T18:35:51.406916] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-05. [2025-09-23T18:35:51.474596] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-23T18:35:51.575161] [INFO ] [REMOTE ] ELS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:35:51.832139] [INFO ] [REMOTE ] ELV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:35:52.202190] [INFO ] [REMOTE ] ELS: Fetching primary data for 2024-12. [2025-09-23T18:35:52.530606] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-23T18:35:53.002201] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-09-23T18:35:53.284954] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-09-23T18:35:53.622630] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-23T18:35:53.802195] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-09-23T18:35:54.135081] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-23T18:35:54.602198] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-09-23T18:35:54.911701] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-09-23T18:35:55.402199] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-09-23T18:35:56.007998] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-23T18:35:56.202199] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-06. [2025-09-23T18:35:57.002194] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-09-23T18:35:57.060045] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-23T18:35:57.334562] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-23T18:35:57.802209] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-01. [2025-09-23T18:35:58.602210] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-07. [2025-09-23T18:35:59.351127] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-23T18:35:59.402206] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-09-23T18:35:59.666534] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-09-23T18:35:59.728630] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-23T18:36:00.202194] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-09-23T18:36:00.555403] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-23T18:36:01.002217] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-02. [2025-09-23T18:36:01.802225] [INFO ] [REMOTE ] ELV: Fetching primary data for 2024-12. [2025-09-23T18:36:02.349481] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-23T18:36:02.602215] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-08. [2025-09-23T18:36:03.402201] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-09-23T18:36:04.202224] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-03. [2025-09-23T18:36:06.738551] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (3.34 seconds). [2025-09-23T18:36:06.739479] [INFO ] [REMOTE ] ELPC: Full fetch complete (1486 records). [2025-09-23T18:36:06.739572] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-09-23T18:36:06.936941] [WARN ] [VALIDATOR ] ELPC: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-23T18:36:06.937156] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:36:06.937229] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:36:06.937299] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-09-23T18:36:06.937367] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-09-23T18:36:06.937404] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-09-23T18:36:06.937475] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-09-23T18:36:06.937559] [INFO ] [MAIN ] Update Progress: 726/2372 symbols completed. ELPC took 17.1s. Estimated remaining: 3h 37m 48s. Rate: 7.6 symbols/min [2025-09-23T18:36:07.115323] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:36:07.115536] [DEBUG] [LOCAL ] EMA: No existing data file found in primary storage. [2025-09-23T18:36:07.115753] [WARN ] [MAIN ] EMA: No existing data found, performing full refresh instead. [2025-09-23T18:36:07.116124] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-09-23T18:36:07.116295] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-09-23T18:36:07.116356] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-09-23T18:36:07.116395] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-09-23T18:36:07.488029] [INFO ] [REMOTE ] EMA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:36:07.488345] [INFO ] [REMOTE ] EMA: Fetching primary data for 2024-12. [2025-09-23T18:36:07.517132] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2024-12 (5.71 seconds). [2025-09-23T18:36:07.527436] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-01. [2025-09-23T18:36:07.644224] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-08 (5.04 seconds). [2025-09-23T18:36:07.649926] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-09. [2025-09-23T18:36:08.675412] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-23T18:36:08.679418] [INFO ] [REMOTE ] ELP: Full fetch complete (37680 records). [2025-09-23T18:36:08.679507] [DEBUG] [VALIDATOR ] ELP: Validating primary data. [2025-09-23T18:36:09.006968] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:36:09.042702] [WARN ] [REMOTE ] EMA: No data returned for month 2024-12 [2025-09-23T18:36:09.057529] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-01. [2025-09-23T18:36:09.057803] [DEBUG] [VALIDATOR ] ELP: All expected trading days are present. [2025-09-23T18:36:09.058740] [DEBUG] [VALIDATOR ] ELP: Primary data validation passed. [2025-09-23T18:36:09.059360] [INFO ] [MAIN ] ELP: Fetched primary data is valid. [2025-09-23T18:36:09.059406] [DEBUG] [LOCAL ] ELP: Saving primary data. [2025-09-23T18:36:09.060472] [DEBUG] [LOCAL ] ELP: Trimmed 37680 records to 25828 (keeping 200 days of data) [2025-09-23T18:36:09.221109] [DEBUG] [LOCAL ] ELP: Primary data saved (25828 records). [2025-09-23T18:36:09.221266] [INFO ] [MAIN ] ELP: Full history saved. [2025-09-23T18:36:09.221347] [INFO ] [MAIN ] Update Progress: 727/2372 symbols completed. ELP took 29.4s. Estimated remaining: 3h 37m 27s. Rate: 7.6 symbols/min [2025-09-23T18:36:09.398956] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:36:09.397942] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:36:09.399928] [WARN ] [REMOTE ] EMA: No data returned for month 2025-01 [2025-09-23T18:36:09.400339] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-02. [2025-09-23T18:36:09.438224] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-03 (5.24 seconds). [2025-09-23T18:36:09.454534] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-04. [2025-09-23T18:36:09.464359] [DEBUG] [LOCAL ] EMD: Loaded 21191 existing records from primary storage. [2025-09-23T18:36:09.464509] [INFO ] [MAIN ] EMD: Loaded 21191 existing records. [2025-09-23T18:36:09.647423] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:36:09.647546] [WARN ] [MAIN ] EMD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:36:09.648368] [INFO ] [MAIN ] EMD: Wiping existing primary data before full refresh. [2025-09-23T18:36:09.648285] [WARN ] [REMOTE ] EMA: No data returned for month 2025-02 [2025-09-23T18:36:09.648495] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-09-23T18:36:09.649764] [DEBUG] [LOCAL ] EMD: Deleted primary data file. [2025-09-23T18:36:09.649828] [INFO ] [MAIN ] EMD: Starting full primary refresh. [2025-09-23T18:36:09.819347] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-03. [2025-09-23T18:36:10.068157] [INFO ] [REMOTE ] EMD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:36:10.070453] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-01 (2.54 seconds). [2025-09-23T18:36:10.096351] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:36:10.096609] [WARN ] [REMOTE ] EMA: No data returned for month 2025-03 [2025-09-23T18:36:10.602238] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-02. [2025-09-23T18:36:10.836427] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-23T18:36:11.402240] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-04. [2025-09-23T18:36:11.601266] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:36:11.601564] [WARN ] [REMOTE ] EMA: No data returned for month 2025-04 [2025-09-23T18:36:11.925423] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-23T18:36:12.202248] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-03. [2025-09-23T18:36:13.002294] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-05. [2025-09-23T18:36:13.802244] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-05. [2025-09-23T18:36:13.840759] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-23T18:36:14.385959] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-23T18:36:14.602209] [INFO ] [REMOTE ] EMD: Fetching primary data for 2024-12. [2025-09-23T18:36:15.402177] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-04. [2025-09-23T18:36:15.997710] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-05 (3.00 seconds). [2025-09-23T18:36:16.202229] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-06. [2025-09-23T18:36:17.002261] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-06. [2025-09-23T18:36:17.231291] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2024-12 (2.63 seconds). [2025-09-23T18:36:17.802248] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-01. [2025-09-23T18:36:18.105281] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-23T18:36:18.536846] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-04 (3.13 seconds). [2025-09-23T18:36:18.570935] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-23T18:36:18.602155] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-02. [2025-09-23T18:36:19.060193] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-06 (2.86 seconds). [2025-09-23T18:36:19.355964] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-23T18:36:19.402152] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-03. [2025-09-23T18:36:20.147159] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-23T18:36:20.202167] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-04. [2025-09-23T18:36:21.009855] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-07. [2025-09-23T18:36:21.011760] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-23T18:36:21.802205] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-07. [2025-09-23T18:36:22.446271] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-23T18:36:22.602171] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-08. [2025-09-23T18:36:23.402245] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-05. [2025-09-23T18:36:23.478053] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-23T18:36:23.769131] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-23T18:36:24.202198] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-08. [2025-09-23T18:36:24.941878] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-23T18:36:25.002211] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-06. [2025-09-23T18:36:25.392179] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-23T18:36:25.802204] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-09. [2025-09-23T18:36:26.419363] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-23T18:36:26.602225] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-05. [2025-09-23T18:36:26.622802] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-23T18:36:26.625915] [INFO ] [REMOTE ] EMA: Full fetch complete (7954 records). [2025-09-23T18:36:26.626000] [DEBUG] [VALIDATOR ] EMA: Validating primary data. [2025-09-23T18:36:26.822440] [WARN ] [VALIDATOR ] EMA: Validation failed - insufficient historical data. Have 82 unique days, need 200 days [2025-09-23T18:36:26.822736] [FATAL] [MAIN ] EMA: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:36:26.822811] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:36:26.822883] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-09-23T18:36:26.822952] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-09-23T18:36:26.822991] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-09-23T18:36:26.823066] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-09-23T18:36:26.823180] [INFO ] [MAIN ] Update Progress: 728/2372 symbols completed. EMA took 19.9s. Estimated remaining: 3h 37m 41s. Rate: 7.6 symbols/min [2025-09-23T18:36:27.010246] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:36:27.047494] [DEBUG] [LOCAL ] EME: Loaded 31792 existing records from primary storage. [2025-09-23T18:36:27.047668] [INFO ] [MAIN ] EME: Loaded 31792 existing records. [2025-09-23T18:36:27.225736] [WARN ] [MAIN ] EME: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:36:27.226044] [INFO ] [MAIN ] EME: Wiping existing primary data before full refresh. [2025-09-23T18:36:27.226105] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-09-23T18:36:27.227129] [DEBUG] [LOCAL ] EME: Deleted primary data file. [2025-09-23T18:36:27.227189] [INFO ] [MAIN ] EME: Starting full primary refresh. [2025-09-23T18:36:27.407502] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-07. [2025-09-23T18:36:27.607970] [INFO ] [REMOTE ] EME: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:36:28.202176] [INFO ] [REMOTE ] EME: Fetching primary data for 2024-12. [2025-09-23T18:36:28.238493] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-23T18:36:29.002200] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-06. [2025-09-23T18:36:29.726341] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-23T18:36:29.802186] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-07. [2025-09-23T18:36:30.369779] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-07 (2.96 seconds). [2025-09-23T18:36:30.440219] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-09-23T18:36:30.602233] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-08. [2025-09-23T18:36:31.008891] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-23T18:36:31.402292] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-08. [2025-09-23T18:36:32.138564] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-23T18:36:32.171821] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-23T18:36:32.202143] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-09. [2025-09-23T18:36:33.002253] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-01. [2025-09-23T18:36:33.322316] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-23T18:36:33.326583] [INFO ] [REMOTE ] EMD: Full fetch complete (32179 records). [2025-09-23T18:36:33.326791] [DEBUG] [VALIDATOR ] EMD: Validating primary data. [2025-09-23T18:36:33.726356] [DEBUG] [VALIDATOR ] EMD: All expected trading days are present. [2025-09-23T18:36:33.726440] [DEBUG] [VALIDATOR ] EMD: Primary data validation passed. [2025-09-23T18:36:33.726968] [INFO ] [MAIN ] EMD: Fetched primary data is valid. [2025-09-23T18:36:33.727031] [DEBUG] [LOCAL ] EMD: Saving primary data. [2025-09-23T18:36:33.727845] [DEBUG] [LOCAL ] EMD: Trimmed 32179 records to 21115 (keeping 200 days of data) [2025-09-23T18:36:33.815582] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-09. [2025-09-23T18:36:33.858570] [DEBUG] [LOCAL ] EMD: Primary data saved (21115 records). [2025-09-23T18:36:33.858738] [INFO ] [MAIN ] EMD: Full history saved. [2025-09-23T18:36:33.858836] [INFO ] [MAIN ] Update Progress: 729/2372 symbols completed. EMD took 24.6s. Estimated remaining: 3h 37m 31s. Rate: 7.6 symbols/min [2025-09-23T18:36:34.035449] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:36:34.041560] [DEBUG] [LOCAL ] EMF: Loaded 3627 existing records from primary storage. [2025-09-23T18:36:34.041699] [INFO ] [MAIN ] EMF: Loaded 3627 existing records. [2025-09-23T18:36:34.246104] [WARN ] [MAIN ] EMF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:36:34.246900] [INFO ] [MAIN ] EMF: Wiping existing primary data before full refresh. [2025-09-23T18:36:34.247000] [INFO ] [LOCAL ] EMF: Starting deletion of primary data. [2025-09-23T18:36:34.247407] [DEBUG] [LOCAL ] EMF: Deleted primary data file. [2025-09-23T18:36:34.247541] [INFO ] [MAIN ] EMF: Starting full primary refresh. [2025-09-23T18:36:34.438734] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-23T18:36:34.607336] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-09. [2025-09-23T18:36:34.661536] [INFO ] [REMOTE ] EMF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:36:35.298945] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-23T18:36:35.312466] [INFO ] [REMOTE ] ELS: Full fetch complete (70511 records). [2025-09-23T18:36:35.312693] [DEBUG] [VALIDATOR ] ELS: Validating primary data. [2025-09-23T18:36:35.410809] [INFO ] [REMOTE ] EMF: Fetching primary data for 2024-12. [2025-09-23T18:36:35.705913] [DEBUG] [VALIDATOR ] ELS: All expected trading days are present. [2025-09-23T18:36:35.706003] [DEBUG] [VALIDATOR ] ELS: Primary data validation passed. [2025-09-23T18:36:35.706849] [INFO ] [MAIN ] ELS: Fetched primary data is valid. [2025-09-23T18:36:35.706912] [DEBUG] [LOCAL ] ELS: Saving primary data. [2025-09-23T18:36:35.708315] [DEBUG] [LOCAL ] ELS: Trimmed 70511 records to 49399 (keeping 200 days of data) [2025-09-23T18:36:36.008235] [DEBUG] [LOCAL ] ELS: Primary data saved (49399 records). [2025-09-23T18:36:36.008393] [INFO ] [MAIN ] ELS: Full history saved. [2025-09-23T18:36:36.008483] [INFO ] [MAIN ] Update Progress: 730/2372 symbols completed. ELS took 45.3s. Estimated remaining: 3h 37m 10s. Rate: 7.6 symbols/min [2025-09-23T18:36:36.181361] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:36:36.209711] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-02. [2025-09-23T18:36:36.230214] [DEBUG] [LOCAL ] EMN: Loaded 50340 existing records from primary storage. [2025-09-23T18:36:36.230374] [INFO ] [MAIN ] EMN: Loaded 50340 existing records. [2025-09-23T18:36:36.455291] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-23T18:36:36.454868] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-23T18:36:36.458014] [WARN ] [MAIN ] EMN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:36:36.466761] [INFO ] [MAIN ] EMN: Wiping existing primary data before full refresh. [2025-09-23T18:36:36.466935] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-09-23T18:36:36.467251] [INFO ] [REMOTE ] ELV: Full fetch complete (73216 records). [2025-09-23T18:36:36.467341] [DEBUG] [VALIDATOR ] ELV: Validating primary data. [2025-09-23T18:36:36.499510] [DEBUG] [LOCAL ] EMN: Deleted primary data file. [2025-09-23T18:36:36.531844] [INFO ] [MAIN ] EMN: Starting full primary refresh. [2025-09-23T18:36:37.025805] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-01. [2025-09-23T18:36:37.242967] [DEBUG] [VALIDATOR ] ELV: All expected trading days are present. [2025-09-23T18:36:37.242856] [INFO ] [REMOTE ] EMN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:36:37.243309] [DEBUG] [VALIDATOR ] ELV: Primary data validation passed. [2025-09-23T18:36:37.244242] [INFO ] [MAIN ] ELV: Fetched primary data is valid. [2025-09-23T18:36:37.244307] [DEBUG] [LOCAL ] ELV: Saving primary data. [2025-09-23T18:36:37.245780] [DEBUG] [LOCAL ] ELV: Trimmed 73216 records to 50571 (keeping 200 days of data) [2025-09-23T18:36:37.595871] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-23T18:36:37.623336] [DEBUG] [LOCAL ] ELV: Primary data saved (50571 records). [2025-09-23T18:36:37.623514] [INFO ] [MAIN ] ELV: Full history saved. [2025-09-23T18:36:37.623601] [INFO ] [MAIN ] Update Progress: 731/2372 symbols completed. ELV took 46.8s. Estimated remaining: 3h 36m 48s. Rate: 7.6 symbols/min [2025-09-23T18:36:37.807373] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-03. [2025-09-23T18:36:37.811152] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:36:37.827424] [DEBUG] [LOCAL ] EMO: Loaded 12340 existing records from primary storage. [2025-09-23T18:36:37.827609] [INFO ] [MAIN ] EMO: Loaded 12340 existing records. [2025-09-23T18:36:38.030961] [WARN ] [MAIN ] EMO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:36:38.024967] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-23T18:36:38.034185] [INFO ] [MAIN ] EMO: Wiping existing primary data before full refresh. [2025-09-23T18:36:38.034806] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-09-23T18:36:38.035910] [DEBUG] [LOCAL ] EMO: Deleted primary data file. [2025-09-23T18:36:38.035974] [INFO ] [MAIN ] EMO: Starting full primary refresh. [2025-09-23T18:36:38.442416] [INFO ] [REMOTE ] EMO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:36:38.602193] [INFO ] [REMOTE ] EMO: Fetching primary data for 2024-12. [2025-09-23T18:36:39.402206] [INFO ] [REMOTE ] EMN: Fetching primary data for 2024-12. [2025-09-23T18:36:39.443691] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-23T18:36:39.460733] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-23T18:36:40.202224] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-04. [2025-09-23T18:36:40.944988] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-23T18:36:41.002217] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-02. [2025-09-23T18:36:41.534393] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-23T18:36:41.613204] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-23T18:36:41.802200] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-01. [2025-09-23T18:36:42.602223] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-03. [2025-09-23T18:36:43.028431] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-23T18:36:43.380586] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-23T18:36:43.402154] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-02. [2025-09-23T18:36:44.202193] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-01. [2025-09-23T18:36:44.925151] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-23T18:36:44.957637] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-23T18:36:45.002183] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-02. [2025-09-23T18:36:45.496258] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-23T18:36:45.802199] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-04. [2025-09-23T18:36:46.275171] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-23T18:36:46.602268] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-03. [2025-09-23T18:36:47.402299] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-05. [2025-09-23T18:36:47.932567] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-23T18:36:48.202216] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-03. [2025-09-23T18:36:48.502045] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-23T18:36:48.726162] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-23T18:36:49.002209] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-05. [2025-09-23T18:36:49.650578] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-23T18:36:49.802160] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-06. [2025-09-23T18:36:50.334779] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-23T18:36:50.602304] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-07. [2025-09-23T18:36:51.338411] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-23T18:36:51.402201] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-04. [2025-09-23T18:36:52.202169] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-04. [2025-09-23T18:36:52.362933] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-23T18:36:53.002208] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-05. [2025-09-23T18:36:53.506914] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-23T18:36:53.802163] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-06. [2025-09-23T18:36:54.084203] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-23T18:36:54.332177] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-23T18:36:54.602210] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-05. [2025-09-23T18:36:55.402188] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-08. [2025-09-23T18:36:55.747695] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-23T18:36:55.939282] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-23T18:36:56.202185] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-06. [2025-09-23T18:36:57.002197] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-09. [2025-09-23T18:36:57.542515] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-23T18:36:57.543580] [INFO ] [REMOTE ] EMF: Full fetch complete (7326 records). [2025-09-23T18:36:57.543673] [DEBUG] [VALIDATOR ] EMF: Validating primary data. [2025-09-23T18:36:57.811043] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-07. [2025-09-23T18:36:57.874294] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-23T18:36:57.970001] [DEBUG] [VALIDATOR ] EMF: All expected trading days are present. [2025-09-23T18:36:57.970092] [DEBUG] [VALIDATOR ] EMF: Primary data validation passed. [2025-09-23T18:36:57.970305] [INFO ] [MAIN ] EMF: Fetched primary data is valid. [2025-09-23T18:36:57.970344] [DEBUG] [LOCAL ] EMF: Saving primary data. [2025-09-23T18:36:57.970770] [DEBUG] [LOCAL ] EMF: Trimmed 7326 records to 3595 (keeping 200 days of data) [2025-09-23T18:36:57.992789] [DEBUG] [LOCAL ] EMF: Primary data saved (3595 records). [2025-09-23T18:36:57.992869] [INFO ] [MAIN ] EMF: Full history saved. [2025-09-23T18:36:57.992945] [INFO ] [MAIN ] Update Progress: 732/2372 symbols completed. EMF took 24.1s. Estimated remaining: 3h 37m 8s. Rate: 7.6 symbols/min [2025-09-23T18:36:58.162543] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:36:58.166841] [DEBUG] [LOCAL ] EMP: Loaded 3032 existing records from primary storage. [2025-09-23T18:36:58.166920] [INFO ] [MAIN ] EMP: Loaded 3032 existing records. [2025-09-23T18:36:58.361923] [WARN ] [MAIN ] EMP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:36:58.362285] [INFO ] [MAIN ] EMP: Wiping existing primary data before full refresh. [2025-09-23T18:36:58.362352] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-09-23T18:36:58.362733] [DEBUG] [LOCAL ] EMP: Deleted primary data file. [2025-09-23T18:36:58.362806] [INFO ] [MAIN ] EMP: Starting full primary refresh. [2025-09-23T18:36:58.617494] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-07. [2025-09-23T18:36:58.761257] [INFO ] [REMOTE ] EMP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:36:58.762470] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-23T18:36:59.402254] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-08. [2025-09-23T18:37:00.054089] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-23T18:37:00.202220] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-06. [2025-09-23T18:37:00.303316] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-23T18:37:01.002195] [INFO ] [REMOTE ] EMP: Fetching primary data for 2024-12. [2025-09-23T18:37:01.584692] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-23T18:37:01.606826] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-23T18:37:01.802241] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-09. [2025-09-23T18:37:02.602157] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-01. [2025-09-23T18:37:02.631144] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-23T18:37:02.636499] [INFO ] [REMOTE ] EMO: Full fetch complete (17038 records). [2025-09-23T18:37:02.636623] [DEBUG] [VALIDATOR ] EMO: Validating primary data. [2025-09-23T18:37:02.637504] [FATAL] [VALIDATOR ] EMO: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:37:02.637609] [FATAL] [MAIN ] EMO: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:37:02.637697] [WARN ] [MAIN ] EMO: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:37:02.637782] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-09-23T18:37:02.637876] [DEBUG] [LOCAL ] EMO: No primary data file found to delete. [2025-09-23T18:37:02.637986] [INFO ] [LOCAL ] EMO: Starting deletion of derivative data. [2025-09-23T18:37:02.638591] [DEBUG] [LOCAL ] EMO: Deleted derivative data file. [2025-09-23T18:37:02.638737] [INFO ] [MAIN ] Update Progress: 733/2372 symbols completed. EMO took 25.0s. Estimated remaining: 3h 36m 52s. Rate: 7.6 symbols/min [2025-09-23T18:37:02.812485] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:37:02.885934] [DEBUG] [LOCAL ] EMR: Loaded 53258 existing records from primary storage. [2025-09-23T18:37:02.886106] [INFO ] [MAIN ] EMR: Loaded 53258 existing records. [2025-09-23T18:37:03.038185] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-23T18:37:03.075571] [WARN ] [MAIN ] EMR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:37:03.075832] [INFO ] [MAIN ] EMR: Wiping existing primary data before full refresh. [2025-09-23T18:37:03.075882] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-09-23T18:37:03.077366] [DEBUG] [LOCAL ] EMR: Deleted primary data file. [2025-09-23T18:37:03.077428] [INFO ] [MAIN ] EMR: Starting full primary refresh. [2025-09-23T18:37:03.407536] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-02. [2025-09-23T18:37:03.474436] [INFO ] [REMOTE ] EMR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:37:03.838513] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-23T18:37:04.202268] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-03. [2025-09-23T18:37:04.701539] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-23T18:37:05.002230] [INFO ] [REMOTE ] EMR: Fetching primary data for 2024-12. [2025-09-23T18:37:05.802211] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-04. [2025-09-23T18:37:06.265723] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-23T18:37:06.523622] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-23T18:37:06.602156] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-01. [2025-09-23T18:37:07.402219] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-05. [2025-09-23T18:37:07.760934] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-23T18:37:08.098102] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-23T18:37:08.202214] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-02. [2025-09-23T18:37:09.002274] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-06. [2025-09-23T18:37:09.572057] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-23T18:37:09.627354] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-23T18:37:09.802202] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-07. [2025-09-23T18:37:10.166410] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-23T18:37:10.602193] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-07. [2025-09-23T18:37:11.402224] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-08. [2025-09-23T18:37:12.202196] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-03. [2025-09-23T18:37:12.264902] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-23T18:37:12.917020] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-23T18:37:13.002240] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-09. [2025-09-23T18:37:13.751311] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-23T18:37:13.802185] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-04. [2025-09-23T18:37:14.570572] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-23T18:37:14.579031] [INFO ] [REMOTE ] EMN: Full fetch complete (71940 records). [2025-09-23T18:37:14.579215] [DEBUG] [VALIDATOR ] EMN: Validating primary data. [2025-09-23T18:37:14.612638] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-08. [2025-09-23T18:37:14.984071] [DEBUG] [VALIDATOR ] EMN: All expected trading days are present. [2025-09-23T18:37:14.984170] [DEBUG] [VALIDATOR ] EMN: Primary data validation passed. [2025-09-23T18:37:14.985146] [INFO ] [MAIN ] EMN: Fetched primary data is valid. [2025-09-23T18:37:14.985234] [DEBUG] [LOCAL ] EMN: Saving primary data. [2025-09-23T18:37:14.986917] [DEBUG] [LOCAL ] EMN: Trimmed 71940 records to 50354 (keeping 200 days of data) [2025-09-23T18:37:15.315576] [DEBUG] [LOCAL ] EMN: Primary data saved (50354 records). [2025-09-23T18:37:15.316090] [INFO ] [MAIN ] EMN: Full history saved. [2025-09-23T18:37:15.316478] [INFO ] [MAIN ] Update Progress: 734/2372 symbols completed. EMN took 39.3s. Estimated remaining: 3h 36m 55s. Rate: 7.6 symbols/min [2025-09-23T18:37:15.418832] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-08. [2025-09-23T18:37:15.516701] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:37:15.537117] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-23T18:37:15.592403] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-23T18:37:15.614495] [DEBUG] [LOCAL ] ENB: Loaded 53518 existing records from primary storage. [2025-09-23T18:37:15.614634] [INFO ] [MAIN ] ENB: Loaded 53518 existing records. [2025-09-23T18:37:15.798966] [WARN ] [MAIN ] ENB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:37:15.799258] [INFO ] [MAIN ] ENB: Wiping existing primary data before full refresh. [2025-09-23T18:37:15.799320] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-09-23T18:37:15.800771] [DEBUG] [LOCAL ] ENB: Deleted primary data file. [2025-09-23T18:37:15.800834] [INFO ] [MAIN ] ENB: Starting full primary refresh. [2025-09-23T18:37:16.096336] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-23T18:37:16.179442] [INFO ] [REMOTE ] ENB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:37:16.202141] [INFO ] [REMOTE ] ENB: Fetching primary data for 2024-12. [2025-09-23T18:37:17.002221] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-05. [2025-09-23T18:37:17.802160] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-09. [2025-09-23T18:37:18.071102] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-23T18:37:18.536460] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-23T18:37:18.538185] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-23T18:37:18.539522] [INFO ] [REMOTE ] EMP: Full fetch complete (4252 records). [2025-09-23T18:37:18.550274] [DEBUG] [VALIDATOR ] EMP: Validating primary data. [2025-09-23T18:37:18.551189] [FATAL] [VALIDATOR ] EMP: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:37:18.551298] [FATAL] [MAIN ] EMP: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:37:18.551692] [WARN ] [MAIN ] EMP: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:37:18.551819] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-09-23T18:37:18.551917] [DEBUG] [LOCAL ] EMP: No primary data file found to delete. [2025-09-23T18:37:18.551997] [INFO ] [LOCAL ] EMP: Starting deletion of derivative data. [2025-09-23T18:37:18.552387] [DEBUG] [LOCAL ] EMP: Deleted derivative data file. [2025-09-23T18:37:18.552539] [INFO ] [MAIN ] Update Progress: 735/2372 symbols completed. EMP took 20.6s. Estimated remaining: 3h 36m 37s. Rate: 7.6 symbols/min [2025-09-23T18:37:18.610098] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-06. [2025-09-23T18:37:18.733426] [INFO ] [MAIN ] ENFY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:37:18.740569] [DEBUG] [LOCAL ] ENFY: Loaded 3051 existing records from primary storage. [2025-09-23T18:37:18.740684] [INFO ] [MAIN ] ENFY: Loaded 3051 existing records. [2025-09-23T18:37:18.916728] [WARN ] [MAIN ] ENFY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:37:18.917010] [INFO ] [MAIN ] ENFY: Wiping existing primary data before full refresh. [2025-09-23T18:37:18.917067] [INFO ] [LOCAL ] ENFY: Starting deletion of primary data. [2025-09-23T18:37:18.917387] [DEBUG] [LOCAL ] ENFY: Deleted primary data file. [2025-09-23T18:37:18.917448] [INFO ] [MAIN ] ENFY: Starting full primary refresh. [2025-09-23T18:37:19.281884] [INFO ] [REMOTE ] ENFY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:37:19.402208] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2024-12. [2025-09-23T18:37:19.916279] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-23T18:37:20.202219] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-09. [2025-09-23T18:37:20.575942] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-23T18:37:21.002206] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-07. [2025-09-23T18:37:21.313088] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-23T18:37:21.324256] [INFO ] [REMOTE ] EME: Full fetch complete (46958 records). [2025-09-23T18:37:21.324406] [DEBUG] [VALIDATOR ] EME: Validating primary data. [2025-09-23T18:37:21.724200] [DEBUG] [VALIDATOR ] EME: All expected trading days are present. [2025-09-23T18:37:21.724307] [DEBUG] [VALIDATOR ] EME: Primary data validation passed. [2025-09-23T18:37:21.725227] [INFO ] [MAIN ] EME: Fetched primary data is valid. [2025-09-23T18:37:21.725301] [DEBUG] [LOCAL ] EME: Saving primary data. [2025-09-23T18:37:21.727151] [DEBUG] [LOCAL ] EME: Trimmed 46958 records to 31702 (keeping 200 days of data) [2025-09-23T18:37:21.809897] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-01. [2025-09-23T18:37:21.956855] [DEBUG] [LOCAL ] EME: Primary data saved (31702 records). [2025-09-23T18:37:21.957008] [INFO ] [MAIN ] EME: Full history saved. [2025-09-23T18:37:21.957143] [INFO ] [MAIN ] Update Progress: 736/2372 symbols completed. EME took 55.1s. Estimated remaining: 3h 36m 18s. Rate: 7.6 symbols/min [2025-09-23T18:37:22.126463] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:37:22.169260] [DEBUG] [LOCAL ] ENIC: Loaded 36699 existing records from primary storage. [2025-09-23T18:37:22.169404] [INFO ] [MAIN ] ENIC: Loaded 36699 existing records. [2025-09-23T18:37:22.365125] [WARN ] [MAIN ] ENIC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:37:22.365556] [INFO ] [MAIN ] ENIC: Wiping existing primary data before full refresh. [2025-09-23T18:37:22.365662] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-09-23T18:37:22.372355] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-23T18:37:22.374805] [DEBUG] [LOCAL ] ENIC: Deleted primary data file. [2025-09-23T18:37:22.375726] [INFO ] [MAIN ] ENIC: Starting full primary refresh. [2025-09-23T18:37:22.604666] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-02. [2025-09-23T18:37:22.773002] [INFO ] [REMOTE ] ENIC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:37:22.853284] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-23T18:37:23.061022] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-23T18:37:23.402271] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-08. [2025-09-23T18:37:24.202215] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-01. [2025-09-23T18:37:24.874851] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-23T18:37:25.002214] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-09. [2025-09-23T18:37:25.802210] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-03. [2025-09-23T18:37:26.119812] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-23T18:37:26.123589] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-23T18:37:26.447786] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-23T18:37:26.456532] [INFO ] [REMOTE ] EMR: Full fetch complete (77110 records). [2025-09-23T18:37:26.456726] [DEBUG] [VALIDATOR ] EMR: Validating primary data. [2025-09-23T18:37:26.609975] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-02. [2025-09-23T18:37:26.882127] [DEBUG] [VALIDATOR ] EMR: All expected trading days are present. [2025-09-23T18:37:26.882260] [DEBUG] [VALIDATOR ] EMR: Primary data validation passed. [2025-09-23T18:37:26.883288] [INFO ] [MAIN ] EMR: Fetched primary data is valid. [2025-09-23T18:37:26.883356] [DEBUG] [LOCAL ] EMR: Saving primary data. [2025-09-23T18:37:26.885051] [DEBUG] [LOCAL ] EMR: Trimmed 77110 records to 53256 (keeping 200 days of data) [2025-09-23T18:37:27.238093] [DEBUG] [LOCAL ] EMR: Primary data saved (53256 records). [2025-09-23T18:37:27.238252] [INFO ] [MAIN ] EMR: Full history saved. [2025-09-23T18:37:27.238391] [INFO ] [MAIN ] Update Progress: 737/2372 symbols completed. EMR took 24.6s. Estimated remaining: 3h 36m 5s. Rate: 7.6 symbols/min [2025-09-23T18:37:27.409524] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-04. [2025-09-23T18:37:27.446684] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:37:27.453547] [DEBUG] [LOCAL ] ENO: Loaded 1966 existing records from primary storage. [2025-09-23T18:37:27.453740] [INFO ] [MAIN ] ENO: Loaded 1966 existing records. [2025-09-23T18:37:27.656918] [WARN ] [MAIN ] ENO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:37:27.657247] [INFO ] [MAIN ] ENO: Wiping existing primary data before full refresh. [2025-09-23T18:37:27.657296] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-09-23T18:37:27.657599] [DEBUG] [LOCAL ] ENO: Deleted primary data file. [2025-09-23T18:37:27.657700] [INFO ] [MAIN ] ENO: Starting full primary refresh. [2025-09-23T18:37:27.805007] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-23T18:37:28.014950] [INFO ] [REMOTE ] ENO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:37:28.202163] [INFO ] [REMOTE ] ENO: Fetching primary data for 2024-12. [2025-09-23T18:37:28.377970] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-23T18:37:28.624688] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-23T18:37:29.002202] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2024-12. [2025-09-23T18:37:29.802212] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-03. [2025-09-23T18:37:30.127316] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-23T18:37:30.602244] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-01. [2025-09-23T18:37:30.935978] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-23T18:37:31.356276] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-23T18:37:31.402250] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-04. [2025-09-23T18:37:32.202230] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-01. [2025-09-23T18:37:33.002212] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-05. [2025-09-23T18:37:33.280717] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-23T18:37:33.534413] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-23T18:37:33.687518] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-23T18:37:33.802192] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-02. [2025-09-23T18:37:34.602202] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-02. [2025-09-23T18:37:34.919440] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-23T18:37:35.152715] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-23T18:37:35.402191] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-03. [2025-09-23T18:37:35.717712] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-23T18:37:36.202189] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-06. [2025-09-23T18:37:36.621305] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-23T18:37:37.002205] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-07. [2025-09-23T18:37:37.505734] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-23T18:37:37.802197] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-05. [2025-09-23T18:37:38.602213] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-08. [2025-09-23T18:37:38.986492] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-23T18:37:39.402163] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-09. [2025-09-23T18:37:39.452933] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-23T18:37:40.003197] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-23T18:37:40.004368] [INFO ] [REMOTE ] ENFY: Full fetch complete (5616 records). [2025-09-23T18:37:40.004441] [DEBUG] [VALIDATOR ] ENFY: Validating primary data. [2025-09-23T18:37:40.211098] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-04. [2025-09-23T18:37:40.389121] [DEBUG] [VALIDATOR ] ENFY: All expected trading days are present. [2025-09-23T18:37:40.389208] [DEBUG] [VALIDATOR ] ENFY: Primary data validation passed. [2025-09-23T18:37:40.389401] [INFO ] [MAIN ] ENFY: Fetched primary data is valid. [2025-09-23T18:37:40.389441] [DEBUG] [LOCAL ] ENFY: Saving primary data. [2025-09-23T18:37:40.389941] [DEBUG] [LOCAL ] ENFY: Trimmed 5616 records to 3059 (keeping 200 days of data) [2025-09-23T18:37:40.411101] [DEBUG] [LOCAL ] ENFY: Primary data saved (3059 records). [2025-09-23T18:37:40.411270] [INFO ] [MAIN ] ENFY: Full history saved. [2025-09-23T18:37:40.411405] [INFO ] [MAIN ] Update Progress: 738/2372 symbols completed. ENFY took 21.9s. Estimated remaining: 3h 36m 8s. Rate: 7.6 symbols/min [2025-09-23T18:37:40.590957] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:37:40.657549] [DEBUG] [LOCAL ] ENOV: Loaded 45225 existing records from primary storage. [2025-09-23T18:37:40.657747] [INFO ] [MAIN ] ENOV: Loaded 45225 existing records. [2025-09-23T18:37:40.799951] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-23T18:37:40.840266] [WARN ] [MAIN ] ENOV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:37:40.840485] [INFO ] [MAIN ] ENOV: Wiping existing primary data before full refresh. [2025-09-23T18:37:40.840532] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-09-23T18:37:40.841855] [DEBUG] [LOCAL ] ENOV: Deleted primary data file. [2025-09-23T18:37:40.841917] [INFO ] [MAIN ] ENOV: Starting full primary refresh. [2025-09-23T18:37:41.022302] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-03. [2025-09-23T18:37:41.209814] [INFO ] [REMOTE ] ENOV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:37:41.802229] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-06. [2025-09-23T18:37:42.296580] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-23T18:37:42.602261] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-05. [2025-09-23T18:37:43.292042] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-23T18:37:43.407391] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2024-12. [2025-09-23T18:37:43.420380] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-23T18:37:44.202235] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-07. [2025-09-23T18:37:44.880181] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-23T18:37:45.002145] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-01. [2025-09-23T18:37:45.653750] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-23T18:37:45.802195] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-08. [2025-09-23T18:37:46.165830] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-23T18:37:46.602210] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-02. [2025-09-23T18:37:47.402188] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-04. [2025-09-23T18:37:47.514312] [DEBUG] [REMOTE ] ENIC: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-09-23T18:37:47.514717] [WARN ] [REMOTE ] ENIC: No data returned for month 2025-04 [2025-09-23T18:37:47.644897] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-23T18:37:47.739913] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-23T18:37:48.202202] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-05. [2025-09-23T18:37:49.002202] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-03. [2025-09-23T18:37:49.656920] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-23T18:37:49.802193] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-06. [2025-09-23T18:37:50.582101] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-23T18:37:50.602150] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-04. [2025-09-23T18:37:50.946572] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-23T18:37:51.402198] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-06. [2025-09-23T18:37:51.916917] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-23T18:37:52.202223] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-07. [2025-09-23T18:37:52.267068] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-23T18:37:52.627869] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-23T18:37:53.002256] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-05. [2025-09-23T18:37:53.802210] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-07. [2025-09-23T18:37:54.340843] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-23T18:37:54.602196] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-08. [2025-09-23T18:37:55.041205] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-23T18:37:55.352427] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-23T18:37:55.402191] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-08. [2025-09-23T18:37:56.202207] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-06. [2025-09-23T18:37:56.380568] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-23T18:37:57.002199] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-09. [2025-09-23T18:37:57.434204] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-23T18:37:57.447054] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-23T18:37:57.448038] [INFO ] [REMOTE ] ENO: Full fetch complete (3130 records). [2025-09-23T18:37:57.448109] [DEBUG] [VALIDATOR ] ENO: Validating primary data. [2025-09-23T18:37:57.813314] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-09. [2025-09-23T18:37:57.820829] [DEBUG] [VALIDATOR ] ENO: All expected trading days are present. [2025-09-23T18:37:57.821874] [DEBUG] [VALIDATOR ] ENO: Primary data validation passed. [2025-09-23T18:37:57.822039] [INFO ] [MAIN ] ENO: Fetched primary data is valid. [2025-09-23T18:37:57.822081] [DEBUG] [LOCAL ] ENO: Saving primary data. [2025-09-23T18:37:57.822437] [DEBUG] [LOCAL ] ENO: Trimmed 3130 records to 1954 (keeping 200 days of data) [2025-09-23T18:37:57.834787] [DEBUG] [LOCAL ] ENO: Primary data saved (1954 records). [2025-09-23T18:37:57.834850] [INFO ] [MAIN ] ENO: Full history saved. [2025-09-23T18:37:57.834919] [INFO ] [MAIN ] Update Progress: 739/2372 symbols completed. ENO took 30.6s. Estimated remaining: 3h 36m 21s. Rate: 7.5 symbols/min [2025-09-23T18:37:58.011538] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:37:58.057629] [DEBUG] [LOCAL ] ENR: Loaded 42631 existing records from primary storage. [2025-09-23T18:37:58.057839] [INFO ] [MAIN ] ENR: Loaded 42631 existing records. [2025-09-23T18:37:58.237619] [WARN ] [MAIN ] ENR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:37:58.237899] [INFO ] [MAIN ] ENR: Wiping existing primary data before full refresh. [2025-09-23T18:37:58.237956] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-09-23T18:37:58.239018] [DEBUG] [LOCAL ] ENR: Deleted primary data file. [2025-09-23T18:37:58.239079] [INFO ] [MAIN ] ENR: Starting full primary refresh. [2025-09-23T18:37:58.591757] [INFO ] [REMOTE ] ENR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:37:58.602143] [INFO ] [REMOTE ] ENR: Fetching primary data for 2024-12. [2025-09-23T18:37:59.402925] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-09. [2025-09-23T18:37:59.408121] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-23T18:37:59.417350] [INFO ] [REMOTE ] ENB: Full fetch complete (77492 records). [2025-09-23T18:37:59.417518] [DEBUG] [VALIDATOR ] ENB: Validating primary data. [2025-09-23T18:37:59.880660] [DEBUG] [VALIDATOR ] ENB: All expected trading days are present. [2025-09-23T18:37:59.880853] [DEBUG] [VALIDATOR ] ENB: Primary data validation passed. [2025-09-23T18:37:59.881871] [INFO ] [MAIN ] ENB: Fetched primary data is valid. [2025-09-23T18:37:59.881982] [DEBUG] [LOCAL ] ENB: Saving primary data. [2025-09-23T18:37:59.900319] [DEBUG] [LOCAL ] ENB: Trimmed 77492 records to 53518 (keeping 200 days of data) [2025-09-23T18:37:59.904049] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-23T18:38:00.206814] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-07. [2025-09-23T18:38:00.257759] [DEBUG] [LOCAL ] ENB: Primary data saved (53518 records). [2025-09-23T18:38:00.257890] [INFO ] [MAIN ] ENB: Full history saved. [2025-09-23T18:38:00.257978] [INFO ] [MAIN ] Update Progress: 740/2372 symbols completed. ENB took 44.9s. Estimated remaining: 3h 36m 1s. Rate: 7.6 symbols/min [2025-09-23T18:38:00.426700] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:38:00.458390] [DEBUG] [LOCAL ] ENS: Loaded 29351 existing records from primary storage. [2025-09-23T18:38:00.458528] [INFO ] [MAIN ] ENS: Loaded 29351 existing records. [2025-09-23T18:38:00.641797] [WARN ] [MAIN ] ENS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:38:00.642141] [INFO ] [MAIN ] ENS: Wiping existing primary data before full refresh. [2025-09-23T18:38:00.656275] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-09-23T18:38:00.657420] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-23T18:38:00.662571] [DEBUG] [LOCAL ] ENS: Deleted primary data file. [2025-09-23T18:38:00.663037] [INFO ] [MAIN ] ENS: Starting full primary refresh. [2025-09-23T18:38:00.706726] [INFO ] [REMOTE ] ENIC: Full fetch complete (45308 records). [2025-09-23T18:38:00.733806] [DEBUG] [VALIDATOR ] ENIC: Validating primary data. [2025-09-23T18:38:01.022991] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-01. [2025-09-23T18:38:01.065442] [WARN ] [VALIDATOR ] ENIC: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-23T18:38:01.095987] [FATAL] [MAIN ] ENIC: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:38:01.114374] [WARN ] [MAIN ] ENIC: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:38:01.126219] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-09-23T18:38:01.142999] [DEBUG] [LOCAL ] ENIC: No primary data file found to delete. [2025-09-23T18:38:01.154545] [INFO ] [LOCAL ] ENIC: Starting deletion of derivative data. [2025-09-23T18:38:01.165705] [DEBUG] [LOCAL ] ENIC: Deleted derivative data file. [2025-09-23T18:38:01.176071] [INFO ] [MAIN ] Update Progress: 741/2372 symbols completed. ENIC took 39.2s. Estimated remaining: 3h 35m 38s. Rate: 7.6 symbols/min [2025-09-23T18:38:01.309302] [INFO ] [REMOTE ] ENS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:38:01.418437] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:38:01.418618] [DEBUG] [LOCAL ] ENVA: No existing data file found in primary storage. [2025-09-23T18:38:01.418688] [WARN ] [MAIN ] ENVA: No existing data found, performing full refresh instead. [2025-09-23T18:38:01.418843] [INFO ] [MAIN ] ENVA: Wiping existing primary data before full refresh. [2025-09-23T18:38:01.418889] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-09-23T18:38:01.418929] [DEBUG] [LOCAL ] ENVA: No primary data file found to delete. [2025-09-23T18:38:01.418960] [INFO ] [MAIN ] ENVA: Starting full primary refresh. [2025-09-23T18:38:01.805507] [INFO ] [REMOTE ] ENS: Fetching primary data for 2024-12. [2025-09-23T18:38:01.805395] [INFO ] [REMOTE ] ENVA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:38:01.954570] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-23T18:38:02.119898] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-23T18:38:02.602258] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-02. [2025-09-23T18:38:02.917630] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-23T18:38:03.402188] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-08. [2025-09-23T18:38:04.042384] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-23T18:38:04.202202] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-03. [2025-09-23T18:38:04.782800] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-23T18:38:05.002290] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-09. [2025-09-23T18:38:05.685056] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-23T18:38:05.802198] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-04. [2025-09-23T18:38:06.250403] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-23T18:38:06.258205] [INFO ] [REMOTE ] ENOV: Full fetch complete (63084 records). [2025-09-23T18:38:06.258358] [DEBUG] [VALIDATOR ] ENOV: Validating primary data. [2025-09-23T18:38:06.608790] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2024-12. [2025-09-23T18:38:06.655581] [DEBUG] [VALIDATOR ] ENOV: All expected trading days are present. [2025-09-23T18:38:06.655709] [DEBUG] [VALIDATOR ] ENOV: Primary data validation passed. [2025-09-23T18:38:06.656518] [INFO ] [MAIN ] ENOV: Fetched primary data is valid. [2025-09-23T18:38:06.656567] [DEBUG] [LOCAL ] ENOV: Saving primary data. [2025-09-23T18:38:06.657985] [DEBUG] [LOCAL ] ENOV: Trimmed 63084 records to 45210 (keeping 200 days of data) [2025-09-23T18:38:06.932465] [DEBUG] [LOCAL ] ENOV: Primary data saved (45210 records). [2025-09-23T18:38:06.932593] [INFO ] [MAIN ] ENOV: Full history saved. [2025-09-23T18:38:06.932708] [INFO ] [MAIN ] Update Progress: 742/2372 symbols completed. ENOV took 26.5s. Estimated remaining: 3h 35m 25s. Rate: 7.6 symbols/min [2025-09-23T18:38:07.120467] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:38:07.135757] [DEBUG] [LOCAL ] EOD: Loaded 14053 existing records from primary storage. [2025-09-23T18:38:07.135876] [INFO ] [MAIN ] EOD: Loaded 14053 existing records. [2025-09-23T18:38:07.332831] [WARN ] [MAIN ] EOD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:38:07.333341] [INFO ] [MAIN ] EOD: Wiping existing primary data before full refresh. [2025-09-23T18:38:07.333411] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-09-23T18:38:07.341412] [DEBUG] [LOCAL ] EOD: Deleted primary data file. [2025-09-23T18:38:07.361589] [INFO ] [MAIN ] EOD: Starting full primary refresh. [2025-09-23T18:38:07.408638] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-23T18:38:07.408732] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-01. [2025-09-23T18:38:07.713880] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-23T18:38:07.775893] [INFO ] [REMOTE ] EOD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:38:08.202172] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-01. [2025-09-23T18:38:08.678806] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-23T18:38:08.918340] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-23T18:38:09.002241] [INFO ] [REMOTE ] EOD: Fetching primary data for 2024-12. [2025-09-23T18:38:09.796104] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-23T18:38:09.802138] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-01. [2025-09-23T18:38:10.494589] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-23T18:38:10.602200] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-02. [2025-09-23T18:38:11.169664] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-23T18:38:11.402222] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-03. [2025-09-23T18:38:12.202181] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-05. [2025-09-23T18:38:12.271499] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-23T18:38:13.002237] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-02. [2025-09-23T18:38:13.520533] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-23T18:38:13.802221] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-02. [2025-09-23T18:38:14.602254] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-04. [2025-09-23T18:38:14.632555] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-23T18:38:15.087534] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-23T18:38:15.250879] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-23T18:38:15.402225] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-03. [2025-09-23T18:38:16.202197] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-06. [2025-09-23T18:38:16.585272] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-23T18:38:17.002236] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-05. [2025-09-23T18:38:17.606557] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-23T18:38:17.623999] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-23T18:38:17.802208] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-07. [2025-09-23T18:38:18.602197] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-03. [2025-09-23T18:38:19.054409] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-23T18:38:19.402303] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-04. [2025-09-23T18:38:19.510826] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-23T18:38:20.202284] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-06. [2025-09-23T18:38:20.495866] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-23T18:38:20.892943] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-23T18:38:21.002267] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-04. [2025-09-23T18:38:21.802268] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-08. [2025-09-23T18:38:21.891401] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-23T18:38:22.602278] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-05. [2025-09-23T18:38:23.349803] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-23T18:38:23.402251] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-05. [2025-09-23T18:38:23.560733] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-23T18:38:24.202204] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-07. [2025-09-23T18:38:24.530871] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-23T18:38:24.959632] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-23T18:38:25.002213] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-06. [2025-09-23T18:38:25.802203] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-09. [2025-09-23T18:38:26.248560] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-23T18:38:26.602190] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-08. [2025-09-23T18:38:27.059355] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-23T18:38:27.067595] [INFO ] [REMOTE ] ENR: Full fetch complete (58051 records). [2025-09-23T18:38:27.067840] [DEBUG] [VALIDATOR ] ENR: Validating primary data. [2025-09-23T18:38:27.408813] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-06. [2025-09-23T18:38:27.529559] [DEBUG] [VALIDATOR ] ENR: All expected trading days are present. [2025-09-23T18:38:27.529780] [DEBUG] [VALIDATOR ] ENR: Primary data validation passed. [2025-09-23T18:38:27.531471] [INFO ] [MAIN ] ENR: Fetched primary data is valid. [2025-09-23T18:38:27.532177] [DEBUG] [LOCAL ] ENR: Saving primary data. [2025-09-23T18:38:27.532076] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-23T18:38:27.538243] [DEBUG] [LOCAL ] ENR: Trimmed 58051 records to 42760 (keeping 200 days of data) [2025-09-23T18:38:27.853933] [DEBUG] [LOCAL ] ENR: Primary data saved (42760 records). [2025-09-23T18:38:27.854170] [INFO ] [MAIN ] ENR: Full history saved. [2025-09-23T18:38:27.854316] [INFO ] [MAIN ] Update Progress: 743/2372 symbols completed. ENR took 30.0s. Estimated remaining: 3h 35m 46s. Rate: 7.6 symbols/min [2025-09-23T18:38:28.043445] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:38:28.103149] [DEBUG] [LOCAL ] EOG: Loaded 53341 existing records from primary storage. [2025-09-23T18:38:28.103345] [INFO ] [MAIN ] EOG: Loaded 53341 existing records. [2025-09-23T18:38:28.210352] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-07. [2025-09-23T18:38:28.299233] [WARN ] [MAIN ] EOG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:38:28.300320] [INFO ] [MAIN ] EOG: Wiping existing primary data before full refresh. [2025-09-23T18:38:28.300391] [INFO ] [LOCAL ] EOG: Starting deletion of primary data. [2025-09-23T18:38:28.301929] [DEBUG] [LOCAL ] EOG: Deleted primary data file. [2025-09-23T18:38:28.301993] [INFO ] [MAIN ] EOG: Starting full primary refresh. [2025-09-23T18:38:28.537500] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-23T18:38:28.708049] [INFO ] [REMOTE ] EOG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:38:29.002214] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-07. [2025-09-23T18:38:29.230181] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-23T18:38:29.802194] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-09. [2025-09-23T18:38:29.920547] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-23T18:38:30.602191] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-08. [2025-09-23T18:38:30.758429] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-23T18:38:30.762246] [INFO ] [REMOTE ] EOD: Full fetch complete (19845 records). [2025-09-23T18:38:30.762338] [DEBUG] [VALIDATOR ] EOD: Validating primary data. [2025-09-23T18:38:31.135802] [DEBUG] [VALIDATOR ] EOD: All expected trading days are present. [2025-09-23T18:38:31.135883] [DEBUG] [VALIDATOR ] EOD: Primary data validation passed. [2025-09-23T18:38:31.136300] [INFO ] [MAIN ] EOD: Fetched primary data is valid. [2025-09-23T18:38:31.136340] [DEBUG] [LOCAL ] EOD: Saving primary data. [2025-09-23T18:38:31.136955] [DEBUG] [LOCAL ] EOD: Trimmed 19845 records to 13989 (keeping 200 days of data) [2025-09-23T18:38:31.217319] [DEBUG] [LOCAL ] EOD: Primary data saved (13989 records). [2025-09-23T18:38:31.217467] [INFO ] [MAIN ] EOD: Full history saved. [2025-09-23T18:38:31.218079] [INFO ] [MAIN ] Update Progress: 744/2372 symbols completed. EOD took 24.3s. Estimated remaining: 3h 35m 28s. Rate: 7.6 symbols/min [2025-09-23T18:38:31.392282] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:38:31.403945] [INFO ] [REMOTE ] EOG: Fetching primary data for 2024-12. [2025-09-23T18:38:31.404323] [DEBUG] [LOCAL ] EOI: Loaded 10586 existing records from primary storage. [2025-09-23T18:38:31.405627] [INFO ] [MAIN ] EOI: Loaded 10586 existing records. [2025-09-23T18:38:31.591785] [WARN ] [MAIN ] EOI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:38:31.592117] [INFO ] [MAIN ] EOI: Wiping existing primary data before full refresh. [2025-09-23T18:38:31.592195] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-09-23T18:38:31.592841] [DEBUG] [LOCAL ] EOI: Deleted primary data file. [2025-09-23T18:38:31.592984] [INFO ] [MAIN ] EOI: Starting full primary refresh. [2025-09-23T18:38:31.679910] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-23T18:38:31.991524] [INFO ] [REMOTE ] EOI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:38:32.202188] [INFO ] [REMOTE ] EOI: Fetching primary data for 2024-12. [2025-09-23T18:38:32.804215] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-23T18:38:32.993604] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-23T18:38:33.004044] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-01. [2025-09-23T18:38:33.802195] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-08. [2025-09-23T18:38:33.830150] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-23T18:38:34.602248] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-02. [2025-09-23T18:38:34.872898] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-23T18:38:35.091830] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-23T18:38:35.402252] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-03. [2025-09-23T18:38:35.962609] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-23T18:38:36.202282] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-09. [2025-09-23T18:38:37.002211] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-01. [2025-09-23T18:38:37.316971] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-23T18:38:37.321955] [INFO ] [REMOTE ] ENVA: Full fetch complete (36587 records). [2025-09-23T18:38:37.322090] [DEBUG] [VALIDATOR ] ENVA: Validating primary data. [2025-09-23T18:38:37.716495] [DEBUG] [VALIDATOR ] ENVA: All expected trading days are present. [2025-09-23T18:38:37.716611] [DEBUG] [VALIDATOR ] ENVA: Primary data validation passed. [2025-09-23T18:38:37.717204] [INFO ] [MAIN ] ENVA: Fetched primary data is valid. [2025-09-23T18:38:37.717260] [DEBUG] [LOCAL ] ENVA: Saving primary data. [2025-09-23T18:38:37.718340] [DEBUG] [LOCAL ] ENVA: Trimmed 36587 records to 25785 (keeping 200 days of data) [2025-09-23T18:38:37.803507] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-04. [2025-09-23T18:38:37.873750] [DEBUG] [LOCAL ] ENVA: Primary data saved (25785 records). [2025-09-23T18:38:37.873886] [INFO ] [MAIN ] ENVA: Full history saved. [2025-09-23T18:38:37.873963] [INFO ] [MAIN ] Update Progress: 745/2372 symbols completed. ENVA took 36.7s. Estimated remaining: 3h 35m 17s. Rate: 7.6 symbols/min [2025-09-23T18:38:38.043821] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:38:38.060746] [DEBUG] [LOCAL ] EOS: Loaded 15475 existing records from primary storage. [2025-09-23T18:38:38.060933] [INFO ] [MAIN ] EOS: Loaded 15475 existing records. [2025-09-23T18:38:38.252683] [WARN ] [MAIN ] EOS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:38:38.252961] [INFO ] [MAIN ] EOS: Wiping existing primary data before full refresh. [2025-09-23T18:38:38.253012] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-09-23T18:38:38.253553] [DEBUG] [LOCAL ] EOS: Deleted primary data file. [2025-09-23T18:38:38.253614] [INFO ] [MAIN ] EOS: Starting full primary refresh. [2025-09-23T18:38:38.620480] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-09. [2025-09-23T18:38:38.626278] [INFO ] [REMOTE ] EOS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:38:38.794439] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-23T18:38:38.818505] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-23T18:38:39.402196] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-02. [2025-09-23T18:38:39.870186] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-23T18:38:39.875638] [INFO ] [REMOTE ] ENS: Full fetch complete (41901 records). [2025-09-23T18:38:39.875803] [DEBUG] [VALIDATOR ] ENS: Validating primary data. [2025-09-23T18:38:40.213373] [INFO ] [REMOTE ] EOS: Fetching primary data for 2024-12. [2025-09-23T18:38:40.265423] [DEBUG] [VALIDATOR ] ENS: All expected trading days are present. [2025-09-23T18:38:40.265505] [DEBUG] [VALIDATOR ] ENS: Primary data validation passed. [2025-09-23T18:38:40.266160] [INFO ] [MAIN ] ENS: Fetched primary data is valid. [2025-09-23T18:38:40.266226] [DEBUG] [LOCAL ] ENS: Saving primary data. [2025-09-23T18:38:40.267254] [DEBUG] [LOCAL ] ENS: Trimmed 41901 records to 29449 (keeping 200 days of data) [2025-09-23T18:38:40.447777] [DEBUG] [LOCAL ] ENS: Primary data saved (29449 records). [2025-09-23T18:38:40.447911] [INFO ] [MAIN ] ENS: Full history saved. [2025-09-23T18:38:40.447993] [INFO ] [MAIN ] Update Progress: 746/2372 symbols completed. ENS took 40.2s. Estimated remaining: 3h 34m 57s. Rate: 7.6 symbols/min [2025-09-23T18:38:40.622859] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:38:40.631860] [DEBUG] [LOCAL ] EOT: Loaded 6845 existing records from primary storage. [2025-09-23T18:38:40.631979] [INFO ] [MAIN ] EOT: Loaded 6845 existing records. [2025-09-23T18:38:40.816954] [WARN ] [MAIN ] EOT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:38:40.817353] [INFO ] [MAIN ] EOT: Wiping existing primary data before full refresh. [2025-09-23T18:38:40.817406] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-09-23T18:38:40.817722] [DEBUG] [LOCAL ] EOT: Deleted primary data file. [2025-09-23T18:38:40.817784] [INFO ] [MAIN ] EOT: Starting full primary refresh. [2025-09-23T18:38:41.007574] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-05. [2025-09-23T18:38:41.186240] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-23T18:38:41.220988] [INFO ] [REMOTE ] EOT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:38:41.244321] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-23T18:38:41.802199] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-01. [2025-09-23T18:38:41.847747] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-23T18:38:42.604848] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-06. [2025-09-23T18:38:42.609542] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-23T18:38:43.402236] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-02. [2025-09-23T18:38:43.605166] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-23T18:38:44.022712] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-23T18:38:44.202204] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-07. [2025-09-23T18:38:44.894540] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-23T18:38:45.002193] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-03. [2025-09-23T18:38:45.802243] [INFO ] [REMOTE ] EOT: Fetching primary data for 2024-12. [2025-09-23T18:38:46.101192] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-23T18:38:46.410615] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-23T18:38:46.602241] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-01. [2025-09-23T18:38:47.037033] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-23T18:38:47.402212] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-02. [2025-09-23T18:38:48.161406] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-23T18:38:48.202154] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-03. [2025-09-23T18:38:48.308047] [DEBUG] [REMOTE ] EOT: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-09-23T18:38:48.308359] [WARN ] [REMOTE ] EOT: No data returned for month 2025-03 [2025-09-23T18:38:49.002250] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-03. [2025-09-23T18:38:49.802200] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-04. [2025-09-23T18:38:50.547867] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-23T18:38:50.582933] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-23T18:38:50.602154] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-04. [2025-09-23T18:38:51.402202] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-05. [2025-09-23T18:38:52.094485] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-23T18:38:52.150865] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-23T18:38:52.202193] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-06. [2025-09-23T18:38:52.786140] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-23T18:38:53.002194] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-04. [2025-09-23T18:38:53.744254] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-23T18:38:53.802153] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-05. [2025-09-23T18:38:54.602245] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-07. [2025-09-23T18:38:54.632148] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-23T18:38:55.402191] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-08. [2025-09-23T18:38:55.497848] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-23T18:38:55.992858] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-23T18:38:56.202207] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-06. [2025-09-23T18:38:56.700338] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-23T18:38:57.002208] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-07. [2025-09-23T18:38:57.685821] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-23T18:38:57.802193] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-08. [2025-09-23T18:38:58.269759] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-23T18:38:58.602250] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-08. [2025-09-23T18:38:59.402313] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-09. [2025-09-23T18:38:59.428340] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-23T18:39:00.023339] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-23T18:39:00.025227] [INFO ] [REMOTE ] EOT: Full fetch complete (9827 records). [2025-09-23T18:39:00.025296] [DEBUG] [VALIDATOR ] EOT: Validating primary data. [2025-09-23T18:39:00.204272] [WARN ] [VALIDATOR ] EOT: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-23T18:39:00.204402] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-05. [2025-09-23T18:39:00.205093] [FATAL] [MAIN ] EOT: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:39:00.205879] [WARN ] [MAIN ] EOT: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:39:00.205953] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-09-23T18:39:00.206038] [DEBUG] [LOCAL ] EOT: No primary data file found to delete. [2025-09-23T18:39:00.206093] [INFO ] [LOCAL ] EOT: Starting deletion of derivative data. [2025-09-23T18:39:00.206473] [DEBUG] [LOCAL ] EOT: Deleted derivative data file. [2025-09-23T18:39:00.206583] [INFO ] [MAIN ] Update Progress: 747/2372 symbols completed. EOT took 19.8s. Estimated remaining: 3h 35m 15s. Rate: 7.5 symbols/min [2025-09-23T18:39:00.376860] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:39:00.403574] [DEBUG] [LOCAL ] EPAC: Loaded 27030 existing records from primary storage. [2025-09-23T18:39:00.403758] [INFO ] [MAIN ] EPAC: Loaded 27030 existing records. [2025-09-23T18:39:00.578375] [WARN ] [MAIN ] EPAC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:39:00.578615] [INFO ] [MAIN ] EPAC: Wiping existing primary data before full refresh. [2025-09-23T18:39:00.578691] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-09-23T18:39:00.579472] [DEBUG] [LOCAL ] EPAC: Deleted primary data file. [2025-09-23T18:39:00.579533] [INFO ] [MAIN ] EPAC: Starting full primary refresh. [2025-09-23T18:39:00.934026] [INFO ] [REMOTE ] EPAC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:39:01.002182] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2024-12. [2025-09-23T18:39:01.802245] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-09. [2025-09-23T18:39:02.538937] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-23T18:39:02.602247] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-01. [2025-09-23T18:39:02.919336] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-05 (2.71 seconds). [2025-09-23T18:39:03.402216] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-06. [2025-09-23T18:39:03.884705] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-23T18:39:03.886906] [INFO ] [REMOTE ] EOI: Full fetch complete (15952 records). [2025-09-23T18:39:03.886984] [DEBUG] [VALIDATOR ] EOI: Validating primary data. [2025-09-23T18:39:04.207306] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-09. [2025-09-23T18:39:04.279487] [DEBUG] [VALIDATOR ] EOI: All expected trading days are present. [2025-09-23T18:39:04.279572] [DEBUG] [VALIDATOR ] EOI: Primary data validation passed. [2025-09-23T18:39:04.279990] [INFO ] [MAIN ] EOI: Fetched primary data is valid. [2025-09-23T18:39:04.280052] [DEBUG] [LOCAL ] EOI: Saving primary data. [2025-09-23T18:39:04.280577] [DEBUG] [LOCAL ] EOI: Trimmed 15952 records to 10531 (keeping 200 days of data) [2025-09-23T18:39:04.345462] [DEBUG] [LOCAL ] EOI: Primary data saved (10531 records). [2025-09-23T18:39:04.345581] [INFO ] [MAIN ] EOI: Full history saved. [2025-09-23T18:39:04.345686] [INFO ] [MAIN ] Update Progress: 748/2372 symbols completed. EOI took 33.1s. Estimated remaining: 3h 34m 59s. Rate: 7.6 symbols/min [2025-09-23T18:39:04.511666] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:39:04.551746] [DEBUG] [LOCAL ] EPAM: Loaded 39649 existing records from primary storage. [2025-09-23T18:39:04.551882] [INFO ] [MAIN ] EPAM: Loaded 39649 existing records. [2025-09-23T18:39:04.736386] [WARN ] [MAIN ] EPAM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:39:04.736958] [INFO ] [MAIN ] EPAM: Wiping existing primary data before full refresh. [2025-09-23T18:39:04.750710] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-09-23T18:39:04.751731] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-23T18:39:04.753694] [DEBUG] [LOCAL ] EPAM: Deleted primary data file. [2025-09-23T18:39:04.757416] [INFO ] [MAIN ] EPAM: Starting full primary refresh. [2025-09-23T18:39:05.005617] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-02. [2025-09-23T18:39:05.073991] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-23T18:39:05.125931] [INFO ] [REMOTE ] EOS: Full fetch complete (23045 records). [2025-09-23T18:39:05.132535] [INFO ] [REMOTE ] EPAM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:39:05.133315] [DEBUG] [VALIDATOR ] EOS: Validating primary data. [2025-09-23T18:39:05.506486] [DEBUG] [VALIDATOR ] EOS: All expected trading days are present. [2025-09-23T18:39:05.506613] [DEBUG] [VALIDATOR ] EOS: Primary data validation passed. [2025-09-23T18:39:05.507115] [INFO ] [MAIN ] EOS: Fetched primary data is valid. [2025-09-23T18:39:05.507192] [DEBUG] [LOCAL ] EOS: Saving primary data. [2025-09-23T18:39:05.508030] [DEBUG] [LOCAL ] EOS: Trimmed 23045 records to 15392 (keeping 200 days of data) [2025-09-23T18:39:05.603870] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-23T18:39:05.639877] [DEBUG] [LOCAL ] EOS: Primary data saved (15392 records). [2025-09-23T18:39:05.640000] [INFO ] [MAIN ] EOS: Full history saved. [2025-09-23T18:39:05.640082] [INFO ] [MAIN ] Update Progress: 749/2372 symbols completed. EOS took 27.8s. Estimated remaining: 3h 34m 37s. Rate: 7.6 symbols/min [2025-09-23T18:39:05.807886] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:39:05.807952] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-07. [2025-09-23T18:39:05.846529] [DEBUG] [LOCAL ] EPC: Loaded 39905 existing records from primary storage. [2025-09-23T18:39:05.846696] [INFO ] [MAIN ] EPC: Loaded 39905 existing records. [2025-09-23T18:39:06.028474] [WARN ] [MAIN ] EPC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:39:06.028903] [INFO ] [MAIN ] EPC: Wiping existing primary data before full refresh. [2025-09-23T18:39:06.028974] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-09-23T18:39:06.035288] [DEBUG] [LOCAL ] EPC: Deleted primary data file. [2025-09-23T18:39:06.042368] [INFO ] [MAIN ] EPC: Starting full primary refresh. [2025-09-23T18:39:06.074757] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-23T18:39:06.398973] [INFO ] [REMOTE ] EPC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:39:06.602180] [INFO ] [REMOTE ] EPC: Fetching primary data for 2024-12. [2025-09-23T18:39:07.402230] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-03. [2025-09-23T18:39:07.496933] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-23T18:39:08.149169] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-23T18:39:08.202199] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2024-12. [2025-09-23T18:39:08.439020] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-23T18:39:09.002249] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-08. [2025-09-23T18:39:09.556045] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-23T18:39:09.802269] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-04. [2025-09-23T18:39:10.602259] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-01. [2025-09-23T18:39:10.767020] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-23T18:39:10.866523] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-23T18:39:11.402238] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-09. [2025-09-23T18:39:11.618163] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-23T18:39:12.202261] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-02. [2025-09-23T18:39:13.002218] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-05. [2025-09-23T18:39:13.027376] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-23T18:39:13.036132] [INFO ] [REMOTE ] EOG: Full fetch complete (77270 records). [2025-09-23T18:39:13.036553] [DEBUG] [VALIDATOR ] EOG: Validating primary data. [2025-09-23T18:39:13.429479] [DEBUG] [VALIDATOR ] EOG: All expected trading days are present. [2025-09-23T18:39:13.429562] [DEBUG] [VALIDATOR ] EOG: Primary data validation passed. [2025-09-23T18:39:13.430457] [INFO ] [MAIN ] EOG: Fetched primary data is valid. [2025-09-23T18:39:13.430520] [DEBUG] [LOCAL ] EOG: Saving primary data. [2025-09-23T18:39:13.432151] [DEBUG] [LOCAL ] EOG: Trimmed 77270 records to 53341 (keeping 200 days of data) [2025-09-23T18:39:13.765036] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-23T18:39:13.796862] [DEBUG] [LOCAL ] EOG: Primary data saved (53341 records). [2025-09-23T18:39:13.797028] [INFO ] [MAIN ] EOG: Full history saved. [2025-09-23T18:39:13.797120] [INFO ] [MAIN ] Update Progress: 750/2372 symbols completed. EOG took 45.9s. Estimated remaining: 3h 34m 29s. Rate: 7.6 symbols/min [2025-09-23T18:39:13.808614] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-01. [2025-09-23T18:39:13.980039] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:39:13.994064] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-23T18:39:14.047067] [DEBUG] [LOCAL ] EPD: Loaded 53616 existing records from primary storage. [2025-09-23T18:39:14.047230] [INFO ] [MAIN ] EPD: Loaded 53616 existing records. [2025-09-23T18:39:14.229048] [WARN ] [MAIN ] EPD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:39:14.229302] [INFO ] [MAIN ] EPD: Wiping existing primary data before full refresh. [2025-09-23T18:39:14.229352] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-09-23T18:39:14.230669] [DEBUG] [LOCAL ] EPD: Deleted primary data file. [2025-09-23T18:39:14.230733] [INFO ] [MAIN ] EPD: Starting full primary refresh. [2025-09-23T18:39:14.600947] [INFO ] [REMOTE ] EPD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:39:14.602155] [INFO ] [REMOTE ] EPD: Fetching primary data for 2024-12. [2025-09-23T18:39:15.402168] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-06. [2025-09-23T18:39:15.490229] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-23T18:39:16.202263] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-03. [2025-09-23T18:39:16.398906] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-23T18:39:17.002208] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-07. [2025-09-23T18:39:17.127035] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2024-12 (2.52 seconds). [2025-09-23T18:39:17.802258] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-01. [2025-09-23T18:39:18.602173] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-02. [2025-09-23T18:39:18.664807] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-09-23T18:39:18.691987] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-23T18:39:19.402240] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-08. [2025-09-23T18:39:19.506470] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-23T18:39:19.780395] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-23T18:39:20.204468] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-03. [2025-09-23T18:39:20.208688] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-23T18:39:21.002216] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-02. [2025-09-23T18:39:21.423936] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-23T18:39:21.802202] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-04. [2025-09-23T18:39:22.452558] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-23T18:39:22.602196] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-04. [2025-09-23T18:39:23.078599] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-23T18:39:23.402190] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-03. [2025-09-23T18:39:23.669743] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-23T18:39:24.202233] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-05. [2025-09-23T18:39:25.002251] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-05. [2025-09-23T18:39:25.053423] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-23T18:39:25.802227] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-09. [2025-09-23T18:39:25.871025] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-23T18:39:26.210895] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-23T18:39:26.602232] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-04. [2025-09-23T18:39:27.209080] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-23T18:39:27.215104] [INFO ] [REMOTE ] EPAC: Full fetch complete (39082 records). [2025-09-23T18:39:27.215234] [DEBUG] [VALIDATOR ] EPAC: Validating primary data. [2025-09-23T18:39:27.419246] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-06. [2025-09-23T18:39:27.611684] [DEBUG] [VALIDATOR ] EPAC: All expected trading days are present. [2025-09-23T18:39:27.611815] [DEBUG] [VALIDATOR ] EPAC: Primary data validation passed. [2025-09-23T18:39:27.612544] [INFO ] [MAIN ] EPAC: Fetched primary data is valid. [2025-09-23T18:39:27.612663] [DEBUG] [LOCAL ] EPAC: Saving primary data. [2025-09-23T18:39:27.617924] [DEBUG] [LOCAL ] EPAC: Trimmed 39082 records to 27051 (keeping 200 days of data) [2025-09-23T18:39:27.779268] [DEBUG] [LOCAL ] EPAC: Primary data saved (27051 records). [2025-09-23T18:39:27.779404] [INFO ] [MAIN ] EPAC: Full history saved. [2025-09-23T18:39:27.779592] [INFO ] [MAIN ] Update Progress: 751/2372 symbols completed. EPAC took 27.6s. Estimated remaining: 3h 34m 34s. Rate: 7.6 symbols/min [2025-09-23T18:39:27.948585] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:39:27.996852] [DEBUG] [LOCAL ] EPR: Loaded 44290 existing records from primary storage. [2025-09-23T18:39:27.997030] [INFO ] [MAIN ] EPR: Loaded 44290 existing records. [2025-09-23T18:39:28.209714] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-06. [2025-09-23T18:39:28.210874] [WARN ] [MAIN ] EPR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:39:28.213533] [INFO ] [MAIN ] EPR: Wiping existing primary data before full refresh. [2025-09-23T18:39:28.213628] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-09-23T18:39:28.215420] [DEBUG] [LOCAL ] EPR: Deleted primary data file. [2025-09-23T18:39:28.215511] [INFO ] [MAIN ] EPR: Starting full primary refresh. [2025-09-23T18:39:28.821120] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-23T18:39:28.883216] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-23T18:39:28.983512] [INFO ] [REMOTE ] EPR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:39:29.002236] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-05. [2025-09-23T18:39:29.301115] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-23T18:39:29.802215] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-07. [2025-09-23T18:39:30.602200] [INFO ] [REMOTE ] EPR: Fetching primary data for 2024-12. [2025-09-23T18:39:31.402207] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-07. [2025-09-23T18:39:31.704789] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-23T18:39:32.026878] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-05 (3.02 seconds). [2025-09-23T18:39:32.202151] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-06. [2025-09-23T18:39:32.527570] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-23T18:39:32.601104] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-23T18:39:33.002194] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-08. [2025-09-23T18:39:33.802156] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-01. [2025-09-23T18:39:34.053211] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-23T18:39:34.180208] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-23T18:39:34.602216] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-07. [2025-09-23T18:39:34.917412] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-23T18:39:35.402220] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-08. [2025-09-23T18:39:36.202174] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-09. [2025-09-23T18:39:36.555315] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-23T18:39:36.661013] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-23T18:39:37.002215] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-08. [2025-09-23T18:39:37.309021] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-23T18:39:37.316040] [INFO ] [REMOTE ] EPC: Full fetch complete (56718 records). [2025-09-23T18:39:37.316177] [DEBUG] [VALIDATOR ] EPC: Validating primary data. [2025-09-23T18:39:37.718328] [DEBUG] [VALIDATOR ] EPC: All expected trading days are present. [2025-09-23T18:39:37.718441] [DEBUG] [VALIDATOR ] EPC: Primary data validation passed. [2025-09-23T18:39:37.719525] [INFO ] [MAIN ] EPC: Fetched primary data is valid. [2025-09-23T18:39:37.719639] [DEBUG] [LOCAL ] EPC: Saving primary data. [2025-09-23T18:39:37.720989] [DEBUG] [LOCAL ] EPC: Trimmed 56718 records to 39891 (keeping 200 days of data) [2025-09-23T18:39:37.820594] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-09. [2025-09-23T18:39:37.979600] [DEBUG] [LOCAL ] EPC: Primary data saved (39891 records). [2025-09-23T18:39:37.979771] [INFO ] [MAIN ] EPC: Full history saved. [2025-09-23T18:39:37.979942] [INFO ] [MAIN ] Update Progress: 752/2372 symbols completed. EPC took 32.3s. Estimated remaining: 3h 34m 31s. Rate: 7.6 symbols/min [2025-09-23T18:39:38.154574] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:39:38.154797] [DEBUG] [LOCAL ] EPRT: No existing data file found in primary storage. [2025-09-23T18:39:38.154852] [WARN ] [MAIN ] EPRT: No existing data found, performing full refresh instead. [2025-09-23T18:39:38.154993] [INFO ] [MAIN ] EPRT: Wiping existing primary data before full refresh. [2025-09-23T18:39:38.155071] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-09-23T18:39:38.155127] [DEBUG] [LOCAL ] EPRT: No primary data file found to delete. [2025-09-23T18:39:38.155183] [INFO ] [MAIN ] EPRT: Starting full primary refresh. [2025-09-23T18:39:38.535041] [INFO ] [REMOTE ] EPRT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:39:38.607269] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2024-12. [2025-09-23T18:39:38.627275] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-23T18:39:39.407405] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-09. [2025-09-23T18:39:39.419817] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-23T18:39:39.430861] [INFO ] [REMOTE ] EPAM: Full fetch complete (56098 records). [2025-09-23T18:39:39.431004] [DEBUG] [VALIDATOR ] EPAM: Validating primary data. [2025-09-23T18:39:39.832281] [DEBUG] [VALIDATOR ] EPAM: All expected trading days are present. [2025-09-23T18:39:39.832466] [DEBUG] [VALIDATOR ] EPAM: Primary data validation passed. [2025-09-23T18:39:39.833569] [INFO ] [MAIN ] EPAM: Fetched primary data is valid. [2025-09-23T18:39:39.833678] [DEBUG] [LOCAL ] EPAM: Saving primary data. [2025-09-23T18:39:39.837556] [DEBUG] [LOCAL ] EPAM: Trimmed 56098 records to 39711 (keeping 200 days of data) [2025-09-23T18:39:39.990775] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-23T18:39:40.149587] [DEBUG] [LOCAL ] EPAM: Primary data saved (39711 records). [2025-09-23T18:39:40.149770] [INFO ] [MAIN ] EPAM: Full history saved. [2025-09-23T18:39:40.149914] [INFO ] [MAIN ] Update Progress: 753/2372 symbols completed. EPAM took 35.8s. Estimated remaining: 3h 34m 11s. Rate: 7.6 symbols/min [2025-09-23T18:39:40.213854] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-02. [2025-09-23T18:39:40.328161] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:39:40.342304] [DEBUG] [LOCAL ] EQBK: Loaded 10916 existing records from primary storage. [2025-09-23T18:39:40.342464] [INFO ] [MAIN ] EQBK: Loaded 10916 existing records. [2025-09-23T18:39:40.533394] [WARN ] [MAIN ] EQBK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:39:40.533945] [INFO ] [MAIN ] EQBK: Wiping existing primary data before full refresh. [2025-09-23T18:39:40.534012] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-09-23T18:39:40.534510] [DEBUG] [LOCAL ] EQBK: Deleted primary data file. [2025-09-23T18:39:40.534573] [INFO ] [MAIN ] EQBK: Starting full primary refresh. [2025-09-23T18:39:40.911802] [INFO ] [REMOTE ] EQBK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:39:41.002275] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2024-12. [2025-09-23T18:39:41.208027] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-23T18:39:41.219194] [INFO ] [REMOTE ] EPD: Full fetch complete (77645 records). [2025-09-23T18:39:41.219386] [DEBUG] [VALIDATOR ] EPD: Validating primary data. [2025-09-23T18:39:41.626711] [DEBUG] [VALIDATOR ] EPD: All expected trading days are present. [2025-09-23T18:39:41.626863] [DEBUG] [VALIDATOR ] EPD: Primary data validation passed. [2025-09-23T18:39:41.628066] [INFO ] [MAIN ] EPD: Fetched primary data is valid. [2025-09-23T18:39:41.638083] [DEBUG] [LOCAL ] EPD: Saving primary data. [2025-09-23T18:39:41.657270] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-23T18:39:41.667030] [DEBUG] [LOCAL ] EPD: Trimmed 77645 records to 53616 (keeping 200 days of data) [2025-09-23T18:39:41.676291] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-23T18:39:41.805768] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-01. [2025-09-23T18:39:42.030063] [DEBUG] [LOCAL ] EPD: Primary data saved (53616 records). [2025-09-23T18:39:42.030216] [INFO ] [MAIN ] EPD: Full history saved. [2025-09-23T18:39:42.030376] [INFO ] [MAIN ] Update Progress: 754/2372 symbols completed. EPD took 28.2s. Estimated remaining: 3h 33m 50s. Rate: 7.6 symbols/min [2025-09-23T18:39:42.202562] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:39:42.259005] [DEBUG] [LOCAL ] EQH: Loaded 52672 existing records from primary storage. [2025-09-23T18:39:42.259161] [INFO ] [MAIN ] EQH: Loaded 52672 existing records. [2025-09-23T18:39:42.433508] [WARN ] [MAIN ] EQH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:39:42.433814] [INFO ] [MAIN ] EQH: Wiping existing primary data before full refresh. [2025-09-23T18:39:42.433864] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-09-23T18:39:42.435161] [DEBUG] [LOCAL ] EQH: Deleted primary data file. [2025-09-23T18:39:42.435222] [INFO ] [MAIN ] EQH: Starting full primary refresh. [2025-09-23T18:39:42.607351] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-03. [2025-09-23T18:39:42.796147] [INFO ] [REMOTE ] EQH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:39:42.980601] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-23T18:39:43.402192] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-01. [2025-09-23T18:39:44.011772] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-23T18:39:44.202168] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-02. [2025-09-23T18:39:44.261737] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-23T18:39:44.824672] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-23T18:39:45.002222] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-03. [2025-09-23T18:39:45.802172] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-04. [2025-09-23T18:39:45.828086] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-23T18:39:46.602208] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-02. [2025-09-23T18:39:47.079023] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-23T18:39:47.402195] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-04. [2025-09-23T18:39:48.020688] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-23T18:39:48.186047] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-23T18:39:48.202150] [INFO ] [REMOTE ] EQH: Fetching primary data for 2024-12. [2025-09-23T18:39:49.002202] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-03. [2025-09-23T18:39:49.601559] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-23T18:39:49.802189] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-01. [2025-09-23T18:39:50.325833] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-23T18:39:50.602193] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-04. [2025-09-23T18:39:51.402189] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-05. [2025-09-23T18:39:51.478237] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-23T18:39:51.891859] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-23T18:39:52.202232] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-05. [2025-09-23T18:39:52.818008] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-23T18:39:52.847602] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-23T18:39:53.002198] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-06. [2025-09-23T18:39:53.469540] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-23T18:39:53.802232] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-02. [2025-09-23T18:39:54.602225] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-06. [2025-09-23T18:39:55.402228] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-07. [2025-09-23T18:39:55.475337] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-23T18:39:55.878978] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-23T18:39:56.086856] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-23T18:39:56.202261] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-07. [2025-09-23T18:39:57.002198] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-05. [2025-09-23T18:39:57.533286] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-23T18:39:57.802207] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-08. [2025-09-23T18:39:58.566479] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-23T18:39:58.602146] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-06. [2025-09-23T18:39:59.402209] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-08. [2025-09-23T18:39:59.597480] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-23T18:39:59.926098] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-23T18:40:00.208919] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-09. [2025-09-23T18:40:00.217393] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-23T18:40:01.002238] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-03. [2025-09-23T18:40:01.326395] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-23T18:40:01.329223] [INFO ] [REMOTE ] EQBK: Full fetch complete (15286 records). [2025-09-23T18:40:01.329306] [DEBUG] [VALIDATOR ] EQBK: Validating primary data. [2025-09-23T18:40:01.329822] [FATAL] [VALIDATOR ] EQBK: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:40:01.329911] [FATAL] [MAIN ] EQBK: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:40:01.329975] [WARN ] [MAIN ] EQBK: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:40:01.330039] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-09-23T18:40:01.330114] [DEBUG] [LOCAL ] EQBK: No primary data file found to delete. [2025-09-23T18:40:01.330165] [INFO ] [LOCAL ] EQBK: Starting deletion of derivative data. [2025-09-23T18:40:01.330842] [DEBUG] [LOCAL ] EQBK: Deleted derivative data file. [2025-09-23T18:40:01.330939] [INFO ] [MAIN ] Update Progress: 755/2372 symbols completed. EQBK took 21.2s. Estimated remaining: 3h 34m 6s. Rate: 7.6 symbols/min [2025-09-23T18:40:01.540074] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:40:01.600253] [DEBUG] [LOCAL ] EQNR: Loaded 53042 existing records from primary storage. [2025-09-23T18:40:01.600406] [INFO ] [MAIN ] EQNR: Loaded 53042 existing records. [2025-09-23T18:40:01.804400] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-07. [2025-09-23T18:40:01.811037] [WARN ] [MAIN ] EQNR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:40:01.812584] [INFO ] [MAIN ] EQNR: Wiping existing primary data before full refresh. [2025-09-23T18:40:01.812889] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-09-23T18:40:01.815269] [DEBUG] [LOCAL ] EQNR: Deleted primary data file. [2025-09-23T18:40:01.815363] [INFO ] [MAIN ] EQNR: Starting full primary refresh. [2025-09-23T18:40:02.218227] [INFO ] [REMOTE ] EQNR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:40:02.602905] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2024-12. [2025-09-23T18:40:02.606573] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-23T18:40:03.402197] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-09. [2025-09-23T18:40:03.947804] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-23T18:40:04.207384] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-08. [2025-09-23T18:40:04.216338] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-23T18:40:04.981243] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-23T18:40:04.990279] [INFO ] [REMOTE ] EPR: Full fetch complete (62886 records). [2025-09-23T18:40:04.990575] [DEBUG] [VALIDATOR ] EPR: Validating primary data. [2025-09-23T18:40:05.009016] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-01. [2025-09-23T18:40:05.446338] [DEBUG] [VALIDATOR ] EPR: All expected trading days are present. [2025-09-23T18:40:05.446594] [DEBUG] [VALIDATOR ] EPR: Primary data validation passed. [2025-09-23T18:40:05.448184] [INFO ] [MAIN ] EPR: Fetched primary data is valid. [2025-09-23T18:40:05.448320] [DEBUG] [LOCAL ] EPR: Saving primary data. [2025-09-23T18:40:05.450914] [DEBUG] [LOCAL ] EPR: Trimmed 62886 records to 44248 (keeping 200 days of data) [2025-09-23T18:40:05.612114] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-23T18:40:05.804468] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-09. [2025-09-23T18:40:05.813315] [DEBUG] [LOCAL ] EPR: Primary data saved (44248 records). [2025-09-23T18:40:05.814713] [INFO ] [MAIN ] EPR: Full history saved. [2025-09-23T18:40:05.814878] [INFO ] [MAIN ] Update Progress: 756/2372 symbols completed. EPR took 38.0s. Estimated remaining: 3h 33m 51s. Rate: 7.6 symbols/min [2025-09-23T18:40:06.013890] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:40:06.077742] [DEBUG] [LOCAL ] EQR: Loaded 51410 existing records from primary storage. [2025-09-23T18:40:06.077965] [INFO ] [MAIN ] EQR: Loaded 51410 existing records. [2025-09-23T18:40:06.261092] [WARN ] [MAIN ] EQR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:40:06.261378] [INFO ] [MAIN ] EQR: Wiping existing primary data before full refresh. [2025-09-23T18:40:06.261427] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-09-23T18:40:06.262569] [DEBUG] [LOCAL ] EQR: Deleted primary data file. [2025-09-23T18:40:06.262631] [INFO ] [MAIN ] EQR: Starting full primary refresh. [2025-09-23T18:40:06.605505] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-04. [2025-09-23T18:40:06.627337] [INFO ] [REMOTE ] EQR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:40:07.027581] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-23T18:40:07.221330] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-23T18:40:07.229840] [INFO ] [REMOTE ] EPRT: Full fetch complete (68679 records). [2025-09-23T18:40:07.230006] [DEBUG] [VALIDATOR ] EPRT: Validating primary data. [2025-09-23T18:40:07.412243] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-02. [2025-09-23T18:40:07.656681] [DEBUG] [VALIDATOR ] EPRT: All expected trading days are present. [2025-09-23T18:40:07.656976] [DEBUG] [VALIDATOR ] EPRT: Primary data validation passed. [2025-09-23T18:40:07.658076] [INFO ] [MAIN ] EPRT: Fetched primary data is valid. [2025-09-23T18:40:07.658147] [DEBUG] [LOCAL ] EPRT: Saving primary data. [2025-09-23T18:40:07.659834] [DEBUG] [LOCAL ] EPRT: Trimmed 68679 records to 48693 (keeping 200 days of data) [2025-09-23T18:40:07.969761] [DEBUG] [LOCAL ] EPRT: Primary data saved (48693 records). [2025-09-23T18:40:07.969899] [INFO ] [MAIN ] EPRT: Full history saved. [2025-09-23T18:40:07.970008] [INFO ] [MAIN ] Update Progress: 757/2372 symbols completed. EPRT took 30.0s. Estimated remaining: 3h 33m 31s. Rate: 7.6 symbols/min [2025-09-23T18:40:08.202176] [INFO ] [REMOTE ] EQR: Fetching primary data for 2024-12. [2025-09-23T18:40:08.488557] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-23T18:40:09.007484] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-05. [2025-09-23T18:40:09.032136] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-23T18:40:09.692140] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-23T18:40:09.802195] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-03. [2025-09-23T18:40:10.536428] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-23T18:40:10.602164] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-06. [2025-09-23T18:40:11.388799] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-23T18:40:11.402145] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-04. [2025-09-23T18:40:11.998614] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-23T18:40:12.202203] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-01. [2025-09-23T18:40:12.942055] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-23T18:40:13.002164] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-05. [2025-09-23T18:40:13.802171] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-07. [2025-09-23T18:40:13.966473] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-23T18:40:14.602154] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-02. [2025-09-23T18:40:14.722638] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-23T18:40:15.407272] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-06. [2025-09-23T18:40:15.428368] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-23T18:40:16.202184] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-08. [2025-09-23T18:40:16.403013] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-23T18:40:17.002239] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-03. [2025-09-23T18:40:17.075520] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-23T18:40:17.607554] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-23T18:40:17.802214] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-07. [2025-09-23T18:40:18.374890] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-23T18:40:18.602210] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-04. [2025-09-23T18:40:19.281466] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-23T18:40:19.402216] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-08. [2025-09-23T18:40:20.202170] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-09. [2025-09-23T18:40:20.340493] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-23T18:40:20.943534] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-23T18:40:21.002217] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-05. [2025-09-23T18:40:21.571750] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-23T18:40:21.582241] [INFO ] [REMOTE ] EQH: Full fetch complete (76310 records). [2025-09-23T18:40:21.582436] [DEBUG] [VALIDATOR ] EQH: Validating primary data. [2025-09-23T18:40:21.808141] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-09. [2025-09-23T18:40:22.045996] [DEBUG] [VALIDATOR ] EQH: All expected trading days are present. [2025-09-23T18:40:22.046101] [DEBUG] [VALIDATOR ] EQH: Primary data validation passed. [2025-09-23T18:40:22.047066] [INFO ] [MAIN ] EQH: Fetched primary data is valid. [2025-09-23T18:40:22.047134] [DEBUG] [LOCAL ] EQH: Saving primary data. [2025-09-23T18:40:22.048777] [DEBUG] [LOCAL ] EQH: Trimmed 76310 records to 52669 (keeping 200 days of data) [2025-09-23T18:40:22.388430] [DEBUG] [LOCAL ] EQH: Primary data saved (52669 records). [2025-09-23T18:40:22.388587] [INFO ] [MAIN ] EQH: Full history saved. [2025-09-23T18:40:22.388697] [INFO ] [MAIN ] Update Progress: 758/2372 symbols completed. EQH took 40.4s. Estimated remaining: 3h 33m 37s. Rate: 7.6 symbols/min [2025-09-23T18:40:22.662999] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-23T18:40:22.679537] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-06. [2025-09-23T18:40:23.537037] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-23T18:40:23.549611] [INFO ] [REMOTE ] EQNR: Full fetch complete (76756 records). [2025-09-23T18:40:23.549840] [DEBUG] [VALIDATOR ] EQNR: Validating primary data. [2025-09-23T18:40:23.949168] [DEBUG] [VALIDATOR ] EQNR: All expected trading days are present. [2025-09-23T18:40:23.949383] [DEBUG] [VALIDATOR ] EQNR: Primary data validation passed. [2025-09-23T18:40:23.950307] [INFO ] [MAIN ] EQNR: Fetched primary data is valid. [2025-09-23T18:40:23.950424] [DEBUG] [LOCAL ] EQNR: Saving primary data. [2025-09-23T18:40:23.952381] [DEBUG] [LOCAL ] EQNR: Trimmed 76756 records to 53041 (keeping 200 days of data) [2025-09-23T18:40:24.091803] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-23T18:40:24.104881] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-07. [2025-09-23T18:40:24.328810] [DEBUG] [LOCAL ] EQNR: Primary data saved (53041 records). [2025-09-23T18:40:24.328975] [INFO ] [MAIN ] EQNR: Full history saved. [2025-09-23T18:40:24.329260] [INFO ] [MAIN ] Update Progress: 759/2372 symbols completed. EQNR took 23.0s. Estimated remaining: 3h 33m 16s. Rate: 7.6 symbols/min [2025-09-23T18:40:25.517567] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-23T18:40:25.532050] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-08. [2025-09-23T18:40:27.234973] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-23T18:40:27.246358] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-09. [2025-09-23T18:40:28.597387] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-23T18:40:28.606298] [INFO ] [REMOTE ] EQR: Full fetch complete (73712 records). [2025-09-23T18:40:28.606597] [DEBUG] [VALIDATOR ] EQR: Validating primary data. [2025-09-23T18:40:28.998586] [DEBUG] [VALIDATOR ] EQR: All expected trading days are present. [2025-09-23T18:40:28.998707] [DEBUG] [VALIDATOR ] EQR: Primary data validation passed. [2025-09-23T18:40:28.999566] [INFO ] [MAIN ] EQR: Fetched primary data is valid. [2025-09-23T18:40:28.999613] [DEBUG] [LOCAL ] EQR: Saving primary data. [2025-09-23T18:40:29.001207] [DEBUG] [LOCAL ] EQR: Trimmed 73712 records to 51413 (keeping 200 days of data) [2025-09-23T18:40:29.320633] [DEBUG] [LOCAL ] EQR: Primary data saved (51413 records). [2025-09-23T18:40:29.320852] [INFO ] [MAIN ] EQR: Full history saved. [2025-09-23T18:40:29.320941] [INFO ] [MAIN ] Update Progress: 760/2372 symbols completed. EQR took 23.5s. Estimated remaining: 3h 33m 2s. Rate: 7.6 symbols/min [2025-09-23T18:40:29.957140] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:40:29.906540] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:40:30.020938] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:40:30.041680] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:40:30.041933] [DEBUG] [LOCAL ] EQS: No existing data file found in primary storage. [2025-09-23T18:40:30.042088] [WARN ] [MAIN ] EQS: No existing data found, performing full refresh instead. [2025-09-23T18:40:30.043813] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-09-23T18:40:30.043928] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-09-23T18:40:30.044031] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-09-23T18:40:30.044161] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-09-23T18:40:30.057989] [DEBUG] [LOCAL ] EQV: Loaded 2833 existing records from primary storage. [2025-09-23T18:40:30.076820] [INFO ] [MAIN ] EQV: Loaded 2833 existing records. [2025-09-23T18:40:30.486261] [WARN ] [MAIN ] EQV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:40:30.550543] [INFO ] [MAIN ] EQV: Wiping existing primary data before full refresh. [2025-09-23T18:40:30.550456] [DEBUG] [LOCAL ] EQT: Loaded 53682 existing records from primary storage. [2025-09-23T18:40:30.560975] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-09-23T18:40:30.587769] [DEBUG] [LOCAL ] ERJ: Loaded 50813 existing records from primary storage. [2025-09-23T18:40:30.587838] [INFO ] [MAIN ] EQT: Loaded 53682 existing records. [2025-09-23T18:40:30.598868] [DEBUG] [LOCAL ] EQV: Deleted primary data file. [2025-09-23T18:40:30.619228] [INFO ] [MAIN ] ERJ: Loaded 50813 existing records. [2025-09-23T18:40:30.705679] [INFO ] [MAIN ] EQV: Starting full primary refresh. [2025-09-23T18:40:30.905091] [INFO ] [REMOTE ] EQS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:40:30.925547] [INFO ] [REMOTE ] EQS: Fetching primary data for 2024-12. [2025-09-23T18:40:31.107395] [WARN ] [MAIN ] EQT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:40:31.149869] [WARN ] [MAIN ] ERJ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:40:31.150301] [INFO ] [MAIN ] EQT: Wiping existing primary data before full refresh. [2025-09-23T18:40:31.160825] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-09-23T18:40:31.171258] [INFO ] [MAIN ] ERJ: Wiping existing primary data before full refresh. [2025-09-23T18:40:31.176408] [DEBUG] [LOCAL ] EQT: Deleted primary data file. [2025-09-23T18:40:31.189599] [INFO ] [MAIN ] EQT: Starting full primary refresh. [2025-09-23T18:40:31.199729] [INFO ] [LOCAL ] ERJ: Starting deletion of primary data. [2025-09-23T18:40:31.261433] [DEBUG] [LOCAL ] ERJ: Deleted primary data file. [2025-09-23T18:40:31.281262] [INFO ] [MAIN ] ERJ: Starting full primary refresh. [2025-09-23T18:40:31.750964] [INFO ] [REMOTE ] EQV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:40:31.803950] [INFO ] [REMOTE ] EQV: Fetching primary data for 2024-12. [2025-09-23T18:40:31.803673] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-23T18:40:31.890229] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-01. [2025-09-23T18:40:32.105485] [INFO ] [REMOTE ] ERJ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:40:32.116065] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2024-12. [2025-09-23T18:40:32.172517] [INFO ] [REMOTE ] EQT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:40:32.172987] [INFO ] [REMOTE ] EQT: Fetching primary data for 2024-12. [2025-09-23T18:40:32.476995] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-23T18:40:32.478050] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-09-23T18:40:32.743594] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-09-23T18:40:32.744507] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-09-23T18:40:32.849435] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-23T18:40:32.851491] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-01. [2025-09-23T18:40:33.085000] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-23T18:40:33.086147] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-09-23T18:40:33.611037] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-23T18:40:33.618220] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-09-23T18:40:33.620064] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-23T18:40:33.807726] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-02. [2025-09-23T18:40:33.814409] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-23T18:40:33.935513] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-23T18:40:34.134990] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-23T18:40:34.477121] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-23T18:40:34.602177] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-09-23T18:40:34.945047] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-23T18:40:35.402183] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-09-23T18:40:35.692803] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-09-23T18:40:36.202202] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-01. [2025-09-23T18:40:37.002203] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-01. [2025-09-23T18:40:37.423622] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-23T18:40:37.802199] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-02. [2025-09-23T18:40:38.602160] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-09-23T18:40:38.725912] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-23T18:40:39.257711] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-23T18:40:39.286563] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-23T18:40:39.402191] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-02. [2025-09-23T18:40:40.202195] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-03. [2025-09-23T18:40:40.922177] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-23T18:40:41.002213] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-03. [2025-09-23T18:40:41.802209] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-03. [2025-09-23T18:40:42.096061] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-23T18:40:42.230666] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-23T18:40:42.602164] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-09-23T18:40:42.870242] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-23T18:40:43.222660] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-23T18:40:43.224067] [INFO ] [REMOTE ] EQS: Full fetch complete (2538 records). [2025-09-23T18:40:43.224142] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-09-23T18:40:43.407280] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-04. [2025-09-23T18:40:43.412832] [WARN ] [VALIDATOR ] EQS: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-09-23T18:40:43.413741] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:40:43.413813] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:40:43.413884] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-09-23T18:40:43.413945] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-09-23T18:40:43.413984] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-09-23T18:40:43.414026] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-09-23T18:40:43.414098] [INFO ] [MAIN ] Update Progress: 761/2372 symbols completed. EQS took 14.1s. Estimated remaining: 3h 33m 7s. Rate: 7.6 symbols/min [2025-09-23T18:40:43.596689] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:40:43.596869] [DEBUG] [LOCAL ] ERO: No existing data file found in primary storage. [2025-09-23T18:40:43.596908] [WARN ] [MAIN ] ERO: No existing data found, performing full refresh instead. [2025-09-23T18:40:43.597054] [INFO ] [MAIN ] ERO: Wiping existing primary data before full refresh. [2025-09-23T18:40:43.597099] [INFO ] [LOCAL ] ERO: Starting deletion of primary data. [2025-09-23T18:40:43.597142] [DEBUG] [LOCAL ] ERO: No primary data file found to delete. [2025-09-23T18:40:43.597233] [INFO ] [MAIN ] ERO: Starting full primary refresh. [2025-09-23T18:40:43.987228] [INFO ] [REMOTE ] ERO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:40:44.202191] [INFO ] [REMOTE ] ERO: Fetching primary data for 2024-12. [2025-09-23T18:40:45.002199] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-04. [2025-09-23T18:40:45.354617] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-23T18:40:45.601745] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-23T18:40:45.606286] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-23T18:40:45.802195] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-05. [2025-09-23T18:40:46.602208] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-04. [2025-09-23T18:40:47.402215] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-05. [2025-09-23T18:40:47.666607] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-23T18:40:47.759327] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-23T18:40:48.202164] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-06. [2025-09-23T18:40:48.320921] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-23T18:40:49.002190] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-01. [2025-09-23T18:40:49.802179] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-05. [2025-09-23T18:40:50.171952] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-23T18:40:50.205183] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-23T18:40:50.602225] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-02. [2025-09-23T18:40:51.201691] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-23T18:40:51.402191] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-06. [2025-09-23T18:40:51.738033] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-23T18:40:52.202215] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-07. [2025-09-23T18:40:52.857294] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-23T18:40:53.002201] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-03. [2025-09-23T18:40:53.802168] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-07. [2025-09-23T18:40:54.182182] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-23T18:40:54.236491] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-23T18:40:54.602259] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-06. [2025-09-23T18:40:55.166863] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-23T18:40:55.402223] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-07. [2025-09-23T18:40:55.446602] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-23T18:40:55.910509] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-23T18:40:56.202222] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-08. [2025-09-23T18:40:56.791469] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-23T18:40:57.002243] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-09. [2025-09-23T18:40:57.480059] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-23T18:40:57.481155] [INFO ] [REMOTE ] EQV: Full fetch complete (5733 records). [2025-09-23T18:40:57.481226] [DEBUG] [VALIDATOR ] EQV: Validating primary data. [2025-09-23T18:40:57.805682] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-04. [2025-09-23T18:40:57.844199] [DEBUG] [VALIDATOR ] EQV: All expected trading days are present. [2025-09-23T18:40:57.844299] [DEBUG] [VALIDATOR ] EQV: Primary data validation passed. [2025-09-23T18:40:57.844469] [INFO ] [MAIN ] EQV: Fetched primary data is valid. [2025-09-23T18:40:57.844509] [DEBUG] [LOCAL ] EQV: Saving primary data. [2025-09-23T18:40:57.844938] [DEBUG] [LOCAL ] EQV: Trimmed 5733 records to 2828 (keeping 200 days of data) [2025-09-23T18:40:57.862582] [DEBUG] [LOCAL ] EQV: Primary data saved (2828 records). [2025-09-23T18:40:57.862728] [INFO ] [MAIN ] EQV: Full history saved. [2025-09-23T18:40:57.863038] [INFO ] [MAIN ] Update Progress: 762/2372 symbols completed. EQV took 28.5s. Estimated remaining: 3h 33m 13s. Rate: 7.6 symbols/min [2025-09-23T18:40:58.042120] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:40:58.042348] [DEBUG] [LOCAL ] ES: No existing data file found in primary storage. [2025-09-23T18:40:58.042404] [WARN ] [MAIN ] ES: No existing data found, performing full refresh instead. [2025-09-23T18:40:58.042561] [INFO ] [MAIN ] ES: Wiping existing primary data before full refresh. [2025-09-23T18:40:58.042604] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-09-23T18:40:58.042673] [DEBUG] [LOCAL ] ES: No primary data file found to delete. [2025-09-23T18:40:58.042728] [INFO ] [MAIN ] ES: Starting full primary refresh. [2025-09-23T18:40:58.397711] [INFO ] [REMOTE ] ES: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:40:58.602224] [INFO ] [REMOTE ] ES: Fetching primary data for 2024-12. [2025-09-23T18:40:59.114180] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-23T18:40:59.402263] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-08. [2025-09-23T18:41:00.098484] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-23T18:41:00.202252] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-05. [2025-09-23T18:41:01.002223] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-01. [2025-09-23T18:41:01.440967] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-23T18:41:01.808068] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-09. [2025-09-23T18:41:01.826269] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-23T18:41:02.442511] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-23T18:41:02.602198] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-08. [2025-09-23T18:41:03.154347] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-23T18:41:03.162989] [INFO ] [REMOTE ] ERJ: Full fetch complete (72204 records). [2025-09-23T18:41:03.163144] [DEBUG] [VALIDATOR ] ERJ: Validating primary data. [2025-09-23T18:41:03.414004] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-06. [2025-09-23T18:41:03.585513] [DEBUG] [VALIDATOR ] ERJ: All expected trading days are present. [2025-09-23T18:41:03.585626] [DEBUG] [VALIDATOR ] ERJ: Primary data validation passed. [2025-09-23T18:41:03.586518] [INFO ] [MAIN ] ERJ: Fetched primary data is valid. [2025-09-23T18:41:03.586572] [DEBUG] [LOCAL ] ERJ: Saving primary data. [2025-09-23T18:41:03.588162] [DEBUG] [LOCAL ] ERJ: Trimmed 72204 records to 50792 (keeping 200 days of data) [2025-09-23T18:41:03.895589] [DEBUG] [LOCAL ] ERJ: Primary data saved (50792 records). [2025-09-23T18:41:03.895760] [INFO ] [MAIN ] ERJ: Full history saved. [2025-09-23T18:41:03.895853] [INFO ] [MAIN ] Update Progress: 763/2372 symbols completed. ERJ took 34.6s. Estimated remaining: 3h 33m 1s. Rate: 7.6 symbols/min [2025-09-23T18:41:04.064798] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:41:04.094395] [DEBUG] [LOCAL ] ESAB: Loaded 25962 existing records from primary storage. [2025-09-23T18:41:04.094582] [INFO ] [MAIN ] ESAB: Loaded 25962 existing records. [2025-09-23T18:41:04.203097] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-02. [2025-09-23T18:41:04.279559] [WARN ] [MAIN ] ESAB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:41:04.279992] [INFO ] [MAIN ] ESAB: Wiping existing primary data before full refresh. [2025-09-23T18:41:04.280151] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-09-23T18:41:04.281436] [DEBUG] [LOCAL ] ESAB: Deleted primary data file. [2025-09-23T18:41:04.281501] [INFO ] [MAIN ] ESAB: Starting full primary refresh. [2025-09-23T18:41:04.608621] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-23T18:41:04.689327] [INFO ] [REMOTE ] ESAB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:41:04.712971] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-23T18:41:05.002236] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-07. [2025-09-23T18:41:05.587703] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-23T18:41:05.802197] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2024-12. [2025-09-23T18:41:06.260116] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-23T18:41:06.602204] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-08. [2025-09-23T18:41:07.061836] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-23T18:41:07.402188] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-09. [2025-09-23T18:41:07.695895] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-23T18:41:08.202278] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-09. [2025-09-23T18:41:09.002215] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-01. [2025-09-23T18:41:09.235413] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-23T18:41:09.245747] [INFO ] [REMOTE ] EQT: Full fetch complete (77692 records). [2025-09-23T18:41:09.245914] [DEBUG] [VALIDATOR ] EQT: Validating primary data. [2025-09-23T18:41:09.643693] [DEBUG] [VALIDATOR ] EQT: All expected trading days are present. [2025-09-23T18:41:09.644186] [DEBUG] [VALIDATOR ] EQT: Primary data validation passed. [2025-09-23T18:41:09.645619] [INFO ] [MAIN ] EQT: Fetched primary data is valid. [2025-09-23T18:41:09.645748] [DEBUG] [LOCAL ] EQT: Saving primary data. [2025-09-23T18:41:09.668364] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-23T18:41:09.675913] [DEBUG] [LOCAL ] EQT: Trimmed 77692 records to 53682 (keeping 200 days of data) [2025-09-23T18:41:09.686817] [INFO ] [REMOTE ] ERO: Full fetch complete (59046 records). [2025-09-23T18:41:09.689104] [DEBUG] [VALIDATOR ] ERO: Validating primary data. [2025-09-23T18:41:09.691884] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-23T18:41:09.802740] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-03. [2025-09-23T18:41:10.344880] [DEBUG] [VALIDATOR ] ERO: All expected trading days are present. [2025-09-23T18:41:10.345775] [DEBUG] [VALIDATOR ] ERO: Primary data validation passed. [2025-09-23T18:41:10.346803] [INFO ] [MAIN ] ERO: Fetched primary data is valid. [2025-09-23T18:41:10.347169] [DEBUG] [LOCAL ] ERO: Saving primary data. [2025-09-23T18:41:10.350844] [DEBUG] [LOCAL ] ERO: Trimmed 59046 records to 41133 (keeping 200 days of data) [2025-09-23T18:41:10.535032] [DEBUG] [LOCAL ] EQT: Primary data saved (53682 records). [2025-09-23T18:41:10.535964] [INFO ] [MAIN ] EQT: Full history saved. [2025-09-23T18:41:10.536985] [INFO ] [MAIN ] Update Progress: 764/2372 symbols completed. EQT took 41.2s. Estimated remaining: 3h 32m 50s. Rate: 7.6 symbols/min [2025-09-23T18:41:10.606851] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-02. [2025-09-23T18:41:10.730324] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:41:10.808751] [DEBUG] [LOCAL ] ESE: Loaded 16560 existing records from primary storage. [2025-09-23T18:41:10.836449] [INFO ] [MAIN ] ESE: Loaded 16560 existing records. [2025-09-23T18:41:11.042962] [WARN ] [MAIN ] ESE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:41:11.045736] [INFO ] [MAIN ] ESE: Wiping existing primary data before full refresh. [2025-09-23T18:41:11.046422] [INFO ] [LOCAL ] ESE: Starting deletion of primary data. [2025-09-23T18:41:11.047917] [DEBUG] [LOCAL ] ESE: Deleted primary data file. [2025-09-23T18:41:11.048311] [INFO ] [MAIN ] ESE: Starting full primary refresh. [2025-09-23T18:41:11.405592] [DEBUG] [LOCAL ] ERO: Primary data saved (41133 records). [2025-09-23T18:41:11.431598] [INFO ] [MAIN ] ERO: Full history saved. [2025-09-23T18:41:11.441312] [INFO ] [MAIN ] Update Progress: 765/2372 symbols completed. ERO took 28.0s. Estimated remaining: 3h 32m 27s. Rate: 7.6 symbols/min [2025-09-23T18:41:11.463394] [INFO ] [REMOTE ] ESE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:41:11.464070] [INFO ] [REMOTE ] ESE: Fetching primary data for 2024-12. [2025-09-23T18:41:11.668708] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:41:11.703703] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-23T18:41:11.762368] [DEBUG] [LOCAL ] ESI: Loaded 50861 existing records from primary storage. [2025-09-23T18:41:11.762567] [INFO ] [MAIN ] ESI: Loaded 50861 existing records. [2025-09-23T18:41:11.961366] [WARN ] [MAIN ] ESI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:41:11.962429] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-23T18:41:11.967148] [INFO ] [MAIN ] ESI: Wiping existing primary data before full refresh. [2025-09-23T18:41:11.967467] [INFO ] [LOCAL ] ESI: Starting deletion of primary data. [2025-09-23T18:41:11.968904] [DEBUG] [LOCAL ] ESI: Deleted primary data file. [2025-09-23T18:41:11.968965] [INFO ] [MAIN ] ESI: Starting full primary refresh. [2025-09-23T18:41:12.207349] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-03. [2025-09-23T18:41:12.286495] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-23T18:41:12.390746] [INFO ] [REMOTE ] ESI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:41:13.002203] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-01. [2025-09-23T18:41:13.253963] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-23T18:41:13.802288] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-04. [2025-09-23T18:41:13.980735] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-23T18:41:14.602249] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-02. [2025-09-23T18:41:15.323296] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-23T18:41:15.343465] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-23T18:41:15.402161] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-05. [2025-09-23T18:41:16.202202] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-04. [2025-09-23T18:41:16.898200] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-23T18:41:17.002175] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-06. [2025-09-23T18:41:17.718441] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-23T18:41:17.802167] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-03. [2025-09-23T18:41:18.602205] [INFO ] [REMOTE ] ESI: Fetching primary data for 2024-12. [2025-09-23T18:41:18.730189] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-23T18:41:18.755970] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-23T18:41:19.402218] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-07. [2025-09-23T18:41:20.202178] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-05. [2025-09-23T18:41:20.236313] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-23T18:41:20.801025] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-23T18:41:21.002188] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-08. [2025-09-23T18:41:21.413341] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-23T18:41:21.802207] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-06. [2025-09-23T18:41:22.611034] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-01. [2025-09-23T18:41:22.638886] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-23T18:41:22.666855] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-23T18:41:23.402199] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-09. [2025-09-23T18:41:23.809030] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-23T18:41:24.202198] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-07. [2025-09-23T18:41:24.853540] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-23T18:41:24.862591] [INFO ] [REMOTE ] ES: Full fetch complete (76153 records). [2025-09-23T18:41:24.862811] [DEBUG] [VALIDATOR ] ES: Validating primary data. [2025-09-23T18:41:25.024927] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-02. [2025-09-23T18:41:25.319099] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-23T18:41:25.323040] [DEBUG] [VALIDATOR ] ES: All expected trading days are present. [2025-09-23T18:41:25.323120] [DEBUG] [VALIDATOR ] ES: Primary data validation passed. [2025-09-23T18:41:25.329217] [INFO ] [MAIN ] ES: Fetched primary data is valid. [2025-09-23T18:41:25.330211] [DEBUG] [LOCAL ] ES: Saving primary data. [2025-09-23T18:41:25.332214] [DEBUG] [LOCAL ] ES: Trimmed 76153 records to 52528 (keeping 200 days of data) [2025-09-23T18:41:25.677490] [DEBUG] [LOCAL ] ES: Primary data saved (52528 records). [2025-09-23T18:41:25.677687] [INFO ] [MAIN ] ES: Full history saved. [2025-09-23T18:41:25.677852] [INFO ] [MAIN ] Update Progress: 766/2372 symbols completed. ES took 27.8s. Estimated remaining: 3h 32m 33s. Rate: 7.6 symbols/min [2025-09-23T18:41:25.807352] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-04. [2025-09-23T18:41:25.873449] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:41:25.918584] [DEBUG] [LOCAL ] ESNT: Loaded 38709 existing records from primary storage. [2025-09-23T18:41:25.918801] [INFO ] [MAIN ] ESNT: Loaded 38709 existing records. [2025-09-23T18:41:26.097147] [WARN ] [MAIN ] ESNT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:41:26.097473] [INFO ] [MAIN ] ESNT: Wiping existing primary data before full refresh. [2025-09-23T18:41:26.097552] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-09-23T18:41:26.098721] [DEBUG] [LOCAL ] ESNT: Deleted primary data file. [2025-09-23T18:41:26.098811] [INFO ] [MAIN ] ESNT: Starting full primary refresh. [2025-09-23T18:41:26.515821] [INFO ] [REMOTE ] ESNT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:41:26.602159] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2024-12. [2025-09-23T18:41:26.724696] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-23T18:41:26.789918] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-23T18:41:27.402202] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-03. [2025-09-23T18:41:27.823610] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-23T18:41:28.202195] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-01. [2025-09-23T18:41:28.769915] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-23T18:41:29.002206] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-08. [2025-09-23T18:41:29.802281] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-04. [2025-09-23T18:41:29.856888] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-23T18:41:30.602195] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-05. [2025-09-23T18:41:30.656443] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-23T18:41:31.356276] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-23T18:41:31.402201] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-05. [2025-09-23T18:41:31.711538] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-23T18:41:32.202266] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-06. [2025-09-23T18:41:32.701682] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-23T18:41:33.002249] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-02. [2025-09-23T18:41:33.179081] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-23T18:41:33.802243] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-07. [2025-09-23T18:41:34.418554] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-23T18:41:34.597799] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-23T18:41:34.602199] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-06. [2025-09-23T18:41:35.402181] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-03. [2025-09-23T18:41:36.021573] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-23T18:41:36.202205] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-07. [2025-09-23T18:41:36.598326] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-23T18:41:37.002198] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-09. [2025-09-23T18:41:37.451452] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-23T18:41:37.802203] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-08. [2025-09-23T18:41:38.018762] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-23T18:41:38.023893] [INFO ] [REMOTE ] ESAB: Full fetch complete (35326 records). [2025-09-23T18:41:38.024013] [DEBUG] [VALIDATOR ] ESAB: Validating primary data. [2025-09-23T18:41:38.437754] [DEBUG] [VALIDATOR ] ESAB: All expected trading days are present. [2025-09-23T18:41:38.437866] [DEBUG] [VALIDATOR ] ESAB: Primary data validation passed. [2025-09-23T18:41:38.438457] [INFO ] [MAIN ] ESAB: Fetched primary data is valid. [2025-09-23T18:41:38.438521] [DEBUG] [LOCAL ] ESAB: Saving primary data. [2025-09-23T18:41:38.440457] [DEBUG] [LOCAL ] ESAB: Trimmed 35326 records to 26041 (keeping 200 days of data) [2025-09-23T18:41:38.605829] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-04. [2025-09-23T18:41:38.631283] [DEBUG] [LOCAL ] ESAB: Primary data saved (26041 records). [2025-09-23T18:41:38.631422] [INFO ] [MAIN ] ESAB: Full history saved. [2025-09-23T18:41:38.631606] [INFO ] [MAIN ] Update Progress: 767/2372 symbols completed. ESAB took 34.7s. Estimated remaining: 3h 32m 35s. Rate: 7.5 symbols/min [2025-09-23T18:41:38.825889] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:41:38.877628] [DEBUG] [LOCAL ] ESRT: Loaded 46390 existing records from primary storage. [2025-09-23T18:41:38.877833] [INFO ] [MAIN ] ESRT: Loaded 46390 existing records. [2025-09-23T18:41:39.074455] [WARN ] [MAIN ] ESRT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:41:39.074824] [INFO ] [MAIN ] ESRT: Wiping existing primary data before full refresh. [2025-09-23T18:41:39.074893] [INFO ] [LOCAL ] ESRT: Starting deletion of primary data. [2025-09-23T18:41:39.076491] [DEBUG] [LOCAL ] ESRT: Deleted primary data file. [2025-09-23T18:41:39.076553] [INFO ] [MAIN ] ESRT: Starting full primary refresh. [2025-09-23T18:41:39.407309] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-08. [2025-09-23T18:41:39.464466] [INFO ] [REMOTE ] ESRT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:41:39.619483] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-23T18:41:40.080282] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-23T18:41:40.202193] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-05. [2025-09-23T18:41:40.804574] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-23T18:41:41.002210] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-09. [2025-09-23T18:41:41.225475] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-23T18:41:41.802227] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-06. [2025-09-23T18:41:42.602200] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2024-12. [2025-09-23T18:41:42.820880] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-23T18:41:42.833281] [INFO ] [REMOTE ] ESI: Full fetch complete (72351 records). [2025-09-23T18:41:42.833466] [DEBUG] [VALIDATOR ] ESI: Validating primary data. [2025-09-23T18:41:43.274728] [DEBUG] [VALIDATOR ] ESI: All expected trading days are present. [2025-09-23T18:41:43.274936] [DEBUG] [VALIDATOR ] ESI: Primary data validation passed. [2025-09-23T18:41:43.275895] [INFO ] [MAIN ] ESI: Fetched primary data is valid. [2025-09-23T18:41:43.275993] [DEBUG] [LOCAL ] ESI: Saving primary data. [2025-09-23T18:41:43.278672] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-23T18:41:43.287235] [DEBUG] [LOCAL ] ESI: Trimmed 72351 records to 50856 (keeping 200 days of data) [2025-09-23T18:41:43.421279] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-09. [2025-09-23T18:41:43.619833] [DEBUG] [LOCAL ] ESI: Primary data saved (50856 records). [2025-09-23T18:41:43.619974] [INFO ] [MAIN ] ESI: Full history saved. [2025-09-23T18:41:43.620070] [INFO ] [MAIN ] Update Progress: 768/2372 symbols completed. ESI took 32.2s. Estimated remaining: 3h 32m 21s. Rate: 7.6 symbols/min [2025-09-23T18:41:43.800636] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:41:43.832550] [DEBUG] [LOCAL ] ESS: Loaded 30116 existing records from primary storage. [2025-09-23T18:41:43.832812] [INFO ] [MAIN ] ESS: Loaded 30116 existing records. [2025-09-23T18:41:44.018485] [WARN ] [MAIN ] ESS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:41:44.018779] [INFO ] [MAIN ] ESS: Wiping existing primary data before full refresh. [2025-09-23T18:41:44.018831] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-09-23T18:41:44.019783] [DEBUG] [LOCAL ] ESS: Deleted primary data file. [2025-09-23T18:41:44.019868] [INFO ] [MAIN ] ESS: Starting full primary refresh. [2025-09-23T18:41:44.209678] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-07. [2025-09-23T18:41:44.426139] [INFO ] [REMOTE ] ESS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:41:44.429345] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-23T18:41:44.450266] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-23T18:41:44.454114] [INFO ] [REMOTE ] ESE: Full fetch complete (21964 records). [2025-09-23T18:41:44.454202] [DEBUG] [VALIDATOR ] ESE: Validating primary data. [2025-09-23T18:41:44.835036] [DEBUG] [VALIDATOR ] ESE: All expected trading days are present. [2025-09-23T18:41:44.835127] [DEBUG] [VALIDATOR ] ESE: Primary data validation passed. [2025-09-23T18:41:44.835558] [INFO ] [MAIN ] ESE: Fetched primary data is valid. [2025-09-23T18:41:44.835597] [DEBUG] [LOCAL ] ESE: Saving primary data. [2025-09-23T18:41:44.836205] [DEBUG] [LOCAL ] ESE: Trimmed 21964 records to 16640 (keeping 200 days of data) [2025-09-23T18:41:44.954028] [DEBUG] [LOCAL ] ESE: Primary data saved (16640 records). [2025-09-23T18:41:44.954181] [INFO ] [MAIN ] ESE: Full history saved. [2025-09-23T18:41:44.954301] [INFO ] [MAIN ] Update Progress: 769/2372 symbols completed. ESE took 34.4s. Estimated remaining: 3h 31m 59s. Rate: 7.6 symbols/min [2025-09-23T18:41:45.009142] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-01. [2025-09-23T18:41:45.130080] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:41:45.193694] [DEBUG] [LOCAL ] ESTC: Loaded 50184 existing records from primary storage. [2025-09-23T18:41:45.194386] [INFO ] [MAIN ] ESTC: Loaded 50184 existing records. [2025-09-23T18:41:45.373328] [WARN ] [MAIN ] ESTC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:41:45.373753] [INFO ] [MAIN ] ESTC: Wiping existing primary data before full refresh. [2025-09-23T18:41:45.373809] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-09-23T18:41:45.375610] [DEBUG] [LOCAL ] ESTC: Deleted primary data file. [2025-09-23T18:41:45.375702] [INFO ] [MAIN ] ESTC: Starting full primary refresh. [2025-09-23T18:41:45.781000] [INFO ] [REMOTE ] ESTC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:41:45.802148] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2024-12. [2025-09-23T18:41:45.846913] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-23T18:41:46.309301] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-23T18:41:46.602210] [INFO ] [REMOTE ] ESS: Fetching primary data for 2024-12. [2025-09-23T18:41:47.412593] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-02. [2025-09-23T18:41:47.418557] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-23T18:41:48.202202] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-01. [2025-09-23T18:41:48.481555] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-23T18:41:48.910171] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-09-23T18:41:49.002347] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-08. [2025-09-23T18:41:49.557247] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-23T18:41:49.802252] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-02. [2025-09-23T18:41:50.210350] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-23T18:41:50.602245] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-09. [2025-09-23T18:41:51.046697] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-23T18:41:51.402186] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-03. [2025-09-23T18:41:52.109944] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-23T18:41:52.116390] [INFO ] [REMOTE ] ESNT: Full fetch complete (57215 records). [2025-09-23T18:41:52.116522] [DEBUG] [VALIDATOR ] ESNT: Validating primary data. [2025-09-23T18:41:52.207278] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-03. [2025-09-23T18:41:52.528046] [DEBUG] [VALIDATOR ] ESNT: All expected trading days are present. [2025-09-23T18:41:52.528325] [DEBUG] [VALIDATOR ] ESNT: Primary data validation passed. [2025-09-23T18:41:52.529098] [INFO ] [MAIN ] ESNT: Fetched primary data is valid. [2025-09-23T18:41:52.529160] [DEBUG] [LOCAL ] ESNT: Saving primary data. [2025-09-23T18:41:52.530354] [DEBUG] [LOCAL ] ESNT: Trimmed 57215 records to 38672 (keeping 200 days of data) [2025-09-23T18:41:52.793079] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-23T18:41:52.814666] [DEBUG] [LOCAL ] ESNT: Primary data saved (38672 records). [2025-09-23T18:41:52.814796] [INFO ] [MAIN ] ESNT: Full history saved. [2025-09-23T18:41:52.814887] [INFO ] [MAIN ] Update Progress: 770/2372 symbols completed. ESNT took 27.1s. Estimated remaining: 3h 31m 51s. Rate: 7.6 symbols/min [2025-09-23T18:41:52.984349] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:41:53.002184] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-04. [2025-09-23T18:41:53.041467] [DEBUG] [LOCAL ] ET: Loaded 53789 existing records from primary storage. [2025-09-23T18:41:53.041600] [INFO ] [MAIN ] ET: Loaded 53789 existing records. [2025-09-23T18:41:53.225546] [WARN ] [MAIN ] ET: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:41:53.225807] [INFO ] [MAIN ] ET: Wiping existing primary data before full refresh. [2025-09-23T18:41:53.225856] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-09-23T18:41:53.228667] [DEBUG] [LOCAL ] ET: Deleted primary data file. [2025-09-23T18:41:53.228728] [INFO ] [MAIN ] ET: Starting full primary refresh. [2025-09-23T18:41:53.594557] [INFO ] [REMOTE ] ET: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:41:53.694905] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-23T18:41:53.802206] [INFO ] [REMOTE ] ET: Fetching primary data for 2024-12. [2025-09-23T18:41:54.602180] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-01. [2025-09-23T18:41:54.744494] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-23T18:41:55.402185] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-05. [2025-09-23T18:41:55.733558] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-23T18:41:55.823675] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-23T18:41:56.202243] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-01. [2025-09-23T18:41:56.601526] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-23T18:41:57.002204] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-06. [2025-09-23T18:41:57.802245] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-04. [2025-09-23T18:41:58.086677] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-23T18:41:58.602247] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-02. [2025-09-23T18:41:58.676359] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-23T18:41:59.402165] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-02. [2025-09-23T18:41:59.604637] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-23T18:41:59.669244] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-23T18:42:00.202249] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-05. [2025-09-23T18:42:01.002227] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-03. [2025-09-23T18:42:01.622179] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-09-23T18:42:01.698365] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-23T18:42:01.802202] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-06. [2025-09-23T18:42:02.013484] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-23T18:42:02.602225] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-03. [2025-09-23T18:42:03.402193] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-07. [2025-09-23T18:42:03.645867] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-23T18:42:04.202240] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-07. [2025-09-23T18:42:05.002201] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-04. [2025-09-23T18:42:05.769171] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-23T18:42:05.802170] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-08. [2025-09-23T18:42:06.212119] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-03 (3.61 seconds). [2025-09-23T18:42:06.565135] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-23T18:42:06.586254] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-07 (3.18 seconds). [2025-09-23T18:42:06.602149] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-08. [2025-09-23T18:42:07.295803] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-23T18:42:07.402185] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-04. [2025-09-23T18:42:08.071889] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-23T18:42:08.202198] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-09. [2025-09-23T18:42:09.002260] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-09. [2025-09-23T18:42:09.482281] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-23T18:42:09.802236] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-05. [2025-09-23T18:42:09.949163] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-23T18:42:09.958163] [INFO ] [REMOTE ] ESTC: Full fetch complete (72172 records). [2025-09-23T18:42:09.958352] [DEBUG] [VALIDATOR ] ESTC: Validating primary data. [2025-09-23T18:42:10.370554] [DEBUG] [VALIDATOR ] ESTC: All expected trading days are present. [2025-09-23T18:42:10.370675] [DEBUG] [VALIDATOR ] ESTC: Primary data validation passed. [2025-09-23T18:42:10.371568] [INFO ] [MAIN ] ESTC: Fetched primary data is valid. [2025-09-23T18:42:10.371683] [DEBUG] [LOCAL ] ESTC: Saving primary data. [2025-09-23T18:42:10.373660] [DEBUG] [LOCAL ] ESTC: Trimmed 72172 records to 50162 (keeping 200 days of data) [2025-09-23T18:42:10.602185] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-05. [2025-09-23T18:42:10.684557] [DEBUG] [LOCAL ] ESTC: Primary data saved (50162 records). [2025-09-23T18:42:10.684719] [INFO ] [MAIN ] ESTC: Full history saved. [2025-09-23T18:42:10.684837] [INFO ] [MAIN ] Update Progress: 771/2372 symbols completed. ESTC took 25.7s. Estimated remaining: 3h 32m 4s. Rate: 7.5 symbols/min [2025-09-23T18:42:10.891008] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:42:10.893064] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-23T18:42:10.893249] [DEBUG] [LOCAL ] ETB: No existing data file found in primary storage. [2025-09-23T18:42:10.900614] [WARN ] [MAIN ] ETB: No existing data found, performing full refresh instead. [2025-09-23T18:42:10.901559] [INFO ] [MAIN ] ETB: Wiping existing primary data before full refresh. [2025-09-23T18:42:10.901639] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-09-23T18:42:10.901806] [INFO ] [REMOTE ] ESRT: Full fetch complete (66363 records). [2025-09-23T18:42:10.901874] [DEBUG] [LOCAL ] ETB: No primary data file found to delete. [2025-09-23T18:42:10.902008] [DEBUG] [VALIDATOR ] ESRT: Validating primary data. [2025-09-23T18:42:10.902210] [INFO ] [MAIN ] ETB: Starting full primary refresh. [2025-09-23T18:42:11.647858] [INFO ] [REMOTE ] ETB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:42:11.668769] [INFO ] [REMOTE ] ETB: Fetching primary data for 2024-12. [2025-09-23T18:42:11.684977] [DEBUG] [VALIDATOR ] ESRT: All expected trading days are present. [2025-09-23T18:42:11.685880] [DEBUG] [VALIDATOR ] ESRT: Primary data validation passed. [2025-09-23T18:42:11.686739] [INFO ] [MAIN ] ESRT: Fetched primary data is valid. [2025-09-23T18:42:11.686934] [DEBUG] [LOCAL ] ESRT: Saving primary data. [2025-09-23T18:42:11.688360] [DEBUG] [LOCAL ] ESRT: Trimmed 66363 records to 46352 (keeping 200 days of data) [2025-09-23T18:42:11.976134] [DEBUG] [LOCAL ] ESRT: Primary data saved (46352 records). [2025-09-23T18:42:11.976292] [INFO ] [MAIN ] ESRT: Full history saved. [2025-09-23T18:42:11.976417] [INFO ] [MAIN ] Update Progress: 772/2372 symbols completed. ESRT took 33.3s. Estimated remaining: 3h 31m 42s. Rate: 7.6 symbols/min [2025-09-23T18:42:12.110129] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-23T18:42:12.183840] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:42:12.204441] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-06. [2025-09-23T18:42:12.226158] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-09-23T18:42:12.262615] [DEBUG] [LOCAL ] ETD: Loaded 27409 existing records from primary storage. [2025-09-23T18:42:12.262794] [INFO ] [MAIN ] ETD: Loaded 27409 existing records. [2025-09-23T18:42:12.447066] [WARN ] [MAIN ] ETD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:42:12.447444] [INFO ] [MAIN ] ETD: Wiping existing primary data before full refresh. [2025-09-23T18:42:12.447592] [INFO ] [LOCAL ] ETD: Starting deletion of primary data. [2025-09-23T18:42:12.454531] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-23T18:42:12.455411] [DEBUG] [LOCAL ] ETD: Deleted primary data file. [2025-09-23T18:42:12.457439] [INFO ] [MAIN ] ETD: Starting full primary refresh. [2025-09-23T18:42:12.819937] [INFO ] [REMOTE ] ETD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:42:13.002215] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-01. [2025-09-23T18:42:13.292717] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-23T18:42:13.471492] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-23T18:42:13.802215] [INFO ] [REMOTE ] ETD: Fetching primary data for 2024-12. [2025-09-23T18:42:14.602204] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-02. [2025-09-23T18:42:14.767188] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-23T18:42:15.373351] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-23T18:42:15.402175] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-07. [2025-09-23T18:42:16.202273] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-03. [2025-09-23T18:42:16.715109] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-23T18:42:16.800087] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-23T18:42:17.002237] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-08. [2025-09-23T18:42:17.802238] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-01. [2025-09-23T18:42:17.970868] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-23T18:42:18.602186] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-04. [2025-09-23T18:42:18.980478] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-23T18:42:19.388327] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-23T18:42:19.402146] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-05. [2025-09-23T18:42:20.202189] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-06. [2025-09-23T18:42:20.233177] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-23T18:42:21.002227] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-02. [2025-09-23T18:42:21.737493] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-23T18:42:21.802159] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-03. [2025-09-23T18:42:22.602150] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-06. [2025-09-23T18:42:22.653546] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-06 (2.45 seconds). [2025-09-23T18:42:22.778989] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-23T18:42:23.193239] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-23T18:42:23.402185] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-07. [2025-09-23T18:42:24.202248] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-04. [2025-09-23T18:42:25.002283] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-07. [2025-09-23T18:42:25.287060] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-23T18:42:25.388515] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-23T18:42:25.805746] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-09. [2025-09-23T18:42:25.810775] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-23T18:42:26.602260] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-08. [2025-09-23T18:42:27.214780] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-23T18:42:27.220091] [INFO ] [REMOTE ] ESS: Full fetch complete (43296 records). [2025-09-23T18:42:27.220215] [DEBUG] [VALIDATOR ] ESS: Validating primary data. [2025-09-23T18:42:27.407460] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-08. [2025-09-23T18:42:27.539338] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-23T18:42:27.645080] [DEBUG] [VALIDATOR ] ESS: All expected trading days are present. [2025-09-23T18:42:27.645209] [DEBUG] [VALIDATOR ] ESS: Primary data validation passed. [2025-09-23T18:42:27.646096] [INFO ] [MAIN ] ESS: Fetched primary data is valid. [2025-09-23T18:42:27.646162] [DEBUG] [LOCAL ] ESS: Saving primary data. [2025-09-23T18:42:27.647299] [DEBUG] [LOCAL ] ESS: Trimmed 43296 records to 30026 (keeping 200 days of data) [2025-09-23T18:42:27.845762] [DEBUG] [LOCAL ] ESS: Primary data saved (30026 records). [2025-09-23T18:42:27.845905] [INFO ] [MAIN ] ESS: Full history saved. [2025-09-23T18:42:27.845995] [INFO ] [MAIN ] Update Progress: 773/2372 symbols completed. ESS took 44.2s. Estimated remaining: 3h 31m 51s. Rate: 7.5 symbols/min [2025-09-23T18:42:28.023253] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:42:28.041522] [DEBUG] [LOCAL ] ETG: Loaded 16734 existing records from primary storage. [2025-09-23T18:42:28.041744] [INFO ] [MAIN ] ETG: Loaded 16734 existing records. [2025-09-23T18:42:28.214166] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-09. [2025-09-23T18:42:28.237961] [WARN ] [MAIN ] ETG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:42:28.239591] [INFO ] [MAIN ] ETG: Wiping existing primary data before full refresh. [2025-09-23T18:42:28.239664] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-09-23T18:42:28.240335] [DEBUG] [LOCAL ] ETG: Deleted primary data file. [2025-09-23T18:42:28.240402] [INFO ] [MAIN ] ETG: Starting full primary refresh. [2025-09-23T18:42:28.597508] [INFO ] [REMOTE ] ETG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:42:29.002406] [INFO ] [REMOTE ] ETG: Fetching primary data for 2024-12. [2025-09-23T18:42:29.499395] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-23T18:42:29.501343] [INFO ] [REMOTE ] ETB: Full fetch complete (17712 records). [2025-09-23T18:42:29.501421] [DEBUG] [VALIDATOR ] ETB: Validating primary data. [2025-09-23T18:42:29.802891] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-05. [2025-09-23T18:42:29.887875] [DEBUG] [VALIDATOR ] ETB: All expected trading days are present. [2025-09-23T18:42:29.887968] [DEBUG] [VALIDATOR ] ETB: Primary data validation passed. [2025-09-23T18:42:29.888421] [INFO ] [MAIN ] ETB: Fetched primary data is valid. [2025-09-23T18:42:29.888464] [DEBUG] [LOCAL ] ETB: Saving primary data. [2025-09-23T18:42:29.889256] [DEBUG] [LOCAL ] ETB: Trimmed 17712 records to 11919 (keeping 200 days of data) [2025-09-23T18:42:29.966844] [DEBUG] [LOCAL ] ETB: Primary data saved (11919 records). [2025-09-23T18:42:29.967001] [INFO ] [MAIN ] ETB: Full history saved. [2025-09-23T18:42:29.967077] [INFO ] [MAIN ] Update Progress: 774/2372 symbols completed. ETB took 19.3s. Estimated remaining: 3h 31m 31s. Rate: 7.6 symbols/min [2025-09-23T18:42:30.135875] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:42:30.152782] [DEBUG] [LOCAL ] ETJ: Loaded 16753 existing records from primary storage. [2025-09-23T18:42:30.152906] [INFO ] [MAIN ] ETJ: Loaded 16753 existing records. [2025-09-23T18:42:30.416575] [WARN ] [MAIN ] ETJ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:42:30.416977] [INFO ] [MAIN ] ETJ: Wiping existing primary data before full refresh. [2025-09-23T18:42:30.417078] [INFO ] [LOCAL ] ETJ: Starting deletion of primary data. [2025-09-23T18:42:30.417794] [DEBUG] [LOCAL ] ETJ: Deleted primary data file. [2025-09-23T18:42:30.417906] [INFO ] [MAIN ] ETJ: Starting full primary refresh. [2025-09-23T18:42:30.753840] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-08 (3.35 seconds). [2025-09-23T18:42:30.802402] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-09. [2025-09-23T18:42:30.883090] [INFO ] [REMOTE ] ETJ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:42:30.911636] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-23T18:42:31.217796] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-23T18:42:31.402205] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-06. [2025-09-23T18:42:32.202242] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2024-12. [2025-09-23T18:42:32.570734] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-23T18:42:32.832558] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-23T18:42:32.842288] [INFO ] [REMOTE ] ET: Full fetch complete (77565 records). [2025-09-23T18:42:32.842477] [DEBUG] [VALIDATOR ] ET: Validating primary data. [2025-09-23T18:42:32.843685] [FATAL] [VALIDATOR ] ET: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:42:32.843802] [FATAL] [MAIN ] ET: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:42:32.843864] [WARN ] [MAIN ] ET: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:42:32.843921] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-09-23T18:42:32.843984] [DEBUG] [LOCAL ] ET: No primary data file found to delete. [2025-09-23T18:42:32.844021] [INFO ] [LOCAL ] ET: Starting deletion of derivative data. [2025-09-23T18:42:32.844506] [DEBUG] [LOCAL ] ET: Deleted derivative data file. [2025-09-23T18:42:32.844615] [INFO ] [MAIN ] Update Progress: 775/2372 symbols completed. ET took 40.0s. Estimated remaining: 3h 31m 12s. Rate: 7.6 symbols/min [2025-09-23T18:42:33.007494] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-01. [2025-09-23T18:42:33.037748] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:42:33.054813] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-23T18:42:33.123769] [DEBUG] [LOCAL ] ETN: Loaded 52837 existing records from primary storage. [2025-09-23T18:42:33.123957] [INFO ] [MAIN ] ETN: Loaded 52837 existing records. [2025-09-23T18:42:33.315979] [WARN ] [MAIN ] ETN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:42:33.316249] [INFO ] [MAIN ] ETN: Wiping existing primary data before full refresh. [2025-09-23T18:42:33.316297] [INFO ] [LOCAL ] ETN: Starting deletion of primary data. [2025-09-23T18:42:33.318387] [DEBUG] [LOCAL ] ETN: Deleted primary data file. [2025-09-23T18:42:33.318449] [INFO ] [MAIN ] ETN: Starting full primary refresh. [2025-09-23T18:42:33.671104] [INFO ] [REMOTE ] ETN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:42:33.802194] [INFO ] [REMOTE ] ETN: Fetching primary data for 2024-12. [2025-09-23T18:42:33.927241] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-23T18:42:34.602228] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-01. [2025-09-23T18:42:35.242813] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-23T18:42:35.402169] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-02. [2025-09-23T18:42:35.869447] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-23T18:42:36.031615] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-23T18:42:36.202211] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-03. [2025-09-23T18:42:37.002203] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-01. [2025-09-23T18:42:37.295454] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-23T18:42:37.802242] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-02. [2025-09-23T18:42:38.602170] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-07. [2025-09-23T18:42:38.840687] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-23T18:42:39.087478] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-23T18:42:39.402231] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-03. [2025-09-23T18:42:39.507113] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-23T18:42:40.062026] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-23T18:42:40.202174] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-08. [2025-09-23T18:42:41.002198] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-02. [2025-09-23T18:42:41.428254] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-23T18:42:41.802201] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-04. [2025-09-23T18:42:42.607987] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-09. [2025-09-23T18:42:42.614401] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-23T18:42:42.942818] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-23T18:42:43.402201] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-05. [2025-09-23T18:42:44.202196] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-04. [2025-09-23T18:42:44.431932] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-23T18:42:44.436826] [INFO ] [REMOTE ] ETD: Full fetch complete (37978 records). [2025-09-23T18:42:44.436938] [DEBUG] [VALIDATOR ] ETD: Validating primary data. [2025-09-23T18:42:44.840234] [DEBUG] [VALIDATOR ] ETD: All expected trading days are present. [2025-09-23T18:42:44.840322] [DEBUG] [VALIDATOR ] ETD: Primary data validation passed. [2025-09-23T18:42:44.841152] [INFO ] [MAIN ] ETD: Fetched primary data is valid. [2025-09-23T18:42:44.841222] [DEBUG] [LOCAL ] ETD: Saving primary data. [2025-09-23T18:42:44.842236] [DEBUG] [LOCAL ] ETD: Trimmed 37978 records to 27418 (keeping 200 days of data) [2025-09-23T18:42:44.955450] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-23T18:42:45.005962] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-06. [2025-09-23T18:42:45.034828] [DEBUG] [LOCAL ] ETD: Primary data saved (27418 records). [2025-09-23T18:42:45.035368] [INFO ] [MAIN ] ETD: Full history saved. [2025-09-23T18:42:45.035490] [INFO ] [MAIN ] Update Progress: 776/2372 symbols completed. ETD took 33.1s. Estimated remaining: 3h 31m 13s. Rate: 7.6 symbols/min [2025-09-23T18:42:45.222991] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:42:45.223201] [DEBUG] [LOCAL ] ETO: No existing data file found in primary storage. [2025-09-23T18:42:45.223263] [WARN ] [MAIN ] ETO: No existing data found, performing full refresh instead. [2025-09-23T18:42:45.223414] [INFO ] [MAIN ] ETO: Wiping existing primary data before full refresh. [2025-09-23T18:42:45.223459] [INFO ] [LOCAL ] ETO: Starting deletion of primary data. [2025-09-23T18:42:45.223501] [DEBUG] [LOCAL ] ETO: No primary data file found to delete. [2025-09-23T18:42:45.223534] [INFO ] [MAIN ] ETO: Starting full primary refresh. [2025-09-23T18:42:45.595224] [INFO ] [REMOTE ] ETO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:42:45.608108] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-23T18:42:45.802177] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-03. [2025-09-23T18:42:46.035067] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-23T18:42:46.602184] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-05. [2025-09-23T18:42:47.324952] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-23T18:42:47.402161] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-06. [2025-09-23T18:42:47.457584] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-23T18:42:48.054478] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-23T18:42:48.202199] [INFO ] [REMOTE ] ETO: Fetching primary data for 2024-12. [2025-09-23T18:42:48.896240] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-23T18:42:49.002217] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-07. [2025-09-23T18:42:49.627713] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-23T18:42:49.802254] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-04. [2025-09-23T18:42:50.602208] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-01. [2025-09-23T18:42:51.009141] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-23T18:42:51.402224] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-02. [2025-09-23T18:42:51.853380] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-23T18:42:52.029021] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-23T18:42:52.202215] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-03. [2025-09-23T18:42:52.893791] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-23T18:42:53.002217] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-04. [2025-09-23T18:42:53.615071] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-23T18:42:53.802211] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-05. [2025-09-23T18:42:54.252581] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-23T18:42:54.602250] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-08. [2025-09-23T18:42:55.402241] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-06. [2025-09-23T18:42:55.523614] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-23T18:42:56.049932] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-23T18:42:56.202296] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-09. [2025-09-23T18:42:56.897723] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-23T18:42:56.900520] [INFO ] [REMOTE ] ETG: Full fetch complete (24984 records). [2025-09-23T18:42:56.900612] [DEBUG] [VALIDATOR ] ETG: Validating primary data. [2025-09-23T18:42:57.006522] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-07. [2025-09-23T18:42:57.280906] [DEBUG] [VALIDATOR ] ETG: All expected trading days are present. [2025-09-23T18:42:57.280986] [DEBUG] [VALIDATOR ] ETG: Primary data validation passed. [2025-09-23T18:42:57.281449] [INFO ] [MAIN ] ETG: Fetched primary data is valid. [2025-09-23T18:42:57.281489] [DEBUG] [LOCAL ] ETG: Saving primary data. [2025-09-23T18:42:57.282138] [DEBUG] [LOCAL ] ETG: Trimmed 24984 records to 16618 (keeping 200 days of data) [2025-09-23T18:42:57.382542] [DEBUG] [LOCAL ] ETG: Primary data saved (16618 records). [2025-09-23T18:42:57.382710] [INFO ] [MAIN ] ETG: Full history saved. [2025-09-23T18:42:57.382857] [INFO ] [MAIN ] Update Progress: 777/2372 symbols completed. ETG took 29.5s. Estimated remaining: 3h 31m 14s. Rate: 7.6 symbols/min [2025-09-23T18:42:57.561230] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-23T18:42:57.560898] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:42:57.563483] [DEBUG] [LOCAL ] ETR: No existing data file found in primary storage. [2025-09-23T18:42:57.563888] [WARN ] [MAIN ] ETR: No existing data found, performing full refresh instead. [2025-09-23T18:42:57.564037] [INFO ] [MAIN ] ETR: Wiping existing primary data before full refresh. [2025-09-23T18:42:57.564079] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-09-23T18:42:57.564121] [DEBUG] [LOCAL ] ETR: No primary data file found to delete. [2025-09-23T18:42:57.564152] [INFO ] [MAIN ] ETR: Starting full primary refresh. [2025-09-23T18:42:57.807326] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-07. [2025-09-23T18:42:57.922210] [INFO ] [REMOTE ] ETR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:42:58.602258] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-08. [2025-09-23T18:42:58.971741] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-23T18:42:59.126166] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-23T18:42:59.402316] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-09. [2025-09-23T18:42:59.954193] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-23T18:42:59.955702] [INFO ] [REMOTE ] ETO: Full fetch complete (9268 records). [2025-09-23T18:42:59.955776] [DEBUG] [VALIDATOR ] ETO: Validating primary data. [2025-09-23T18:43:00.207417] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-05. [2025-09-23T18:43:00.333766] [DEBUG] [VALIDATOR ] ETO: All expected trading days are present. [2025-09-23T18:43:00.333843] [DEBUG] [VALIDATOR ] ETO: Primary data validation passed. [2025-09-23T18:43:00.334076] [INFO ] [MAIN ] ETO: Fetched primary data is valid. [2025-09-23T18:43:00.334113] [DEBUG] [LOCAL ] ETO: Saving primary data. [2025-09-23T18:43:00.334527] [DEBUG] [LOCAL ] ETO: Trimmed 9268 records to 6492 (keeping 200 days of data) [2025-09-23T18:43:00.374030] [DEBUG] [LOCAL ] ETO: Primary data saved (6492 records). [2025-09-23T18:43:00.374145] [INFO ] [MAIN ] ETO: Full history saved. [2025-09-23T18:43:00.374217] [INFO ] [MAIN ] Update Progress: 778/2372 symbols completed. ETO took 15.3s. Estimated remaining: 3h 30m 56s. Rate: 7.6 symbols/min [2025-09-23T18:43:00.542760] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:43:00.565149] [DEBUG] [LOCAL ] ETV: Loaded 21450 existing records from primary storage. [2025-09-23T18:43:00.565284] [INFO ] [MAIN ] ETV: Loaded 21450 existing records. [2025-09-23T18:43:00.740432] [WARN ] [MAIN ] ETV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:43:00.740743] [INFO ] [MAIN ] ETV: Wiping existing primary data before full refresh. [2025-09-23T18:43:00.740798] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-09-23T18:43:00.741912] [DEBUG] [LOCAL ] ETV: Deleted primary data file. [2025-09-23T18:43:00.741975] [INFO ] [MAIN ] ETV: Starting full primary refresh. [2025-09-23T18:43:01.011943] [INFO ] [REMOTE ] ETR: Fetching primary data for 2024-12. [2025-09-23T18:43:01.093308] [INFO ] [REMOTE ] ETV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:43:01.802199] [INFO ] [REMOTE ] ETV: Fetching primary data for 2024-12. [2025-09-23T18:43:02.318416] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-23T18:43:02.602224] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-06. [2025-09-23T18:43:02.757492] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-23T18:43:03.022019] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-23T18:43:03.402259] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-01. [2025-09-23T18:43:04.202210] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-01. [2025-09-23T18:43:04.436084] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-23T18:43:04.462543] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-23T18:43:05.002199] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-08. [2025-09-23T18:43:05.581980] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-23T18:43:05.780952] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-23T18:43:05.802144] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-02. [2025-09-23T18:43:06.602233] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-07. [2025-09-23T18:43:07.402169] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-02. [2025-09-23T18:43:07.629596] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-23T18:43:08.090924] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-23T18:43:08.202234] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-03. [2025-09-23T18:43:08.415858] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-23T18:43:09.002194] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-09. [2025-09-23T18:43:09.055547] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-23T18:43:09.802174] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-08. [2025-09-23T18:43:10.033876] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-23T18:43:10.037115] [INFO ] [REMOTE ] ETJ: Full fetch complete (24918 records). [2025-09-23T18:43:10.037192] [DEBUG] [VALIDATOR ] ETJ: Validating primary data. [2025-09-23T18:43:10.397444] [DEBUG] [VALIDATOR ] ETJ: All expected trading days are present. [2025-09-23T18:43:10.397552] [DEBUG] [VALIDATOR ] ETJ: Primary data validation passed. [2025-09-23T18:43:10.398100] [INFO ] [MAIN ] ETJ: Fetched primary data is valid. [2025-09-23T18:43:10.398164] [DEBUG] [LOCAL ] ETJ: Saving primary data. [2025-09-23T18:43:10.399151] [DEBUG] [LOCAL ] ETJ: Trimmed 24918 records to 16617 (keeping 200 days of data) [2025-09-23T18:43:10.496560] [DEBUG] [LOCAL ] ETJ: Primary data saved (16617 records). [2025-09-23T18:43:10.496731] [INFO ] [MAIN ] ETJ: Full history saved. [2025-09-23T18:43:10.496843] [INFO ] [MAIN ] Update Progress: 779/2372 symbols completed. ETJ took 40.5s. Estimated remaining: 3h 30m 53s. Rate: 7.6 symbols/min [2025-09-23T18:43:10.607315] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-03. [2025-09-23T18:43:10.665836] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:43:10.689827] [DEBUG] [LOCAL ] ETW: Loaded 25180 existing records from primary storage. [2025-09-23T18:43:10.689970] [INFO ] [MAIN ] ETW: Loaded 25180 existing records. [2025-09-23T18:43:10.866331] [WARN ] [MAIN ] ETW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:43:10.866594] [INFO ] [MAIN ] ETW: Wiping existing primary data before full refresh. [2025-09-23T18:43:10.866664] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-09-23T18:43:10.867406] [DEBUG] [LOCAL ] ETW: Deleted primary data file. [2025-09-23T18:43:10.867509] [INFO ] [MAIN ] ETW: Starting full primary refresh. [2025-09-23T18:43:11.224552] [INFO ] [REMOTE ] ETW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:43:11.402202] [INFO ] [REMOTE ] ETW: Fetching primary data for 2024-12. [2025-09-23T18:43:12.021068] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-23T18:43:12.211278] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-09. [2025-09-23T18:43:12.217557] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-23T18:43:12.301420] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-23T18:43:13.002220] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-04. [2025-09-23T18:43:13.802233] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-01. [2025-09-23T18:43:13.895467] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-23T18:43:14.521118] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-09-23T18:43:14.535795] [INFO ] [REMOTE ] ETN: Full fetch complete (76580 records). [2025-09-23T18:43:14.536008] [DEBUG] [VALIDATOR ] ETN: Validating primary data. [2025-09-23T18:43:14.606585] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-05. [2025-09-23T18:43:14.741668] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-23T18:43:14.978620] [DEBUG] [VALIDATOR ] ETN: All expected trading days are present. [2025-09-23T18:43:14.978786] [DEBUG] [VALIDATOR ] ETN: Primary data validation passed. [2025-09-23T18:43:14.979747] [INFO ] [MAIN ] ETN: Fetched primary data is valid. [2025-09-23T18:43:14.979814] [DEBUG] [LOCAL ] ETN: Saving primary data. [2025-09-23T18:43:14.981331] [DEBUG] [LOCAL ] ETN: Trimmed 76580 records to 52836 (keeping 200 days of data) [2025-09-23T18:43:15.315832] [DEBUG] [LOCAL ] ETN: Primary data saved (52836 records). [2025-09-23T18:43:15.315984] [INFO ] [MAIN ] ETN: Full history saved. [2025-09-23T18:43:15.316072] [INFO ] [MAIN ] Update Progress: 780/2372 symbols completed. ETN took 42.5s. Estimated remaining: 3h 30m 38s. Rate: 7.6 symbols/min [2025-09-23T18:43:15.405855] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-02. [2025-09-23T18:43:15.487898] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:43:15.495209] [DEBUG] [LOCAL ] ETX: Loaded 4913 existing records from primary storage. [2025-09-23T18:43:15.495313] [INFO ] [MAIN ] ETX: Loaded 4913 existing records. [2025-09-23T18:43:15.698939] [WARN ] [MAIN ] ETX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:43:15.699696] [INFO ] [MAIN ] ETX: Wiping existing primary data before full refresh. [2025-09-23T18:43:15.699848] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-09-23T18:43:15.700265] [DEBUG] [LOCAL ] ETX: Deleted primary data file. [2025-09-23T18:43:15.700346] [INFO ] [MAIN ] ETX: Starting full primary refresh. [2025-09-23T18:43:15.897943] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-23T18:43:16.092576] [INFO ] [REMOTE ] ETX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:43:16.169306] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-23T18:43:16.202185] [INFO ] [REMOTE ] ETX: Fetching primary data for 2024-12. [2025-09-23T18:43:16.929345] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-23T18:43:17.002249] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-03. [2025-09-23T18:43:17.733814] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-23T18:43:17.802209] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-06. [2025-09-23T18:43:18.486920] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-23T18:43:18.602213] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-07. [2025-09-23T18:43:19.356843] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-23T18:43:19.402187] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-08. [2025-09-23T18:43:20.202195] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-04. [2025-09-23T18:43:20.680549] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-23T18:43:21.002233] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-04. [2025-09-23T18:43:21.202590] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-23T18:43:21.802212] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-01. [2025-09-23T18:43:22.304176] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-23T18:43:22.536202] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-23T18:43:22.602241] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-02. [2025-09-23T18:43:23.047173] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-23T18:43:23.402202] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-05. [2025-09-23T18:43:24.202207] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-09. [2025-09-23T18:43:24.581256] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-23T18:43:25.002202] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-03. [2025-09-23T18:43:25.069933] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-23T18:43:25.073893] [INFO ] [REMOTE ] ETV: Full fetch complete (31749 records). [2025-09-23T18:43:25.074014] [DEBUG] [VALIDATOR ] ETV: Validating primary data. [2025-09-23T18:43:25.459768] [DEBUG] [VALIDATOR ] ETV: All expected trading days are present. [2025-09-23T18:43:25.459854] [DEBUG] [VALIDATOR ] ETV: Primary data validation passed. [2025-09-23T18:43:25.460442] [INFO ] [MAIN ] ETV: Fetched primary data is valid. [2025-09-23T18:43:25.460506] [DEBUG] [LOCAL ] ETV: Saving primary data. [2025-09-23T18:43:25.462675] [DEBUG] [LOCAL ] ETV: Trimmed 31749 records to 21362 (keeping 200 days of data) [2025-09-23T18:43:25.558199] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-23T18:43:25.608110] [DEBUG] [LOCAL ] ETV: Primary data saved (21362 records). [2025-09-23T18:43:25.608253] [INFO ] [MAIN ] ETV: Full history saved. [2025-09-23T18:43:25.608350] [INFO ] [MAIN ] Update Progress: 781/2372 symbols completed. ETV took 25.2s. Estimated remaining: 3h 30m 35s. Rate: 7.6 symbols/min [2025-09-23T18:43:25.783848] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:43:25.802248] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-04. [2025-09-23T18:43:25.814257] [DEBUG] [LOCAL ] ETY: Loaded 22861 existing records from primary storage. [2025-09-23T18:43:25.814386] [INFO ] [MAIN ] ETY: Loaded 22861 existing records. [2025-09-23T18:43:25.995753] [WARN ] [MAIN ] ETY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:43:25.996026] [INFO ] [MAIN ] ETY: Wiping existing primary data before full refresh. [2025-09-23T18:43:25.996090] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-09-23T18:43:25.996753] [DEBUG] [LOCAL ] ETY: Deleted primary data file. [2025-09-23T18:43:25.996844] [INFO ] [MAIN ] ETY: Starting full primary refresh. [2025-09-23T18:43:26.281456] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-23T18:43:26.384307] [INFO ] [REMOTE ] ETY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:43:26.602206] [INFO ] [REMOTE ] ETY: Fetching primary data for 2024-12. [2025-09-23T18:43:27.402195] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-05. [2025-09-23T18:43:27.452674] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-23T18:43:27.872494] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-23T18:43:28.202195] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-05. [2025-09-23T18:43:29.002241] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-06. [2025-09-23T18:43:29.468593] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-23T18:43:29.720424] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-23T18:43:29.802260] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-01. [2025-09-23T18:43:30.584713] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-23T18:43:30.602248] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-06. [2025-09-23T18:43:31.402218] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-02. [2025-09-23T18:43:32.202411] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-07. [2025-09-23T18:43:32.712915] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-23T18:43:32.846043] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-23T18:43:33.002163] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-08. [2025-09-23T18:43:33.083618] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-09-23T18:43:33.474709] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-23T18:43:33.802204] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-09. [2025-09-23T18:43:34.602163] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-07. [2025-09-23T18:43:34.652708] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-23T18:43:34.654814] [INFO ] [REMOTE ] ETX: Full fetch complete (7032 records). [2025-09-23T18:43:34.654932] [DEBUG] [VALIDATOR ] ETX: Validating primary data. [2025-09-23T18:43:35.032388] [DEBUG] [VALIDATOR ] ETX: All expected trading days are present. [2025-09-23T18:43:35.032482] [DEBUG] [VALIDATOR ] ETX: Primary data validation passed. [2025-09-23T18:43:35.032736] [INFO ] [MAIN ] ETX: Fetched primary data is valid. [2025-09-23T18:43:35.032867] [DEBUG] [LOCAL ] ETX: Saving primary data. [2025-09-23T18:43:35.033323] [DEBUG] [LOCAL ] ETX: Trimmed 7032 records to 4964 (keeping 200 days of data) [2025-09-23T18:43:35.068209] [DEBUG] [LOCAL ] ETX: Primary data saved (4964 records). [2025-09-23T18:43:35.068338] [INFO ] [MAIN ] ETX: Full history saved. [2025-09-23T18:43:35.068472] [INFO ] [MAIN ] Update Progress: 782/2372 symbols completed. ETX took 19.8s. Estimated remaining: 3h 30m 30s. Rate: 7.6 symbols/min [2025-09-23T18:43:35.243559] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:43:35.269790] [DEBUG] [LOCAL ] EVC: Loaded 19774 existing records from primary storage. [2025-09-23T18:43:35.269915] [INFO ] [MAIN ] EVC: Loaded 19774 existing records. [2025-09-23T18:43:35.415859] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-03. [2025-09-23T18:43:35.463063] [WARN ] [MAIN ] EVC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:43:35.463386] [INFO ] [MAIN ] EVC: Wiping existing primary data before full refresh. [2025-09-23T18:43:35.463453] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-09-23T18:43:35.464091] [DEBUG] [LOCAL ] EVC: Deleted primary data file. [2025-09-23T18:43:35.464177] [INFO ] [MAIN ] EVC: Starting full primary refresh. [2025-09-23T18:43:35.831275] [INFO ] [REMOTE ] EVC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:43:35.918784] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-23T18:43:36.202181] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-08. [2025-09-23T18:43:36.244109] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-23T18:43:37.002195] [INFO ] [REMOTE ] EVC: Fetching primary data for 2024-12. [2025-09-23T18:43:37.153338] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-23T18:43:37.802196] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-09. [2025-09-23T18:43:38.602174] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-06. [2025-09-23T18:43:38.691584] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-23T18:43:38.906567] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-23T18:43:38.911082] [INFO ] [REMOTE ] ETW: Full fetch complete (36288 records). [2025-09-23T18:43:38.911252] [DEBUG] [VALIDATOR ] ETW: Validating primary data. [2025-09-23T18:43:39.308637] [DEBUG] [VALIDATOR ] ETW: All expected trading days are present. [2025-09-23T18:43:39.308746] [DEBUG] [VALIDATOR ] ETW: Primary data validation passed. [2025-09-23T18:43:39.309284] [INFO ] [MAIN ] ETW: Fetched primary data is valid. [2025-09-23T18:43:39.309323] [DEBUG] [LOCAL ] ETW: Saving primary data. [2025-09-23T18:43:39.310186] [DEBUG] [LOCAL ] ETW: Trimmed 36288 records to 25080 (keeping 200 days of data) [2025-09-23T18:43:39.407568] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-04. [2025-09-23T18:43:39.476981] [DEBUG] [LOCAL ] ETW: Primary data saved (25080 records). [2025-09-23T18:43:39.477229] [INFO ] [MAIN ] ETW: Full history saved. [2025-09-23T18:43:39.477424] [INFO ] [MAIN ] Update Progress: 783/2372 symbols completed. ETW took 29.0s. Estimated remaining: 3h 30m 15s. Rate: 7.6 symbols/min [2025-09-23T18:43:39.650804] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:43:39.689078] [DEBUG] [LOCAL ] EVEX: Loaded 29592 existing records from primary storage. [2025-09-23T18:43:39.689287] [INFO ] [MAIN ] EVEX: Loaded 29592 existing records. [2025-09-23T18:43:39.869175] [WARN ] [MAIN ] EVEX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:43:39.869755] [INFO ] [MAIN ] EVEX: Wiping existing primary data before full refresh. [2025-09-23T18:43:39.869829] [INFO ] [LOCAL ] EVEX: Starting deletion of primary data. [2025-09-23T18:43:39.870487] [DEBUG] [LOCAL ] EVEX: Deleted primary data file. [2025-09-23T18:43:39.870548] [INFO ] [MAIN ] EVEX: Starting full primary refresh. [2025-09-23T18:43:40.225405] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-01. [2025-09-23T18:43:40.265832] [INFO ] [REMOTE ] EVEX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:43:40.303326] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-23T18:43:40.421231] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-23T18:43:41.002197] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2024-12. [2025-09-23T18:43:41.455622] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-23T18:43:41.802210] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-02. [2025-09-23T18:43:42.590451] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-23T18:43:42.602164] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-05. [2025-09-23T18:43:42.769230] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-23T18:43:43.333393] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-23T18:43:43.402182] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-06. [2025-09-23T18:43:44.202209] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-03. [2025-09-23T18:43:44.441467] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-23T18:43:45.002269] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-07. [2025-09-23T18:43:45.074526] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-23T18:43:45.802200] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-07. [2025-09-23T18:43:46.588741] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-23T18:43:46.602175] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-01. [2025-09-23T18:43:46.972219] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-23T18:43:47.412724] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-08. [2025-09-23T18:43:47.415432] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-23T18:43:48.202218] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-04. [2025-09-23T18:43:48.453776] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-23T18:43:49.002272] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-09. [2025-09-23T18:43:49.054745] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-23T18:43:49.780333] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-23T18:43:49.784271] [INFO ] [REMOTE ] ETY: Full fetch complete (34152 records). [2025-09-23T18:43:49.784362] [DEBUG] [VALIDATOR ] ETY: Validating primary data. [2025-09-23T18:43:49.807376] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-08. [2025-09-23T18:43:50.162145] [DEBUG] [VALIDATOR ] ETY: All expected trading days are present. [2025-09-23T18:43:50.162232] [DEBUG] [VALIDATOR ] ETY: Primary data validation passed. [2025-09-23T18:43:50.162852] [INFO ] [MAIN ] ETY: Fetched primary data is valid. [2025-09-23T18:43:50.162915] [DEBUG] [LOCAL ] ETY: Saving primary data. [2025-09-23T18:43:50.163850] [DEBUG] [LOCAL ] ETY: Trimmed 34152 records to 22694 (keeping 200 days of data) [2025-09-23T18:43:50.327335] [DEBUG] [LOCAL ] ETY: Primary data saved (22694 records). [2025-09-23T18:43:50.327590] [INFO ] [MAIN ] ETY: Full history saved. [2025-09-23T18:43:50.327716] [INFO ] [MAIN ] Update Progress: 784/2372 symbols completed. ETY took 24.7s. Estimated remaining: 3h 30m 13s. Rate: 7.6 symbols/min [2025-09-23T18:43:50.517604] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:43:50.531974] [DEBUG] [LOCAL ] EVF: Loaded 9041 existing records from primary storage. [2025-09-23T18:43:50.532109] [INFO ] [MAIN ] EVF: Loaded 9041 existing records. [2025-09-23T18:43:50.611273] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-02. [2025-09-23T18:43:50.724350] [WARN ] [MAIN ] EVF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:43:50.724779] [INFO ] [MAIN ] EVF: Wiping existing primary data before full refresh. [2025-09-23T18:43:50.724840] [INFO ] [LOCAL ] EVF: Starting deletion of primary data. [2025-09-23T18:43:50.725391] [DEBUG] [LOCAL ] EVF: Deleted primary data file. [2025-09-23T18:43:50.725453] [INFO ] [MAIN ] EVF: Starting full primary refresh. [2025-09-23T18:43:51.178378] [INFO ] [REMOTE ] EVF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:43:51.399987] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-23T18:43:51.404913] [INFO ] [REMOTE ] EVF: Fetching primary data for 2024-12. [2025-09-23T18:43:51.583031] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-23T18:43:51.947804] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-23T18:43:52.202203] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-01. [2025-09-23T18:43:52.911961] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-23T18:43:53.002166] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-05. [2025-09-23T18:43:53.653500] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-23T18:43:53.802257] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-02. [2025-09-23T18:43:54.246988] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-23T18:43:54.602229] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-03. [2025-09-23T18:43:55.402253] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-09. [2025-09-23T18:43:55.740235] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-23T18:43:56.202227] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-06. [2025-09-23T18:43:56.820940] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-23T18:43:56.831719] [INFO ] [REMOTE ] ETR: Full fetch complete (76974 records). [2025-09-23T18:43:56.831880] [DEBUG] [VALIDATOR ] ETR: Validating primary data. [2025-09-23T18:43:57.017166] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-04. [2025-09-23T18:43:57.280518] [DEBUG] [VALIDATOR ] ETR: All expected trading days are present. [2025-09-23T18:43:57.280785] [DEBUG] [VALIDATOR ] ETR: Primary data validation passed. [2025-09-23T18:43:57.282386] [INFO ] [MAIN ] ETR: Fetched primary data is valid. [2025-09-23T18:43:57.282948] [DEBUG] [LOCAL ] ETR: Saving primary data. [2025-09-23T18:43:57.283639] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-23T18:43:57.290859] [DEBUG] [LOCAL ] ETR: Trimmed 76974 records to 53225 (keeping 200 days of data) [2025-09-23T18:43:57.642830] [DEBUG] [LOCAL ] ETR: Primary data saved (53225 records). [2025-09-23T18:43:57.643130] [INFO ] [MAIN ] ETR: Full history saved. [2025-09-23T18:43:57.643214] [INFO ] [MAIN ] Update Progress: 785/2372 symbols completed. ETR took 1m 0s. Estimated remaining: 3h 30m 4s. Rate: 7.6 symbols/min [2025-09-23T18:43:57.812906] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-07. [2025-09-23T18:43:57.815631] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:43:57.832106] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-23T18:43:57.842896] [DEBUG] [LOCAL ] EVG: Loaded 5780 existing records from primary storage. [2025-09-23T18:43:57.843380] [INFO ] [MAIN ] EVG: Loaded 5780 existing records. [2025-09-23T18:43:58.021053] [WARN ] [MAIN ] EVG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:43:58.021355] [INFO ] [MAIN ] EVG: Wiping existing primary data before full refresh. [2025-09-23T18:43:58.021404] [INFO ] [LOCAL ] EVG: Starting deletion of primary data. [2025-09-23T18:43:58.022170] [DEBUG] [LOCAL ] EVG: Deleted primary data file. [2025-09-23T18:43:58.022231] [INFO ] [MAIN ] EVG: Starting full primary refresh. [2025-09-23T18:43:58.393864] [INFO ] [REMOTE ] EVG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:43:58.602248] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-05. [2025-09-23T18:43:58.672881] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-23T18:43:59.402200] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-08. [2025-09-23T18:44:00.098043] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-23T18:44:00.202194] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-06. [2025-09-23T18:44:01.002271] [INFO ] [REMOTE ] EVG: Fetching primary data for 2024-12. [2025-09-23T18:44:01.802255] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-03. [2025-09-23T18:44:02.203116] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-08 (2.80 seconds). [2025-09-23T18:44:02.400531] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-23T18:44:02.462424] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-23T18:44:02.602168] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-04. [2025-09-23T18:44:02.625871] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-23T18:44:03.402196] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-07. [2025-09-23T18:44:03.774089] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-23T18:44:04.202196] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-09. [2025-09-23T18:44:04.482692] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-23T18:44:04.989061] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-23T18:44:04.992268] [INFO ] [REMOTE ] EVC: Full fetch complete (31094 records). [2025-09-23T18:44:04.992348] [DEBUG] [VALIDATOR ] EVC: Validating primary data. [2025-09-23T18:44:05.007276] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-05. [2025-09-23T18:44:05.383935] [DEBUG] [VALIDATOR ] EVC: All expected trading days are present. [2025-09-23T18:44:05.384037] [DEBUG] [VALIDATOR ] EVC: Primary data validation passed. [2025-09-23T18:44:05.384598] [INFO ] [MAIN ] EVC: Fetched primary data is valid. [2025-09-23T18:44:05.384639] [DEBUG] [LOCAL ] EVC: Saving primary data. [2025-09-23T18:44:05.386483] [DEBUG] [LOCAL ] EVC: Trimmed 31094 records to 19546 (keeping 200 days of data) [2025-09-23T18:44:05.514512] [DEBUG] [LOCAL ] EVC: Primary data saved (19546 records). [2025-09-23T18:44:05.514638] [INFO ] [MAIN ] EVC: Full history saved. [2025-09-23T18:44:05.514761] [INFO ] [MAIN ] Update Progress: 786/2372 symbols completed. EVC took 30.4s. Estimated remaining: 3h 29m 56s. Rate: 7.6 symbols/min [2025-09-23T18:44:05.693640] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:44:05.729577] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-23T18:44:05.749841] [DEBUG] [LOCAL ] EVH: Loaded 49345 existing records from primary storage. [2025-09-23T18:44:05.750001] [INFO ] [MAIN ] EVH: Loaded 49345 existing records. [2025-09-23T18:44:05.811982] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-06. [2025-09-23T18:44:05.933962] [WARN ] [MAIN ] EVH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:44:05.934189] [INFO ] [MAIN ] EVH: Wiping existing primary data before full refresh. [2025-09-23T18:44:05.934238] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-09-23T18:44:05.935437] [DEBUG] [LOCAL ] EVH: Deleted primary data file. [2025-09-23T18:44:05.935499] [INFO ] [MAIN ] EVH: Starting full primary refresh. [2025-09-23T18:44:06.291532] [INFO ] [REMOTE ] EVH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:44:06.602257] [INFO ] [REMOTE ] EVH: Fetching primary data for 2024-12. [2025-09-23T18:44:06.693866] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-23T18:44:07.402202] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-07. [2025-09-23T18:44:07.964477] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-23T18:44:08.202215] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-01. [2025-09-23T18:44:08.223849] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-23T18:44:09.002213] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-08. [2025-09-23T18:44:09.621005] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-23T18:44:09.802227] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-02. [2025-09-23T18:44:10.329998] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-23T18:44:10.602254] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-01. [2025-09-23T18:44:10.966383] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-23T18:44:11.213813] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-23T18:44:11.402204] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-09. [2025-09-23T18:44:12.202194] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-03. [2025-09-23T18:44:13.002214] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-08. [2025-09-23T18:44:13.077412] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-23T18:44:13.085875] [INFO ] [REMOTE ] EVEX: Full fetch complete (41541 records). [2025-09-23T18:44:13.086031] [DEBUG] [VALIDATOR ] EVEX: Validating primary data. [2025-09-23T18:44:13.478608] [DEBUG] [VALIDATOR ] EVEX: All expected trading days are present. [2025-09-23T18:44:13.478803] [DEBUG] [VALIDATOR ] EVEX: Primary data validation passed. [2025-09-23T18:44:13.479449] [INFO ] [MAIN ] EVEX: Fetched primary data is valid. [2025-09-23T18:44:13.479574] [DEBUG] [LOCAL ] EVEX: Saving primary data. [2025-09-23T18:44:13.480831] [DEBUG] [LOCAL ] EVEX: Trimmed 41541 records to 29806 (keeping 200 days of data) [2025-09-23T18:44:13.625069] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-23T18:44:13.695754] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-23T18:44:13.702235] [DEBUG] [LOCAL ] EVEX: Primary data saved (29806 records). [2025-09-23T18:44:13.702331] [INFO ] [MAIN ] EVEX: Full history saved. [2025-09-23T18:44:13.702418] [INFO ] [MAIN ] Update Progress: 787/2372 symbols completed. EVEX took 34.2s. Estimated remaining: 3h 29m 48s. Rate: 7.6 symbols/min [2025-09-23T18:44:13.804728] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-04. [2025-09-23T18:44:13.895957] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:44:13.908735] [DEBUG] [LOCAL ] EVN: Loaded 10956 existing records from primary storage. [2025-09-23T18:44:13.908878] [INFO ] [MAIN ] EVN: Loaded 10956 existing records. [2025-09-23T18:44:14.103685] [WARN ] [MAIN ] EVN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:44:14.103963] [INFO ] [MAIN ] EVN: Wiping existing primary data before full refresh. [2025-09-23T18:44:14.104049] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-09-23T18:44:14.104585] [DEBUG] [LOCAL ] EVN: Deleted primary data file. [2025-09-23T18:44:14.104674] [INFO ] [MAIN ] EVN: Starting full primary refresh. [2025-09-23T18:44:14.465312] [INFO ] [REMOTE ] EVN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:44:14.602195] [INFO ] [REMOTE ] EVN: Fetching primary data for 2024-12. [2025-09-23T18:44:15.402195] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-09. [2025-09-23T18:44:15.900854] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-23T18:44:16.127310] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-09-23T18:44:16.163337] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-23T18:44:16.166506] [INFO ] [REMOTE ] EVF: Full fetch complete (11805 records). [2025-09-23T18:44:16.166598] [DEBUG] [VALIDATOR ] EVF: Validating primary data. [2025-09-23T18:44:16.207283] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-02. [2025-09-23T18:44:16.567903] [DEBUG] [VALIDATOR ] EVF: All expected trading days are present. [2025-09-23T18:44:16.567995] [DEBUG] [VALIDATOR ] EVF: Primary data validation passed. [2025-09-23T18:44:16.568315] [INFO ] [MAIN ] EVF: Fetched primary data is valid. [2025-09-23T18:44:16.568357] [DEBUG] [LOCAL ] EVF: Saving primary data. [2025-09-23T18:44:16.568995] [DEBUG] [LOCAL ] EVF: Trimmed 11805 records to 9163 (keeping 200 days of data) [2025-09-23T18:44:16.622281] [DEBUG] [LOCAL ] EVF: Primary data saved (9163 records). [2025-09-23T18:44:16.622409] [INFO ] [MAIN ] EVF: Full history saved. [2025-09-23T18:44:16.622491] [INFO ] [MAIN ] Update Progress: 788/2372 symbols completed. EVF took 26.3s. Estimated remaining: 3h 29m 30s. Rate: 7.6 symbols/min [2025-09-23T18:44:16.801765] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:44:16.845927] [DEBUG] [LOCAL ] EVR: Loaded 35778 existing records from primary storage. [2025-09-23T18:44:16.846069] [INFO ] [MAIN ] EVR: Loaded 35778 existing records. [2025-09-23T18:44:17.006183] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-01. [2025-09-23T18:44:17.035522] [WARN ] [MAIN ] EVR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:44:17.036266] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-23T18:44:17.037300] [INFO ] [MAIN ] EVR: Wiping existing primary data before full refresh. [2025-09-23T18:44:17.039085] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-09-23T18:44:17.040216] [DEBUG] [LOCAL ] EVR: Deleted primary data file. [2025-09-23T18:44:17.040282] [INFO ] [MAIN ] EVR: Starting full primary refresh. [2025-09-23T18:44:17.415503] [INFO ] [REMOTE ] EVR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:44:17.802241] [INFO ] [REMOTE ] EVR: Fetching primary data for 2024-12. [2025-09-23T18:44:17.932167] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-23T18:44:18.602251] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-05. [2025-09-23T18:44:19.208927] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-23T18:44:19.402214] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-01. [2025-09-23T18:44:20.202164] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-02. [2025-09-23T18:44:20.590403] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-23T18:44:20.708260] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-23T18:44:20.736546] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-23T18:44:21.002221] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-03. [2025-09-23T18:44:21.381956] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-23T18:44:21.802229] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-06. [2025-09-23T18:44:22.602196] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-04. [2025-09-23T18:44:22.942217] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-23T18:44:23.021171] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-23T18:44:23.402217] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-07. [2025-09-23T18:44:24.202198] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-02. [2025-09-23T18:44:24.725312] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-23T18:44:25.002249] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-03. [2025-09-23T18:44:25.644867] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-23T18:44:25.693227] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-23T18:44:25.802188] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-04. [2025-09-23T18:44:26.602148] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-03. [2025-09-23T18:44:26.678847] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-23T18:44:27.402196] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-08. [2025-09-23T18:44:27.866617] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-23T18:44:28.202179] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-04. [2025-09-23T18:44:28.678699] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-23T18:44:29.002276] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-05. [2025-09-23T18:44:29.457737] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-23T18:44:29.621456] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-23T18:44:29.802201] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-05. [2025-09-23T18:44:30.602194] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-06. [2025-09-23T18:44:30.612252] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-23T18:44:31.337238] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-23T18:44:31.402180] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-07. [2025-09-23T18:44:31.918856] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-23T18:44:32.202208] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-08. [2025-09-23T18:44:33.002233] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-09. [2025-09-23T18:44:33.097990] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-23T18:44:33.802208] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-06. [2025-09-23T18:44:34.233296] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-23T18:44:34.430277] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-23T18:44:34.438407] [INFO ] [REMOTE ] EVH: Full fetch complete (71747 records). [2025-09-23T18:44:34.438535] [DEBUG] [VALIDATOR ] EVH: Validating primary data. [2025-09-23T18:44:34.612744] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-07. [2025-09-23T18:44:34.846109] [DEBUG] [VALIDATOR ] EVH: All expected trading days are present. [2025-09-23T18:44:34.846226] [DEBUG] [VALIDATOR ] EVH: Primary data validation passed. [2025-09-23T18:44:34.847096] [INFO ] [MAIN ] EVH: Fetched primary data is valid. [2025-09-23T18:44:34.847161] [DEBUG] [LOCAL ] EVH: Saving primary data. [2025-09-23T18:44:34.848594] [DEBUG] [LOCAL ] EVH: Trimmed 71747 records to 49348 (keeping 200 days of data) [2025-09-23T18:44:35.075803] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-23T18:44:35.158114] [DEBUG] [LOCAL ] EVH: Primary data saved (49348 records). [2025-09-23T18:44:35.158269] [INFO ] [MAIN ] EVH: Full history saved. [2025-09-23T18:44:35.158358] [INFO ] [MAIN ] Update Progress: 789/2372 symbols completed. EVH took 29.6s. Estimated remaining: 3h 29m 44s. Rate: 7.5 symbols/min [2025-09-23T18:44:35.342263] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:44:35.359815] [DEBUG] [LOCAL ] EVT: Loaded 17313 existing records from primary storage. [2025-09-23T18:44:35.359952] [INFO ] [MAIN ] EVT: Loaded 17313 existing records. [2025-09-23T18:44:35.412182] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-05. [2025-09-23T18:44:35.539883] [WARN ] [MAIN ] EVT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:44:35.540120] [INFO ] [MAIN ] EVT: Wiping existing primary data before full refresh. [2025-09-23T18:44:35.540174] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-09-23T18:44:35.540883] [DEBUG] [LOCAL ] EVT: Deleted primary data file. [2025-09-23T18:44:35.540943] [INFO ] [MAIN ] EVT: Starting full primary refresh. [2025-09-23T18:44:35.917686] [INFO ] [REMOTE ] EVT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:44:36.202196] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-08. [2025-09-23T18:44:36.575781] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-23T18:44:36.969563] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-23T18:44:37.002187] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-09. [2025-09-23T18:44:37.523483] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-23T18:44:37.525100] [INFO ] [REMOTE ] EVG: Full fetch complete (8032 records). [2025-09-23T18:44:37.525176] [DEBUG] [VALIDATOR ] EVG: Validating primary data. [2025-09-23T18:44:37.807274] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-06. [2025-09-23T18:44:37.915726] [DEBUG] [VALIDATOR ] EVG: All expected trading days are present. [2025-09-23T18:44:37.915836] [DEBUG] [VALIDATOR ] EVG: Primary data validation passed. [2025-09-23T18:44:37.916121] [INFO ] [MAIN ] EVG: Fetched primary data is valid. [2025-09-23T18:44:37.916230] [DEBUG] [LOCAL ] EVG: Saving primary data. [2025-09-23T18:44:37.916746] [DEBUG] [LOCAL ] EVG: Trimmed 8032 records to 5777 (keeping 200 days of data) [2025-09-23T18:44:37.952705] [DEBUG] [LOCAL ] EVG: Primary data saved (5777 records). [2025-09-23T18:44:37.952836] [INFO ] [MAIN ] EVG: Full history saved. [2025-09-23T18:44:37.952923] [INFO ] [MAIN ] Update Progress: 790/2372 symbols completed. EVG took 40.3s. Estimated remaining: 3h 29m 25s. Rate: 7.6 symbols/min [2025-09-23T18:44:38.124596] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:44:38.124858] [DEBUG] [LOCAL ] EVTC: No existing data file found in primary storage. [2025-09-23T18:44:38.124915] [WARN ] [MAIN ] EVTC: No existing data found, performing full refresh instead. [2025-09-23T18:44:38.125108] [INFO ] [MAIN ] EVTC: Wiping existing primary data before full refresh. [2025-09-23T18:44:38.125161] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-09-23T18:44:38.125206] [DEBUG] [LOCAL ] EVTC: No primary data file found to delete. [2025-09-23T18:44:38.125240] [INFO ] [MAIN ] EVTC: Starting full primary refresh. [2025-09-23T18:44:38.484874] [INFO ] [REMOTE ] EVTC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:44:38.602197] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-09. [2025-09-23T18:44:39.170519] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-23T18:44:39.327151] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-23T18:44:39.329623] [INFO ] [REMOTE ] EVN: Full fetch complete (17461 records). [2025-09-23T18:44:39.329743] [DEBUG] [VALIDATOR ] EVN: Validating primary data. [2025-09-23T18:44:39.407338] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-07. [2025-09-23T18:44:39.703266] [DEBUG] [VALIDATOR ] EVN: All expected trading days are present. [2025-09-23T18:44:39.703346] [DEBUG] [VALIDATOR ] EVN: Primary data validation passed. [2025-09-23T18:44:39.703744] [INFO ] [MAIN ] EVN: Fetched primary data is valid. [2025-09-23T18:44:39.703806] [DEBUG] [LOCAL ] EVN: Saving primary data. [2025-09-23T18:44:39.704338] [DEBUG] [LOCAL ] EVN: Trimmed 17461 records to 10996 (keeping 200 days of data) [2025-09-23T18:44:39.772057] [DEBUG] [LOCAL ] EVN: Primary data saved (10996 records). [2025-09-23T18:44:39.772225] [INFO ] [MAIN ] EVN: Full history saved. [2025-09-23T18:44:39.772363] [INFO ] [MAIN ] Update Progress: 791/2372 symbols completed. EVN took 26.1s. Estimated remaining: 3h 29m 5s. Rate: 7.6 symbols/min [2025-09-23T18:44:39.945796] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:44:39.984113] [DEBUG] [LOCAL ] EVTL: Loaded 36915 existing records from primary storage. [2025-09-23T18:44:39.984273] [INFO ] [MAIN ] EVTL: Loaded 36915 existing records. [2025-09-23T18:44:40.160297] [WARN ] [MAIN ] EVTL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:44:40.160591] [INFO ] [MAIN ] EVTL: Wiping existing primary data before full refresh. [2025-09-23T18:44:40.160660] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-09-23T18:44:40.161700] [DEBUG] [LOCAL ] EVTL: Deleted primary data file. [2025-09-23T18:44:40.161762] [INFO ] [MAIN ] EVTL: Starting full primary refresh. [2025-09-23T18:44:40.207288] [INFO ] [REMOTE ] EVT: Fetching primary data for 2024-12. [2025-09-23T18:44:40.515822] [INFO ] [REMOTE ] EVTL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:44:40.719817] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-23T18:44:40.981997] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-23T18:44:41.002158] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-01. [2025-09-23T18:44:41.668733] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-23T18:44:41.802239] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2024-12. [2025-09-23T18:44:42.602252] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2024-12. [2025-09-23T18:44:43.212219] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-23T18:44:43.402195] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-01. [2025-09-23T18:44:43.603347] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-23T18:44:44.202217] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-01. [2025-09-23T18:44:44.534565] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-23T18:44:45.002151] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-02. [2025-09-23T18:44:45.113444] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-23T18:44:45.802172] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-08. [2025-09-23T18:44:46.000798] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-23T18:44:46.602208] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-03. [2025-09-23T18:44:46.855861] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-23T18:44:47.402232] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-02. [2025-09-23T18:44:47.649699] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-23T18:44:48.202238] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-09. [2025-09-23T18:44:48.414589] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-23T18:44:49.002233] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-03. [2025-09-23T18:44:49.534734] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-23T18:44:49.540231] [INFO ] [REMOTE ] EVR: Full fetch complete (50733 records). [2025-09-23T18:44:49.540360] [DEBUG] [VALIDATOR ] EVR: Validating primary data. [2025-09-23T18:44:49.807398] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-02. [2025-09-23T18:44:49.974152] [DEBUG] [VALIDATOR ] EVR: All expected trading days are present. [2025-09-23T18:44:49.974281] [DEBUG] [VALIDATOR ] EVR: Primary data validation passed. [2025-09-23T18:44:49.975117] [INFO ] [MAIN ] EVR: Fetched primary data is valid. [2025-09-23T18:44:49.975204] [DEBUG] [LOCAL ] EVR: Saving primary data. [2025-09-23T18:44:49.976741] [DEBUG] [LOCAL ] EVR: Trimmed 50733 records to 35659 (keeping 200 days of data) [2025-09-23T18:44:50.061172] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-23T18:44:50.229928] [DEBUG] [LOCAL ] EVR: Primary data saved (35659 records). [2025-09-23T18:44:50.230099] [INFO ] [MAIN ] EVR: Full history saved. [2025-09-23T18:44:50.230213] [INFO ] [MAIN ] Update Progress: 792/2372 symbols completed. EVR took 33.6s. Estimated remaining: 3h 29m 2s. Rate: 7.6 symbols/min [2025-09-23T18:44:50.401416] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:44:50.424483] [DEBUG] [LOCAL ] EVTR: Loaded 23026 existing records from primary storage. [2025-09-23T18:44:50.424621] [INFO ] [MAIN ] EVTR: Loaded 23026 existing records. [2025-09-23T18:44:50.604361] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-04. [2025-09-23T18:44:50.606921] [WARN ] [MAIN ] EVTR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:44:50.608139] [INFO ] [MAIN ] EVTR: Wiping existing primary data before full refresh. [2025-09-23T18:44:50.608214] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-09-23T18:44:50.609094] [DEBUG] [LOCAL ] EVTR: Deleted primary data file. [2025-09-23T18:44:50.609161] [INFO ] [MAIN ] EVTR: Starting full primary refresh. [2025-09-23T18:44:50.937043] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-23T18:44:51.020247] [INFO ] [REMOTE ] EVTR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:44:51.402183] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2024-12. [2025-09-23T18:44:51.720822] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-23T18:44:52.202255] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-05. [2025-09-23T18:44:52.573103] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-23T18:44:53.002204] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-04. [2025-09-23T18:44:53.807285] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-03. [2025-09-23T18:44:53.824558] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-23T18:44:54.191610] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-23T18:44:54.602303] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-05. [2025-09-23T18:44:54.816975] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-23T18:44:55.402166] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-04. [2025-09-23T18:44:55.715421] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-23T18:44:56.202244] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-01. [2025-09-23T18:44:56.670361] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-23T18:44:57.002237] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-05. [2025-09-23T18:44:57.250123] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-23T18:44:57.802168] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-06. [2025-09-23T18:44:57.846204] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-23T18:44:58.602203] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-02. [2025-09-23T18:44:59.245316] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-23T18:44:59.402179] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-03. [2025-09-23T18:44:59.530257] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-23T18:45:00.110056] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-23T18:45:00.202219] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-06. [2025-09-23T18:45:01.002229] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-06. [2025-09-23T18:45:01.256224] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-23T18:45:01.802243] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-07. [2025-09-23T18:45:02.422095] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-23T18:45:02.602264] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-07. [2025-09-23T18:45:03.402255] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-07. [2025-09-23T18:45:04.202206] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-04. [2025-09-23T18:45:05.664548] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-07 (3.06 seconds). [2025-09-23T18:45:05.671681] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-08. [2025-09-23T18:45:07.013912] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-07 (5.21 seconds). [2025-09-23T18:45:07.024713] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-08. [2025-09-23T18:45:07.354204] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-23T18:45:07.360504] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-09. [2025-09-23T18:45:07.397169] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-04 (3.19 seconds). [2025-09-23T18:45:07.402227] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-05. [2025-09-23T18:45:07.566469] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-07 (4.16 seconds). [2025-09-23T18:45:08.000236] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-23T18:45:08.003064] [INFO ] [REMOTE ] EVT: Full fetch complete (25301 records). [2025-09-23T18:45:08.003163] [DEBUG] [VALIDATOR ] EVT: Validating primary data. [2025-09-23T18:45:08.003722] [FATAL] [VALIDATOR ] EVT: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:45:08.003805] [FATAL] [MAIN ] EVT: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:45:08.003868] [WARN ] [MAIN ] EVT: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:45:08.003942] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-09-23T18:45:08.004007] [DEBUG] [LOCAL ] EVT: No primary data file found to delete. [2025-09-23T18:45:08.004044] [INFO ] [LOCAL ] EVT: Starting deletion of derivative data. [2025-09-23T18:45:08.004491] [DEBUG] [LOCAL ] EVT: Deleted derivative data file. [2025-09-23T18:45:08.004585] [INFO ] [MAIN ] Update Progress: 793/2372 symbols completed. EVT took 32.8s. Estimated remaining: 3h 29m 14s. Rate: 7.5 symbols/min [2025-09-23T18:45:08.179558] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:45:08.193578] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-23T18:45:08.202133] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-06. [2025-09-23T18:45:08.250463] [DEBUG] [LOCAL ] EW: Loaded 53396 existing records from primary storage. [2025-09-23T18:45:08.250634] [INFO ] [MAIN ] EW: Loaded 53396 existing records. [2025-09-23T18:45:08.437559] [WARN ] [MAIN ] EW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:45:08.437838] [INFO ] [MAIN ] EW: Wiping existing primary data before full refresh. [2025-09-23T18:45:08.437887] [INFO ] [LOCAL ] EW: Starting deletion of primary data. [2025-09-23T18:45:08.438979] [DEBUG] [LOCAL ] EW: Deleted primary data file. [2025-09-23T18:45:08.439039] [INFO ] [MAIN ] EW: Starting full primary refresh. [2025-09-23T18:45:08.828068] [INFO ] [REMOTE ] EW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:45:08.856202] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-23T18:45:08.903345] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-23T18:45:09.002220] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-07. [2025-09-23T18:45:09.802233] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-08. [2025-09-23T18:45:10.076794] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-23T18:45:10.602160] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-08. [2025-09-23T18:45:10.697505] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-23T18:45:11.402161] [INFO ] [REMOTE ] EW: Fetching primary data for 2024-12. [2025-09-23T18:45:11.550348] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-23T18:45:12.202202] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-09. [2025-09-23T18:45:13.002190] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-09. [2025-09-23T18:45:13.802169] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-09. [2025-09-23T18:45:14.115554] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2024-12 (2.71 seconds). [2025-09-23T18:45:14.575969] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-09-23T18:45:14.582019] [INFO ] [REMOTE ] EVTR: Full fetch complete (31698 records). [2025-09-23T18:45:14.582156] [DEBUG] [VALIDATOR ] EVTR: Validating primary data. [2025-09-23T18:45:14.615519] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-01. [2025-09-23T18:45:14.964955] [DEBUG] [VALIDATOR ] EVTR: All expected trading days are present. [2025-09-23T18:45:14.965077] [DEBUG] [VALIDATOR ] EVTR: Primary data validation passed. [2025-09-23T18:45:14.965627] [INFO ] [MAIN ] EVTR: Fetched primary data is valid. [2025-09-23T18:45:14.965705] [DEBUG] [LOCAL ] EVTR: Saving primary data. [2025-09-23T18:45:14.966514] [DEBUG] [LOCAL ] EVTR: Trimmed 31698 records to 23118 (keeping 200 days of data) [2025-09-23T18:45:15.110522] [DEBUG] [LOCAL ] EVTR: Primary data saved (23118 records). [2025-09-23T18:45:15.110720] [INFO ] [MAIN ] EVTR: Full history saved. [2025-09-23T18:45:15.110833] [INFO ] [MAIN ] Update Progress: 794/2372 symbols completed. EVTR took 24.9s. Estimated remaining: 3h 29m 4s. Rate: 7.5 symbols/min [2025-09-23T18:45:15.290389] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-23T18:45:15.314066] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:45:15.319930] [INFO ] [REMOTE ] EVTC: Full fetch complete (37831 records). [2025-09-23T18:45:15.320038] [DEBUG] [VALIDATOR ] EVTC: Validating primary data. [2025-09-23T18:45:15.583947] [DEBUG] [LOCAL ] EXG: Loaded 34542 existing records from primary storage. [2025-09-23T18:45:15.610865] [INFO ] [MAIN ] EXG: Loaded 34542 existing records. [2025-09-23T18:45:15.901458] [DEBUG] [VALIDATOR ] EVTC: All expected trading days are present. [2025-09-23T18:45:15.927796] [DEBUG] [VALIDATOR ] EVTC: Primary data validation passed. [2025-09-23T18:45:15.928506] [INFO ] [MAIN ] EVTC: Fetched primary data is valid. [2025-09-23T18:45:15.934572] [WARN ] [MAIN ] EXG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:45:15.935093] [DEBUG] [LOCAL ] EVTC: Saving primary data. [2025-09-23T18:45:15.935389] [INFO ] [MAIN ] EXG: Wiping existing primary data before full refresh. [2025-09-23T18:45:15.935703] [INFO ] [LOCAL ] EXG: Starting deletion of primary data. [2025-09-23T18:45:15.936689] [DEBUG] [LOCAL ] EVTC: Trimmed 37831 records to 26511 (keeping 200 days of data) [2025-09-23T18:45:15.937155] [DEBUG] [LOCAL ] EXG: Deleted primary data file. [2025-09-23T18:45:15.937329] [INFO ] [MAIN ] EXG: Starting full primary refresh. [2025-09-23T18:45:16.118319] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-09 (3.12 seconds). [2025-09-23T18:45:16.173595] [INFO ] [REMOTE ] EVTL: Full fetch complete (50311 records). [2025-09-23T18:45:16.197245] [DEBUG] [VALIDATOR ] EVTL: Validating primary data. [2025-09-23T18:45:16.794218] [INFO ] [REMOTE ] EXG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:45:16.826265] [INFO ] [REMOTE ] EXG: Fetching primary data for 2024-12. [2025-09-23T18:45:16.839978] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-09-23T18:45:16.896162] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-02. [2025-09-23T18:45:16.984886] [DEBUG] [LOCAL ] EVTC: Primary data saved (26511 records). [2025-09-23T18:45:17.000841] [INFO ] [MAIN ] EVTC: Full history saved. [2025-09-23T18:45:17.004419] [INFO ] [MAIN ] Update Progress: 795/2372 symbols completed. EVTC took 39.1s. Estimated remaining: 3h 28m 44s. Rate: 7.6 symbols/min [2025-09-23T18:45:17.048741] [DEBUG] [VALIDATOR ] EVTL: All expected trading days are present. [2025-09-23T18:45:17.060257] [DEBUG] [VALIDATOR ] EVTL: Primary data validation passed. [2025-09-23T18:45:17.081365] [INFO ] [MAIN ] EVTL: Fetched primary data is valid. [2025-09-23T18:45:17.086915] [DEBUG] [LOCAL ] EVTL: Saving primary data. [2025-09-23T18:45:17.140885] [DEBUG] [LOCAL ] EVTL: Trimmed 50311 records to 37168 (keeping 200 days of data) [2025-09-23T18:45:17.241557] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:45:17.242075] [DEBUG] [LOCAL ] EXK: No existing data file found in primary storage. [2025-09-23T18:45:17.267508] [WARN ] [MAIN ] EXK: No existing data found, performing full refresh instead. [2025-09-23T18:45:17.269422] [INFO ] [MAIN ] EXK: Wiping existing primary data before full refresh. [2025-09-23T18:45:17.269523] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-09-23T18:45:17.270852] [DEBUG] [LOCAL ] EXK: No primary data file found to delete. [2025-09-23T18:45:17.272611] [INFO ] [MAIN ] EXK: Starting full primary refresh. [2025-09-23T18:45:17.671610] [INFO ] [REMOTE ] EXK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:45:17.673480] [INFO ] [REMOTE ] EXK: Fetching primary data for 2024-12. [2025-09-23T18:45:17.783059] [DEBUG] [LOCAL ] EVTL: Primary data saved (37168 records). [2025-09-23T18:45:17.783191] [INFO ] [MAIN ] EVTL: Full history saved. [2025-09-23T18:45:17.783274] [INFO ] [MAIN ] Update Progress: 796/2372 symbols completed. EVTL took 38.0s. Estimated remaining: 3h 28m 22s. Rate: 7.6 symbols/min [2025-09-23T18:45:17.950232] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:45:17.984606] [DEBUG] [LOCAL ] EXP: Loaded 30188 existing records from primary storage. [2025-09-23T18:45:17.984766] [INFO ] [MAIN ] EXP: Loaded 30188 existing records. [2025-09-23T18:45:18.163299] [WARN ] [MAIN ] EXP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:45:18.163548] [INFO ] [MAIN ] EXP: Wiping existing primary data before full refresh. [2025-09-23T18:45:18.163597] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-09-23T18:45:18.164415] [DEBUG] [LOCAL ] EXP: Deleted primary data file. [2025-09-23T18:45:18.164476] [INFO ] [MAIN ] EXP: Starting full primary refresh. [2025-09-23T18:45:18.541938] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-23T18:45:18.547133] [INFO ] [REMOTE ] EXP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:45:18.554419] [INFO ] [REMOTE ] EXP: Fetching primary data for 2024-12. [2025-09-23T18:45:18.584785] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-23T18:45:18.602146] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-03. [2025-09-23T18:45:19.230970] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-23T18:45:19.402214] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-01. [2025-09-23T18:45:19.607541] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-23T18:45:20.202166] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-01. [2025-09-23T18:45:20.532307] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-23T18:45:20.761662] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-23T18:45:21.002232] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-04. [2025-09-23T18:45:21.121016] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-23T18:45:21.802246] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-02. [2025-09-23T18:45:22.582462] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-23T18:45:22.602153] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-05. [2025-09-23T18:45:23.089544] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-23T18:45:23.402252] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-02. [2025-09-23T18:45:24.202202] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-01. [2025-09-23T18:45:24.585170] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-23T18:45:24.710823] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-23T18:45:25.002256] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-03. [2025-09-23T18:45:25.210422] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-23T18:45:25.802209] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-02. [2025-09-23T18:45:26.501514] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-23T18:45:26.602202] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-03. [2025-09-23T18:45:26.748119] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-23T18:45:27.402251] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-03. [2025-09-23T18:45:28.124268] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-23T18:45:28.202154] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-04. [2025-09-23T18:45:28.888568] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-23T18:45:29.002157] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-04. [2025-09-23T18:45:29.709556] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-23T18:45:29.802159] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-05. [2025-09-23T18:45:30.202627] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-23T18:45:30.602200] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-04. [2025-09-23T18:45:31.224300] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-23T18:45:31.402175] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-06. [2025-09-23T18:45:32.202166] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-05. [2025-09-23T18:45:32.259969] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-23T18:45:33.002195] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-05. [2025-09-23T18:45:33.298170] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-23T18:45:33.330926] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-23T18:45:33.802201] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-06. [2025-09-23T18:45:34.457805] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-23T18:45:34.602207] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-07. [2025-09-23T18:45:35.030250] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-23T18:45:35.402189] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-06. [2025-09-23T18:45:36.202194] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-07. [2025-09-23T18:45:36.484313] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-23T18:45:36.550923] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-23T18:45:37.002188] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-07. [2025-09-23T18:45:37.309383] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-23T18:45:37.802209] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-08. [2025-09-23T18:45:38.299981] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-23T18:45:38.602187] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-06. [2025-09-23T18:45:38.779587] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-23T18:45:39.402250] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-09. [2025-09-23T18:45:40.059119] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-23T18:45:40.202184] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-07. [2025-09-23T18:45:40.850052] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-23T18:45:40.855516] [INFO ] [REMOTE ] EXP: Full fetch complete (43227 records). [2025-09-23T18:45:40.855609] [DEBUG] [VALIDATOR ] EXP: Validating primary data. [2025-09-23T18:45:41.013110] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-08. [2025-09-23T18:45:41.281273] [DEBUG] [VALIDATOR ] EXP: All expected trading days are present. [2025-09-23T18:45:41.281363] [DEBUG] [VALIDATOR ] EXP: Primary data validation passed. [2025-09-23T18:45:41.282032] [INFO ] [MAIN ] EXP: Fetched primary data is valid. [2025-09-23T18:45:41.282094] [DEBUG] [LOCAL ] EXP: Saving primary data. [2025-09-23T18:45:41.283051] [DEBUG] [LOCAL ] EXP: Trimmed 43227 records to 30120 (keeping 200 days of data) [2025-09-23T18:45:41.477349] [DEBUG] [LOCAL ] EXP: Primary data saved (30120 records). [2025-09-23T18:45:41.477484] [INFO ] [MAIN ] EXP: Full history saved. [2025-09-23T18:45:41.477567] [INFO ] [MAIN ] Update Progress: 797/2372 symbols completed. EXP took 23.7s. Estimated remaining: 3h 28m 45s. Rate: 7.5 symbols/min [2025-09-23T18:45:41.802166] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-08. [2025-09-23T18:45:41.976175] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-23T18:45:42.602196] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-08. [2025-09-23T18:45:42.872544] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-23T18:45:42.934527] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-23T18:45:43.402214] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-09. [2025-09-23T18:45:44.202185] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-09. [2025-09-23T18:45:44.382435] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-23T18:45:45.002189] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-09. [2025-09-23T18:45:45.004340] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-23T18:45:45.014566] [INFO ] [REMOTE ] EW: Full fetch complete (77347 records). [2025-09-23T18:45:45.014770] [DEBUG] [VALIDATOR ] EW: Validating primary data. [2025-09-23T18:45:45.349303] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-23T18:45:45.393569] [INFO ] [REMOTE ] EXG: Full fetch complete (49965 records). [2025-09-23T18:45:45.413007] [DEBUG] [VALIDATOR ] EXG: Validating primary data. [2025-09-23T18:45:45.529534] [DEBUG] [VALIDATOR ] EW: All expected trading days are present. [2025-09-23T18:45:45.541591] [DEBUG] [VALIDATOR ] EW: Primary data validation passed. [2025-09-23T18:45:45.562589] [INFO ] [MAIN ] EW: Fetched primary data is valid. [2025-09-23T18:45:45.562701] [DEBUG] [LOCAL ] EW: Saving primary data. [2025-09-23T18:45:45.625335] [DEBUG] [LOCAL ] EW: Trimmed 77347 records to 53396 (keeping 200 days of data) [2025-09-23T18:45:45.963669] [DEBUG] [VALIDATOR ] EXG: All expected trading days are present. [2025-09-23T18:45:45.964362] [DEBUG] [VALIDATOR ] EXG: Primary data validation passed. [2025-09-23T18:45:45.965440] [INFO ] [MAIN ] EXG: Fetched primary data is valid. [2025-09-23T18:45:45.965791] [DEBUG] [LOCAL ] EXG: Saving primary data. [2025-09-23T18:45:45.972412] [DEBUG] [LOCAL ] EXG: Trimmed 49965 records to 34386 (keeping 200 days of data) [2025-09-23T18:45:46.407841] [DEBUG] [LOCAL ] EXG: Primary data saved (34386 records). [2025-09-23T18:45:46.408971] [INFO ] [MAIN ] EXG: Full history saved. [2025-09-23T18:45:46.409154] [INFO ] [MAIN ] Update Progress: 798/2372 symbols completed. EXG took 31.3s. Estimated remaining: 3h 28m 31s. Rate: 7.5 symbols/min [2025-09-23T18:45:46.424167] [DEBUG] [LOCAL ] EW: Primary data saved (53396 records). [2025-09-23T18:45:46.424325] [INFO ] [MAIN ] EW: Full history saved. [2025-09-23T18:45:46.424419] [INFO ] [MAIN ] Update Progress: 799/2372 symbols completed. EW took 38.4s. Estimated remaining: 3h 28m 8s. Rate: 7.6 symbols/min [2025-09-23T18:45:46.947744] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-23T18:45:46.958235] [INFO ] [REMOTE ] EXK: Full fetch complete (76447 records). [2025-09-23T18:45:46.958370] [DEBUG] [VALIDATOR ] EXK: Validating primary data. [2025-09-23T18:45:47.346431] [DEBUG] [VALIDATOR ] EXK: All expected trading days are present. [2025-09-23T18:45:47.346515] [DEBUG] [VALIDATOR ] EXK: Primary data validation passed. [2025-09-23T18:45:47.347366] [INFO ] [MAIN ] EXK: Fetched primary data is valid. [2025-09-23T18:45:47.347430] [DEBUG] [LOCAL ] EXK: Saving primary data. [2025-09-23T18:45:47.349814] [DEBUG] [LOCAL ] EXK: Trimmed 76447 records to 53111 (keeping 200 days of data) [2025-09-23T18:45:47.652682] [DEBUG] [LOCAL ] EXK: Primary data saved (53111 records). [2025-09-23T18:45:47.652827] [INFO ] [MAIN ] EXK: Full history saved. [2025-09-23T18:45:47.652902] [INFO ] [MAIN ] Update Progress: 800/2372 symbols completed. EXK took 30.6s. Estimated remaining: 3h 27m 47s. Rate: 7.6 symbols/min [2025-09-23T18:45:48.345891] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:45:48.346915] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:45:48.295056] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:45:48.372104] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:45:48.445366] [DEBUG] [LOCAL ] FAF: Loaded 42036 existing records from primary storage. [2025-09-23T18:45:48.445596] [INFO ] [MAIN ] FAF: Loaded 42036 existing records. [2025-09-23T18:45:48.597252] [DEBUG] [LOCAL ] EXR: Loaded 45520 existing records from primary storage. [2025-09-23T18:45:48.597596] [INFO ] [MAIN ] EXR: Loaded 45520 existing records. [2025-09-23T18:45:48.608946] [DEBUG] [LOCAL ] EXPD: Loaded 48212 existing records from primary storage. [2025-09-23T18:45:48.633993] [INFO ] [MAIN ] EXPD: Loaded 48212 existing records. [2025-09-23T18:45:48.761197] [DEBUG] [LOCAL ] F: Loaded 53820 existing records from primary storage. [2025-09-23T18:45:48.841255] [INFO ] [MAIN ] F: Loaded 53820 existing records. [2025-09-23T18:45:48.770389] [WARN ] [MAIN ] FAF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:45:48.907608] [INFO ] [MAIN ] FAF: Wiping existing primary data before full refresh. [2025-09-23T18:45:48.945677] [INFO ] [LOCAL ] FAF: Starting deletion of primary data. [2025-09-23T18:45:48.997345] [DEBUG] [LOCAL ] FAF: Deleted primary data file. [2025-09-23T18:45:49.052417] [INFO ] [MAIN ] FAF: Starting full primary refresh. [2025-09-23T18:45:49.170298] [WARN ] [MAIN ] EXR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:45:49.291875] [INFO ] [MAIN ] EXR: Wiping existing primary data before full refresh. [2025-09-23T18:45:49.292143] [WARN ] [MAIN ] F: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:45:49.305754] [INFO ] [LOCAL ] EXR: Starting deletion of primary data. [2025-09-23T18:45:49.327639] [DEBUG] [LOCAL ] EXR: Deleted primary data file. [2025-09-23T18:45:49.300471] [WARN ] [MAIN ] EXPD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:45:49.338118] [INFO ] [MAIN ] F: Wiping existing primary data before full refresh. [2025-09-23T18:45:49.348508] [INFO ] [LOCAL ] F: Starting deletion of primary data. [2025-09-23T18:45:49.348573] [INFO ] [MAIN ] EXR: Starting full primary refresh. [2025-09-23T18:45:49.364671] [INFO ] [MAIN ] EXPD: Wiping existing primary data before full refresh. [2025-09-23T18:45:49.364528] [DEBUG] [LOCAL ] F: Deleted primary data file. [2025-09-23T18:45:49.378098] [INFO ] [MAIN ] F: Starting full primary refresh. [2025-09-23T18:45:49.387969] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-09-23T18:45:49.422576] [DEBUG] [LOCAL ] EXPD: Deleted primary data file. [2025-09-23T18:45:49.428459] [INFO ] [MAIN ] EXPD: Starting full primary refresh. [2025-09-23T18:45:50.388498] [INFO ] [REMOTE ] FAF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:45:50.481069] [INFO ] [REMOTE ] FAF: Fetching primary data for 2024-12. [2025-09-23T18:45:50.737570] [INFO ] [REMOTE ] EXPD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:45:50.798403] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2024-12. [2025-09-23T18:45:50.804539] [INFO ] [REMOTE ] EXR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:45:50.839856] [INFO ] [REMOTE ] F: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:45:50.840360] [INFO ] [REMOTE ] EXR: Fetching primary data for 2024-12. [2025-09-23T18:45:50.841084] [INFO ] [REMOTE ] F: Fetching primary data for 2024-12. [2025-09-23T18:45:52.024776] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-23T18:45:52.031929] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-01. [2025-09-23T18:45:52.190458] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-23T18:45:52.199203] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-01. [2025-09-23T18:45:52.306608] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-23T18:45:52.315924] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-01. [2025-09-23T18:45:53.088081] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-23T18:45:53.096869] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-02. [2025-09-23T18:45:53.270298] [INFO ] [REMOTE ] F: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-09-23T18:45:53.283090] [INFO ] [REMOTE ] F: Fetching primary data for 2025-01. [2025-09-23T18:45:53.445911] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-23T18:45:53.455191] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-02. [2025-09-23T18:45:53.598729] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-23T18:45:53.802212] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-02. [2025-09-23T18:45:54.000133] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-23T18:45:54.602238] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-03. [2025-09-23T18:45:55.033465] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-23T18:45:55.155121] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-23T18:45:55.303800] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-23T18:45:55.402247] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-03. [2025-09-23T18:45:55.810236] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-23T18:45:56.202208] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-03. [2025-09-23T18:45:56.753030] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-23T18:45:57.002260] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-04. [2025-09-23T18:45:57.588045] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-23T18:45:57.802256] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-04. [2025-09-23T18:45:58.602175] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-04. [2025-09-23T18:45:58.801918] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-23T18:45:59.131632] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-23T18:45:59.402236] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-05. [2025-09-23T18:46:00.044275] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-23T18:46:00.202264] [INFO ] [REMOTE ] F: Fetching primary data for 2025-02. [2025-09-23T18:46:00.998080] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-23T18:46:01.006556] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-05. [2025-09-23T18:46:01.802222] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-05. [2025-09-23T18:46:02.609462] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-06. [2025-09-23T18:46:02.630661] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-02 (2.43 seconds). [2025-09-23T18:46:02.732486] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-23T18:46:03.402171] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-06. [2025-09-23T18:46:03.673373] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-23T18:46:03.744712] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-23T18:46:04.202199] [INFO ] [REMOTE ] F: Fetching primary data for 2025-03. [2025-09-23T18:46:04.898317] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-23T18:46:05.002224] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-07. [2025-09-23T18:46:05.802223] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-06. [2025-09-23T18:46:06.377314] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-23T18:46:06.573538] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-09-23T18:46:06.602153] [INFO ] [REMOTE ] F: Fetching primary data for 2025-04. [2025-09-23T18:46:06.939896] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-23T18:46:07.402216] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-07. [2025-09-23T18:46:08.202229] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-08. [2025-09-23T18:46:08.931407] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-23T18:46:09.002212] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-08. [2025-09-23T18:46:09.381068] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-04 (2.78 seconds). [2025-09-23T18:46:09.481560] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-23T18:46:09.802213] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-07. [2025-09-23T18:46:10.237052] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-23T18:46:10.602202] [INFO ] [REMOTE ] F: Fetching primary data for 2025-05. [2025-09-23T18:46:11.402175] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-09. [2025-09-23T18:46:11.486167] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-23T18:46:12.202191] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-08. [2025-09-23T18:46:12.928607] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-23T18:46:12.940156] [INFO ] [REMOTE ] EXPD: Full fetch complete (69184 records). [2025-09-23T18:46:12.940435] [DEBUG] [VALIDATOR ] EXPD: Validating primary data. [2025-09-23T18:46:13.011921] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-09. [2025-09-23T18:46:13.595391] [DEBUG] [VALIDATOR ] EXPD: All expected trading days are present. [2025-09-23T18:46:13.595567] [DEBUG] [VALIDATOR ] EXPD: Primary data validation passed. [2025-09-23T18:46:13.597145] [INFO ] [MAIN ] EXPD: Fetched primary data is valid. [2025-09-23T18:46:13.609578] [DEBUG] [LOCAL ] EXPD: Saving primary data. [2025-09-23T18:46:13.616518] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-23T18:46:13.633704] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-05 (3.03 seconds). [2025-09-23T18:46:13.669098] [DEBUG] [LOCAL ] EXPD: Trimmed 69184 records to 48158 (keeping 200 days of data) [2025-09-23T18:46:13.810786] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-09. [2025-09-23T18:46:14.117940] [DEBUG] [LOCAL ] EXPD: Primary data saved (48158 records). [2025-09-23T18:46:14.118165] [INFO ] [MAIN ] EXPD: Full history saved. [2025-09-23T18:46:14.120311] [INFO ] [MAIN ] Update Progress: 801/2372 symbols completed. EXPD took 26.5s. Estimated remaining: 3h 28m 15s. Rate: 7.5 symbols/min [2025-09-23T18:46:14.316888] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:46:14.378350] [DEBUG] [LOCAL ] FBIN: Loaded 50429 existing records from primary storage. [2025-09-23T18:46:14.378594] [INFO ] [MAIN ] FBIN: Loaded 50429 existing records. [2025-09-23T18:46:14.602508] [WARN ] [MAIN ] FBIN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:46:14.602316] [INFO ] [REMOTE ] F: Fetching primary data for 2025-06. [2025-09-23T18:46:14.604116] [INFO ] [MAIN ] FBIN: Wiping existing primary data before full refresh. [2025-09-23T18:46:14.604262] [INFO ] [LOCAL ] FBIN: Starting deletion of primary data. [2025-09-23T18:46:14.612335] [DEBUG] [LOCAL ] FBIN: Deleted primary data file. [2025-09-23T18:46:14.623616] [INFO ] [MAIN ] FBIN: Starting full primary refresh. [2025-09-23T18:46:14.689372] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-23T18:46:14.750218] [INFO ] [REMOTE ] EXR: Full fetch complete (65759 records). [2025-09-23T18:46:14.750448] [DEBUG] [VALIDATOR ] EXR: Validating primary data. [2025-09-23T18:46:15.355823] [INFO ] [REMOTE ] FBIN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:46:15.409072] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2024-12. [2025-09-23T18:46:15.455440] [DEBUG] [VALIDATOR ] EXR: All expected trading days are present. [2025-09-23T18:46:15.455553] [DEBUG] [VALIDATOR ] EXR: Primary data validation passed. [2025-09-23T18:46:15.456463] [INFO ] [MAIN ] EXR: Fetched primary data is valid. [2025-09-23T18:46:15.456530] [DEBUG] [LOCAL ] EXR: Saving primary data. [2025-09-23T18:46:15.458585] [DEBUG] [LOCAL ] EXR: Trimmed 65759 records to 45526 (keeping 200 days of data) [2025-09-23T18:46:15.608456] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-23T18:46:15.683908] [INFO ] [REMOTE ] FAF: Full fetch complete (57511 records). [2025-09-23T18:46:15.709498] [DEBUG] [VALIDATOR ] FAF: Validating primary data. [2025-09-23T18:46:15.976594] [DEBUG] [LOCAL ] EXR: Primary data saved (45526 records). [2025-09-23T18:46:15.982876] [INFO ] [MAIN ] EXR: Full history saved. [2025-09-23T18:46:15.994367] [INFO ] [MAIN ] Update Progress: 802/2372 symbols completed. EXR took 28.3s. Estimated remaining: 3h 27m 55s. Rate: 7.6 symbols/min [2025-09-23T18:46:16.376542] [DEBUG] [VALIDATOR ] FAF: All expected trading days are present. [2025-09-23T18:46:16.395220] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:46:16.393472] [DEBUG] [VALIDATOR ] FAF: Primary data validation passed. [2025-09-23T18:46:16.396217] [INFO ] [MAIN ] FAF: Fetched primary data is valid. [2025-09-23T18:46:16.396668] [DEBUG] [LOCAL ] FAF: Saving primary data. [2025-09-23T18:46:16.398570] [DEBUG] [LOCAL ] FAF: Trimmed 57511 records to 42006 (keeping 200 days of data) [2025-09-23T18:46:16.523937] [DEBUG] [LOCAL ] FBK: Loaded 25489 existing records from primary storage. [2025-09-23T18:46:16.528322] [INFO ] [MAIN ] FBK: Loaded 25489 existing records. [2025-09-23T18:46:16.831880] [WARN ] [MAIN ] FBK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:46:16.834852] [INFO ] [MAIN ] FBK: Wiping existing primary data before full refresh. [2025-09-23T18:46:16.839066] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-09-23T18:46:16.840441] [DEBUG] [LOCAL ] FBK: Deleted primary data file. [2025-09-23T18:46:16.840907] [INFO ] [MAIN ] FBK: Starting full primary refresh. [2025-09-23T18:46:17.059773] [DEBUG] [LOCAL ] FAF: Primary data saved (42006 records). [2025-09-23T18:46:17.119902] [INFO ] [MAIN ] FAF: Full history saved. [2025-09-23T18:46:17.134634] [INFO ] [MAIN ] Update Progress: 803/2372 symbols completed. FAF took 29.5s. Estimated remaining: 3h 27m 34s. Rate: 7.6 symbols/min [2025-09-23T18:46:17.444522] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-23T18:46:17.490692] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-06 (2.89 seconds). [2025-09-23T18:46:17.473172] [INFO ] [REMOTE ] FBK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:46:17.554685] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:46:17.523552] [INFO ] [REMOTE ] FBK: Fetching primary data for 2024-12. [2025-09-23T18:46:17.565217] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-01. [2025-09-23T18:46:17.617845] [DEBUG] [LOCAL ] FBP: Loaded 46272 existing records from primary storage. [2025-09-23T18:46:17.618020] [INFO ] [MAIN ] FBP: Loaded 46272 existing records. [2025-09-23T18:46:17.808813] [INFO ] [REMOTE ] F: Fetching primary data for 2025-07. [2025-09-23T18:46:17.815202] [WARN ] [MAIN ] FBP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:46:17.815516] [INFO ] [MAIN ] FBP: Wiping existing primary data before full refresh. [2025-09-23T18:46:17.816334] [INFO ] [LOCAL ] FBP: Starting deletion of primary data. [2025-09-23T18:46:17.817435] [DEBUG] [LOCAL ] FBP: Deleted primary data file. [2025-09-23T18:46:17.817530] [INFO ] [MAIN ] FBP: Starting full primary refresh. [2025-09-23T18:46:18.187854] [INFO ] [REMOTE ] FBP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:46:18.602244] [INFO ] [REMOTE ] FBP: Fetching primary data for 2024-12. [2025-09-23T18:46:18.739158] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-23T18:46:19.268766] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-23T18:46:19.402234] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-01. [2025-09-23T18:46:19.910005] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-23T18:46:20.043744] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-23T18:46:20.205167] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-02. [2025-09-23T18:46:20.209058] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-09-23T18:46:21.002236] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-02. [2025-09-23T18:46:21.136134] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-23T18:46:21.802227] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-01. [2025-09-23T18:46:22.373805] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-23T18:46:22.602229] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-03. [2025-09-23T18:46:23.008358] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-23T18:46:23.402193] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-02. [2025-09-23T18:46:24.010483] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-23T18:46:24.202206] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-04. [2025-09-23T18:46:24.838424] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-23T18:46:25.002203] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-03. [2025-09-23T18:46:25.578893] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-23T18:46:25.802207] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-05. [2025-09-23T18:46:26.441795] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-23T18:46:26.602202] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-04. [2025-09-23T18:46:27.138856] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-23T18:46:27.402286] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-03. [2025-09-23T18:46:27.900735] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-23T18:46:28.202207] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-06. [2025-09-23T18:46:28.424379] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-23T18:46:29.002193] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-05. [2025-09-23T18:46:29.549778] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-23T18:46:29.802222] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-07. [2025-09-23T18:46:30.555676] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-23T18:46:30.602204] [INFO ] [REMOTE ] F: Fetching primary data for 2025-08. [2025-09-23T18:46:31.160707] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-23T18:46:31.402197] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-08. [2025-09-23T18:46:32.202190] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-04. [2025-09-23T18:46:32.992832] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-23T18:46:33.003134] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-06. [2025-09-23T18:46:33.082234] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-08 (2.48 seconds). [2025-09-23T18:46:33.114502] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-23T18:46:33.802198] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-05. [2025-09-23T18:46:34.129793] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-23T18:46:34.592255] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-23T18:46:34.602157] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-06. [2025-09-23T18:46:35.402175] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-07. [2025-09-23T18:46:35.649314] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-23T18:46:36.202197] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-09. [2025-09-23T18:46:36.708931] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-23T18:46:37.002193] [INFO ] [REMOTE ] F: Fetching primary data for 2025-09. [2025-09-23T18:46:37.802178] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-08. [2025-09-23T18:46:37.905349] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-23T18:46:37.913978] [INFO ] [REMOTE ] FBIN: Full fetch complete (72628 records). [2025-09-23T18:46:37.914220] [DEBUG] [VALIDATOR ] FBIN: Validating primary data. [2025-09-23T18:46:38.326460] [DEBUG] [VALIDATOR ] FBIN: All expected trading days are present. [2025-09-23T18:46:38.326634] [DEBUG] [VALIDATOR ] FBIN: Primary data validation passed. [2025-09-23T18:46:38.327614] [INFO ] [MAIN ] FBIN: Fetched primary data is valid. [2025-09-23T18:46:38.327713] [DEBUG] [LOCAL ] FBIN: Saving primary data. [2025-09-23T18:46:38.329354] [DEBUG] [LOCAL ] FBIN: Trimmed 72628 records to 50411 (keeping 200 days of data) [2025-09-23T18:46:38.619061] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-07. [2025-09-23T18:46:38.659068] [DEBUG] [LOCAL ] FBIN: Primary data saved (50411 records). [2025-09-23T18:46:38.659211] [INFO ] [MAIN ] FBIN: Full history saved. [2025-09-23T18:46:38.659321] [INFO ] [MAIN ] Update Progress: 804/2372 symbols completed. FBIN took 24.5s. Estimated remaining: 3h 27m 53s. Rate: 7.5 symbols/min [2025-09-23T18:46:38.841319] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:46:38.885981] [DEBUG] [LOCAL ] FBRT: Loaded 34333 existing records from primary storage. [2025-09-23T18:46:38.886314] [INFO ] [MAIN ] FBRT: Loaded 34333 existing records. [2025-09-23T18:46:39.087977] [WARN ] [MAIN ] FBRT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:46:39.088944] [INFO ] [MAIN ] FBRT: Wiping existing primary data before full refresh. [2025-09-23T18:46:39.089252] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-09-23T18:46:39.090746] [DEBUG] [LOCAL ] FBRT: Deleted primary data file. [2025-09-23T18:46:39.090815] [INFO ] [MAIN ] FBRT: Starting full primary refresh. [2025-09-23T18:46:39.311631] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-09-23T18:46:39.396994] [INFO ] [REMOTE ] F: Full fetch complete (77999 records). [2025-09-23T18:46:39.425075] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-23T18:46:39.456760] [DEBUG] [VALIDATOR ] F: Validating primary data. [2025-09-23T18:46:39.484969] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-09. [2025-09-23T18:46:39.641557] [INFO ] [REMOTE ] FBRT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:46:40.027441] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-23T18:46:40.027606] [DEBUG] [VALIDATOR ] F: All expected trading days are present. [2025-09-23T18:46:40.027861] [DEBUG] [VALIDATOR ] F: Primary data validation passed. [2025-09-23T18:46:40.037010] [INFO ] [MAIN ] F: Fetched primary data is valid. [2025-09-23T18:46:40.037094] [DEBUG] [LOCAL ] F: Saving primary data. [2025-09-23T18:46:40.038868] [DEBUG] [LOCAL ] F: Trimmed 77999 records to 53820 (keeping 200 days of data) [2025-09-23T18:46:40.228426] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-08. [2025-09-23T18:46:40.383328] [DEBUG] [LOCAL ] F: Primary data saved (53820 records). [2025-09-23T18:46:40.383494] [INFO ] [MAIN ] F: Full history saved. [2025-09-23T18:46:40.383610] [INFO ] [MAIN ] Update Progress: 805/2372 symbols completed. F took 52.7s. Estimated remaining: 3h 27m 33s. Rate: 7.6 symbols/min [2025-09-23T18:46:40.555331] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:46:40.574378] [DEBUG] [LOCAL ] FC: Loaded 15403 existing records from primary storage. [2025-09-23T18:46:40.574512] [INFO ] [MAIN ] FC: Loaded 15403 existing records. [2025-09-23T18:46:40.841715] [WARN ] [MAIN ] FC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:46:40.842848] [INFO ] [MAIN ] FC: Wiping existing primary data before full refresh. [2025-09-23T18:46:40.843087] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-09-23T18:46:40.844004] [DEBUG] [LOCAL ] FC: Deleted primary data file. [2025-09-23T18:46:40.844064] [INFO ] [MAIN ] FC: Starting full primary refresh. [2025-09-23T18:46:41.005763] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2024-12. [2025-09-23T18:46:41.005637] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-23T18:46:41.113732] [INFO ] [REMOTE ] FBP: Full fetch complete (66253 records). [2025-09-23T18:46:41.128113] [DEBUG] [VALIDATOR ] FBP: Validating primary data. [2025-09-23T18:46:41.355575] [INFO ] [REMOTE ] FC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:46:41.635508] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-23T18:46:41.662907] [DEBUG] [VALIDATOR ] FBP: All expected trading days are present. [2025-09-23T18:46:41.663140] [DEBUG] [VALIDATOR ] FBP: Primary data validation passed. [2025-09-23T18:46:41.663999] [INFO ] [MAIN ] FBP: Fetched primary data is valid. [2025-09-23T18:46:41.664082] [DEBUG] [LOCAL ] FBP: Saving primary data. [2025-09-23T18:46:41.665617] [DEBUG] [LOCAL ] FBP: Trimmed 66253 records to 46254 (keeping 200 days of data) [2025-09-23T18:46:41.847493] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-09. [2025-09-23T18:46:41.954416] [DEBUG] [LOCAL ] FBP: Primary data saved (46254 records). [2025-09-23T18:46:41.954551] [INFO ] [MAIN ] FBP: Full history saved. [2025-09-23T18:46:41.954632] [INFO ] [MAIN ] Update Progress: 806/2372 symbols completed. FBP took 24.8s. Estimated remaining: 3h 27m 12s. Rate: 7.6 symbols/min [2025-09-23T18:46:42.141048] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:46:42.185723] [DEBUG] [LOCAL ] FCF: Loaded 39806 existing records from primary storage. [2025-09-23T18:46:42.185933] [INFO ] [MAIN ] FCF: Loaded 39806 existing records. [2025-09-23T18:46:42.383177] [WARN ] [MAIN ] FCF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:46:42.383476] [INFO ] [MAIN ] FCF: Wiping existing primary data before full refresh. [2025-09-23T18:46:42.392887] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-09-23T18:46:42.401344] [DEBUG] [LOCAL ] FCF: Deleted primary data file. [2025-09-23T18:46:42.403504] [INFO ] [MAIN ] FCF: Starting full primary refresh. [2025-09-23T18:46:42.477209] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-23T18:46:42.610148] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-01. [2025-09-23T18:46:42.787601] [INFO ] [REMOTE ] FCF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:46:42.800337] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-23T18:46:42.804985] [INFO ] [REMOTE ] FBK: Full fetch complete (32917 records). [2025-09-23T18:46:42.805191] [DEBUG] [VALIDATOR ] FBK: Validating primary data. [2025-09-23T18:46:43.192446] [DEBUG] [VALIDATOR ] FBK: All expected trading days are present. [2025-09-23T18:46:43.192538] [DEBUG] [VALIDATOR ] FBK: Primary data validation passed. [2025-09-23T18:46:43.193095] [INFO ] [MAIN ] FBK: Fetched primary data is valid. [2025-09-23T18:46:43.193159] [DEBUG] [LOCAL ] FBK: Saving primary data. [2025-09-23T18:46:43.194203] [DEBUG] [LOCAL ] FBK: Trimmed 32917 records to 25604 (keeping 200 days of data) [2025-09-23T18:46:43.369703] [DEBUG] [LOCAL ] FBK: Primary data saved (25604 records). [2025-09-23T18:46:43.369857] [INFO ] [MAIN ] FBK: Full history saved. [2025-09-23T18:46:43.369974] [INFO ] [MAIN ] Update Progress: 807/2372 symbols completed. FBK took 27.4s. Estimated remaining: 3h 26m 52s. Rate: 7.6 symbols/min [2025-09-23T18:46:43.403297] [INFO ] [REMOTE ] FCF: Fetching primary data for 2024-12. [2025-09-23T18:46:43.561236] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:46:43.579101] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-23T18:46:43.608594] [DEBUG] [LOCAL ] FCN: Loaded 26353 existing records from primary storage. [2025-09-23T18:46:43.608762] [INFO ] [MAIN ] FCN: Loaded 26353 existing records. [2025-09-23T18:46:43.796781] [WARN ] [MAIN ] FCN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:46:43.797026] [INFO ] [MAIN ] FCN: Wiping existing primary data before full refresh. [2025-09-23T18:46:43.797074] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-09-23T18:46:43.797795] [DEBUG] [LOCAL ] FCN: Deleted primary data file. [2025-09-23T18:46:43.797872] [INFO ] [MAIN ] FCN: Starting full primary refresh. [2025-09-23T18:46:44.171994] [INFO ] [REMOTE ] FCN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:46:44.202200] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-02. [2025-09-23T18:46:44.906560] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-23T18:46:45.002189] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-01. [2025-09-23T18:46:45.618122] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-23T18:46:45.802208] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-03. [2025-09-23T18:46:46.360019] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-23T18:46:46.602187] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-02. [2025-09-23T18:46:47.165413] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-23T18:46:47.402198] [INFO ] [REMOTE ] FC: Fetching primary data for 2024-12. [2025-09-23T18:46:47.977000] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-23T18:46:48.207277] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-04. [2025-09-23T18:46:48.218202] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-23T18:46:49.002227] [INFO ] [REMOTE ] FCN: Fetching primary data for 2024-12. [2025-09-23T18:46:49.423262] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-23T18:46:49.793141] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-23T18:46:49.802160] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-01. [2025-09-23T18:46:50.602198] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-05. [2025-09-23T18:46:50.831343] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-23T18:46:51.402263] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-01. [2025-09-23T18:46:51.603783] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-23T18:46:52.202172] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-06. [2025-09-23T18:46:52.394538] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-23T18:46:53.002226] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-02. [2025-09-23T18:46:53.573065] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-23T18:46:53.802206] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-03. [2025-09-23T18:46:54.380731] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-23T18:46:54.602223] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-02. [2025-09-23T18:46:55.168504] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-23T18:46:55.336236] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-23T18:46:55.402238] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-04. [2025-09-23T18:46:56.202201] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-07. [2025-09-23T18:46:57.002169] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-03. [2025-09-23T18:46:57.005378] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-23T18:46:57.278770] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-23T18:46:57.802154] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-03. [2025-09-23T18:46:57.898998] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-23T18:46:58.453919] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-23T18:46:58.602205] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-04. [2025-09-23T18:46:59.402214] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-04. [2025-09-23T18:46:59.666745] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-23T18:47:00.202227] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-05. [2025-09-23T18:47:00.563313] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-23T18:47:01.002209] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-05. [2025-09-23T18:47:01.802173] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-08. [2025-09-23T18:47:01.878341] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-23T18:47:01.914451] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-23T18:47:02.602184] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-06. [2025-09-23T18:47:02.717924] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-23T18:47:03.402216] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-05. [2025-09-23T18:47:03.493123] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-23T18:47:04.202207] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-07. [2025-09-23T18:47:04.310759] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-23T18:47:05.002163] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-09. [2025-09-23T18:47:05.138574] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-23T18:47:05.802276] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-06. [2025-09-23T18:47:06.282825] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-23T18:47:06.291427] [INFO ] [REMOTE ] FBRT: Full fetch complete (48270 records). [2025-09-23T18:47:06.291703] [DEBUG] [VALIDATOR ] FBRT: Validating primary data. [2025-09-23T18:47:06.607407] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-08. [2025-09-23T18:47:06.729704] [DEBUG] [VALIDATOR ] FBRT: All expected trading days are present. [2025-09-23T18:47:06.729819] [DEBUG] [VALIDATOR ] FBRT: Primary data validation passed. [2025-09-23T18:47:06.730548] [INFO ] [MAIN ] FBRT: Fetched primary data is valid. [2025-09-23T18:47:06.730633] [DEBUG] [LOCAL ] FBRT: Saving primary data. [2025-09-23T18:47:06.731989] [DEBUG] [LOCAL ] FBRT: Trimmed 48270 records to 34381 (keeping 200 days of data) [2025-09-23T18:47:06.837842] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-23T18:47:06.965567] [DEBUG] [LOCAL ] FBRT: Primary data saved (34381 records). [2025-09-23T18:47:06.965746] [INFO ] [MAIN ] FBRT: Full history saved. [2025-09-23T18:47:06.965848] [INFO ] [MAIN ] Update Progress: 808/2372 symbols completed. FBRT took 28.3s. Estimated remaining: 3h 27m 14s. Rate: 7.5 symbols/min [2025-09-23T18:47:07.150412] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:47:07.190979] [DEBUG] [LOCAL ] FCPT: Loaded 37416 existing records from primary storage. [2025-09-23T18:47:07.191163] [INFO ] [MAIN ] FCPT: Loaded 37416 existing records. [2025-09-23T18:47:07.404837] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-23T18:47:07.404132] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-06. [2025-09-23T18:47:07.412051] [WARN ] [MAIN ] FCPT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:47:07.413616] [INFO ] [MAIN ] FCPT: Wiping existing primary data before full refresh. [2025-09-23T18:47:07.413698] [INFO ] [LOCAL ] FCPT: Starting deletion of primary data. [2025-09-23T18:47:07.414567] [DEBUG] [LOCAL ] FCPT: Deleted primary data file. [2025-09-23T18:47:07.414670] [INFO ] [MAIN ] FCPT: Starting full primary refresh. [2025-09-23T18:47:07.808426] [INFO ] [REMOTE ] FCPT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:47:08.202197] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2024-12. [2025-09-23T18:47:08.427087] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-23T18:47:09.002226] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-07. [2025-09-23T18:47:09.590481] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-23T18:47:09.802220] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-01. [2025-09-23T18:47:10.544526] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-23T18:47:10.602149] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-08. [2025-09-23T18:47:10.831838] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-23T18:47:11.402211] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-07. [2025-09-23T18:47:12.005351] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-23T18:47:12.202235] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-02. [2025-09-23T18:47:12.268414] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-23T18:47:13.002201] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-09. [2025-09-23T18:47:13.548950] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-23T18:47:13.802207] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-03. [2025-09-23T18:47:14.238144] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-23T18:47:14.240967] [INFO ] [REMOTE ] FC: Full fetch complete (21535 records). [2025-09-23T18:47:14.241040] [DEBUG] [VALIDATOR ] FC: Validating primary data. [2025-09-23T18:47:14.604610] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-09. [2025-09-23T18:47:14.605680] [DEBUG] [VALIDATOR ] FC: All expected trading days are present. [2025-09-23T18:47:14.605771] [DEBUG] [VALIDATOR ] FC: Primary data validation passed. [2025-09-23T18:47:14.606223] [INFO ] [MAIN ] FC: Fetched primary data is valid. [2025-09-23T18:47:14.606265] [DEBUG] [LOCAL ] FC: Saving primary data. [2025-09-23T18:47:14.607084] [DEBUG] [LOCAL ] FC: Trimmed 21535 records to 15388 (keeping 200 days of data) [2025-09-23T18:47:14.697734] [DEBUG] [LOCAL ] FC: Primary data saved (15388 records). [2025-09-23T18:47:14.697879] [INFO ] [MAIN ] FC: Full history saved. [2025-09-23T18:47:14.697967] [INFO ] [MAIN ] Update Progress: 809/2372 symbols completed. FC took 34.3s. Estimated remaining: 3h 27m 6s. Rate: 7.5 symbols/min [2025-09-23T18:47:14.872282] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:47:14.872473] [DEBUG] [LOCAL ] FCRX: No existing data file found in primary storage. [2025-09-23T18:47:14.872527] [WARN ] [MAIN ] FCRX: No existing data found, performing full refresh instead. [2025-09-23T18:47:14.872706] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-09-23T18:47:14.872821] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-09-23T18:47:14.872885] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-09-23T18:47:14.872920] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-09-23T18:47:15.227002] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:47:15.399512] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-23T18:47:15.408089] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-08. [2025-09-23T18:47:15.799228] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-23T18:47:15.805731] [INFO ] [REMOTE ] FCF: Full fetch complete (58010 records). [2025-09-23T18:47:15.805859] [DEBUG] [VALIDATOR ] FCF: Validating primary data. [2025-09-23T18:47:16.194249] [DEBUG] [VALIDATOR ] FCF: All expected trading days are present. [2025-09-23T18:47:16.194416] [DEBUG] [VALIDATOR ] FCF: Primary data validation passed. [2025-09-23T18:47:16.195283] [INFO ] [MAIN ] FCF: Fetched primary data is valid. [2025-09-23T18:47:16.195370] [DEBUG] [LOCAL ] FCF: Saving primary data. [2025-09-23T18:47:16.209588] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2024-12. [2025-09-23T18:47:16.197113] [DEBUG] [LOCAL ] FCF: Trimmed 58010 records to 39757 (keeping 200 days of data) [2025-09-23T18:47:16.212573] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-23T18:47:16.464773] [DEBUG] [LOCAL ] FCF: Primary data saved (39757 records). [2025-09-23T18:47:16.464915] [INFO ] [MAIN ] FCF: Full history saved. [2025-09-23T18:47:16.465035] [INFO ] [MAIN ] Update Progress: 810/2372 symbols completed. FCF took 34.5s. Estimated remaining: 3h 26m 46s. Rate: 7.6 symbols/min [2025-09-23T18:47:16.648484] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-23T18:47:16.651698] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:47:16.668341] [DEBUG] [LOCAL ] FCT: Loaded 14298 existing records from primary storage. [2025-09-23T18:47:16.668475] [INFO ] [MAIN ] FCT: Loaded 14298 existing records. [2025-09-23T18:47:16.845775] [WARN ] [MAIN ] FCT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:47:16.846117] [INFO ] [MAIN ] FCT: Wiping existing primary data before full refresh. [2025-09-23T18:47:16.846197] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-09-23T18:47:16.846780] [DEBUG] [LOCAL ] FCT: Deleted primary data file. [2025-09-23T18:47:16.846843] [INFO ] [MAIN ] FCT: Starting full primary refresh. [2025-09-23T18:47:17.007289] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-01. [2025-09-23T18:47:17.226533] [INFO ] [REMOTE ] FCT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:47:17.567705] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-23T18:47:17.802249] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-09-23T18:47:18.105593] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-09-23T18:47:18.602206] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-09-23T18:47:18.941624] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-23T18:47:19.402191] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-09-23T18:47:19.678192] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-09-23T18:47:20.202203] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-09-23T18:47:20.577272] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-23T18:47:21.002202] [INFO ] [REMOTE ] FCT: Fetching primary data for 2024-12. [2025-09-23T18:47:21.802176] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-09. [2025-09-23T18:47:22.079466] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-23T18:47:22.602230] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-04. [2025-09-23T18:47:22.739680] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-23T18:47:22.743939] [INFO ] [REMOTE ] FCN: Full fetch complete (35621 records). [2025-09-23T18:47:22.744030] [DEBUG] [VALIDATOR ] FCN: Validating primary data. [2025-09-23T18:47:23.125062] [DEBUG] [VALIDATOR ] FCN: All expected trading days are present. [2025-09-23T18:47:23.125157] [DEBUG] [VALIDATOR ] FCN: Primary data validation passed. [2025-09-23T18:47:23.125742] [INFO ] [MAIN ] FCN: Fetched primary data is valid. [2025-09-23T18:47:23.125806] [DEBUG] [LOCAL ] FCN: Saving primary data. [2025-09-23T18:47:23.126808] [DEBUG] [LOCAL ] FCN: Trimmed 35621 records to 26312 (keeping 200 days of data) [2025-09-23T18:47:23.289774] [DEBUG] [LOCAL ] FCN: Primary data saved (26312 records). [2025-09-23T18:47:23.289922] [INFO ] [MAIN ] FCN: Full history saved. [2025-09-23T18:47:23.290013] [INFO ] [MAIN ] Update Progress: 811/2372 symbols completed. FCN took 39.9s. Estimated remaining: 3h 26m 36s. Rate: 7.6 symbols/min [2025-09-23T18:47:23.407279] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-01. [2025-09-23T18:47:23.472977] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:47:23.529565] [DEBUG] [LOCAL ] FCX: Loaded 53700 existing records from primary storage. [2025-09-23T18:47:23.529759] [INFO ] [MAIN ] FCX: Loaded 53700 existing records. [2025-09-23T18:47:23.707751] [WARN ] [MAIN ] FCX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:47:23.708038] [INFO ] [MAIN ] FCX: Wiping existing primary data before full refresh. [2025-09-23T18:47:23.708085] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-09-23T18:47:23.709305] [DEBUG] [LOCAL ] FCX: Deleted primary data file. [2025-09-23T18:47:23.709365] [INFO ] [MAIN ] FCX: Starting full primary refresh. [2025-09-23T18:47:24.098164] [INFO ] [REMOTE ] FCX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:47:24.131637] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-23T18:47:24.152835] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-23T18:47:24.202244] [INFO ] [REMOTE ] FCX: Fetching primary data for 2024-12. [2025-09-23T18:47:25.002231] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-05. [2025-09-23T18:47:25.802225] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-06. [2025-09-23T18:47:26.208407] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-23T18:47:26.348239] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-23T18:47:26.371405] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-23T18:47:26.602211] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-06. [2025-09-23T18:47:27.402196] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-02. [2025-09-23T18:47:27.627413] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-23T18:47:28.202218] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-01. [2025-09-23T18:47:28.241895] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-23T18:47:29.002250] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-07. [2025-09-23T18:47:29.352097] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-23T18:47:29.802166] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-03. [2025-09-23T18:47:29.874522] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-23T18:47:30.602190] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-02. [2025-09-23T18:47:30.709566] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-23T18:47:31.402248] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-08. [2025-09-23T18:47:31.703421] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-09-23T18:47:32.154356] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-23T18:47:32.202145] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-04. [2025-09-23T18:47:33.002214] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-09-23T18:47:33.267835] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-23T18:47:33.504854] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-23T18:47:33.505759] [INFO ] [REMOTE ] FCRX: Full fetch complete (1644 records). [2025-09-23T18:47:33.505846] [DEBUG] [VALIDATOR ] FCRX: Validating primary data. [2025-09-23T18:47:33.686629] [WARN ] [VALIDATOR ] FCRX: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-09-23T18:47:33.686856] [FATAL] [MAIN ] FCRX: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:47:33.686902] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:47:33.686940] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-09-23T18:47:33.687000] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-09-23T18:47:33.687035] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-09-23T18:47:33.687074] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-09-23T18:47:33.687129] [INFO ] [MAIN ] Update Progress: 812/2372 symbols completed. FCRX took 19.0s. Estimated remaining: 3h 26m 33s. Rate: 7.6 symbols/min [2025-09-23T18:47:33.807379] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-05. [2025-09-23T18:47:33.858433] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:47:33.891929] [DEBUG] [LOCAL ] FDP: Loaded 30411 existing records from primary storage. [2025-09-23T18:47:33.892075] [INFO ] [MAIN ] FDP: Loaded 30411 existing records. [2025-09-23T18:47:34.070370] [WARN ] [MAIN ] FDP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:47:34.070625] [INFO ] [MAIN ] FDP: Wiping existing primary data before full refresh. [2025-09-23T18:47:34.070703] [INFO ] [LOCAL ] FDP: Starting deletion of primary data. [2025-09-23T18:47:34.071620] [DEBUG] [LOCAL ] FDP: Deleted primary data file. [2025-09-23T18:47:34.071713] [INFO ] [MAIN ] FDP: Starting full primary refresh. [2025-09-23T18:47:34.431681] [INFO ] [REMOTE ] FDP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:47:34.602168] [INFO ] [REMOTE ] FDP: Fetching primary data for 2024-12. [2025-09-23T18:47:34.658556] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-23T18:47:35.402195] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-06. [2025-09-23T18:47:35.597697] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-23T18:47:35.967731] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-23T18:47:36.202189] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-03. [2025-09-23T18:47:37.002206] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-01. [2025-09-23T18:47:37.802198] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-07. [2025-09-23T18:47:38.032109] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-23T18:47:38.212077] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-23T18:47:38.602241] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-04. [2025-09-23T18:47:38.948717] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-23T18:47:39.402207] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-07. [2025-09-23T18:47:40.202195] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-02. [2025-09-23T18:47:40.592016] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-23T18:47:40.593948] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-23T18:47:41.002145] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-05. [2025-09-23T18:47:41.466325] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-23T18:47:41.802206] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-03. [2025-09-23T18:47:42.602167] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-08. [2025-09-23T18:47:42.834860] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-23T18:47:42.878785] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-23T18:47:43.402267] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-04. [2025-09-23T18:47:43.660667] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-23T18:47:44.202200] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-08. [2025-09-23T18:47:44.533199] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-23T18:47:45.002261] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-05. [2025-09-23T18:47:45.117951] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-23T18:47:45.802214] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-09. [2025-09-23T18:47:46.169052] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-23T18:47:46.513881] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-23T18:47:46.517087] [INFO ] [REMOTE ] FCT: Full fetch complete (21093 records). [2025-09-23T18:47:46.517198] [DEBUG] [VALIDATOR ] FCT: Validating primary data. [2025-09-23T18:47:46.607313] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-06. [2025-09-23T18:47:46.903355] [DEBUG] [VALIDATOR ] FCT: All expected trading days are present. [2025-09-23T18:47:46.903440] [DEBUG] [VALIDATOR ] FCT: Primary data validation passed. [2025-09-23T18:47:46.904020] [INFO ] [MAIN ] FCT: Fetched primary data is valid. [2025-09-23T18:47:46.904087] [DEBUG] [LOCAL ] FCT: Saving primary data. [2025-09-23T18:47:46.904780] [DEBUG] [LOCAL ] FCT: Trimmed 21093 records to 14327 (keeping 200 days of data) [2025-09-23T18:47:47.000572] [DEBUG] [LOCAL ] FCT: Primary data saved (14327 records). [2025-09-23T18:47:47.000761] [INFO ] [MAIN ] FCT: Full history saved. [2025-09-23T18:47:47.000866] [INFO ] [MAIN ] Update Progress: 813/2372 symbols completed. FCT took 30.5s. Estimated remaining: 3h 26m 35s. Rate: 7.5 symbols/min [2025-09-23T18:47:47.179900] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:47:47.207403] [DEBUG] [LOCAL ] FDS: Loaded 25991 existing records from primary storage. [2025-09-23T18:47:47.207541] [INFO ] [MAIN ] FDS: Loaded 25991 existing records. [2025-09-23T18:47:47.386590] [WARN ] [MAIN ] FDS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:47:47.386867] [INFO ] [MAIN ] FDS: Wiping existing primary data before full refresh. [2025-09-23T18:47:47.386917] [INFO ] [LOCAL ] FDS: Starting deletion of primary data. [2025-09-23T18:47:47.387754] [DEBUG] [LOCAL ] FDS: Deleted primary data file. [2025-09-23T18:47:47.387815] [INFO ] [MAIN ] FDS: Starting full primary refresh. [2025-09-23T18:47:47.408079] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-06. [2025-09-23T18:47:47.741259] [INFO ] [REMOTE ] FDS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:47:48.202145] [INFO ] [REMOTE ] FDS: Fetching primary data for 2024-12. [2025-09-23T18:47:48.342908] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-23T18:47:48.762100] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-23T18:47:49.002222] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-07. [2025-09-23T18:47:49.063083] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-23T18:47:49.802215] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-09. [2025-09-23T18:47:50.602270] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-07. [2025-09-23T18:47:50.875223] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-23T18:47:50.881622] [INFO ] [REMOTE ] FCPT: Full fetch complete (53284 records). [2025-09-23T18:47:50.881759] [DEBUG] [VALIDATOR ] FCPT: Validating primary data. [2025-09-23T18:47:51.272531] [DEBUG] [VALIDATOR ] FCPT: All expected trading days are present. [2025-09-23T18:47:51.272635] [DEBUG] [VALIDATOR ] FCPT: Primary data validation passed. [2025-09-23T18:47:51.273418] [INFO ] [MAIN ] FCPT: Fetched primary data is valid. [2025-09-23T18:47:51.273543] [DEBUG] [LOCAL ] FCPT: Saving primary data. [2025-09-23T18:47:51.274807] [DEBUG] [LOCAL ] FCPT: Trimmed 53284 records to 37424 (keeping 200 days of data) [2025-09-23T18:47:51.442032] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-01. [2025-09-23T18:47:51.512738] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-09-23T18:47:51.551052] [DEBUG] [LOCAL ] FCPT: Primary data saved (37424 records). [2025-09-23T18:47:51.551215] [INFO ] [MAIN ] FCPT: Full history saved. [2025-09-23T18:47:51.551309] [INFO ] [MAIN ] Update Progress: 814/2372 symbols completed. FCPT took 44.6s. Estimated remaining: 3h 26m 20s. Rate: 7.6 symbols/min [2025-09-23T18:47:51.737980] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:47:51.757717] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-23T18:47:51.813373] [DEBUG] [LOCAL ] FDX: Loaded 51613 existing records from primary storage. [2025-09-23T18:47:51.813517] [INFO ] [MAIN ] FDX: Loaded 51613 existing records. [2025-09-23T18:47:51.993263] [WARN ] [MAIN ] FDX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:47:51.993521] [INFO ] [MAIN ] FDX: Wiping existing primary data before full refresh. [2025-09-23T18:47:51.993569] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-09-23T18:47:51.994862] [DEBUG] [LOCAL ] FDX: Deleted primary data file. [2025-09-23T18:47:51.994921] [INFO ] [MAIN ] FDX: Starting full primary refresh. [2025-09-23T18:47:52.207383] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-08. [2025-09-23T18:47:52.351210] [INFO ] [REMOTE ] FDX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:47:52.855335] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-23T18:47:53.002166] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-02. [2025-09-23T18:47:53.236387] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-23T18:47:53.802189] [INFO ] [REMOTE ] FDX: Fetching primary data for 2024-12. [2025-09-23T18:47:53.864040] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-23T18:47:54.602254] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-08. [2025-09-23T18:47:55.402197] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-09. [2025-09-23T18:47:55.532139] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-23T18:47:56.202205] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-03. [2025-09-23T18:47:56.234548] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-23T18:47:56.688804] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-23T18:47:56.693788] [INFO ] [REMOTE ] FDP: Full fetch complete (42746 records). [2025-09-23T18:47:56.693918] [DEBUG] [VALIDATOR ] FDP: Validating primary data. [2025-09-23T18:47:57.007281] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-09. [2025-09-23T18:47:57.096455] [DEBUG] [VALIDATOR ] FDP: All expected trading days are present. [2025-09-23T18:47:57.096629] [DEBUG] [VALIDATOR ] FDP: Primary data validation passed. [2025-09-23T18:47:57.097421] [INFO ] [MAIN ] FDP: Fetched primary data is valid. [2025-09-23T18:47:57.097566] [DEBUG] [LOCAL ] FDP: Saving primary data. [2025-09-23T18:47:57.099146] [DEBUG] [LOCAL ] FDP: Trimmed 42746 records to 30430 (keeping 200 days of data) [2025-09-23T18:47:57.224224] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-23T18:47:57.318841] [DEBUG] [LOCAL ] FDP: Primary data saved (30430 records). [2025-09-23T18:47:57.318992] [INFO ] [MAIN ] FDP: Full history saved. [2025-09-23T18:47:57.319078] [INFO ] [MAIN ] Update Progress: 815/2372 symbols completed. FDP took 23.6s. Estimated remaining: 3h 26m 8s. Rate: 7.6 symbols/min [2025-09-23T18:47:57.498591] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:47:57.549155] [DEBUG] [LOCAL ] FE: Loaded 53438 existing records from primary storage. [2025-09-23T18:47:57.549300] [INFO ] [MAIN ] FE: Loaded 53438 existing records. [2025-09-23T18:47:57.728952] [WARN ] [MAIN ] FE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:47:57.729381] [INFO ] [MAIN ] FE: Wiping existing primary data before full refresh. [2025-09-23T18:47:57.729436] [INFO ] [LOCAL ] FE: Starting deletion of primary data. [2025-09-23T18:47:57.730621] [DEBUG] [LOCAL ] FE: Deleted primary data file. [2025-09-23T18:47:57.730717] [INFO ] [MAIN ] FE: Starting full primary refresh. [2025-09-23T18:47:57.807267] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-01. [2025-09-23T18:47:58.111664] [INFO ] [REMOTE ] FE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:47:58.602212] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-04. [2025-09-23T18:47:59.133760] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-23T18:47:59.148281] [INFO ] [REMOTE ] FCX: Full fetch complete (77739 records). [2025-09-23T18:47:59.148501] [DEBUG] [VALIDATOR ] FCX: Validating primary data. [2025-09-23T18:47:59.405612] [INFO ] [REMOTE ] FE: Fetching primary data for 2024-12. [2025-09-23T18:47:59.732864] [DEBUG] [VALIDATOR ] FCX: All expected trading days are present. [2025-09-23T18:47:59.733162] [DEBUG] [VALIDATOR ] FCX: Primary data validation passed. [2025-09-23T18:47:59.734662] [INFO ] [MAIN ] FCX: Fetched primary data is valid. [2025-09-23T18:47:59.737139] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-23T18:47:59.735188] [DEBUG] [LOCAL ] FCX: Saving primary data. [2025-09-23T18:47:59.762561] [DEBUG] [LOCAL ] FCX: Trimmed 77739 records to 53700 (keeping 200 days of data) [2025-09-23T18:47:59.766223] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-23T18:48:00.096017] [DEBUG] [LOCAL ] FCX: Primary data saved (53700 records). [2025-09-23T18:48:00.096187] [INFO ] [MAIN ] FCX: Full history saved. [2025-09-23T18:48:00.096287] [INFO ] [MAIN ] Update Progress: 816/2372 symbols completed. FCX took 36.8s. Estimated remaining: 3h 25m 51s. Rate: 7.6 symbols/min [2025-09-23T18:48:00.207309] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-05. [2025-09-23T18:48:00.268832] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:48:00.268965] [DEBUG] [LOCAL ] FENG: No existing data file found in primary storage. [2025-09-23T18:48:00.269018] [WARN ] [MAIN ] FENG: No existing data found, performing full refresh instead. [2025-09-23T18:48:00.269158] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-09-23T18:48:00.269204] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-09-23T18:48:00.269245] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-09-23T18:48:00.269278] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-09-23T18:48:00.620633] [INFO ] [REMOTE ] FENG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:48:01.002164] [INFO ] [REMOTE ] FENG: Fetching primary data for 2024-12. [2025-09-23T18:48:01.120244] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-23T18:48:01.352115] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-09-23T18:48:01.709853] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-23T18:48:01.802222] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-06. [2025-09-23T18:48:02.602235] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-02. [2025-09-23T18:48:03.402248] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-01. [2025-09-23T18:48:04.158919] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-09-23T18:48:04.202148] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-07. [2025-09-23T18:48:05.002243] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-01. [2025-09-23T18:48:05.173168] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-23T18:48:05.222834] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-23T18:48:05.737634] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-02 (3.14 seconds). [2025-09-23T18:48:05.802165] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-03. [2025-09-23T18:48:06.327223] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-23T18:48:06.602213] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-09-23T18:48:06.921501] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-23T18:48:07.402177] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-08. [2025-09-23T18:48:07.526222] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-23T18:48:08.202239] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-02. [2025-09-23T18:48:08.342296] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-23T18:48:09.002200] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-04. [2025-09-23T18:48:09.642476] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-23T18:48:09.802226] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-03. [2025-09-23T18:48:10.609239] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-09-23T18:48:10.629920] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-23T18:48:11.166359] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-23T18:48:11.402196] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-09. [2025-09-23T18:48:11.615934] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-23T18:48:12.202217] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-09-23T18:48:12.549038] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-23T18:48:13.002233] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-04. [2025-09-23T18:48:13.034586] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-23T18:48:13.041341] [INFO ] [REMOTE ] FDS: Full fetch complete (36728 records). [2025-09-23T18:48:13.041493] [DEBUG] [VALIDATOR ] FDS: Validating primary data. [2025-09-23T18:48:13.422002] [DEBUG] [VALIDATOR ] FDS: All expected trading days are present. [2025-09-23T18:48:13.422090] [DEBUG] [VALIDATOR ] FDS: Primary data validation passed. [2025-09-23T18:48:13.423051] [INFO ] [MAIN ] FDS: Fetched primary data is valid. [2025-09-23T18:48:13.423113] [DEBUG] [LOCAL ] FDS: Saving primary data. [2025-09-23T18:48:13.423995] [DEBUG] [LOCAL ] FDS: Trimmed 36728 records to 26130 (keeping 200 days of data) [2025-09-23T18:48:13.590092] [DEBUG] [LOCAL ] FDS: Primary data saved (26130 records). [2025-09-23T18:48:13.590232] [INFO ] [MAIN ] FDS: Full history saved. [2025-09-23T18:48:13.590319] [INFO ] [MAIN ] Update Progress: 817/2372 symbols completed. FDS took 26.6s. Estimated remaining: 3h 25m 53s. Rate: 7.6 symbols/min [2025-09-23T18:48:13.766352] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:48:13.802217] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-05. [2025-09-23T18:48:13.818551] [DEBUG] [LOCAL ] FERG: Loaded 49036 existing records from primary storage. [2025-09-23T18:48:13.818745] [INFO ] [MAIN ] FERG: Loaded 49036 existing records. [2025-09-23T18:48:13.995980] [WARN ] [MAIN ] FERG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:48:13.996254] [INFO ] [MAIN ] FERG: Wiping existing primary data before full refresh. [2025-09-23T18:48:13.996302] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-09-23T18:48:13.997457] [DEBUG] [LOCAL ] FERG: Deleted primary data file. [2025-09-23T18:48:13.997518] [INFO ] [MAIN ] FERG: Starting full primary refresh. [2025-09-23T18:48:14.345535] [INFO ] [REMOTE ] FERG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:48:14.602200] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-09-23T18:48:15.376089] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-09-23T18:48:15.402173] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-05. [2025-09-23T18:48:15.438601] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-23T18:48:15.916859] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-23T18:48:16.202198] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-06. [2025-09-23T18:48:17.002224] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-09-23T18:48:17.076488] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-23T18:48:17.337616] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-23T18:48:17.802236] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-06. [2025-09-23T18:48:17.843190] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-23T18:48:18.602303] [INFO ] [REMOTE ] FERG: Fetching primary data for 2024-12. [2025-09-23T18:48:19.122320] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-23T18:48:19.402274] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-07. [2025-09-23T18:48:20.101871] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-23T18:48:20.202211] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-01. [2025-09-23T18:48:21.002177] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-09-23T18:48:21.198908] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-23T18:48:21.321987] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-23T18:48:21.619774] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-23T18:48:21.802199] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-02. [2025-09-23T18:48:22.602213] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-09-23T18:48:22.888752] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-09-23T18:48:23.270082] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-23T18:48:23.402169] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-03. [2025-09-23T18:48:24.202258] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-08. [2025-09-23T18:48:25.002224] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-07. [2025-09-23T18:48:25.802255] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-09-23T18:48:26.247329] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-03 (2.85 seconds). [2025-09-23T18:48:26.422609] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-23T18:48:26.599812] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-23T18:48:26.600824] [INFO ] [REMOTE ] FENG: Full fetch complete (2119 records). [2025-09-23T18:48:26.600909] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-09-23T18:48:26.613468] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-04. [2025-09-23T18:48:26.799637] [WARN ] [VALIDATOR ] FENG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-23T18:48:26.799885] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:48:26.799967] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:48:26.800066] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-09-23T18:48:26.800195] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-09-23T18:48:26.800270] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-09-23T18:48:26.800367] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-09-23T18:48:26.800477] [INFO ] [MAIN ] Update Progress: 818/2372 symbols completed. FENG took 26.7s. Estimated remaining: 3h 25m 55s. Rate: 7.5 symbols/min [2025-09-23T18:48:26.986461] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:48:27.010487] [DEBUG] [LOCAL ] FET: Loaded 12626 existing records from primary storage. [2025-09-23T18:48:27.010672] [INFO ] [MAIN ] FET: Loaded 12626 existing records. [2025-09-23T18:48:27.225942] [WARN ] [MAIN ] FET: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:48:27.226309] [INFO ] [MAIN ] FET: Wiping existing primary data before full refresh. [2025-09-23T18:48:27.230210] [INFO ] [LOCAL ] FET: Starting deletion of primary data. [2025-09-23T18:48:27.231022] [DEBUG] [LOCAL ] FET: Deleted primary data file. [2025-09-23T18:48:27.231106] [INFO ] [MAIN ] FET: Starting full primary refresh. [2025-09-23T18:48:27.232441] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-23T18:48:27.420947] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-08. [2025-09-23T18:48:27.606419] [INFO ] [REMOTE ] FET: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:48:28.202166] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-09. [2025-09-23T18:48:28.269871] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-23T18:48:29.002202] [INFO ] [REMOTE ] FET: Fetching primary data for 2024-12. [2025-09-23T18:48:29.550959] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-23T18:48:29.600780] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-23T18:48:29.802210] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-01. [2025-09-23T18:48:30.090096] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-23T18:48:30.103268] [INFO ] [REMOTE ] FE: Full fetch complete (77190 records). [2025-09-23T18:48:30.103514] [DEBUG] [VALIDATOR ] FE: Validating primary data. [2025-09-23T18:48:30.524144] [DEBUG] [VALIDATOR ] FE: All expected trading days are present. [2025-09-23T18:48:30.524293] [DEBUG] [VALIDATOR ] FE: Primary data validation passed. [2025-09-23T18:48:30.525323] [INFO ] [MAIN ] FE: Fetched primary data is valid. [2025-09-23T18:48:30.525423] [DEBUG] [LOCAL ] FE: Saving primary data. [2025-09-23T18:48:30.527041] [DEBUG] [LOCAL ] FE: Trimmed 77190 records to 53435 (keeping 200 days of data) [2025-09-23T18:48:30.625525] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-05. [2025-09-23T18:48:30.767465] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-23T18:48:30.883137] [DEBUG] [LOCAL ] FE: Primary data saved (53435 records). [2025-09-23T18:48:30.883422] [INFO ] [MAIN ] FE: Full history saved. [2025-09-23T18:48:30.883700] [INFO ] [MAIN ] Update Progress: 819/2372 symbols completed. FE took 33.6s. Estimated remaining: 3h 25m 40s. Rate: 7.6 symbols/min [2025-09-23T18:48:31.059574] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:48:31.092160] [DEBUG] [LOCAL ] FF: Loaded 25726 existing records from primary storage. [2025-09-23T18:48:31.092330] [INFO ] [MAIN ] FF: Loaded 25726 existing records. [2025-09-23T18:48:31.285019] [WARN ] [MAIN ] FF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:48:31.285309] [INFO ] [MAIN ] FF: Wiping existing primary data before full refresh. [2025-09-23T18:48:31.285359] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-09-23T18:48:31.286046] [DEBUG] [LOCAL ] FF: Deleted primary data file. [2025-09-23T18:48:31.286163] [INFO ] [MAIN ] FF: Starting full primary refresh. [2025-09-23T18:48:31.407399] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-02. [2025-09-23T18:48:31.682076] [INFO ] [REMOTE ] FF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:48:32.202163] [INFO ] [REMOTE ] FF: Fetching primary data for 2024-12. [2025-09-23T18:48:32.308865] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-23T18:48:32.316238] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-23T18:48:33.002155] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-03. [2025-09-23T18:48:33.036035] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-23T18:48:33.802227] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-01. [2025-09-23T18:48:33.857562] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-23T18:48:34.592905] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-23T18:48:34.602198] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-02. [2025-09-23T18:48:35.384042] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-23T18:48:35.402140] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-03. [2025-09-23T18:48:36.202196] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-06. [2025-09-23T18:48:36.728015] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-23T18:48:37.002251] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-04. [2025-09-23T18:48:37.738839] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-23T18:48:37.788058] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-23T18:48:37.802144] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-05. [2025-09-23T18:48:38.572115] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-23T18:48:38.602157] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-06. [2025-09-23T18:48:39.264029] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-23T18:48:39.402232] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-04. [2025-09-23T18:48:40.202188] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-09. [2025-09-23T18:48:40.825180] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-23T18:48:41.002243] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-07. [2025-09-23T18:48:41.565410] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-23T18:48:41.802225] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-08. [2025-09-23T18:48:41.856758] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-23T18:48:41.871227] [INFO ] [REMOTE ] FDX: Full fetch complete (74423 records). [2025-09-23T18:48:41.871446] [DEBUG] [VALIDATOR ] FDX: Validating primary data. [2025-09-23T18:48:42.316398] [DEBUG] [VALIDATOR ] FDX: All expected trading days are present. [2025-09-23T18:48:42.316577] [DEBUG] [VALIDATOR ] FDX: Primary data validation passed. [2025-09-23T18:48:42.317520] [INFO ] [MAIN ] FDX: Fetched primary data is valid. [2025-09-23T18:48:42.317585] [DEBUG] [LOCAL ] FDX: Saving primary data. [2025-09-23T18:48:42.320328] [DEBUG] [LOCAL ] FDX: Trimmed 74423 records to 51622 (keeping 200 days of data) [2025-09-23T18:48:42.624190] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-07. [2025-09-23T18:48:42.669045] [DEBUG] [LOCAL ] FDX: Primary data saved (51622 records). [2025-09-23T18:48:42.669409] [INFO ] [MAIN ] FDX: Full history saved. [2025-09-23T18:48:42.669673] [INFO ] [MAIN ] Update Progress: 820/2372 symbols completed. FDX took 51.1s. Estimated remaining: 3h 25m 39s. Rate: 7.5 symbols/min [2025-09-23T18:48:42.794065] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-23T18:48:42.870411] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:48:42.879803] [DEBUG] [LOCAL ] FFA: Loaded 5609 existing records from primary storage. [2025-09-23T18:48:42.879921] [INFO ] [MAIN ] FFA: Loaded 5609 existing records. [2025-09-23T18:48:43.054616] [WARN ] [MAIN ] FFA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:48:43.054973] [INFO ] [MAIN ] FFA: Wiping existing primary data before full refresh. [2025-09-23T18:48:43.055065] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-09-23T18:48:43.055487] [DEBUG] [LOCAL ] FFA: Deleted primary data file. [2025-09-23T18:48:43.055546] [INFO ] [MAIN ] FFA: Starting full primary refresh. [2025-09-23T18:48:43.409234] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-09. [2025-09-23T18:48:43.417931] [INFO ] [REMOTE ] FFA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:48:44.052009] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-23T18:48:44.055409] [INFO ] [REMOTE ] FET: Full fetch complete (18147 records). [2025-09-23T18:48:44.055616] [DEBUG] [VALIDATOR ] FET: Validating primary data. [2025-09-23T18:48:44.205253] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-05. [2025-09-23T18:48:44.439698] [DEBUG] [VALIDATOR ] FET: All expected trading days are present. [2025-09-23T18:48:44.439891] [DEBUG] [VALIDATOR ] FET: Primary data validation passed. [2025-09-23T18:48:44.440419] [INFO ] [MAIN ] FET: Fetched primary data is valid. [2025-09-23T18:48:44.440587] [DEBUG] [LOCAL ] FET: Saving primary data. [2025-09-23T18:48:44.452627] [DEBUG] [LOCAL ] FET: Trimmed 18147 records to 12690 (keeping 200 days of data) [2025-09-23T18:48:44.480244] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-23T18:48:44.570318] [DEBUG] [LOCAL ] FET: Primary data saved (12690 records). [2025-09-23T18:48:44.570492] [INFO ] [MAIN ] FET: Full history saved. [2025-09-23T18:48:44.570613] [INFO ] [MAIN ] Update Progress: 821/2372 symbols completed. FET took 17.8s. Estimated remaining: 3h 25m 20s. Rate: 7.6 symbols/min [2025-09-23T18:48:44.751276] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:48:44.774933] [DEBUG] [LOCAL ] FFC: Loaded 16591 existing records from primary storage. [2025-09-23T18:48:44.775092] [INFO ] [MAIN ] FFC: Loaded 16591 existing records. [2025-09-23T18:48:44.958776] [WARN ] [MAIN ] FFC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:48:44.959139] [INFO ] [MAIN ] FFC: Wiping existing primary data before full refresh. [2025-09-23T18:48:44.959206] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-09-23T18:48:44.960437] [DEBUG] [LOCAL ] FFC: Deleted primary data file. [2025-09-23T18:48:44.960500] [INFO ] [MAIN ] FFC: Starting full primary refresh. [2025-09-23T18:48:45.014382] [INFO ] [REMOTE ] FFA: Fetching primary data for 2024-12. [2025-09-23T18:48:45.318612] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-23T18:48:45.355358] [INFO ] [REMOTE ] FFC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:48:45.488721] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-23T18:48:45.802252] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-06. [2025-09-23T18:48:46.602252] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-01. [2025-09-23T18:48:46.656106] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-23T18:48:47.360289] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-23T18:48:47.402162] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-02. [2025-09-23T18:48:47.977779] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-23T18:48:48.202216] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-08. [2025-09-23T18:48:49.002201] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-03. [2025-09-23T18:48:49.431505] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-23T18:48:49.679228] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-23T18:48:49.802172] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-09. [2025-09-23T18:48:50.602239] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-04. [2025-09-23T18:48:51.146497] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-23T18:48:51.402275] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-05. [2025-09-23T18:48:51.710135] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-23T18:48:51.721193] [INFO ] [REMOTE ] FERG: Full fetch complete (71049 records). [2025-09-23T18:48:51.721421] [DEBUG] [VALIDATOR ] FERG: Validating primary data. [2025-09-23T18:48:51.880512] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-23T18:48:52.175522] [DEBUG] [VALIDATOR ] FERG: All expected trading days are present. [2025-09-23T18:48:52.175667] [DEBUG] [VALIDATOR ] FERG: Primary data validation passed. [2025-09-23T18:48:52.176587] [INFO ] [MAIN ] FERG: Fetched primary data is valid. [2025-09-23T18:48:52.176672] [DEBUG] [LOCAL ] FERG: Saving primary data. [2025-09-23T18:48:52.178273] [DEBUG] [LOCAL ] FERG: Trimmed 71049 records to 49033 (keeping 200 days of data) [2025-09-23T18:48:52.248160] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-07. [2025-09-23T18:48:52.528956] [DEBUG] [LOCAL ] FERG: Primary data saved (49033 records). [2025-09-23T18:48:52.529094] [INFO ] [MAIN ] FERG: Full history saved. [2025-09-23T18:48:52.529178] [INFO ] [MAIN ] Update Progress: 822/2372 symbols completed. FERG took 38.9s. Estimated remaining: 3h 25m 12s. Rate: 7.6 symbols/min [2025-09-23T18:48:52.753704] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:48:52.797786] [DEBUG] [LOCAL ] FFWM: Loaded 36236 existing records from primary storage. [2025-09-23T18:48:52.797955] [INFO ] [MAIN ] FFWM: Loaded 36236 existing records. [2025-09-23T18:48:52.973099] [WARN ] [MAIN ] FFWM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:48:52.973321] [INFO ] [MAIN ] FFWM: Wiping existing primary data before full refresh. [2025-09-23T18:48:52.973369] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-09-23T18:48:52.974266] [DEBUG] [LOCAL ] FFWM: Deleted primary data file. [2025-09-23T18:48:52.974327] [INFO ] [MAIN ] FFWM: Starting full primary refresh. [2025-09-23T18:48:53.007387] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-06. [2025-09-23T18:48:53.333857] [INFO ] [REMOTE ] FFWM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:48:53.363757] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-23T18:48:53.410812] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-23T18:48:53.802218] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2024-12. [2025-09-23T18:48:54.602203] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-08. [2025-09-23T18:48:55.082845] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-23T18:48:55.402218] [INFO ] [REMOTE ] FFC: Fetching primary data for 2024-12. [2025-09-23T18:48:55.466916] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-23T18:48:56.202195] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-01. [2025-09-23T18:48:56.423748] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-23T18:48:57.002207] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-01. [2025-09-23T18:48:57.102321] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-23T18:48:57.802230] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-09. [2025-09-23T18:48:57.978084] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-23T18:48:58.607455] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-02. [2025-09-23T18:48:58.611030] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-23T18:48:58.615726] [INFO ] [REMOTE ] FF: Full fetch complete (37110 records). [2025-09-23T18:48:58.615890] [DEBUG] [VALIDATOR ] FF: Validating primary data. [2025-09-23T18:48:59.004876] [DEBUG] [VALIDATOR ] FF: All expected trading days are present. [2025-09-23T18:48:59.004981] [DEBUG] [VALIDATOR ] FF: Primary data validation passed. [2025-09-23T18:48:59.005663] [INFO ] [MAIN ] FF: Fetched primary data is valid. [2025-09-23T18:48:59.005727] [DEBUG] [LOCAL ] FF: Saving primary data. [2025-09-23T18:48:59.006620] [DEBUG] [LOCAL ] FF: Trimmed 37110 records to 25538 (keeping 200 days of data) [2025-09-23T18:48:59.161441] [DEBUG] [LOCAL ] FF: Primary data saved (25538 records). [2025-09-23T18:48:59.161575] [INFO ] [MAIN ] FF: Full history saved. [2025-09-23T18:48:59.161681] [INFO ] [MAIN ] Update Progress: 823/2372 symbols completed. FF took 28.3s. Estimated remaining: 3h 25m 2s. Rate: 7.6 symbols/min [2025-09-23T18:48:59.331306] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:48:59.351524] [DEBUG] [LOCAL ] FG: Loaded 22417 existing records from primary storage. [2025-09-23T18:48:59.351938] [INFO ] [MAIN ] FG: Loaded 22417 existing records. [2025-09-23T18:48:59.407682] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-07. [2025-09-23T18:48:59.536755] [WARN ] [MAIN ] FG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:48:59.537001] [INFO ] [MAIN ] FG: Wiping existing primary data before full refresh. [2025-09-23T18:48:59.537049] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-09-23T18:48:59.537807] [DEBUG] [LOCAL ] FG: Deleted primary data file. [2025-09-23T18:48:59.537869] [INFO ] [MAIN ] FG: Starting full primary refresh. [2025-09-23T18:48:59.779299] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-23T18:48:59.937574] [INFO ] [REMOTE ] FG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:49:00.070203] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-23T18:49:00.202238] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-02. [2025-09-23T18:49:01.002258] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-08. [2025-09-23T18:49:01.139103] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-23T18:49:01.598577] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-23T18:49:01.802293] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-03. [2025-09-23T18:49:02.602221] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-09. [2025-09-23T18:49:03.116306] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-23T18:49:03.118015] [INFO ] [REMOTE ] FFA: Full fetch complete (8181 records). [2025-09-23T18:49:03.118092] [DEBUG] [VALIDATOR ] FFA: Validating primary data. [2025-09-23T18:49:03.402624] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-03. [2025-09-23T18:49:03.562614] [DEBUG] [VALIDATOR ] FFA: All expected trading days are present. [2025-09-23T18:49:03.555538] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-23T18:49:03.569914] [DEBUG] [VALIDATOR ] FFA: Primary data validation passed. [2025-09-23T18:49:03.570329] [INFO ] [MAIN ] FFA: Fetched primary data is valid. [2025-09-23T18:49:03.570608] [DEBUG] [LOCAL ] FFA: Saving primary data. [2025-09-23T18:49:03.571503] [DEBUG] [LOCAL ] FFA: Trimmed 8181 records to 5632 (keeping 200 days of data) [2025-09-23T18:49:03.606875] [DEBUG] [LOCAL ] FFA: Primary data saved (5632 records). [2025-09-23T18:49:03.606976] [INFO ] [MAIN ] FFA: Full history saved. [2025-09-23T18:49:03.607061] [INFO ] [MAIN ] Update Progress: 824/2372 symbols completed. FFA took 20.9s. Estimated remaining: 3h 24m 47s. Rate: 7.6 symbols/min [2025-09-23T18:49:03.783268] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:49:03.789958] [DEBUG] [LOCAL ] FGN: Loaded 3942 existing records from primary storage. [2025-09-23T18:49:03.790080] [INFO ] [MAIN ] FGN: Loaded 3942 existing records. [2025-09-23T18:49:03.973629] [WARN ] [MAIN ] FGN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:49:03.973894] [INFO ] [MAIN ] FGN: Wiping existing primary data before full refresh. [2025-09-23T18:49:03.973969] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-09-23T18:49:03.974213] [DEBUG] [LOCAL ] FGN: Deleted primary data file. [2025-09-23T18:49:03.974272] [INFO ] [MAIN ] FGN: Starting full primary refresh. [2025-09-23T18:49:04.210879] [INFO ] [REMOTE ] FG: Fetching primary data for 2024-12. [2025-09-23T18:49:04.341365] [INFO ] [REMOTE ] FGN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:49:04.425489] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-23T18:49:05.002169] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-04. [2025-09-23T18:49:05.113450] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-23T18:49:05.802220] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-04. [2025-09-23T18:49:06.391675] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-23T18:49:06.602198] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-05. [2025-09-23T18:49:06.861765] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-23T18:49:07.402246] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-01. [2025-09-23T18:49:07.945911] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-23T18:49:07.960864] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-23T18:49:08.202194] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-06. [2025-09-23T18:49:09.002202] [INFO ] [REMOTE ] FGN: Fetching primary data for 2024-12. [2025-09-23T18:49:09.099699] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-23T18:49:09.570638] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-23T18:49:09.802225] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-05. [2025-09-23T18:49:10.599470] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-23T18:49:10.603516] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-07. [2025-09-23T18:49:11.402201] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-01. [2025-09-23T18:49:11.604768] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-23T18:49:11.977539] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-23T18:49:12.202220] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-08. [2025-09-23T18:49:13.002199] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-02. [2025-09-23T18:49:13.165950] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-23T18:49:13.467857] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-23T18:49:13.802198] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-02. [2025-09-23T18:49:14.602221] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-06. [2025-09-23T18:49:14.627089] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-23T18:49:15.311194] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-23T18:49:15.402186] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-07. [2025-09-23T18:49:16.202159] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-09. [2025-09-23T18:49:16.520813] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-23T18:49:17.002207] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-08. [2025-09-23T18:49:17.163031] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-23T18:49:17.168832] [INFO ] [REMOTE ] FFWM: Full fetch complete (51646 records). [2025-09-23T18:49:17.168947] [DEBUG] [VALIDATOR ] FFWM: Validating primary data. [2025-09-23T18:49:17.550331] [DEBUG] [VALIDATOR ] FFWM: All expected trading days are present. [2025-09-23T18:49:17.550436] [DEBUG] [VALIDATOR ] FFWM: Primary data validation passed. [2025-09-23T18:49:17.551112] [INFO ] [MAIN ] FFWM: Fetched primary data is valid. [2025-09-23T18:49:17.551176] [DEBUG] [LOCAL ] FFWM: Saving primary data. [2025-09-23T18:49:17.552276] [DEBUG] [LOCAL ] FFWM: Trimmed 51646 records to 36225 (keeping 200 days of data) [2025-09-23T18:49:17.756086] [DEBUG] [LOCAL ] FFWM: Primary data saved (36225 records). [2025-09-23T18:49:17.756244] [INFO ] [MAIN ] FFWM: Full history saved. [2025-09-23T18:49:17.756346] [INFO ] [MAIN ] Update Progress: 825/2372 symbols completed. FFWM took 25.2s. Estimated remaining: 3h 24m 51s. Rate: 7.6 symbols/min [2025-09-23T18:49:17.809063] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-03. [2025-09-23T18:49:17.930962] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:49:17.931132] [DEBUG] [LOCAL ] FGSN: No existing data file found in primary storage. [2025-09-23T18:49:17.931167] [WARN ] [MAIN ] FGSN: No existing data found, performing full refresh instead. [2025-09-23T18:49:17.931310] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-09-23T18:49:17.931351] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-09-23T18:49:17.931391] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-09-23T18:49:17.931423] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-09-23T18:49:18.048690] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-23T18:49:18.306094] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:49:18.436400] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-23T18:49:18.602206] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-03. [2025-09-23T18:49:19.402207] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-09. [2025-09-23T18:49:19.856691] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-23T18:49:20.178272] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-23T18:49:20.182752] [INFO ] [REMOTE ] FFC: Full fetch complete (24718 records). [2025-09-23T18:49:20.182848] [DEBUG] [VALIDATOR ] FFC: Validating primary data. [2025-09-23T18:49:20.211703] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-04. [2025-09-23T18:49:20.563403] [DEBUG] [VALIDATOR ] FFC: All expected trading days are present. [2025-09-23T18:49:20.563519] [DEBUG] [VALIDATOR ] FFC: Primary data validation passed. [2025-09-23T18:49:20.564028] [INFO ] [MAIN ] FFC: Fetched primary data is valid. [2025-09-23T18:49:20.564090] [DEBUG] [LOCAL ] FFC: Saving primary data. [2025-09-23T18:49:20.564739] [DEBUG] [LOCAL ] FFC: Trimmed 24718 records to 16600 (keeping 200 days of data) [2025-09-23T18:49:20.670912] [DEBUG] [LOCAL ] FFC: Primary data saved (16600 records). [2025-09-23T18:49:20.671077] [INFO ] [MAIN ] FFC: Full history saved. [2025-09-23T18:49:20.671182] [INFO ] [MAIN ] Update Progress: 826/2372 symbols completed. FFC took 36.1s. Estimated remaining: 3h 24m 33s. Rate: 7.6 symbols/min [2025-09-23T18:49:20.846683] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:49:20.860203] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-23T18:49:20.896636] [DEBUG] [LOCAL ] FHI: Loaded 40812 existing records from primary storage. [2025-09-23T18:49:20.896841] [INFO ] [MAIN ] FHI: Loaded 40812 existing records. [2025-09-23T18:49:21.006450] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-04. [2025-09-23T18:49:21.104768] [WARN ] [MAIN ] FHI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:49:21.105086] [INFO ] [MAIN ] FHI: Wiping existing primary data before full refresh. [2025-09-23T18:49:21.105185] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-09-23T18:49:21.106451] [DEBUG] [LOCAL ] FHI: Deleted primary data file. [2025-09-23T18:49:21.106529] [INFO ] [MAIN ] FHI: Starting full primary refresh. [2025-09-23T18:49:21.501708] [INFO ] [REMOTE ] FHI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:49:21.802196] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2024-12. [2025-09-23T18:49:22.000025] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-23T18:49:22.025093] [DEBUG] [REMOTE ] FGSN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:49:22.025499] [WARN ] [REMOTE ] FGSN: No data returned for month 2024-12 [2025-09-23T18:49:22.602206] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-01. [2025-09-23T18:49:23.071216] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-23T18:49:23.402226] [INFO ] [REMOTE ] FHI: Fetching primary data for 2024-12. [2025-09-23T18:49:24.202232] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-05. [2025-09-23T18:49:24.578437] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-23T18:49:24.776941] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-23T18:49:25.002199] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-02. [2025-09-23T18:49:25.392974] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-23T18:49:25.802237] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-05. [2025-09-23T18:49:26.602182] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-06. [2025-09-23T18:49:27.056925] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-23T18:49:27.218766] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-23T18:49:27.402227] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-06. [2025-09-23T18:49:28.202184] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-07. [2025-09-23T18:49:28.292872] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-23T18:49:28.573124] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-23T18:49:29.002229] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-08. [2025-09-23T18:49:29.361891] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-23T18:49:29.802246] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-07. [2025-09-23T18:49:30.469969] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-23T18:49:30.602210] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-01. [2025-09-23T18:49:31.402185] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-03. [2025-09-23T18:49:31.645744] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-23T18:49:31.981171] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-23T18:49:32.202255] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-08. [2025-09-23T18:49:33.002221] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-09. [2025-09-23T18:49:33.198530] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-23T18:49:33.435789] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-23T18:49:33.436923] [INFO ] [REMOTE ] FGN: Full fetch complete (5757 records). [2025-09-23T18:49:33.436995] [DEBUG] [VALIDATOR ] FGN: Validating primary data. [2025-09-23T18:49:33.807274] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-04. [2025-09-23T18:49:33.815368] [DEBUG] [VALIDATOR ] FGN: All expected trading days are present. [2025-09-23T18:49:33.816283] [DEBUG] [VALIDATOR ] FGN: Primary data validation passed. [2025-09-23T18:49:33.816483] [INFO ] [MAIN ] FGN: Fetched primary data is valid. [2025-09-23T18:49:33.816526] [DEBUG] [LOCAL ] FGN: Saving primary data. [2025-09-23T18:49:33.817024] [DEBUG] [LOCAL ] FGN: Trimmed 5757 records to 3923 (keeping 200 days of data) [2025-09-23T18:49:33.843366] [DEBUG] [LOCAL ] FGN: Primary data saved (3923 records). [2025-09-23T18:49:33.843476] [INFO ] [MAIN ] FGN: Full history saved. [2025-09-23T18:49:33.843559] [INFO ] [MAIN ] Update Progress: 827/2372 symbols completed. FGN took 30.2s. Estimated remaining: 3h 24m 35s. Rate: 7.6 symbols/min [2025-09-23T18:49:34.031614] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:49:34.087614] [DEBUG] [LOCAL ] FHN: Loaded 53369 existing records from primary storage. [2025-09-23T18:49:34.087813] [INFO ] [MAIN ] FHN: Loaded 53369 existing records. [2025-09-23T18:49:34.278387] [WARN ] [MAIN ] FHN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:49:34.278709] [INFO ] [MAIN ] FHN: Wiping existing primary data before full refresh. [2025-09-23T18:49:34.278767] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-09-23T18:49:34.280626] [DEBUG] [LOCAL ] FHN: Deleted primary data file. [2025-09-23T18:49:34.280724] [INFO ] [MAIN ] FHN: Starting full primary refresh. [2025-09-23T18:49:34.586311] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-23T18:49:34.616721] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-09. [2025-09-23T18:49:34.657611] [INFO ] [REMOTE ] FHN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:49:35.402194] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-02. [2025-09-23T18:49:35.753137] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-23T18:49:35.757482] [INFO ] [REMOTE ] FG: Full fetch complete (27150 records). [2025-09-23T18:49:35.757628] [DEBUG] [VALIDATOR ] FG: Validating primary data. [2025-09-23T18:49:36.159289] [DEBUG] [VALIDATOR ] FG: All expected trading days are present. [2025-09-23T18:49:36.159439] [DEBUG] [VALIDATOR ] FG: Primary data validation passed. [2025-09-23T18:49:36.160321] [INFO ] [MAIN ] FG: Fetched primary data is valid. [2025-09-23T18:49:36.160389] [DEBUG] [LOCAL ] FG: Saving primary data. [2025-09-23T18:49:36.161595] [DEBUG] [LOCAL ] FG: Trimmed 27150 records to 22512 (keeping 200 days of data) [2025-09-23T18:49:36.216560] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-05. [2025-09-23T18:49:36.309178] [DEBUG] [LOCAL ] FG: Primary data saved (22512 records). [2025-09-23T18:49:36.309361] [INFO ] [MAIN ] FG: Full history saved. [2025-09-23T18:49:36.309468] [INFO ] [MAIN ] Update Progress: 828/2372 symbols completed. FG took 37.1s. Estimated remaining: 3h 24m 17s. Rate: 7.6 symbols/min [2025-09-23T18:49:36.491757] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:49:36.518534] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-23T18:49:36.579157] [DEBUG] [LOCAL ] FI: Loaded 53506 existing records from primary storage. [2025-09-23T18:49:36.579401] [INFO ] [MAIN ] FI: Loaded 53506 existing records. [2025-09-23T18:49:36.686915] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-23T18:49:36.775245] [WARN ] [MAIN ] FI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:49:36.775581] [INFO ] [MAIN ] FI: Wiping existing primary data before full refresh. [2025-09-23T18:49:36.775632] [INFO ] [LOCAL ] FI: Starting deletion of primary data. [2025-09-23T18:49:36.777384] [DEBUG] [LOCAL ] FI: Deleted primary data file. [2025-09-23T18:49:36.777446] [INFO ] [MAIN ] FI: Starting full primary refresh. [2025-09-23T18:49:37.007423] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-03. [2025-09-23T18:49:37.137737] [INFO ] [REMOTE ] FI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:49:37.802206] [INFO ] [REMOTE ] FHN: Fetching primary data for 2024-12. [2025-09-23T18:49:38.582696] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-23T18:49:38.602154] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-04. [2025-09-23T18:49:39.200620] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-23T18:49:39.402208] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-01. [2025-09-23T18:49:40.158495] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-23T18:49:40.202289] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-05. [2025-09-23T18:49:41.002162] [INFO ] [REMOTE ] FI: Fetching primary data for 2024-12. [2025-09-23T18:49:41.108988] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-23T18:49:41.316798] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-23T18:49:41.802196] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-06. [2025-09-23T18:49:42.333299] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-23T18:49:42.447431] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-23T18:49:42.602214] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-07. [2025-09-23T18:49:43.158238] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-23T18:49:43.402243] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-08. [2025-09-23T18:49:43.817031] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-23T18:49:44.202258] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-09. [2025-09-23T18:49:44.944115] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-23T18:49:44.945520] [INFO ] [REMOTE ] FGSN: Full fetch complete (7531 records). [2025-09-23T18:49:44.945592] [DEBUG] [VALIDATOR ] FGSN: Validating primary data. [2025-09-23T18:49:45.008620] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-01. [2025-09-23T18:49:45.137071] [WARN ] [VALIDATOR ] FGSN: Validation failed - insufficient historical data. Have 170 unique days, need 200 days [2025-09-23T18:49:45.137757] [FATAL] [MAIN ] FGSN: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:49:45.137827] [WARN ] [MAIN ] FGSN: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:49:45.137896] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-09-23T18:49:45.137961] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-09-23T18:49:45.137997] [INFO ] [LOCAL ] FGSN: Starting deletion of derivative data. [2025-09-23T18:49:45.138048] [DEBUG] [LOCAL ] FGSN: No derivative data file found to delete. [2025-09-23T18:49:45.138129] [INFO ] [MAIN ] Update Progress: 829/2372 symbols completed. FGSN took 27.4s. Estimated remaining: 3h 24m 11s. Rate: 7.6 symbols/min [2025-09-23T18:49:45.308532] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:49:45.330859] [DEBUG] [LOCAL ] FICO: Loaded 20499 existing records from primary storage. [2025-09-23T18:49:45.331035] [INFO ] [MAIN ] FICO: Loaded 20499 existing records. [2025-09-23T18:49:45.510211] [WARN ] [MAIN ] FICO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:49:45.510543] [INFO ] [MAIN ] FICO: Wiping existing primary data before full refresh. [2025-09-23T18:49:45.510597] [INFO ] [LOCAL ] FICO: Starting deletion of primary data. [2025-09-23T18:49:45.511234] [DEBUG] [LOCAL ] FICO: Deleted primary data file. [2025-09-23T18:49:45.511294] [INFO ] [MAIN ] FICO: Starting full primary refresh. [2025-09-23T18:49:45.807313] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-02. [2025-09-23T18:49:45.874860] [INFO ] [REMOTE ] FICO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:49:46.375699] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-23T18:49:46.602224] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-02. [2025-09-23T18:49:47.312086] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-23T18:49:47.402161] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-03. [2025-09-23T18:49:48.202206] [INFO ] [REMOTE ] FICO: Fetching primary data for 2024-12. [2025-09-23T18:49:48.328592] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-23T18:49:48.711953] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-23T18:49:48.838897] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-23T18:49:49.002168] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-06. [2025-09-23T18:49:49.802213] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-03. [2025-09-23T18:49:50.507420] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-23T18:49:50.602152] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-07. [2025-09-23T18:49:51.213346] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-23T18:49:51.402188] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-04. [2025-09-23T18:49:51.750241] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-23T18:49:52.202261] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-01. [2025-09-23T18:49:52.983637] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-23T18:49:53.002163] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-02. [2025-09-23T18:49:53.361133] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-23T18:49:53.802199] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-04. [2025-09-23T18:49:53.821974] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-23T18:49:54.602207] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-03. [2025-09-23T18:49:55.266201] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-23T18:49:55.364546] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-23T18:49:55.402145] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-04. [2025-09-23T18:49:56.202192] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-05. [2025-09-23T18:49:56.564875] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-23T18:49:57.002221] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-05. [2025-09-23T18:49:57.779997] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-23T18:49:57.802182] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-06. [2025-09-23T18:49:58.472494] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-23T18:49:58.602251] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-05. [2025-09-23T18:49:59.402242] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-08. [2025-09-23T18:49:59.709443] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-23T18:49:59.902174] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-23T18:50:00.202265] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-06. [2025-09-23T18:50:00.752539] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-23T18:50:01.002258] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-09. [2025-09-23T18:50:01.198418] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-23T18:50:01.802276] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-07. [2025-09-23T18:50:02.231861] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-23T18:50:02.238912] [INFO ] [REMOTE ] FHI: Full fetch complete (57911 records). [2025-09-23T18:50:02.239093] [DEBUG] [VALIDATOR ] FHI: Validating primary data. [2025-09-23T18:50:02.628860] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-06. [2025-09-23T18:50:02.651007] [DEBUG] [VALIDATOR ] FHI: All expected trading days are present. [2025-09-23T18:50:02.651127] [DEBUG] [VALIDATOR ] FHI: Primary data validation passed. [2025-09-23T18:50:02.652093] [INFO ] [MAIN ] FHI: Fetched primary data is valid. [2025-09-23T18:50:02.652163] [DEBUG] [LOCAL ] FHI: Saving primary data. [2025-09-23T18:50:02.653854] [DEBUG] [LOCAL ] FHI: Trimmed 57911 records to 40816 (keeping 200 days of data) [2025-09-23T18:50:02.914391] [DEBUG] [LOCAL ] FHI: Primary data saved (40816 records). [2025-09-23T18:50:02.914520] [INFO ] [MAIN ] FHI: Full history saved. [2025-09-23T18:50:02.914618] [INFO ] [MAIN ] Update Progress: 830/2372 symbols completed. FHI took 42.2s. Estimated remaining: 3h 24m 21s. Rate: 7.5 symbols/min [2025-09-23T18:50:03.086302] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:50:03.086506] [DEBUG] [LOCAL ] FIG: No existing data file found in primary storage. [2025-09-23T18:50:03.086564] [WARN ] [MAIN ] FIG: No existing data found, performing full refresh instead. [2025-09-23T18:50:03.086741] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-09-23T18:50:03.086793] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-09-23T18:50:03.086838] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-09-23T18:50:03.086874] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-09-23T18:50:03.415121] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-07. [2025-09-23T18:50:03.463954] [INFO ] [REMOTE ] FIG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:50:03.878445] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-23T18:50:03.971999] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-23T18:50:04.202239] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-07. [2025-09-23T18:50:04.512103] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-23T18:50:05.002263] [INFO ] [REMOTE ] FIG: Fetching primary data for 2024-12. [2025-09-23T18:50:05.327194] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-09-23T18:50:05.802204] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-01. [2025-09-23T18:50:06.041345] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-01 (0.24 seconds). [2025-09-23T18:50:06.043870] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-23T18:50:06.602232] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-08. [2025-09-23T18:50:07.402201] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-08. [2025-09-23T18:50:08.002820] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-23T18:50:08.202238] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-09-23T18:50:08.528467] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-23T18:50:08.872076] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-23T18:50:09.002428] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-09-23T18:50:09.260498] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (0.26 seconds). [2025-09-23T18:50:09.802226] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-09-23T18:50:10.092022] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-09-23T18:50:10.602209] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-09. [2025-09-23T18:50:11.402229] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-09-23T18:50:11.541219] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-23T18:50:11.545112] [INFO ] [REMOTE ] FICO: Full fetch complete (28356 records). [2025-09-23T18:50:11.545272] [DEBUG] [VALIDATOR ] FICO: Validating primary data. [2025-09-23T18:50:11.708222] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-23T18:50:11.948524] [DEBUG] [VALIDATOR ] FICO: All expected trading days are present. [2025-09-23T18:50:11.948700] [DEBUG] [VALIDATOR ] FICO: Primary data validation passed. [2025-09-23T18:50:11.949286] [INFO ] [MAIN ] FICO: Fetched primary data is valid. [2025-09-23T18:50:11.949335] [DEBUG] [LOCAL ] FICO: Saving primary data. [2025-09-23T18:50:11.950068] [DEBUG] [LOCAL ] FICO: Trimmed 28356 records to 20466 (keeping 200 days of data) [2025-09-23T18:50:12.078855] [DEBUG] [LOCAL ] FICO: Primary data saved (20466 records). [2025-09-23T18:50:12.078983] [INFO ] [MAIN ] FICO: Full history saved. [2025-09-23T18:50:12.079062] [INFO ] [MAIN ] Update Progress: 831/2372 symbols completed. FICO took 26.9s. Estimated remaining: 3h 24m 15s. Rate: 7.5 symbols/min [2025-09-23T18:50:12.217046] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-08. [2025-09-23T18:50:12.249812] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:50:12.296459] [DEBUG] [LOCAL ] FIGS: Loaded 48969 existing records from primary storage. [2025-09-23T18:50:12.296624] [INFO ] [MAIN ] FIGS: Loaded 48969 existing records. [2025-09-23T18:50:12.481995] [WARN ] [MAIN ] FIGS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:50:12.482282] [INFO ] [MAIN ] FIGS: Wiping existing primary data before full refresh. [2025-09-23T18:50:12.482332] [INFO ] [LOCAL ] FIGS: Starting deletion of primary data. [2025-09-23T18:50:12.483403] [DEBUG] [LOCAL ] FIGS: Deleted primary data file. [2025-09-23T18:50:12.483465] [INFO ] [MAIN ] FIGS: Starting full primary refresh. [2025-09-23T18:50:12.898021] [INFO ] [REMOTE ] FIGS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:50:13.002188] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2024-12. [2025-09-23T18:50:13.802168] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-09-23T18:50:13.876371] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-23T18:50:14.002803] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:50:14.003178] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-09-23T18:50:14.314330] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-23T18:50:14.602198] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-07. [2025-09-23T18:50:14.956250] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-23T18:50:15.402195] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-09. [2025-09-23T18:50:16.202187] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-09. [2025-09-23T18:50:17.002226] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-08. [2025-09-23T18:50:17.292679] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-23T18:50:17.302041] [INFO ] [REMOTE ] FHN: Full fetch complete (77276 records). [2025-09-23T18:50:17.302192] [DEBUG] [VALIDATOR ] FHN: Validating primary data. [2025-09-23T18:50:17.695100] [DEBUG] [VALIDATOR ] FHN: All expected trading days are present. [2025-09-23T18:50:17.695191] [DEBUG] [VALIDATOR ] FHN: Primary data validation passed. [2025-09-23T18:50:17.696090] [INFO ] [MAIN ] FHN: Fetched primary data is valid. [2025-09-23T18:50:17.696155] [DEBUG] [LOCAL ] FHN: Saving primary data. [2025-09-23T18:50:17.697681] [DEBUG] [LOCAL ] FHN: Trimmed 77276 records to 53369 (keeping 200 days of data) [2025-09-23T18:50:17.802777] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-01. [2025-09-23T18:50:17.841785] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-23T18:50:17.854157] [INFO ] [REMOTE ] FI: Full fetch complete (77160 records). [2025-09-23T18:50:17.855557] [DEBUG] [VALIDATOR ] FI: Validating primary data. [2025-09-23T18:50:18.484360] [DEBUG] [VALIDATOR ] FI: All expected trading days are present. [2025-09-23T18:50:18.484803] [DEBUG] [VALIDATOR ] FI: Primary data validation passed. [2025-09-23T18:50:18.486038] [INFO ] [MAIN ] FI: Fetched primary data is valid. [2025-09-23T18:50:18.486471] [DEBUG] [LOCAL ] FI: Saving primary data. [2025-09-23T18:50:18.491405] [DEBUG] [LOCAL ] FI: Trimmed 77160 records to 53505 (keeping 200 days of data) [2025-09-23T18:50:18.616857] [DEBUG] [LOCAL ] FHN: Primary data saved (53369 records). [2025-09-23T18:50:18.618131] [INFO ] [MAIN ] FHN: Full history saved. [2025-09-23T18:50:18.618839] [INFO ] [MAIN ] Update Progress: 832/2372 symbols completed. FHN took 44.8s. Estimated remaining: 3h 24m 5s. Rate: 7.5 symbols/min [2025-09-23T18:50:18.811480] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:50:18.978915] [DEBUG] [LOCAL ] FIHL: Loaded 40389 existing records from primary storage. [2025-09-23T18:50:19.019848] [INFO ] [MAIN ] FIHL: Loaded 40389 existing records. [2025-09-23T18:50:19.148944] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-23T18:50:19.208436] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-02. [2025-09-23T18:50:19.301804] [WARN ] [MAIN ] FIHL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:50:19.306611] [INFO ] [MAIN ] FIHL: Wiping existing primary data before full refresh. [2025-09-23T18:50:19.307895] [INFO ] [LOCAL ] FIHL: Starting deletion of primary data. [2025-09-23T18:50:19.310794] [DEBUG] [LOCAL ] FIHL: Deleted primary data file. [2025-09-23T18:50:19.311415] [INFO ] [MAIN ] FIHL: Starting full primary refresh. [2025-09-23T18:50:19.429353] [DEBUG] [LOCAL ] FI: Primary data saved (53505 records). [2025-09-23T18:50:19.435351] [INFO ] [MAIN ] FI: Full history saved. [2025-09-23T18:50:19.435542] [INFO ] [MAIN ] Update Progress: 833/2372 symbols completed. FI took 43.1s. Estimated remaining: 3h 23m 44s. Rate: 7.6 symbols/min [2025-09-23T18:50:19.809365] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:50:19.893721] [INFO ] [REMOTE ] FIHL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:50:19.896419] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2024-12. [2025-09-23T18:50:19.902005] [DEBUG] [LOCAL ] FINS: Loaded 8193 existing records from primary storage. [2025-09-23T18:50:19.902232] [INFO ] [MAIN ] FINS: Loaded 8193 existing records. [2025-09-23T18:50:20.117663] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-08 (3.12 seconds). [2025-09-23T18:50:20.123688] [WARN ] [MAIN ] FINS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:50:20.135499] [INFO ] [MAIN ] FINS: Wiping existing primary data before full refresh. [2025-09-23T18:50:20.135572] [INFO ] [LOCAL ] FINS: Starting deletion of primary data. [2025-09-23T18:50:20.136121] [DEBUG] [LOCAL ] FINS: Deleted primary data file. [2025-09-23T18:50:20.136206] [INFO ] [MAIN ] FINS: Starting full primary refresh. [2025-09-23T18:50:20.211098] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-09. [2025-09-23T18:50:20.498528] [INFO ] [REMOTE ] FINS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:50:20.810333] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-23T18:50:20.844022] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-23T18:50:21.002207] [INFO ] [REMOTE ] FINS: Fetching primary data for 2024-12. [2025-09-23T18:50:21.619876] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-23T18:50:21.802195] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-01. [2025-09-23T18:50:22.556288] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-23T18:50:22.602144] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-02. [2025-09-23T18:50:22.941461] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-09 (2.73 seconds). [2025-09-23T18:50:22.950032] [INFO ] [REMOTE ] FIG: Full fetch complete (15024 records). [2025-09-23T18:50:22.950113] [DEBUG] [VALIDATOR ] FIG: Validating primary data. [2025-09-23T18:50:23.132246] [WARN ] [VALIDATOR ] FIG: Validation failed - insufficient historical data. Have 145 unique days, need 200 days [2025-09-23T18:50:23.132577] [FATAL] [MAIN ] FIG: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:50:23.132696] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:50:23.132790] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-09-23T18:50:23.132874] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-09-23T18:50:23.132914] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-09-23T18:50:23.132978] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-09-23T18:50:23.133061] [INFO ] [MAIN ] Update Progress: 834/2372 symbols completed. FIG took 20.2s. Estimated remaining: 3h 23m 28s. Rate: 7.6 symbols/min [2025-09-23T18:50:23.260689] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-23T18:50:23.323223] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:50:23.366918] [DEBUG] [LOCAL ] FINV: Loaded 45117 existing records from primary storage. [2025-09-23T18:50:23.367072] [INFO ] [MAIN ] FINV: Loaded 45117 existing records. [2025-09-23T18:50:23.407304] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-03. [2025-09-23T18:50:23.572554] [WARN ] [MAIN ] FINV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:50:23.572845] [INFO ] [MAIN ] FINV: Wiping existing primary data before full refresh. [2025-09-23T18:50:23.572898] [INFO ] [LOCAL ] FINV: Starting deletion of primary data. [2025-09-23T18:50:23.574084] [DEBUG] [LOCAL ] FINV: Deleted primary data file. [2025-09-23T18:50:23.574162] [INFO ] [MAIN ] FINV: Starting full primary refresh. [2025-09-23T18:50:23.949282] [INFO ] [REMOTE ] FINV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:50:24.092888] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-23T18:50:24.202201] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-03. [2025-09-23T18:50:25.002214] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-01. [2025-09-23T18:50:25.802202] [INFO ] [REMOTE ] FINV: Fetching primary data for 2024-12. [2025-09-23T18:50:25.947195] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-23T18:50:26.321720] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-23T18:50:26.602205] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-04. [2025-09-23T18:50:26.878580] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-23T18:50:27.402197] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-02. [2025-09-23T18:50:27.814277] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-23T18:50:28.202192] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-05. [2025-09-23T18:50:28.300070] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-23T18:50:29.002196] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-03. [2025-09-23T18:50:29.517517] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-23T18:50:29.802197] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-04. [2025-09-23T18:50:30.291956] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-23T18:50:30.572610] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-23T18:50:30.602156] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-04. [2025-09-23T18:50:31.402232] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-01. [2025-09-23T18:50:32.134303] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-23T18:50:32.202231] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-05. [2025-09-23T18:50:32.489636] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-23T18:50:33.002226] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-05. [2025-09-23T18:50:33.265916] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-23T18:50:33.503634] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-23T18:50:33.802225] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-06. [2025-09-23T18:50:34.602196] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-06. [2025-09-23T18:50:34.861281] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-23T18:50:35.402197] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-02. [2025-09-23T18:50:36.005528] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-23T18:50:36.202205] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-07. [2025-09-23T18:50:37.002206] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-07. [2025-09-23T18:50:37.094266] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-23T18:50:37.262989] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-23T18:50:37.801473] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-23T18:50:37.803984] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-03. [2025-09-23T18:50:38.602215] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-08. [2025-09-23T18:50:39.352834] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-23T18:50:39.381273] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-23T18:50:39.402148] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-04. [2025-09-23T18:50:40.202190] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-09. [2025-09-23T18:50:40.708561] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-23T18:50:40.710372] [INFO ] [REMOTE ] FINS: Full fetch complete (12772 records). [2025-09-23T18:50:40.710492] [DEBUG] [VALIDATOR ] FINS: Validating primary data. [2025-09-23T18:50:41.007321] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-06. [2025-09-23T18:50:41.092286] [DEBUG] [VALIDATOR ] FINS: All expected trading days are present. [2025-09-23T18:50:41.092399] [DEBUG] [VALIDATOR ] FINS: Primary data validation passed. [2025-09-23T18:50:41.092847] [INFO ] [MAIN ] FINS: Fetched primary data is valid. [2025-09-23T18:50:41.092920] [DEBUG] [LOCAL ] FINS: Saving primary data. [2025-09-23T18:50:41.093477] [DEBUG] [LOCAL ] FINS: Trimmed 12772 records to 8218 (keeping 200 days of data) [2025-09-23T18:50:41.149601] [DEBUG] [LOCAL ] FINS: Primary data saved (8218 records). [2025-09-23T18:50:41.149756] [INFO ] [MAIN ] FINS: Full history saved. [2025-09-23T18:50:41.149905] [INFO ] [MAIN ] Update Progress: 835/2372 symbols completed. FINS took 21.7s. Estimated remaining: 3h 23m 39s. Rate: 7.5 symbols/min [2025-09-23T18:50:41.329889] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:50:41.362613] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-23T18:50:41.429336] [DEBUG] [LOCAL ] FIS: Loaded 53366 existing records from primary storage. [2025-09-23T18:50:41.429494] [INFO ] [MAIN ] FIS: Loaded 53366 existing records. [2025-09-23T18:50:41.605766] [WARN ] [MAIN ] FIS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:50:41.606025] [INFO ] [MAIN ] FIS: Wiping existing primary data before full refresh. [2025-09-23T18:50:41.606086] [INFO ] [LOCAL ] FIS: Starting deletion of primary data. [2025-09-23T18:50:41.607291] [DEBUG] [LOCAL ] FIS: Deleted primary data file. [2025-09-23T18:50:41.607352] [INFO ] [MAIN ] FIS: Starting full primary refresh. [2025-09-23T18:50:41.812096] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-08. [2025-09-23T18:50:41.960521] [INFO ] [REMOTE ] FIS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:50:42.602191] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-05. [2025-09-23T18:50:42.735349] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-23T18:50:43.364378] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-23T18:50:43.402182] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-09. [2025-09-23T18:50:43.668408] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-23T18:50:44.202206] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-07. [2025-09-23T18:50:44.580434] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-23T18:50:44.588557] [INFO ] [REMOTE ] FIHL: Full fetch complete (55853 records). [2025-09-23T18:50:44.588787] [DEBUG] [VALIDATOR ] FIHL: Validating primary data. [2025-09-23T18:50:44.985093] [DEBUG] [VALIDATOR ] FIHL: All expected trading days are present. [2025-09-23T18:50:44.985197] [DEBUG] [VALIDATOR ] FIHL: Primary data validation passed. [2025-09-23T18:50:44.985968] [INFO ] [MAIN ] FIHL: Fetched primary data is valid. [2025-09-23T18:50:44.986061] [DEBUG] [LOCAL ] FIHL: Saving primary data. [2025-09-23T18:50:44.987472] [DEBUG] [LOCAL ] FIHL: Trimmed 55853 records to 40370 (keeping 200 days of data) [2025-09-23T18:50:45.050432] [INFO ] [REMOTE ] FIS: Fetching primary data for 2024-12. [2025-09-23T18:50:45.260966] [DEBUG] [LOCAL ] FIHL: Primary data saved (40370 records). [2025-09-23T18:50:45.261218] [INFO ] [MAIN ] FIHL: Full history saved. [2025-09-23T18:50:45.261467] [INFO ] [MAIN ] Update Progress: 836/2372 symbols completed. FIHL took 26.6s. Estimated remaining: 3h 23m 24s. Rate: 7.6 symbols/min [2025-09-23T18:50:45.447214] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:50:45.522668] [DEBUG] [LOCAL ] FIX: Loaded 30683 existing records from primary storage. [2025-09-23T18:50:45.522858] [INFO ] [MAIN ] FIX: Loaded 30683 existing records. [2025-09-23T18:50:45.590945] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-23T18:50:45.719255] [WARN ] [MAIN ] FIX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:50:45.719521] [INFO ] [MAIN ] FIX: Wiping existing primary data before full refresh. [2025-09-23T18:50:45.719585] [INFO ] [LOCAL ] FIX: Starting deletion of primary data. [2025-09-23T18:50:45.720387] [DEBUG] [LOCAL ] FIX: Deleted primary data file. [2025-09-23T18:50:45.720468] [INFO ] [MAIN ] FIX: Starting full primary refresh. [2025-09-23T18:50:45.807337] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-06. [2025-09-23T18:50:46.115722] [INFO ] [REMOTE ] FIX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:50:46.479701] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-23T18:50:46.602166] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-01. [2025-09-23T18:50:46.928965] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-23T18:50:47.402201] [INFO ] [REMOTE ] FIX: Fetching primary data for 2024-12. [2025-09-23T18:50:47.975834] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-23T18:50:48.202162] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-02. [2025-09-23T18:50:48.611526] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-23T18:50:49.002204] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-01. [2025-09-23T18:50:49.638357] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-23T18:50:49.802173] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-03. [2025-09-23T18:50:50.457780] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-23T18:50:50.602202] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-02. [2025-09-23T18:50:51.402201] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-07. [2025-09-23T18:50:51.607475] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-23T18:50:52.121311] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-23T18:50:52.202147] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-03. [2025-09-23T18:50:52.966304] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-23T18:50:53.002155] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-08. [2025-09-23T18:50:53.802258] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-04. [2025-09-23T18:50:53.841088] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-23T18:50:54.350867] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-23T18:50:54.602249] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-08. [2025-09-23T18:50:55.411272] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-09. [2025-09-23T18:50:55.417344] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-23T18:50:55.902502] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-23T18:50:56.202199] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-05. [2025-09-23T18:50:57.002313] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-09. [2025-09-23T18:50:57.062768] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-23T18:50:57.075302] [INFO ] [REMOTE ] FINV: Full fetch complete (63512 records). [2025-09-23T18:50:57.075564] [DEBUG] [VALIDATOR ] FINV: Validating primary data. [2025-09-23T18:50:57.494122] [DEBUG] [VALIDATOR ] FINV: All expected trading days are present. [2025-09-23T18:50:57.494270] [DEBUG] [VALIDATOR ] FINV: Primary data validation passed. [2025-09-23T18:50:57.495128] [INFO ] [MAIN ] FINV: Fetched primary data is valid. [2025-09-23T18:50:57.495194] [DEBUG] [LOCAL ] FINV: Saving primary data. [2025-09-23T18:50:57.496730] [DEBUG] [LOCAL ] FINV: Trimmed 63512 records to 45120 (keeping 200 days of data) [2025-09-23T18:50:57.655207] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-23T18:50:57.811707] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-04. [2025-09-23T18:50:57.830894] [DEBUG] [LOCAL ] FINV: Primary data saved (45120 records). [2025-09-23T18:50:57.831017] [INFO ] [MAIN ] FINV: Full history saved. [2025-09-23T18:50:57.831144] [INFO ] [MAIN ] Update Progress: 837/2372 symbols completed. FINV took 34.7s. Estimated remaining: 3h 23m 24s. Rate: 7.5 symbols/min [2025-09-23T18:50:58.397252] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-23T18:50:58.405517] [INFO ] [REMOTE ] FIGS: Full fetch complete (71049 records). [2025-09-23T18:50:58.405678] [DEBUG] [VALIDATOR ] FIGS: Validating primary data. [2025-09-23T18:50:58.629810] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-06. [2025-09-23T18:50:58.802738] [DEBUG] [VALIDATOR ] FIGS: All expected trading days are present. [2025-09-23T18:50:58.802846] [DEBUG] [VALIDATOR ] FIGS: Primary data validation passed. [2025-09-23T18:50:58.803756] [INFO ] [MAIN ] FIGS: Fetched primary data is valid. [2025-09-23T18:50:58.803825] [DEBUG] [LOCAL ] FIGS: Saving primary data. [2025-09-23T18:50:58.805500] [DEBUG] [LOCAL ] FIGS: Trimmed 71049 records to 48950 (keeping 200 days of data) [2025-09-23T18:50:59.112499] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-23T18:50:59.137577] [DEBUG] [LOCAL ] FIGS: Primary data saved (48950 records). [2025-09-23T18:50:59.137751] [INFO ] [MAIN ] FIGS: Full history saved. [2025-09-23T18:50:59.137871] [INFO ] [MAIN ] Update Progress: 838/2372 symbols completed. FIGS took 47.1s. Estimated remaining: 3h 23m 4s. Rate: 7.6 symbols/min [2025-09-23T18:50:59.402447] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-05. [2025-09-23T18:51:00.416395] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-23T18:51:00.428406] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-07. [2025-09-23T18:51:00.485300] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-23T18:51:01.002207] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-06. [2025-09-23T18:51:02.404385] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-23T18:51:02.410619] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-07. [2025-09-23T18:51:03.236048] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-07 (2.81 seconds). [2025-09-23T18:51:03.248085] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-08. [2025-09-23T18:51:05.683743] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-07 (3.27 seconds). [2025-09-23T18:51:05.690483] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-08. [2025-09-23T18:51:06.629300] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-23T18:51:06.636081] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-09. [2025-09-23T18:51:06.851092] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-08 (3.60 seconds). [2025-09-23T18:51:06.862875] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-09. [2025-09-23T18:51:08.062721] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-23T18:51:08.069961] [INFO ] [REMOTE ] FIX: Full fetch complete (45664 records). [2025-09-23T18:51:08.070134] [DEBUG] [VALIDATOR ] FIX: Validating primary data. [2025-09-23T18:51:08.487538] [DEBUG] [VALIDATOR ] FIX: All expected trading days are present. [2025-09-23T18:51:08.487914] [DEBUG] [VALIDATOR ] FIX: Primary data validation passed. [2025-09-23T18:51:08.488688] [INFO ] [MAIN ] FIX: Fetched primary data is valid. [2025-09-23T18:51:08.488753] [DEBUG] [LOCAL ] FIX: Saving primary data. [2025-09-23T18:51:08.489948] [DEBUG] [LOCAL ] FIX: Trimmed 45664 records to 30519 (keeping 200 days of data) [2025-09-23T18:51:08.702066] [DEBUG] [LOCAL ] FIX: Primary data saved (30519 records). [2025-09-23T18:51:08.702224] [INFO ] [MAIN ] FIX: Full history saved. [2025-09-23T18:51:08.702335] [INFO ] [MAIN ] Update Progress: 839/2372 symbols completed. FIX took 23.4s. Estimated remaining: 3h 22m 59s. Rate: 7.6 symbols/min [2025-09-23T18:51:08.743322] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-23T18:51:08.753830] [INFO ] [REMOTE ] FIS: Full fetch complete (77170 records). [2025-09-23T18:51:08.754034] [DEBUG] [VALIDATOR ] FIS: Validating primary data. [2025-09-23T18:51:09.159903] [DEBUG] [VALIDATOR ] FIS: All expected trading days are present. [2025-09-23T18:51:09.160002] [DEBUG] [VALIDATOR ] FIS: Primary data validation passed. [2025-09-23T18:51:09.160982] [INFO ] [MAIN ] FIS: Fetched primary data is valid. [2025-09-23T18:51:09.161052] [DEBUG] [LOCAL ] FIS: Saving primary data. [2025-09-23T18:51:09.162744] [DEBUG] [LOCAL ] FIS: Trimmed 77170 records to 53366 (keeping 200 days of data) [2025-09-23T18:51:09.520609] [DEBUG] [LOCAL ] FIS: Primary data saved (53366 records). [2025-09-23T18:51:09.520806] [INFO ] [MAIN ] FIS: Full history saved. [2025-09-23T18:51:09.520924] [INFO ] [MAIN ] Update Progress: 840/2372 symbols completed. FIS took 28.4s. Estimated remaining: 3h 22m 38s. Rate: 7.6 symbols/min [2025-09-23T18:51:10.258791] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:51:10.302534] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:51:10.306228] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:51:10.316568] [DEBUG] [LOCAL ] FIXT: No existing data file found in primary storage. [2025-09-23T18:51:10.335847] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:51:10.336178] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-09-23T18:51:10.337103] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-09-23T18:51:10.337191] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-09-23T18:51:10.337372] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-09-23T18:51:10.337456] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-09-23T18:51:10.440351] [DEBUG] [LOCAL ] FLC: Loaded 5602 existing records from primary storage. [2025-09-23T18:51:10.452016] [INFO ] [MAIN ] FLC: Loaded 5602 existing records. [2025-09-23T18:51:10.778143] [DEBUG] [LOCAL ] FLG: Loaded 53331 existing records from primary storage. [2025-09-23T18:51:10.810751] [DEBUG] [LOCAL ] FLNG: Loaded 34117 existing records from primary storage. [2025-09-23T18:51:10.826433] [INFO ] [MAIN ] FLG: Loaded 53331 existing records. [2025-09-23T18:51:10.832136] [INFO ] [MAIN ] FLNG: Loaded 34117 existing records. [2025-09-23T18:51:11.096424] [WARN ] [MAIN ] FLC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:51:11.160990] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:51:11.189796] [INFO ] [MAIN ] FLC: Wiping existing primary data before full refresh. [2025-09-23T18:51:11.195449] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2024-12. [2025-09-23T18:51:11.205867] [INFO ] [LOCAL ] FLC: Starting deletion of primary data. [2025-09-23T18:51:11.242630] [DEBUG] [LOCAL ] FLC: Deleted primary data file. [2025-09-23T18:51:11.287701] [WARN ] [MAIN ] FLG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:51:11.288021] [INFO ] [MAIN ] FLC: Starting full primary refresh. [2025-09-23T18:51:11.303884] [INFO ] [MAIN ] FLG: Wiping existing primary data before full refresh. [2025-09-23T18:51:11.391022] [INFO ] [LOCAL ] FLG: Starting deletion of primary data. [2025-09-23T18:51:11.419564] [DEBUG] [LOCAL ] FLG: Deleted primary data file. [2025-09-23T18:51:11.430297] [WARN ] [MAIN ] FLNG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:51:11.471793] [INFO ] [MAIN ] FLNG: Wiping existing primary data before full refresh. [2025-09-23T18:51:11.471945] [INFO ] [LOCAL ] FLNG: Starting deletion of primary data. [2025-09-23T18:51:11.464418] [INFO ] [MAIN ] FLG: Starting full primary refresh. [2025-09-23T18:51:11.483221] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:51:11.529122] [WARN ] [REMOTE ] FIXT: No data returned for month 2024-12 [2025-09-23T18:51:11.504631] [DEBUG] [LOCAL ] FLNG: Deleted primary data file. [2025-09-23T18:51:11.545281] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-01. [2025-09-23T18:51:11.544946] [INFO ] [MAIN ] FLNG: Starting full primary refresh. [2025-09-23T18:51:11.892981] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:51:12.002446] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-01 [2025-09-23T18:51:12.077834] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-02. [2025-09-23T18:51:12.385968] [INFO ] [REMOTE ] FLC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:51:12.440827] [INFO ] [REMOTE ] FLC: Fetching primary data for 2024-12. [2025-09-23T18:51:12.446857] [INFO ] [REMOTE ] FLG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:51:12.453575] [INFO ] [REMOTE ] FLG: Fetching primary data for 2024-12. [2025-09-23T18:51:12.538611] [INFO ] [REMOTE ] FLNG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:51:12.538932] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2024-12. [2025-09-23T18:51:12.705890] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:51:12.706222] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-02 [2025-09-23T18:51:12.706743] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-03. [2025-09-23T18:51:13.119742] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:51:13.120055] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-03 [2025-09-23T18:51:13.120502] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-04. [2025-09-23T18:51:13.280218] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-23T18:51:13.282985] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-01. [2025-09-23T18:51:14.463536] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-23T18:51:14.465530] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-02. [2025-09-23T18:51:14.809523] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:51:14.811107] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-04 [2025-09-23T18:51:14.812148] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-05. [2025-09-23T18:51:14.842436] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-09-23T18:51:14.851165] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-01. [2025-09-23T18:51:14.898530] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-23T18:51:14.959044] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2024-12 (2.51 seconds). [2025-09-23T18:51:15.055562] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:51:15.055980] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-05 [2025-09-23T18:51:15.402233] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-06. [2025-09-23T18:51:15.938765] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-23T18:51:16.196192] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-23T18:51:16.203992] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-07. [2025-09-23T18:51:16.568158] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-23T18:51:17.002236] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-01. [2025-09-23T18:51:17.802201] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-03. [2025-09-23T18:51:18.203478] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-23T18:51:18.539311] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-23T18:51:18.602172] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-02. [2025-09-23T18:51:19.402191] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-04. [2025-09-23T18:51:19.936328] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-23T18:51:20.202172] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-05. [2025-09-23T18:51:20.378707] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-23T18:51:20.599363] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-23T18:51:21.002213] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-02. [2025-09-23T18:51:21.802211] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-06. [2025-09-23T18:51:22.149463] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-23T18:51:22.411551] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-23T18:51:22.602204] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-03. [2025-09-23T18:51:23.402189] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-08. [2025-09-23T18:51:23.715566] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-23T18:51:24.175114] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-23T18:51:24.202152] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-04. [2025-09-23T18:51:25.002189] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-03. [2025-09-23T18:51:25.802205] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-09. [2025-09-23T18:51:26.602194] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-07. [2025-09-23T18:51:27.099315] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-04 (2.90 seconds). [2025-09-23T18:51:27.310314] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-09-23T18:51:27.402180] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-05. [2025-09-23T18:51:27.484578] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-23T18:51:27.485688] [INFO ] [REMOTE ] FIXT: Full fetch complete (1720 records). [2025-09-23T18:51:27.485759] [DEBUG] [VALIDATOR ] FIXT: Validating primary data. [2025-09-23T18:51:27.572050] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-23T18:51:27.676043] [WARN ] [VALIDATOR ] FIXT: Validation failed - insufficient historical data. Have 69 unique days, need 200 days [2025-09-23T18:51:27.676249] [FATAL] [MAIN ] FIXT: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:51:27.676317] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:51:27.676387] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-09-23T18:51:27.676451] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-09-23T18:51:27.676487] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-09-23T18:51:27.676526] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-09-23T18:51:27.676606] [INFO ] [MAIN ] Update Progress: 841/2372 symbols completed. FIXT took 18.2s. Estimated remaining: 3h 22m 49s. Rate: 7.5 symbols/min [2025-09-23T18:51:27.847803] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:51:27.903619] [DEBUG] [LOCAL ] FLO: Loaded 51894 existing records from primary storage. [2025-09-23T18:51:27.903827] [INFO ] [MAIN ] FLO: Loaded 51894 existing records. [2025-09-23T18:51:28.108886] [WARN ] [MAIN ] FLO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:51:28.109181] [INFO ] [MAIN ] FLO: Wiping existing primary data before full refresh. [2025-09-23T18:51:28.109235] [INFO ] [LOCAL ] FLO: Starting deletion of primary data. [2025-09-23T18:51:28.110791] [DEBUG] [LOCAL ] FLO: Deleted primary data file. [2025-09-23T18:51:28.110855] [INFO ] [MAIN ] FLO: Starting full primary refresh. [2025-09-23T18:51:28.209752] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-04. [2025-09-23T18:51:28.502412] [INFO ] [REMOTE ] FLO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:51:28.747213] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-23T18:51:29.002210] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-06. [2025-09-23T18:51:29.304969] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-23T18:51:29.802219] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-05. [2025-09-23T18:51:30.602237] [INFO ] [REMOTE ] FLO: Fetching primary data for 2024-12. [2025-09-23T18:51:30.868134] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-23T18:51:31.108166] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-23T18:51:31.402190] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-07. [2025-09-23T18:51:31.963906] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-23T18:51:32.202287] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-06. [2025-09-23T18:51:32.868392] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-23T18:51:33.002250] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-08. [2025-09-23T18:51:33.635417] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-23T18:51:33.721169] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-23T18:51:33.802194] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-09. [2025-09-23T18:51:34.602212] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-01. [2025-09-23T18:51:34.739198] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-23T18:51:34.740550] [INFO ] [REMOTE ] FLC: Full fetch complete (8039 records). [2025-09-23T18:51:34.740618] [DEBUG] [VALIDATOR ] FLC: Validating primary data. [2025-09-23T18:51:35.140516] [DEBUG] [VALIDATOR ] FLC: All expected trading days are present. [2025-09-23T18:51:35.140604] [DEBUG] [VALIDATOR ] FLC: Primary data validation passed. [2025-09-23T18:51:35.140883] [INFO ] [MAIN ] FLC: Fetched primary data is valid. [2025-09-23T18:51:35.140948] [DEBUG] [LOCAL ] FLC: Saving primary data. [2025-09-23T18:51:35.141382] [DEBUG] [LOCAL ] FLC: Trimmed 8039 records to 5537 (keeping 200 days of data) [2025-09-23T18:51:35.177159] [DEBUG] [LOCAL ] FLC: Primary data saved (5537 records). [2025-09-23T18:51:35.177281] [INFO ] [MAIN ] FLC: Full history saved. [2025-09-23T18:51:35.177370] [INFO ] [MAIN ] Update Progress: 842/2372 symbols completed. FLC took 25.6s. Estimated remaining: 3h 22m 40s. Rate: 7.5 symbols/min [2025-09-23T18:51:35.366141] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:51:35.366332] [DEBUG] [LOCAL ] FLOC: No existing data file found in primary storage. [2025-09-23T18:51:35.366372] [WARN ] [MAIN ] FLOC: No existing data found, performing full refresh instead. [2025-09-23T18:51:35.366520] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-09-23T18:51:35.366564] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-09-23T18:51:35.366606] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-09-23T18:51:35.366661] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-09-23T18:51:35.410619] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-08. [2025-09-23T18:51:35.794572] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:51:36.202170] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2024-12. [2025-09-23T18:51:36.342684] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-23T18:51:36.421348] [DEBUG] [REMOTE ] FLOC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T18:51:36.421682] [WARN ] [REMOTE ] FLOC: No data returned for month 2024-12 [2025-09-23T18:51:36.851557] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-23T18:51:37.002231] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-01. [2025-09-23T18:51:37.717395] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-23T18:51:37.802145] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-02. [2025-09-23T18:51:38.573013] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-23T18:51:38.602166] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-03. [2025-09-23T18:51:39.402216] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-02. [2025-09-23T18:51:39.640900] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-23T18:51:40.202224] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-09. [2025-09-23T18:51:40.969047] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-23T18:51:41.002147] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-03. [2025-09-23T18:51:41.665017] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-23T18:51:41.674080] [INFO ] [REMOTE ] FLG: Full fetch complete (77290 records). [2025-09-23T18:51:41.674235] [DEBUG] [VALIDATOR ] FLG: Validating primary data. [2025-09-23T18:51:41.807290] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-04. [2025-09-23T18:51:42.089337] [DEBUG] [VALIDATOR ] FLG: All expected trading days are present. [2025-09-23T18:51:42.089437] [DEBUG] [VALIDATOR ] FLG: Primary data validation passed. [2025-09-23T18:51:42.090355] [INFO ] [MAIN ] FLG: Fetched primary data is valid. [2025-09-23T18:51:42.090425] [DEBUG] [LOCAL ] FLG: Saving primary data. [2025-09-23T18:51:42.092061] [DEBUG] [LOCAL ] FLG: Trimmed 77290 records to 53329 (keeping 200 days of data) [2025-09-23T18:51:42.433708] [DEBUG] [LOCAL ] FLG: Primary data saved (53329 records). [2025-09-23T18:51:42.433922] [INFO ] [MAIN ] FLG: Full history saved. [2025-09-23T18:51:42.435100] [INFO ] [MAIN ] Update Progress: 843/2372 symbols completed. FLG took 32.9s. Estimated remaining: 3h 22m 31s. Rate: 7.6 symbols/min [2025-09-23T18:51:42.604072] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-07. [2025-09-23T18:51:42.624593] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:51:42.680035] [DEBUG] [LOCAL ] FLR: Loaded 53122 existing records from primary storage. [2025-09-23T18:51:42.680305] [INFO ] [MAIN ] FLR: Loaded 53122 existing records. [2025-09-23T18:51:42.832533] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-23T18:51:42.927915] [WARN ] [MAIN ] FLR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:51:42.928371] [INFO ] [MAIN ] FLR: Wiping existing primary data before full refresh. [2025-09-23T18:51:42.928467] [INFO ] [LOCAL ] FLR: Starting deletion of primary data. [2025-09-23T18:51:42.935033] [DEBUG] [LOCAL ] FLR: Deleted primary data file. [2025-09-23T18:51:42.944138] [INFO ] [MAIN ] FLR: Starting full primary refresh. [2025-09-23T18:51:42.978479] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-23T18:51:43.310954] [INFO ] [REMOTE ] FLR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:51:43.402152] [INFO ] [REMOTE ] FLR: Fetching primary data for 2024-12. [2025-09-23T18:51:43.710905] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-23T18:51:44.202237] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-08. [2025-09-23T18:51:45.002248] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-04. [2025-09-23T18:51:45.070047] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-23T18:51:45.261184] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-23T18:51:45.802217] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-09. [2025-09-23T18:51:46.607744] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-05. [2025-09-23T18:51:46.653275] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-23T18:51:47.402240] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-01. [2025-09-23T18:51:47.438912] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-23T18:51:47.445879] [INFO ] [REMOTE ] FLNG: Full fetch complete (50967 records). [2025-09-23T18:51:47.445989] [DEBUG] [VALIDATOR ] FLNG: Validating primary data. [2025-09-23T18:51:47.856629] [DEBUG] [VALIDATOR ] FLNG: All expected trading days are present. [2025-09-23T18:51:47.856759] [DEBUG] [VALIDATOR ] FLNG: Primary data validation passed. [2025-09-23T18:51:47.857478] [INFO ] [MAIN ] FLNG: Fetched primary data is valid. [2025-09-23T18:51:47.857520] [DEBUG] [LOCAL ] FLNG: Saving primary data. [2025-09-23T18:51:47.858733] [DEBUG] [LOCAL ] FLNG: Trimmed 50967 records to 34056 (keeping 200 days of data) [2025-09-23T18:51:47.966776] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-23T18:51:48.098016] [DEBUG] [LOCAL ] FLNG: Primary data saved (34056 records). [2025-09-23T18:51:48.098165] [INFO ] [MAIN ] FLNG: Full history saved. [2025-09-23T18:51:48.098294] [INFO ] [MAIN ] Update Progress: 844/2372 symbols completed. FLNG took 38.6s. Estimated remaining: 3h 22m 19s. Rate: 7.6 symbols/min [2025-09-23T18:51:48.207304] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-06. [2025-09-23T18:51:48.268944] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:51:48.314611] [DEBUG] [LOCAL ] FLS: Loaded 50181 existing records from primary storage. [2025-09-23T18:51:48.314786] [INFO ] [MAIN ] FLS: Loaded 50181 existing records. [2025-09-23T18:51:48.490843] [WARN ] [MAIN ] FLS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:51:48.491128] [INFO ] [MAIN ] FLS: Wiping existing primary data before full refresh. [2025-09-23T18:51:48.491177] [INFO ] [LOCAL ] FLS: Starting deletion of primary data. [2025-09-23T18:51:48.492472] [DEBUG] [LOCAL ] FLS: Deleted primary data file. [2025-09-23T18:51:48.492537] [INFO ] [MAIN ] FLS: Starting full primary refresh. [2025-09-23T18:51:48.866084] [INFO ] [REMOTE ] FLS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:51:48.924798] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-23T18:51:49.002193] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-02. [2025-09-23T18:51:49.090440] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-23T18:51:49.802201] [INFO ] [REMOTE ] FLS: Fetching primary data for 2024-12. [2025-09-23T18:51:50.252417] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-23T18:51:50.602241] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-05. [2025-09-23T18:51:51.300619] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-23T18:51:51.402265] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-01. [2025-09-23T18:51:51.995381] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-23T18:51:52.202220] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-07. [2025-09-23T18:51:52.669975] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-23T18:51:53.002246] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-03. [2025-09-23T18:51:53.566954] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-23T18:51:53.802202] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-08. [2025-09-23T18:51:54.549009] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-23T18:51:54.602151] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-04. [2025-09-23T18:51:54.691874] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-23T18:51:55.402245] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-06. [2025-09-23T18:51:56.203971] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-09. [2025-09-23T18:51:56.210562] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-23T18:51:56.724236] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-23T18:51:57.002215] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-07. [2025-09-23T18:51:57.079022] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-23T18:51:57.085092] [INFO ] [REMOTE ] FLOC: Full fetch complete (37066 records). [2025-09-23T18:51:57.085234] [DEBUG] [VALIDATOR ] FLOC: Validating primary data. [2025-09-23T18:51:57.282082] [WARN ] [VALIDATOR ] FLOC: Validation failed - insufficient historical data. Have 172 unique days, need 200 days [2025-09-23T18:51:57.282515] [FATAL] [MAIN ] FLOC: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:51:57.282661] [WARN ] [MAIN ] FLOC: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:51:57.282726] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-09-23T18:51:57.282789] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-09-23T18:51:57.282824] [INFO ] [LOCAL ] FLOC: Starting deletion of derivative data. [2025-09-23T18:51:57.282862] [DEBUG] [LOCAL ] FLOC: No derivative data file found to delete. [2025-09-23T18:51:57.282933] [INFO ] [MAIN ] Update Progress: 845/2372 symbols completed. FLOC took 22.1s. Estimated remaining: 3h 22m 13s. Rate: 7.6 symbols/min [2025-09-23T18:51:57.456210] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:51:57.508211] [DEBUG] [LOCAL ] FLUT: Loaded 50933 existing records from primary storage. [2025-09-23T18:51:57.508371] [INFO ] [MAIN ] FLUT: Loaded 50933 existing records. [2025-09-23T18:51:57.690355] [WARN ] [MAIN ] FLUT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:51:57.690593] [INFO ] [MAIN ] FLUT: Wiping existing primary data before full refresh. [2025-09-23T18:51:57.690662] [INFO ] [LOCAL ] FLUT: Starting deletion of primary data. [2025-09-23T18:51:57.691984] [DEBUG] [LOCAL ] FLUT: Deleted primary data file. [2025-09-23T18:51:57.692049] [INFO ] [MAIN ] FLUT: Starting full primary refresh. [2025-09-23T18:51:57.807340] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-02. [2025-09-23T18:51:58.074938] [INFO ] [REMOTE ] FLUT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:51:58.602189] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2024-12. [2025-09-23T18:51:58.645384] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-23T18:51:59.112376] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-23T18:51:59.402265] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-08. [2025-09-23T18:51:59.937571] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-23T18:52:00.202205] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-01. [2025-09-23T18:52:00.858322] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-23T18:52:01.002230] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-09. [2025-09-23T18:52:01.802218] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-05. [2025-09-23T18:52:01.957807] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-23T18:52:02.516357] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-23T18:52:02.525327] [INFO ] [REMOTE ] FLO: Full fetch complete (74856 records). [2025-09-23T18:52:02.525488] [DEBUG] [VALIDATOR ] FLO: Validating primary data. [2025-09-23T18:52:02.607290] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-02. [2025-09-23T18:52:02.977913] [DEBUG] [VALIDATOR ] FLO: All expected trading days are present. [2025-09-23T18:52:02.978024] [DEBUG] [VALIDATOR ] FLO: Primary data validation passed. [2025-09-23T18:52:02.979126] [INFO ] [MAIN ] FLO: Fetched primary data is valid. [2025-09-23T18:52:02.979198] [DEBUG] [LOCAL ] FLO: Saving primary data. [2025-09-23T18:52:02.980956] [DEBUG] [LOCAL ] FLO: Trimmed 74856 records to 51894 (keeping 200 days of data) [2025-09-23T18:52:03.321892] [DEBUG] [LOCAL ] FLO: Primary data saved (51894 records). [2025-09-23T18:52:03.322037] [INFO ] [MAIN ] FLO: Full history saved. [2025-09-23T18:52:03.322125] [INFO ] [MAIN ] Update Progress: 846/2372 symbols completed. FLO took 35.6s. Estimated remaining: 3h 22m 2s. Rate: 7.6 symbols/min [2025-09-23T18:52:03.403253] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-03. [2025-09-23T18:52:03.536525] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-23T18:52:03.539808] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:52:03.572240] [DEBUG] [LOCAL ] FLXR: Loaded 19779 existing records from primary storage. [2025-09-23T18:52:03.572379] [INFO ] [MAIN ] FLXR: Loaded 19779 existing records. [2025-09-23T18:52:03.753680] [WARN ] [MAIN ] FLXR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:52:03.753942] [INFO ] [MAIN ] FLXR: Wiping existing primary data before full refresh. [2025-09-23T18:52:03.753990] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-09-23T18:52:03.754609] [DEBUG] [LOCAL ] FLXR: Deleted primary data file. [2025-09-23T18:52:03.754707] [INFO ] [MAIN ] FLXR: Starting full primary refresh. [2025-09-23T18:52:04.127913] [INFO ] [REMOTE ] FLXR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:52:04.188195] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-23T18:52:04.202174] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2024-12. [2025-09-23T18:52:04.936342] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-23T18:52:05.002177] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-01. [2025-09-23T18:52:05.187531] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-23T18:52:05.723468] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-23T18:52:05.802177] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-02. [2025-09-23T18:52:06.361439] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-23T18:52:06.602245] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-03. [2025-09-23T18:52:07.402216] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-06. [2025-09-23T18:52:08.202265] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-03. [2025-09-23T18:52:08.610878] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-23T18:52:08.868990] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-23T18:52:08.979119] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-23T18:52:09.002225] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-07. [2025-09-23T18:52:09.802233] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-04. [2025-09-23T18:52:10.602284] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-04. [2025-09-23T18:52:10.993268] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-23T18:52:11.123762] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-23T18:52:11.215103] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-23T18:52:11.402251] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-05. [2025-09-23T18:52:12.202248] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-08. [2025-09-23T18:52:12.411466] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-23T18:52:13.002202] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-06. [2025-09-23T18:52:13.802214] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-05. [2025-09-23T18:52:14.075594] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-23T18:52:14.166735] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-23T18:52:14.602265] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-09. [2025-09-23T18:52:15.132879] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-23T18:52:15.402261] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-07. [2025-09-23T18:52:16.072016] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-23T18:52:16.202189] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-08. [2025-09-23T18:52:16.578186] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-23T18:52:16.588826] [INFO ] [REMOTE ] FLR: Full fetch complete (76301 records). [2025-09-23T18:52:16.588993] [DEBUG] [VALIDATOR ] FLR: Validating primary data. [2025-09-23T18:52:16.984033] [DEBUG] [VALIDATOR ] FLR: All expected trading days are present. [2025-09-23T18:52:16.984150] [DEBUG] [VALIDATOR ] FLR: Primary data validation passed. [2025-09-23T18:52:16.985236] [INFO ] [MAIN ] FLR: Fetched primary data is valid. [2025-09-23T18:52:16.985328] [DEBUG] [LOCAL ] FLR: Saving primary data. [2025-09-23T18:52:17.007762] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-06. [2025-09-23T18:52:17.011894] [DEBUG] [LOCAL ] FLR: Trimmed 76301 records to 53120 (keeping 200 days of data) [2025-09-23T18:52:17.014693] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-23T18:52:17.330183] [DEBUG] [LOCAL ] FLR: Primary data saved (53120 records). [2025-09-23T18:52:17.330363] [INFO ] [MAIN ] FLR: Full history saved. [2025-09-23T18:52:17.330469] [INFO ] [MAIN ] Update Progress: 847/2372 symbols completed. FLR took 34.9s. Estimated remaining: 3h 22m 5s. Rate: 7.5 symbols/min [2025-09-23T18:52:17.497706] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:52:17.548060] [DEBUG] [LOCAL ] FMC: Loaded 51794 existing records from primary storage. [2025-09-23T18:52:17.548213] [INFO ] [MAIN ] FMC: Loaded 51794 existing records. [2025-09-23T18:52:17.726574] [WARN ] [MAIN ] FMC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:52:17.726907] [INFO ] [MAIN ] FMC: Wiping existing primary data before full refresh. [2025-09-23T18:52:17.726958] [INFO ] [LOCAL ] FMC: Starting deletion of primary data. [2025-09-23T18:52:17.728612] [DEBUG] [LOCAL ] FMC: Deleted primary data file. [2025-09-23T18:52:17.728701] [INFO ] [MAIN ] FMC: Starting full primary refresh. [2025-09-23T18:52:17.807364] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-04. [2025-09-23T18:52:18.092479] [INFO ] [REMOTE ] FMC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:52:18.602191] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-09. [2025-09-23T18:52:18.725919] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-23T18:52:19.402239] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-07. [2025-09-23T18:52:19.552474] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-23T18:52:19.854769] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-23T18:52:19.859536] [INFO ] [REMOTE ] FLXR: Full fetch complete (24692 records). [2025-09-23T18:52:19.859704] [DEBUG] [VALIDATOR ] FLXR: Validating primary data. [2025-09-23T18:52:20.220381] [INFO ] [REMOTE ] FMC: Fetching primary data for 2024-12. [2025-09-23T18:52:20.233547] [DEBUG] [VALIDATOR ] FLXR: All expected trading days are present. [2025-09-23T18:52:20.233608] [DEBUG] [VALIDATOR ] FLXR: Primary data validation passed. [2025-09-23T18:52:20.234152] [INFO ] [MAIN ] FLXR: Fetched primary data is valid. [2025-09-23T18:52:20.234336] [DEBUG] [LOCAL ] FLXR: Saving primary data. [2025-09-23T18:52:20.235163] [DEBUG] [LOCAL ] FLXR: Trimmed 24692 records to 19843 (keeping 200 days of data) [2025-09-23T18:52:20.360418] [DEBUG] [LOCAL ] FLXR: Primary data saved (19843 records). [2025-09-23T18:52:20.360548] [INFO ] [MAIN ] FLXR: Full history saved. [2025-09-23T18:52:20.360632] [INFO ] [MAIN ] Update Progress: 848/2372 symbols completed. FLXR took 17.0s. Estimated remaining: 3h 21m 48s. Rate: 7.6 symbols/min [2025-09-23T18:52:20.529240] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:52:20.537277] [DEBUG] [LOCAL ] FMN: Loaded 6172 existing records from primary storage. [2025-09-23T18:52:20.537383] [INFO ] [MAIN ] FMN: Loaded 6172 existing records. [2025-09-23T18:52:20.719099] [WARN ] [MAIN ] FMN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:52:20.719586] [INFO ] [MAIN ] FMN: Wiping existing primary data before full refresh. [2025-09-23T18:52:20.719764] [INFO ] [LOCAL ] FMN: Starting deletion of primary data. [2025-09-23T18:52:20.720261] [DEBUG] [LOCAL ] FMN: Deleted primary data file. [2025-09-23T18:52:20.720408] [INFO ] [MAIN ] FMN: Starting full primary refresh. [2025-09-23T18:52:21.003274] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-05. [2025-09-23T18:52:21.114060] [INFO ] [REMOTE ] FMN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:52:21.118439] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-23T18:52:21.619522] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-23T18:52:21.802308] [INFO ] [REMOTE ] FMN: Fetching primary data for 2024-12. [2025-09-23T18:52:22.490906] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-23T18:52:22.602165] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-01. [2025-09-23T18:52:22.935000] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-23T18:52:23.402195] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-06. [2025-09-23T18:52:24.202244] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-08. [2025-09-23T18:52:24.882542] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-09-23T18:52:25.002271] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-02. [2025-09-23T18:52:25.531052] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-23T18:52:25.802194] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-01. [2025-09-23T18:52:26.007258] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-23T18:52:26.602181] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-03. [2025-09-23T18:52:26.954163] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-06 (3.55 seconds). [2025-09-23T18:52:27.102913] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-23T18:52:27.125898] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-23T18:52:27.402196] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-04. [2025-09-23T18:52:27.895368] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-23T18:52:28.202181] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-02. [2025-09-23T18:52:29.002266] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-05. [2025-09-23T18:52:29.569855] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-23T18:52:29.802203] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-07. [2025-09-23T18:52:29.876075] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-23T18:52:30.602195] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-03. [2025-09-23T18:52:31.402219] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-06. [2025-09-23T18:52:31.712753] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-23T18:52:32.023866] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-23T18:52:32.024174] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-23T18:52:32.202254] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-07. [2025-09-23T18:52:32.640346] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-23T18:52:33.002262] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-08. [2025-09-23T18:52:33.802197] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-04. [2025-09-23T18:52:34.602240] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-08. [2025-09-23T18:52:34.837243] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-23T18:52:35.066382] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-23T18:52:35.402187] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-09. [2025-09-23T18:52:35.447984] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-23T18:52:36.202238] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-09. [2025-09-23T18:52:37.002249] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-09. [2025-09-23T18:52:37.675989] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-23T18:52:37.677497] [INFO ] [REMOTE ] FMN: Full fetch complete (10182 records). [2025-09-23T18:52:37.677580] [DEBUG] [VALIDATOR ] FMN: Validating primary data. [2025-09-23T18:52:37.805952] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-05. [2025-09-23T18:52:38.076873] [DEBUG] [VALIDATOR ] FMN: All expected trading days are present. [2025-09-23T18:52:38.078513] [DEBUG] [VALIDATOR ] FMN: Primary data validation passed. [2025-09-23T18:52:38.078871] [INFO ] [MAIN ] FMN: Fetched primary data is valid. [2025-09-23T18:52:38.078404] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-09 (2.68 seconds). [2025-09-23T18:52:38.079031] [DEBUG] [LOCAL ] FMN: Saving primary data. [2025-09-23T18:52:38.088274] [DEBUG] [LOCAL ] FMN: Trimmed 10182 records to 6172 (keeping 200 days of data) [2025-09-23T18:52:38.107461] [INFO ] [REMOTE ] FLUT: Full fetch complete (72724 records). [2025-09-23T18:52:38.116128] [DEBUG] [VALIDATOR ] FLUT: Validating primary data. [2025-09-23T18:52:38.395706] [DEBUG] [LOCAL ] FMN: Primary data saved (6172 records). [2025-09-23T18:52:38.436338] [INFO ] [MAIN ] FMN: Full history saved. [2025-09-23T18:52:38.475214] [INFO ] [MAIN ] Update Progress: 849/2372 symbols completed. FMN took 18.1s. Estimated remaining: 3h 21m 58s. Rate: 7.5 symbols/min [2025-09-23T18:52:38.596424] [DEBUG] [VALIDATOR ] FLUT: All expected trading days are present. [2025-09-23T18:52:38.652520] [DEBUG] [VALIDATOR ] FLUT: Primary data validation passed. [2025-09-23T18:52:38.699474] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-09-23T18:52:38.693195] [INFO ] [MAIN ] FLUT: Fetched primary data is valid. [2025-09-23T18:52:38.723637] [DEBUG] [LOCAL ] FLUT: Saving primary data. [2025-09-23T18:52:38.788868] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:52:38.789879] [INFO ] [REMOTE ] FLS: Full fetch complete (71313 records). [2025-09-23T18:52:38.790009] [DEBUG] [VALIDATOR ] FLS: Validating primary data. [2025-09-23T18:52:38.803290] [DEBUG] [LOCAL ] FLUT: Trimmed 72724 records to 50884 (keeping 200 days of data) [2025-09-23T18:52:39.211913] [DEBUG] [LOCAL ] FMS: Loaded 30396 existing records from primary storage. [2025-09-23T18:52:39.239808] [INFO ] [MAIN ] FMS: Loaded 30396 existing records. [2025-09-23T18:52:39.802012] [DEBUG] [VALIDATOR ] FLS: All expected trading days are present. [2025-09-23T18:52:39.844681] [WARN ] [MAIN ] FMS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:52:39.845193] [DEBUG] [VALIDATOR ] FLS: Primary data validation passed. [2025-09-23T18:52:39.847971] [INFO ] [MAIN ] FLS: Fetched primary data is valid. [2025-09-23T18:52:39.848801] [DEBUG] [LOCAL ] FLS: Saving primary data. [2025-09-23T18:52:39.850550] [INFO ] [MAIN ] FMS: Wiping existing primary data before full refresh. [2025-09-23T18:52:39.851193] [INFO ] [LOCAL ] FMS: Starting deletion of primary data. [2025-09-23T18:52:39.855735] [DEBUG] [LOCAL ] FMS: Deleted primary data file. [2025-09-23T18:52:39.856161] [INFO ] [MAIN ] FMS: Starting full primary refresh. [2025-09-23T18:52:39.972527] [DEBUG] [LOCAL ] FLS: Trimmed 71313 records to 50186 (keeping 200 days of data) [2025-09-23T18:52:40.509500] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-05 (2.70 seconds). [2025-09-23T18:52:40.580234] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-06. [2025-09-23T18:52:40.574194] [DEBUG] [LOCAL ] FLUT: Primary data saved (50884 records). [2025-09-23T18:52:40.599783] [INFO ] [MAIN ] FLUT: Full history saved. [2025-09-23T18:52:40.600278] [INFO ] [MAIN ] Update Progress: 850/2372 symbols completed. FLUT took 43.3s. Estimated remaining: 3h 21m 40s. Rate: 7.5 symbols/min [2025-09-23T18:52:40.746939] [INFO ] [REMOTE ] FMS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:52:40.766204] [INFO ] [REMOTE ] FMS: Fetching primary data for 2024-12. [2025-09-23T18:52:40.885413] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:52:41.029975] [DEBUG] [LOCAL ] FMX: Loaded 40726 existing records from primary storage. [2025-09-23T18:52:41.031369] [INFO ] [MAIN ] FMX: Loaded 40726 existing records. [2025-09-23T18:52:41.248149] [WARN ] [MAIN ] FMX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:52:41.249228] [INFO ] [MAIN ] FMX: Wiping existing primary data before full refresh. [2025-09-23T18:52:41.249676] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-09-23T18:52:41.251999] [DEBUG] [LOCAL ] FMX: Deleted primary data file. [2025-09-23T18:52:41.252353] [INFO ] [MAIN ] FMX: Starting full primary refresh. [2025-09-23T18:52:41.693522] [INFO ] [REMOTE ] FMX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:52:41.695843] [INFO ] [REMOTE ] FMX: Fetching primary data for 2024-12. [2025-09-23T18:52:41.705620] [DEBUG] [LOCAL ] FLS: Primary data saved (50186 records). [2025-09-23T18:52:41.705888] [INFO ] [MAIN ] FLS: Full history saved. [2025-09-23T18:52:41.706032] [INFO ] [MAIN ] Update Progress: 851/2372 symbols completed. FLS took 53.6s. Estimated remaining: 3h 21m 19s. Rate: 7.6 symbols/min [2025-09-23T18:52:41.902554] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:52:41.921872] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-23T18:52:41.928470] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-01. [2025-09-23T18:52:41.930870] [DEBUG] [LOCAL ] FMY: Loaded 1383 existing records from primary storage. [2025-09-23T18:52:41.932026] [INFO ] [MAIN ] FMY: Loaded 1383 existing records. [2025-09-23T18:52:42.121018] [WARN ] [MAIN ] FMY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:52:42.121441] [INFO ] [MAIN ] FMY: Wiping existing primary data before full refresh. [2025-09-23T18:52:42.121526] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-09-23T18:52:42.121823] [DEBUG] [LOCAL ] FMY: Deleted primary data file. [2025-09-23T18:52:42.121966] [INFO ] [MAIN ] FMY: Starting full primary refresh. [2025-09-23T18:52:42.257717] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-23T18:52:42.324778] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-07. [2025-09-23T18:52:42.533332] [INFO ] [REMOTE ] FMY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:52:42.602193] [INFO ] [REMOTE ] FMY: Fetching primary data for 2024-12. [2025-09-23T18:52:43.009487] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-23T18:52:43.126887] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-23T18:52:43.177587] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-23T18:52:43.402197] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-01. [2025-09-23T18:52:43.751317] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-23T18:52:43.942914] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-23T18:52:44.202212] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-02. [2025-09-23T18:52:44.953159] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-23T18:52:45.002199] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-02. [2025-09-23T18:52:45.444831] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-23T18:52:45.802207] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-08. [2025-09-23T18:52:46.602179] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-03. [2025-09-23T18:52:47.402217] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-03. [2025-09-23T18:52:47.538944] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-23T18:52:48.064945] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-23T18:52:48.071250] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-23T18:52:48.202196] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-01. [2025-09-23T18:52:49.002224] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-04. [2025-09-23T18:52:49.280453] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-09-23T18:52:49.684881] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-23T18:52:49.802202] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-02. [2025-09-23T18:52:50.602211] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-09. [2025-09-23T18:52:50.883313] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-23T18:52:51.402205] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-05. [2025-09-23T18:52:51.766200] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-23T18:52:51.937699] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-23T18:52:51.947294] [INFO ] [REMOTE ] FMC: Full fetch complete (74881 records). [2025-09-23T18:52:51.947453] [DEBUG] [VALIDATOR ] FMC: Validating primary data. [2025-09-23T18:52:52.207454] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-03. [2025-09-23T18:52:52.352281] [DEBUG] [VALIDATOR ] FMC: All expected trading days are present. [2025-09-23T18:52:52.352363] [DEBUG] [VALIDATOR ] FMC: Primary data validation passed. [2025-09-23T18:52:52.353380] [INFO ] [MAIN ] FMC: Fetched primary data is valid. [2025-09-23T18:52:52.353483] [DEBUG] [LOCAL ] FMC: Saving primary data. [2025-09-23T18:52:52.359220] [DEBUG] [LOCAL ] FMC: Trimmed 74881 records to 51787 (keeping 200 days of data) [2025-09-23T18:52:52.677207] [DEBUG] [LOCAL ] FMC: Primary data saved (51787 records). [2025-09-23T18:52:52.677343] [INFO ] [MAIN ] FMC: Full history saved. [2025-09-23T18:52:52.677529] [INFO ] [MAIN ] Update Progress: 852/2372 symbols completed. FMC took 35.3s. Estimated remaining: 3h 21m 17s. Rate: 7.6 symbols/min [2025-09-23T18:52:52.857823] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:52:52.900048] [DEBUG] [LOCAL ] FN: Loaded 39605 existing records from primary storage. [2025-09-23T18:52:52.900238] [INFO ] [MAIN ] FN: Loaded 39605 existing records. [2025-09-23T18:52:53.007309] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-04. [2025-09-23T18:52:53.080967] [WARN ] [MAIN ] FN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:52:53.081268] [INFO ] [MAIN ] FN: Wiping existing primary data before full refresh. [2025-09-23T18:52:53.081333] [INFO ] [LOCAL ] FN: Starting deletion of primary data. [2025-09-23T18:52:53.082233] [DEBUG] [LOCAL ] FN: Deleted primary data file. [2025-09-23T18:52:53.082314] [INFO ] [MAIN ] FN: Starting full primary refresh. [2025-09-23T18:52:53.446264] [INFO ] [REMOTE ] FN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:52:53.501215] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-23T18:52:53.802217] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-04. [2025-09-23T18:52:54.045773] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-23T18:52:54.602217] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-05. [2025-09-23T18:52:55.052878] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-23T18:52:55.402245] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-06. [2025-09-23T18:52:55.664830] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-09-23T18:52:55.968080] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-23T18:52:56.202223] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-05. [2025-09-23T18:52:57.002203] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-06. [2025-09-23T18:52:57.706125] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-23T18:52:57.802154] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-06. [2025-09-23T18:52:58.179113] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-23T18:52:58.602192] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-07. [2025-09-23T18:52:58.991348] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-23T18:52:59.402245] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-07. [2025-09-23T18:52:59.580331] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-23T18:52:59.695448] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-09-23T18:53:00.202227] [INFO ] [REMOTE ] FN: Fetching primary data for 2024-12. [2025-09-23T18:53:01.002222] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-08. [2025-09-23T18:53:01.308438] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-23T18:53:01.367072] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-23T18:53:01.802198] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-09. [2025-09-23T18:53:02.303440] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-23T18:53:02.304342] [INFO ] [REMOTE ] FMY: Full fetch complete (1956 records). [2025-09-23T18:53:02.304439] [DEBUG] [VALIDATOR ] FMY: Validating primary data. [2025-09-23T18:53:02.607323] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-01. [2025-09-23T18:53:02.678861] [DEBUG] [VALIDATOR ] FMY: All expected trading days are present. [2025-09-23T18:53:02.678948] [DEBUG] [VALIDATOR ] FMY: Primary data validation passed. [2025-09-23T18:53:02.679067] [INFO ] [MAIN ] FMY: Fetched primary data is valid. [2025-09-23T18:53:02.679129] [DEBUG] [LOCAL ] FMY: Saving primary data. [2025-09-23T18:53:02.679503] [DEBUG] [LOCAL ] FMY: Trimmed 1956 records to 1382 (keeping 200 days of data) [2025-09-23T18:53:02.689770] [DEBUG] [LOCAL ] FMY: Primary data saved (1382 records). [2025-09-23T18:53:02.689871] [INFO ] [MAIN ] FMY: Full history saved. [2025-09-23T18:53:02.690000] [INFO ] [MAIN ] Update Progress: 853/2372 symbols completed. FMY took 21.0s. Estimated remaining: 3h 21m 13s. Rate: 7.5 symbols/min [2025-09-23T18:53:02.857711] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:53:02.929673] [DEBUG] [LOCAL ] FNB: Loaded 52454 existing records from primary storage. [2025-09-23T18:53:02.929854] [INFO ] [MAIN ] FNB: Loaded 52454 existing records. [2025-09-23T18:53:03.113522] [WARN ] [MAIN ] FNB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:53:03.113766] [INFO ] [MAIN ] FNB: Wiping existing primary data before full refresh. [2025-09-23T18:53:03.113831] [INFO ] [LOCAL ] FNB: Starting deletion of primary data. [2025-09-23T18:53:03.116042] [DEBUG] [LOCAL ] FNB: Deleted primary data file. [2025-09-23T18:53:03.116104] [INFO ] [MAIN ] FNB: Starting full primary refresh. [2025-09-23T18:53:03.407353] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-08. [2025-09-23T18:53:03.473324] [INFO ] [REMOTE ] FNB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:53:03.813836] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-23T18:53:04.202260] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-07. [2025-09-23T18:53:04.738119] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-23T18:53:05.002203] [INFO ] [REMOTE ] FNB: Fetching primary data for 2024-12. [2025-09-23T18:53:05.778492] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-23T18:53:05.802160] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-08. [2025-09-23T18:53:06.334263] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-23T18:53:06.602187] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-01. [2025-09-23T18:53:07.402194] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-09. [2025-09-23T18:53:08.082202] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-23T18:53:08.211070] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-02. [2025-09-23T18:53:08.216576] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-09-23T18:53:08.312099] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-23T18:53:08.317690] [INFO ] [REMOTE ] FMS: Full fetch complete (42328 records). [2025-09-23T18:53:08.317846] [DEBUG] [VALIDATOR ] FMS: Validating primary data. [2025-09-23T18:53:08.722765] [DEBUG] [VALIDATOR ] FMS: All expected trading days are present. [2025-09-23T18:53:08.722858] [DEBUG] [VALIDATOR ] FMS: Primary data validation passed. [2025-09-23T18:53:08.723461] [INFO ] [MAIN ] FMS: Fetched primary data is valid. [2025-09-23T18:53:08.723502] [DEBUG] [LOCAL ] FMS: Saving primary data. [2025-09-23T18:53:08.724708] [DEBUG] [LOCAL ] FMS: Trimmed 42328 records to 30385 (keeping 200 days of data) [2025-09-23T18:53:08.918681] [DEBUG] [LOCAL ] FMS: Primary data saved (30385 records). [2025-09-23T18:53:08.918817] [INFO ] [MAIN ] FMS: Full history saved. [2025-09-23T18:53:08.918901] [INFO ] [MAIN ] Update Progress: 854/2372 symbols completed. FMS took 30.4s. Estimated remaining: 3h 21m 2s. Rate: 7.6 symbols/min [2025-09-23T18:53:09.008157] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-09. [2025-09-23T18:53:09.089556] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:53:09.148702] [DEBUG] [LOCAL ] FND: Loaded 52159 existing records from primary storage. [2025-09-23T18:53:09.148855] [INFO ] [MAIN ] FND: Loaded 52159 existing records. [2025-09-23T18:53:09.330248] [WARN ] [MAIN ] FND: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:53:09.330602] [INFO ] [MAIN ] FND: Wiping existing primary data before full refresh. [2025-09-23T18:53:09.330680] [INFO ] [LOCAL ] FND: Starting deletion of primary data. [2025-09-23T18:53:09.331847] [DEBUG] [LOCAL ] FND: Deleted primary data file. [2025-09-23T18:53:09.331910] [INFO ] [MAIN ] FND: Starting full primary refresh. [2025-09-23T18:53:09.707458] [INFO ] [REMOTE ] FND: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:53:09.760311] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-23T18:53:09.802156] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-03. [2025-09-23T18:53:10.531148] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-23T18:53:10.539601] [INFO ] [REMOTE ] FMX: Full fetch complete (57714 records). [2025-09-23T18:53:10.539755] [DEBUG] [VALIDATOR ] FMX: Validating primary data. [2025-09-23T18:53:10.607440] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-02. [2025-09-23T18:53:10.930307] [DEBUG] [VALIDATOR ] FMX: All expected trading days are present. [2025-09-23T18:53:10.930386] [DEBUG] [VALIDATOR ] FMX: Primary data validation passed. [2025-09-23T18:53:10.931131] [INFO ] [MAIN ] FMX: Fetched primary data is valid. [2025-09-23T18:53:10.931193] [DEBUG] [LOCAL ] FMX: Saving primary data. [2025-09-23T18:53:10.932450] [DEBUG] [LOCAL ] FMX: Trimmed 57714 records to 40734 (keeping 200 days of data) [2025-09-23T18:53:11.210864] [DEBUG] [LOCAL ] FMX: Primary data saved (40734 records). [2025-09-23T18:53:11.211032] [INFO ] [MAIN ] FMX: Full history saved. [2025-09-23T18:53:11.211184] [INFO ] [MAIN ] Update Progress: 855/2372 symbols completed. FMX took 30.6s. Estimated remaining: 3h 20m 44s. Rate: 7.6 symbols/min [2025-09-23T18:53:11.455531] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:53:11.452595] [INFO ] [REMOTE ] FND: Fetching primary data for 2024-12. [2025-09-23T18:53:11.509248] [DEBUG] [LOCAL ] FNF: Loaded 49257 existing records from primary storage. [2025-09-23T18:53:11.509432] [INFO ] [MAIN ] FNF: Loaded 49257 existing records. [2025-09-23T18:53:11.692098] [WARN ] [MAIN ] FNF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:53:11.692616] [INFO ] [MAIN ] FNF: Wiping existing primary data before full refresh. [2025-09-23T18:53:11.692840] [INFO ] [LOCAL ] FNF: Starting deletion of primary data. [2025-09-23T18:53:11.701827] [DEBUG] [LOCAL ] FNF: Deleted primary data file. [2025-09-23T18:53:11.714102] [INFO ] [MAIN ] FNF: Starting full primary refresh. [2025-09-23T18:53:11.789989] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-23T18:53:12.098987] [INFO ] [REMOTE ] FNF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:53:12.202159] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-04. [2025-09-23T18:53:12.279787] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-23T18:53:13.002222] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-03. [2025-09-23T18:53:13.118005] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-23T18:53:13.491698] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-23T18:53:13.802187] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-05. [2025-09-23T18:53:14.561017] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-23T18:53:14.602158] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-04. [2025-09-23T18:53:15.402227] [INFO ] [REMOTE ] FNF: Fetching primary data for 2024-12. [2025-09-23T18:53:15.475603] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-23T18:53:16.049285] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-23T18:53:16.202242] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-05. [2025-09-23T18:53:16.993756] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-23T18:53:17.003127] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-01. [2025-09-23T18:53:17.552743] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-23T18:53:17.802250] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-01. [2025-09-23T18:53:18.297274] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-23T18:53:18.602211] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-02. [2025-09-23T18:53:19.046989] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-23T18:53:19.402204] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-02. [2025-09-23T18:53:20.210306] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-06. [2025-09-23T18:53:20.216993] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-23T18:53:20.588012] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-23T18:53:21.002197] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-03. [2025-09-23T18:53:21.633936] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-23T18:53:21.802234] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-03. [2025-09-23T18:53:22.602227] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-06. [2025-09-23T18:53:22.802857] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-23T18:53:23.114621] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-23T18:53:23.402200] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-04. [2025-09-23T18:53:24.004808] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-23T18:53:24.202220] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-07. [2025-09-23T18:53:25.002253] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-04. [2025-09-23T18:53:25.261623] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-23T18:53:25.630833] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-23T18:53:25.802218] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-08. [2025-09-23T18:53:26.291330] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-23T18:53:26.602211] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-07. [2025-09-23T18:53:27.069209] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-23T18:53:27.402256] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-05. [2025-09-23T18:53:27.997199] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-23T18:53:28.202184] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-08. [2025-09-23T18:53:28.699917] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-23T18:53:29.002210] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-06. [2025-09-23T18:53:29.802189] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-09. [2025-09-23T18:53:29.835730] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-23T18:53:30.602234] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-05. [2025-09-23T18:53:30.675099] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-23T18:53:31.079026] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-23T18:53:31.085533] [INFO ] [REMOTE ] FN: Full fetch complete (56445 records). [2025-09-23T18:53:31.085692] [DEBUG] [VALIDATOR ] FN: Validating primary data. [2025-09-23T18:53:31.408367] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-09. [2025-09-23T18:53:31.481854] [DEBUG] [VALIDATOR ] FN: All expected trading days are present. [2025-09-23T18:53:31.481935] [DEBUG] [VALIDATOR ] FN: Primary data validation passed. [2025-09-23T18:53:31.482702] [INFO ] [MAIN ] FN: Fetched primary data is valid. [2025-09-23T18:53:31.482764] [DEBUG] [LOCAL ] FN: Saving primary data. [2025-09-23T18:53:31.484031] [DEBUG] [LOCAL ] FN: Trimmed 56445 records to 39497 (keeping 200 days of data) [2025-09-23T18:53:31.720851] [DEBUG] [LOCAL ] FN: Primary data saved (39497 records). [2025-09-23T18:53:31.720993] [INFO ] [MAIN ] FN: Full history saved. [2025-09-23T18:53:31.721092] [INFO ] [MAIN ] Update Progress: 856/2372 symbols completed. FN took 39.0s. Estimated remaining: 3h 20m 58s. Rate: 7.5 symbols/min [2025-09-23T18:53:31.887689] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:53:31.934346] [DEBUG] [LOCAL ] FNV: Loaded 46472 existing records from primary storage. [2025-09-23T18:53:31.934485] [INFO ] [MAIN ] FNV: Loaded 46472 existing records. [2025-09-23T18:53:32.115558] [WARN ] [MAIN ] FNV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:53:32.115972] [INFO ] [MAIN ] FNV: Wiping existing primary data before full refresh. [2025-09-23T18:53:32.116129] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-09-23T18:53:32.117306] [DEBUG] [LOCAL ] FNV: Deleted primary data file. [2025-09-23T18:53:32.117372] [INFO ] [MAIN ] FNV: Starting full primary refresh. [2025-09-23T18:53:32.243694] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-07. [2025-09-23T18:53:32.305224] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-23T18:53:32.533660] [INFO ] [REMOTE ] FNV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:53:32.831205] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-23T18:53:32.839933] [INFO ] [REMOTE ] FNB: Full fetch complete (75633 records). [2025-09-23T18:53:32.840075] [DEBUG] [VALIDATOR ] FNB: Validating primary data. [2025-09-23T18:53:33.014876] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-06. [2025-09-23T18:53:33.231063] [DEBUG] [VALIDATOR ] FNB: All expected trading days are present. [2025-09-23T18:53:33.231145] [DEBUG] [VALIDATOR ] FNB: Primary data validation passed. [2025-09-23T18:53:33.232025] [INFO ] [MAIN ] FNB: Fetched primary data is valid. [2025-09-23T18:53:33.232091] [DEBUG] [LOCAL ] FNB: Saving primary data. [2025-09-23T18:53:33.233523] [DEBUG] [LOCAL ] FNB: Trimmed 75633 records to 52450 (keeping 200 days of data) [2025-09-23T18:53:33.563097] [DEBUG] [LOCAL ] FNB: Primary data saved (52450 records). [2025-09-23T18:53:33.563220] [INFO ] [MAIN ] FNB: Full history saved. [2025-09-23T18:53:33.563299] [INFO ] [MAIN ] Update Progress: 857/2372 symbols completed. FNB took 30.9s. Estimated remaining: 3h 20m 39s. Rate: 7.6 symbols/min [2025-09-23T18:53:33.735599] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:53:33.749993] [DEBUG] [LOCAL ] FOA: Loaded 13132 existing records from primary storage. [2025-09-23T18:53:33.750131] [INFO ] [MAIN ] FOA: Loaded 13132 existing records. [2025-09-23T18:53:33.813605] [INFO ] [REMOTE ] FNV: Fetching primary data for 2024-12. [2025-09-23T18:53:33.967387] [WARN ] [MAIN ] FOA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:53:33.971336] [INFO ] [MAIN ] FOA: Wiping existing primary data before full refresh. [2025-09-23T18:53:33.973300] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-23T18:53:33.985754] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-09-23T18:53:33.986837] [DEBUG] [LOCAL ] FOA: Deleted primary data file. [2025-09-23T18:53:33.986912] [INFO ] [MAIN ] FOA: Starting full primary refresh. [2025-09-23T18:53:34.369862] [INFO ] [REMOTE ] FOA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:53:34.438337] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-23T18:53:34.602192] [INFO ] [REMOTE ] FOA: Fetching primary data for 2024-12. [2025-09-23T18:53:35.156215] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-23T18:53:35.402166] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-01. [2025-09-23T18:53:35.711474] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-23T18:53:36.202216] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-08. [2025-09-23T18:53:36.739051] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-23T18:53:37.002195] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-07. [2025-09-23T18:53:37.551093] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-23T18:53:37.802219] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-02. [2025-09-23T18:53:38.396924] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-23T18:53:38.602238] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-01. [2025-09-23T18:53:39.107603] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-23T18:53:39.402158] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-08. [2025-09-23T18:53:39.440332] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-23T18:53:40.202193] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-03. [2025-09-23T18:53:40.713090] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-23T18:53:41.002188] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-09. [2025-09-23T18:53:41.506232] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-23T18:53:41.802183] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-02. [2025-09-23T18:53:42.535494] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-23T18:53:42.544282] [INFO ] [REMOTE ] FND: Full fetch complete (74359 records). [2025-09-23T18:53:42.544452] [DEBUG] [VALIDATOR ] FND: Validating primary data. [2025-09-23T18:53:42.607390] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-09. [2025-09-23T18:53:42.893475] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-23T18:53:42.973813] [DEBUG] [VALIDATOR ] FND: All expected trading days are present. [2025-09-23T18:53:42.973897] [DEBUG] [VALIDATOR ] FND: Primary data validation passed. [2025-09-23T18:53:42.974851] [INFO ] [MAIN ] FND: Fetched primary data is valid. [2025-09-23T18:53:42.974916] [DEBUG] [LOCAL ] FND: Saving primary data. [2025-09-23T18:53:42.976513] [DEBUG] [LOCAL ] FND: Trimmed 74359 records to 52147 (keeping 200 days of data) [2025-09-23T18:53:43.290842] [DEBUG] [LOCAL ] FND: Primary data saved (52147 records). [2025-09-23T18:53:43.290987] [INFO ] [MAIN ] FND: Full history saved. [2025-09-23T18:53:43.291087] [INFO ] [MAIN ] Update Progress: 858/2372 symbols completed. FND took 34.4s. Estimated remaining: 3h 20m 34s. Rate: 7.5 symbols/min [2025-09-23T18:53:43.407271] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-03. [2025-09-23T18:53:43.472291] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:53:43.483278] [DEBUG] [LOCAL ] FOF: Loaded 8383 existing records from primary storage. [2025-09-23T18:53:43.483472] [INFO ] [MAIN ] FOF: Loaded 8383 existing records. [2025-09-23T18:53:43.693819] [WARN ] [MAIN ] FOF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:53:43.694147] [INFO ] [MAIN ] FOF: Wiping existing primary data before full refresh. [2025-09-23T18:53:43.694201] [INFO ] [LOCAL ] FOF: Starting deletion of primary data. [2025-09-23T18:53:43.694588] [DEBUG] [LOCAL ] FOF: Deleted primary data file. [2025-09-23T18:53:43.694678] [INFO ] [MAIN ] FOF: Starting full primary refresh. [2025-09-23T18:53:44.059878] [INFO ] [REMOTE ] FOF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:53:44.071493] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-23T18:53:44.183372] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-23T18:53:44.192129] [INFO ] [REMOTE ] FNF: Full fetch complete (69497 records). [2025-09-23T18:53:44.192293] [DEBUG] [VALIDATOR ] FNF: Validating primary data. [2025-09-23T18:53:44.207350] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-04. [2025-09-23T18:53:44.631074] [DEBUG] [VALIDATOR ] FNF: All expected trading days are present. [2025-09-23T18:53:44.631172] [DEBUG] [VALIDATOR ] FNF: Primary data validation passed. [2025-09-23T18:53:44.632058] [INFO ] [MAIN ] FNF: Fetched primary data is valid. [2025-09-23T18:53:44.632125] [DEBUG] [LOCAL ] FNF: Saving primary data. [2025-09-23T18:53:44.633606] [DEBUG] [LOCAL ] FNF: Trimmed 69497 records to 49223 (keeping 200 days of data) [2025-09-23T18:53:44.939485] [DEBUG] [LOCAL ] FNF: Primary data saved (49223 records). [2025-09-23T18:53:44.939625] [INFO ] [MAIN ] FNF: Full history saved. [2025-09-23T18:53:44.939746] [INFO ] [MAIN ] Update Progress: 859/2372 symbols completed. FNF took 33.7s. Estimated remaining: 3h 20m 15s. Rate: 7.6 symbols/min [2025-09-23T18:53:45.007494] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-04. [2025-09-23T18:53:45.117366] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:53:45.138298] [DEBUG] [LOCAL ] FOR: Loaded 20202 existing records from primary storage. [2025-09-23T18:53:45.138434] [INFO ] [MAIN ] FOR: Loaded 20202 existing records. [2025-09-23T18:53:45.315786] [WARN ] [MAIN ] FOR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:53:45.316054] [INFO ] [MAIN ] FOR: Wiping existing primary data before full refresh. [2025-09-23T18:53:45.316101] [INFO ] [LOCAL ] FOR: Starting deletion of primary data. [2025-09-23T18:53:45.316721] [DEBUG] [LOCAL ] FOR: Deleted primary data file. [2025-09-23T18:53:45.316783] [INFO ] [MAIN ] FOR: Starting full primary refresh. [2025-09-23T18:53:45.671572] [INFO ] [REMOTE ] FOR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:53:45.802234] [INFO ] [REMOTE ] FOR: Fetching primary data for 2024-12. [2025-09-23T18:53:46.029303] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-23T18:53:46.194390] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-23T18:53:46.404144] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-23T18:53:46.602252] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-01. [2025-09-23T18:53:47.402180] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-05. [2025-09-23T18:53:47.425014] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-23T18:53:48.202348] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-05. [2025-09-23T18:53:48.725710] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-23T18:53:49.002244] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-06. [2025-09-23T18:53:49.069352] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-23T18:53:49.485547] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-23T18:53:49.802256] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-02. [2025-09-23T18:53:50.527540] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-23T18:53:50.602274] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-03. [2025-09-23T18:53:51.315900] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-23T18:53:51.402236] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-07. [2025-09-23T18:53:51.909762] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-23T18:53:52.202213] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-08. [2025-09-23T18:53:52.781454] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-23T18:53:53.002202] [INFO ] [REMOTE ] FOF: Fetching primary data for 2024-12. [2025-09-23T18:53:53.768255] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-23T18:53:53.802154] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-09. [2025-09-23T18:53:54.505807] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-23T18:53:54.508961] [INFO ] [REMOTE ] FOA: Full fetch complete (22437 records). [2025-09-23T18:53:54.509037] [DEBUG] [VALIDATOR ] FOA: Validating primary data. [2025-09-23T18:53:54.607382] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-06. [2025-09-23T18:53:54.888696] [DEBUG] [VALIDATOR ] FOA: All expected trading days are present. [2025-09-23T18:53:54.888779] [DEBUG] [VALIDATOR ] FOA: Primary data validation passed. [2025-09-23T18:53:54.889232] [INFO ] [MAIN ] FOA: Fetched primary data is valid. [2025-09-23T18:53:54.889270] [DEBUG] [LOCAL ] FOA: Saving primary data. [2025-09-23T18:53:54.889870] [DEBUG] [LOCAL ] FOA: Trimmed 22437 records to 13184 (keeping 200 days of data) [2025-09-23T18:53:54.966124] [DEBUG] [LOCAL ] FOA: Primary data saved (13184 records). [2025-09-23T18:53:54.966263] [INFO ] [MAIN ] FOA: Full history saved. [2025-09-23T18:53:54.966348] [INFO ] [MAIN ] Update Progress: 860/2372 symbols completed. FOA took 21.4s. Estimated remaining: 3h 20m 11s. Rate: 7.6 symbols/min [2025-09-23T18:53:55.132444] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:53:55.181490] [DEBUG] [LOCAL ] FOUR: Loaded 49522 existing records from primary storage. [2025-09-23T18:53:55.181629] [INFO ] [MAIN ] FOUR: Loaded 49522 existing records. [2025-09-23T18:53:55.358360] [WARN ] [MAIN ] FOUR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:53:55.358660] [INFO ] [MAIN ] FOUR: Wiping existing primary data before full refresh. [2025-09-23T18:53:55.358722] [INFO ] [LOCAL ] FOUR: Starting deletion of primary data. [2025-09-23T18:53:55.359956] [DEBUG] [LOCAL ] FOUR: Deleted primary data file. [2025-09-23T18:53:55.360016] [INFO ] [MAIN ] FOUR: Starting full primary refresh. [2025-09-23T18:53:55.407345] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-04. [2025-09-23T18:53:55.732531] [INFO ] [REMOTE ] FOUR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:53:55.949448] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-23T18:53:56.202182] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-07. [2025-09-23T18:53:56.789244] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-23T18:53:57.002259] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-01. [2025-09-23T18:53:57.537735] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-23T18:53:57.538515] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-23T18:53:57.802206] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-05. [2025-09-23T18:53:58.523985] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-23T18:53:58.602186] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-06. [2025-09-23T18:53:59.402185] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-02. [2025-09-23T18:53:59.507452] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-23T18:53:59.837135] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-23T18:54:00.202270] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-08. [2025-09-23T18:54:01.002242] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-07. [2025-09-23T18:54:01.802224] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2024-12. [2025-09-23T18:54:02.132787] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-23T18:54:02.165712] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-23T18:54:02.602213] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-03. [2025-09-23T18:54:03.402239] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-09. [2025-09-23T18:54:04.202327] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-08. [2025-09-23T18:54:04.367191] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-23T18:54:05.002263] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-04. [2025-09-23T18:54:05.118233] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-23T18:54:05.125786] [INFO ] [REMOTE ] FNV: Full fetch complete (66002 records). [2025-09-23T18:54:05.125902] [DEBUG] [VALIDATOR ] FNV: Validating primary data. [2025-09-23T18:54:05.484825] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-23T18:54:05.515287] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2024-12 (3.71 seconds). [2025-09-23T18:54:05.616793] [DEBUG] [VALIDATOR ] FNV: All expected trading days are present. [2025-09-23T18:54:05.616984] [DEBUG] [VALIDATOR ] FNV: Primary data validation passed. [2025-09-23T18:54:05.618042] [INFO ] [MAIN ] FNV: Fetched primary data is valid. [2025-09-23T18:54:05.618232] [DEBUG] [LOCAL ] FNV: Saving primary data. [2025-09-23T18:54:05.628580] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-23T18:54:05.632995] [DEBUG] [LOCAL ] FNV: Trimmed 66002 records to 46430 (keeping 200 days of data) [2025-09-23T18:54:05.832007] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-01. [2025-09-23T18:54:05.948175] [DEBUG] [LOCAL ] FNV: Primary data saved (46430 records). [2025-09-23T18:54:05.948357] [INFO ] [MAIN ] FNV: Full history saved. [2025-09-23T18:54:05.948453] [INFO ] [MAIN ] Update Progress: 861/2372 symbols completed. FNV took 34.2s. Estimated remaining: 3h 20m 9s. Rate: 7.5 symbols/min [2025-09-23T18:54:06.126364] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:54:06.145177] [DEBUG] [LOCAL ] FPF: Loaded 17594 existing records from primary storage. [2025-09-23T18:54:06.145307] [INFO ] [MAIN ] FPF: Loaded 17594 existing records. [2025-09-23T18:54:06.333696] [WARN ] [MAIN ] FPF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:54:06.334001] [INFO ] [MAIN ] FPF: Wiping existing primary data before full refresh. [2025-09-23T18:54:06.334057] [INFO ] [LOCAL ] FPF: Starting deletion of primary data. [2025-09-23T18:54:06.334717] [DEBUG] [LOCAL ] FPF: Deleted primary data file. [2025-09-23T18:54:06.334812] [INFO ] [MAIN ] FPF: Starting full primary refresh. [2025-09-23T18:54:06.609760] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-09. [2025-09-23T18:54:06.715705] [INFO ] [REMOTE ] FPF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:54:07.180759] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-23T18:54:07.356292] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-23T18:54:07.359732] [INFO ] [REMOTE ] FOR: Full fetch complete (29857 records). [2025-09-23T18:54:07.359816] [DEBUG] [VALIDATOR ] FOR: Validating primary data. [2025-09-23T18:54:07.412384] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-05. [2025-09-23T18:54:07.731748] [DEBUG] [VALIDATOR ] FOR: All expected trading days are present. [2025-09-23T18:54:07.731828] [DEBUG] [VALIDATOR ] FOR: Primary data validation passed. [2025-09-23T18:54:07.732343] [INFO ] [MAIN ] FOR: Fetched primary data is valid. [2025-09-23T18:54:07.732380] [DEBUG] [LOCAL ] FOR: Saving primary data. [2025-09-23T18:54:07.733112] [DEBUG] [LOCAL ] FOR: Trimmed 29857 records to 20132 (keeping 200 days of data) [2025-09-23T18:54:07.848780] [DEBUG] [LOCAL ] FOR: Primary data saved (20132 records). [2025-09-23T18:54:07.848905] [INFO ] [MAIN ] FOR: Full history saved. [2025-09-23T18:54:07.848984] [INFO ] [MAIN ] Update Progress: 862/2372 symbols completed. FOR took 22.9s. Estimated remaining: 3h 19m 50s. Rate: 7.6 symbols/min [2025-09-23T18:54:07.976740] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-23T18:54:08.037673] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:54:08.056696] [DEBUG] [LOCAL ] FPH: Loaded 19781 existing records from primary storage. [2025-09-23T18:54:08.056826] [INFO ] [MAIN ] FPH: Loaded 19781 existing records. [2025-09-23T18:54:08.207261] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-06. [2025-09-23T18:54:08.238518] [WARN ] [MAIN ] FPH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:54:08.238747] [INFO ] [MAIN ] FPH: Wiping existing primary data before full refresh. [2025-09-23T18:54:08.238803] [INFO ] [LOCAL ] FPH: Starting deletion of primary data. [2025-09-23T18:54:08.239407] [DEBUG] [LOCAL ] FPH: Deleted primary data file. [2025-09-23T18:54:08.239467] [INFO ] [MAIN ] FPH: Starting full primary refresh. [2025-09-23T18:54:08.591820] [INFO ] [REMOTE ] FPH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:54:09.002171] [INFO ] [REMOTE ] FPH: Fetching primary data for 2024-12. [2025-09-23T18:54:09.003060] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-23T18:54:09.710929] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-23T18:54:09.802193] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-02. [2025-09-23T18:54:10.602216] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-07. [2025-09-23T18:54:11.196337] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-23T18:54:11.354736] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-23T18:54:11.402239] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-08. [2025-09-23T18:54:12.202215] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-01. [2025-09-23T18:54:12.221422] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-23T18:54:13.002208] [INFO ] [REMOTE ] FPF: Fetching primary data for 2024-12. [2025-09-23T18:54:13.802221] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-03. [2025-09-23T18:54:13.953209] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-23T18:54:14.602193] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-02. [2025-09-23T18:54:14.910833] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-23T18:54:15.402179] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-09. [2025-09-23T18:54:15.420986] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-23T18:54:15.801109] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-23T18:54:16.128419] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-23T18:54:16.130906] [INFO ] [REMOTE ] FOF: Full fetch complete (11844 records). [2025-09-23T18:54:16.130985] [DEBUG] [VALIDATOR ] FOF: Validating primary data. [2025-09-23T18:54:16.207455] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-01. [2025-09-23T18:54:16.503097] [DEBUG] [VALIDATOR ] FOF: All expected trading days are present. [2025-09-23T18:54:16.503234] [DEBUG] [VALIDATOR ] FOF: Primary data validation passed. [2025-09-23T18:54:16.503584] [INFO ] [MAIN ] FOF: Fetched primary data is valid. [2025-09-23T18:54:16.503628] [DEBUG] [LOCAL ] FOF: Saving primary data. [2025-09-23T18:54:16.504188] [DEBUG] [LOCAL ] FOF: Trimmed 11844 records to 8395 (keeping 200 days of data) [2025-09-23T18:54:16.556770] [DEBUG] [LOCAL ] FOF: Primary data saved (8395 records). [2025-09-23T18:54:16.556915] [INFO ] [MAIN ] FOF: Full history saved. [2025-09-23T18:54:16.557001] [INFO ] [MAIN ] Update Progress: 863/2372 symbols completed. FOF took 33.3s. Estimated remaining: 3h 19m 43s. Rate: 7.6 symbols/min [2025-09-23T18:54:16.725054] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:54:16.761010] [DEBUG] [LOCAL ] FPI: Loaded 31107 existing records from primary storage. [2025-09-23T18:54:16.761200] [INFO ] [MAIN ] FPI: Loaded 31107 existing records. [2025-09-23T18:54:16.941394] [WARN ] [MAIN ] FPI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:54:16.941698] [INFO ] [MAIN ] FPI: Wiping existing primary data before full refresh. [2025-09-23T18:54:16.941756] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-09-23T18:54:16.942794] [DEBUG] [LOCAL ] FPI: Deleted primary data file. [2025-09-23T18:54:16.942856] [INFO ] [MAIN ] FPI: Starting full primary refresh. [2025-09-23T18:54:17.007436] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-03. [2025-09-23T18:54:17.343003] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-23T18:54:17.369155] [INFO ] [REMOTE ] FPI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:54:17.802212] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-04. [2025-09-23T18:54:18.090332] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-23T18:54:18.602199] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-04. [2025-09-23T18:54:19.402197] [INFO ] [REMOTE ] FPI: Fetching primary data for 2024-12. [2025-09-23T18:54:19.682008] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-23T18:54:19.712038] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-23T18:54:20.202320] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-05. [2025-09-23T18:54:20.353064] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-23T18:54:21.002205] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-05. [2025-09-23T18:54:21.161488] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-23T18:54:21.802251] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-02. [2025-09-23T18:54:22.416771] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-23T18:54:22.602223] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-03. [2025-09-23T18:54:22.874534] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-23T18:54:23.401400] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-23T18:54:23.404910] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-06. [2025-09-23T18:54:24.202284] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-06. [2025-09-23T18:54:25.002229] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-04. [2025-09-23T18:54:25.161180] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-23T18:54:25.206028] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-23T18:54:25.650619] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-23T18:54:25.802225] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-07. [2025-09-23T18:54:26.602164] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-01. [2025-09-23T18:54:26.961151] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-23T18:54:27.403516] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-08. [2025-09-23T18:54:27.405934] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-23T18:54:28.074439] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-23T18:54:28.202190] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-07. [2025-09-23T18:54:29.002224] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-09. [2025-09-23T18:54:29.803326] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-02. [2025-09-23T18:54:29.806630] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-23T18:54:29.828437] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-23T18:54:29.832419] [INFO ] [REMOTE ] FPH: Full fetch complete (31627 records). [2025-09-23T18:54:29.832502] [DEBUG] [VALIDATOR ] FPH: Validating primary data. [2025-09-23T18:54:30.241115] [DEBUG] [VALIDATOR ] FPH: All expected trading days are present. [2025-09-23T18:54:30.241212] [DEBUG] [VALIDATOR ] FPH: Primary data validation passed. [2025-09-23T18:54:30.241876] [INFO ] [MAIN ] FPH: Fetched primary data is valid. [2025-09-23T18:54:30.241941] [DEBUG] [LOCAL ] FPH: Saving primary data. [2025-09-23T18:54:30.242832] [DEBUG] [LOCAL ] FPH: Trimmed 31627 records to 19740 (keeping 200 days of data) [2025-09-23T18:54:30.355483] [DEBUG] [LOCAL ] FPH: Primary data saved (19740 records). [2025-09-23T18:54:30.355661] [INFO ] [MAIN ] FPH: Full history saved. [2025-09-23T18:54:30.355771] [INFO ] [MAIN ] Update Progress: 864/2372 symbols completed. FPH took 22.5s. Estimated remaining: 3h 19m 46s. Rate: 7.5 symbols/min [2025-09-23T18:54:30.529394] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:54:30.574814] [DEBUG] [LOCAL ] FR: Loaded 46677 existing records from primary storage. [2025-09-23T18:54:30.574994] [INFO ] [MAIN ] FR: Loaded 46677 existing records. [2025-09-23T18:54:30.607373] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-05. [2025-09-23T18:54:30.759012] [WARN ] [MAIN ] FR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:54:30.759692] [INFO ] [MAIN ] FR: Wiping existing primary data before full refresh. [2025-09-23T18:54:30.759815] [INFO ] [LOCAL ] FR: Starting deletion of primary data. [2025-09-23T18:54:30.767011] [DEBUG] [LOCAL ] FR: Deleted primary data file. [2025-09-23T18:54:30.767119] [INFO ] [MAIN ] FR: Starting full primary refresh. [2025-09-23T18:54:30.855553] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-23T18:54:31.156178] [INFO ] [REMOTE ] FR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:54:31.402216] [INFO ] [REMOTE ] FR: Fetching primary data for 2024-12. [2025-09-23T18:54:31.543779] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-23T18:54:32.202222] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-03. [2025-09-23T18:54:32.820274] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-23T18:54:33.002259] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-01. [2025-09-23T18:54:33.062605] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-23T18:54:33.802212] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-06. [2025-09-23T18:54:34.471989] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-23T18:54:34.602199] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-07. [2025-09-23T18:54:34.918211] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-23T18:54:35.259503] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-23T18:54:35.402225] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-02. [2025-09-23T18:54:36.202253] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-04. [2025-09-23T18:54:36.542835] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-23T18:54:37.002272] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-08. [2025-09-23T18:54:37.592142] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-23T18:54:37.733970] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-23T18:54:37.802223] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-09. [2025-09-23T18:54:38.555758] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-23T18:54:38.559779] [INFO ] [REMOTE ] FPF: Full fetch complete (26319 records). [2025-09-23T18:54:38.559900] [DEBUG] [VALIDATOR ] FPF: Validating primary data. [2025-09-23T18:54:38.607431] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-05. [2025-09-23T18:54:38.976226] [DEBUG] [VALIDATOR ] FPF: All expected trading days are present. [2025-09-23T18:54:38.976337] [DEBUG] [VALIDATOR ] FPF: Primary data validation passed. [2025-09-23T18:54:38.977275] [INFO ] [MAIN ] FPF: Fetched primary data is valid. [2025-09-23T18:54:38.977396] [DEBUG] [LOCAL ] FPF: Saving primary data. [2025-09-23T18:54:38.978375] [DEBUG] [LOCAL ] FPF: Trimmed 26319 records to 17613 (keeping 200 days of data) [2025-09-23T18:54:39.095072] [DEBUG] [LOCAL ] FPF: Primary data saved (17613 records). [2025-09-23T18:54:39.095239] [INFO ] [MAIN ] FPF: Full history saved. [2025-09-23T18:54:39.095350] [INFO ] [MAIN ] Update Progress: 865/2372 symbols completed. FPF took 33.1s. Estimated remaining: 3h 19m 39s. Rate: 7.5 symbols/min [2025-09-23T18:54:39.293188] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:54:39.311285] [DEBUG] [LOCAL ] FRA: Loaded 14592 existing records from primary storage. [2025-09-23T18:54:39.311428] [INFO ] [MAIN ] FRA: Loaded 14592 existing records. [2025-09-23T18:54:39.407544] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-08. [2025-09-23T18:54:39.505623] [WARN ] [MAIN ] FRA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:54:39.505890] [INFO ] [MAIN ] FRA: Wiping existing primary data before full refresh. [2025-09-23T18:54:39.505941] [INFO ] [LOCAL ] FRA: Starting deletion of primary data. [2025-09-23T18:54:39.506509] [DEBUG] [LOCAL ] FRA: Deleted primary data file. [2025-09-23T18:54:39.506570] [INFO ] [MAIN ] FRA: Starting full primary refresh. [2025-09-23T18:54:39.877497] [INFO ] [REMOTE ] FRA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:54:40.057389] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-23T18:54:40.202256] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-06. [2025-09-23T18:54:41.008128] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-03. [2025-09-23T18:54:41.030174] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-23T18:54:41.121364] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-23T18:54:41.802231] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-09. [2025-09-23T18:54:42.602234] [INFO ] [REMOTE ] FRA: Fetching primary data for 2024-12. [2025-09-23T18:54:42.703820] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-23T18:54:43.330043] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-23T18:54:43.347907] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-23T18:54:43.360852] [INFO ] [REMOTE ] FOUR: Full fetch complete (71941 records). [2025-09-23T18:54:43.361076] [DEBUG] [VALIDATOR ] FOUR: Validating primary data. [2025-09-23T18:54:43.407523] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-07. [2025-09-23T18:54:43.867833] [DEBUG] [VALIDATOR ] FOUR: All expected trading days are present. [2025-09-23T18:54:43.868061] [DEBUG] [VALIDATOR ] FOUR: Primary data validation passed. [2025-09-23T18:54:43.869380] [INFO ] [MAIN ] FOUR: Fetched primary data is valid. [2025-09-23T18:54:43.869538] [DEBUG] [LOCAL ] FOUR: Saving primary data. [2025-09-23T18:54:43.871389] [DEBUG] [LOCAL ] FOUR: Trimmed 71941 records to 49524 (keeping 200 days of data) [2025-09-23T18:54:44.181745] [DEBUG] [LOCAL ] FOUR: Primary data saved (49524 records). [2025-09-23T18:54:44.181886] [INFO ] [MAIN ] FOUR: Full history saved. [2025-09-23T18:54:44.182135] [INFO ] [MAIN ] Update Progress: 866/2372 symbols completed. FOUR took 49.2s. Estimated remaining: 3h 19m 26s. Rate: 7.6 symbols/min [2025-09-23T18:54:44.212028] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-04. [2025-09-23T18:54:44.356785] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:54:44.376512] [DEBUG] [LOCAL ] FRGE: Loaded 18734 existing records from primary storage. [2025-09-23T18:54:44.376672] [INFO ] [MAIN ] FRGE: Loaded 18734 existing records. [2025-09-23T18:54:44.553384] [WARN ] [MAIN ] FRGE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:54:44.553715] [INFO ] [MAIN ] FRGE: Wiping existing primary data before full refresh. [2025-09-23T18:54:44.553785] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-09-23T18:54:44.554363] [DEBUG] [LOCAL ] FRGE: Deleted primary data file. [2025-09-23T18:54:44.554424] [INFO ] [MAIN ] FRGE: Starting full primary refresh. [2025-09-23T18:54:44.910250] [INFO ] [REMOTE ] FRGE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:54:44.931259] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-23T18:54:45.002182] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2024-12. [2025-09-23T18:54:45.580994] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-23T18:54:45.802209] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-01. [2025-09-23T18:54:46.256233] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-23T18:54:46.608703] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-08. [2025-09-23T18:54:46.624811] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-23T18:54:47.402211] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-02. [2025-09-23T18:54:47.427258] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-23T18:54:47.998508] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-23T18:54:48.202205] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-03. [2025-09-23T18:54:49.002185] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-01. [2025-09-23T18:54:49.274051] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-23T18:54:49.802194] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-04. [2025-09-23T18:54:50.404144] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-23T18:54:50.602186] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-02. [2025-09-23T18:54:50.850892] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-23T18:54:51.402235] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-05. [2025-09-23T18:54:51.549310] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-23T18:54:52.202226] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-09. [2025-09-23T18:54:52.793411] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-23T18:54:53.002200] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-03. [2025-09-23T18:54:53.116806] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-23T18:54:53.121917] [INFO ] [REMOTE ] FPI: Full fetch complete (44088 records). [2025-09-23T18:54:53.122014] [DEBUG] [VALIDATOR ] FPI: Validating primary data. [2025-09-23T18:54:53.521592] [DEBUG] [VALIDATOR ] FPI: All expected trading days are present. [2025-09-23T18:54:53.521723] [DEBUG] [VALIDATOR ] FPI: Primary data validation passed. [2025-09-23T18:54:53.522378] [INFO ] [MAIN ] FPI: Fetched primary data is valid. [2025-09-23T18:54:53.522476] [DEBUG] [LOCAL ] FPI: Saving primary data. [2025-09-23T18:54:53.523554] [DEBUG] [LOCAL ] FPI: Trimmed 44088 records to 31151 (keeping 200 days of data) [2025-09-23T18:54:53.721693] [DEBUG] [LOCAL ] FPI: Primary data saved (31151 records). [2025-09-23T18:54:53.721834] [INFO ] [MAIN ] FPI: Full history saved. [2025-09-23T18:54:53.721965] [INFO ] [MAIN ] Update Progress: 867/2372 symbols completed. FPI took 37.2s. Estimated remaining: 3h 19m 21s. Rate: 7.5 symbols/min [2025-09-23T18:54:53.807539] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-06. [2025-09-23T18:54:53.895768] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:54:53.953728] [DEBUG] [LOCAL ] FRO: Loaded 51881 existing records from primary storage. [2025-09-23T18:54:53.953877] [INFO ] [MAIN ] FRO: Loaded 51881 existing records. [2025-09-23T18:54:54.144868] [WARN ] [MAIN ] FRO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:54:54.145284] [INFO ] [MAIN ] FRO: Wiping existing primary data before full refresh. [2025-09-23T18:54:54.145354] [INFO ] [LOCAL ] FRO: Starting deletion of primary data. [2025-09-23T18:54:54.146572] [DEBUG] [LOCAL ] FRO: Deleted primary data file. [2025-09-23T18:54:54.146676] [INFO ] [MAIN ] FRO: Starting full primary refresh. [2025-09-23T18:54:54.464347] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-23T18:54:54.536551] [INFO ] [REMOTE ] FRO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:54:54.602149] [INFO ] [REMOTE ] FRO: Fetching primary data for 2024-12. [2025-09-23T18:54:55.090425] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-23T18:54:55.402220] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-05. [2025-09-23T18:54:55.926019] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-23T18:54:56.112509] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-23T18:54:56.202170] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-01. [2025-09-23T18:54:57.002239] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-04. [2025-09-23T18:54:57.760392] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-23T18:54:57.802160] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-06. [2025-09-23T18:54:58.268980] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-23T18:54:58.367772] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-23T18:54:58.602199] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-02. [2025-09-23T18:54:59.402206] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-07. [2025-09-23T18:55:00.048462] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-23T18:55:00.202188] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-03. [2025-09-23T18:55:00.794870] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-23T18:55:01.002202] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-07. [2025-09-23T18:55:01.802290] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-05. [2025-09-23T18:55:02.028209] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-23T18:55:02.219746] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-23T18:55:02.437490] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-23T18:55:02.602278] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-06. [2025-09-23T18:55:03.402173] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-08. [2025-09-23T18:55:03.570075] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-23T18:55:04.202214] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-08. [2025-09-23T18:55:04.225236] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-23T18:55:05.002200] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-07. [2025-09-23T18:55:05.702779] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-23T18:55:05.802159] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-09. [2025-09-23T18:55:05.853733] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-23T18:55:06.602204] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-08. [2025-09-23T18:55:07.351107] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-23T18:55:07.358935] [INFO ] [REMOTE ] FR: Full fetch complete (66530 records). [2025-09-23T18:55:07.359084] [DEBUG] [VALIDATOR ] FR: Validating primary data. [2025-09-23T18:55:07.414053] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-09. [2025-09-23T18:55:07.479757] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-23T18:55:07.777936] [DEBUG] [VALIDATOR ] FR: All expected trading days are present. [2025-09-23T18:55:07.778031] [DEBUG] [VALIDATOR ] FR: Primary data validation passed. [2025-09-23T18:55:07.778850] [INFO ] [MAIN ] FR: Fetched primary data is valid. [2025-09-23T18:55:07.778913] [DEBUG] [LOCAL ] FR: Saving primary data. [2025-09-23T18:55:07.780309] [DEBUG] [LOCAL ] FR: Trimmed 66530 records to 46597 (keeping 200 days of data) [2025-09-23T18:55:08.076841] [DEBUG] [LOCAL ] FR: Primary data saved (46597 records). [2025-09-23T18:55:08.076977] [INFO ] [MAIN ] FR: Full history saved. [2025-09-23T18:55:08.077116] [INFO ] [MAIN ] Update Progress: 868/2372 symbols completed. FR took 37.7s. Estimated remaining: 3h 19m 24s. Rate: 7.5 symbols/min [2025-09-23T18:55:08.207337] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-04. [2025-09-23T18:55:08.251359] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:55:08.297308] [DEBUG] [LOCAL ] FRT: Loaded 42371 existing records from primary storage. [2025-09-23T18:55:08.297453] [INFO ] [MAIN ] FRT: Loaded 42371 existing records. [2025-09-23T18:55:08.475016] [WARN ] [MAIN ] FRT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:55:08.475340] [INFO ] [MAIN ] FRT: Wiping existing primary data before full refresh. [2025-09-23T18:55:08.475401] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-09-23T18:55:08.484382] [DEBUG] [LOCAL ] FRT: Deleted primary data file. [2025-09-23T18:55:08.484475] [INFO ] [MAIN ] FRT: Starting full primary refresh. [2025-09-23T18:55:08.529431] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-23T18:55:08.581902] [INFO ] [REMOTE ] FRA: Full fetch complete (24237 records). [2025-09-23T18:55:08.592539] [DEBUG] [VALIDATOR ] FRA: Validating primary data. [2025-09-23T18:55:09.008497] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-09. [2025-09-23T18:55:09.140915] [INFO ] [REMOTE ] FRT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:55:09.260371] [DEBUG] [VALIDATOR ] FRA: All expected trading days are present. [2025-09-23T18:55:09.260457] [DEBUG] [VALIDATOR ] FRA: Primary data validation passed. [2025-09-23T18:55:09.260978] [INFO ] [MAIN ] FRA: Fetched primary data is valid. [2025-09-23T18:55:09.261062] [DEBUG] [LOCAL ] FRA: Saving primary data. [2025-09-23T18:55:09.261820] [DEBUG] [LOCAL ] FRA: Trimmed 24237 records to 14584 (keeping 200 days of data) [2025-09-23T18:55:09.352408] [DEBUG] [LOCAL ] FRA: Primary data saved (14584 records). [2025-09-23T18:55:09.352561] [INFO ] [MAIN ] FRA: Full history saved. [2025-09-23T18:55:09.352738] [INFO ] [MAIN ] Update Progress: 869/2372 symbols completed. FRA took 30.3s. Estimated remaining: 3h 19m 5s. Rate: 7.5 symbols/min [2025-09-23T18:55:09.523202] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:55:09.572703] [DEBUG] [LOCAL ] FSCO: Loaded 36753 existing records from primary storage. [2025-09-23T18:55:09.572856] [INFO ] [MAIN ] FSCO: Loaded 36753 existing records. [2025-09-23T18:55:09.752144] [WARN ] [MAIN ] FSCO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:55:09.752601] [INFO ] [MAIN ] FSCO: Wiping existing primary data before full refresh. [2025-09-23T18:55:09.752720] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-09-23T18:55:09.754449] [DEBUG] [LOCAL ] FSCO: Deleted primary data file. [2025-09-23T18:55:09.754513] [INFO ] [MAIN ] FSCO: Starting full primary refresh. [2025-09-23T18:55:09.817413] [INFO ] [REMOTE ] FRT: Fetching primary data for 2024-12. [2025-09-23T18:55:10.164860] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-23T18:55:10.147368] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-23T18:55:10.171591] [INFO ] [REMOTE ] FSCO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:55:10.192442] [INFO ] [REMOTE ] FRGE: Full fetch complete (34204 records). [2025-09-23T18:55:10.193452] [DEBUG] [VALIDATOR ] FRGE: Validating primary data. [2025-09-23T18:55:10.595042] [DEBUG] [VALIDATOR ] FRGE: All expected trading days are present. [2025-09-23T18:55:10.595132] [DEBUG] [VALIDATOR ] FRGE: Primary data validation passed. [2025-09-23T18:55:10.595768] [INFO ] [MAIN ] FRGE: Fetched primary data is valid. [2025-09-23T18:55:10.595830] [DEBUG] [LOCAL ] FRGE: Saving primary data. [2025-09-23T18:55:10.596662] [DEBUG] [LOCAL ] FRGE: Trimmed 34204 records to 18585 (keeping 200 days of data) [2025-09-23T18:55:10.602215] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2024-12. [2025-09-23T18:55:10.712345] [DEBUG] [LOCAL ] FRGE: Primary data saved (18585 records). [2025-09-23T18:55:10.712480] [INFO ] [MAIN ] FRGE: Full history saved. [2025-09-23T18:55:10.712565] [INFO ] [MAIN ] Update Progress: 870/2372 symbols completed. FRGE took 26.5s. Estimated remaining: 3h 18m 45s. Rate: 7.6 symbols/min [2025-09-23T18:55:10.882402] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:55:10.935419] [DEBUG] [LOCAL ] FSK: Loaded 49383 existing records from primary storage. [2025-09-23T18:55:10.935761] [INFO ] [MAIN ] FSK: Loaded 49383 existing records. [2025-09-23T18:55:11.140228] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-23T18:55:11.151545] [WARN ] [MAIN ] FSK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:55:11.152245] [INFO ] [MAIN ] FSK: Wiping existing primary data before full refresh. [2025-09-23T18:55:11.152318] [INFO ] [LOCAL ] FSK: Starting deletion of primary data. [2025-09-23T18:55:11.153516] [DEBUG] [LOCAL ] FSK: Deleted primary data file. [2025-09-23T18:55:11.153582] [INFO ] [MAIN ] FSK: Starting full primary refresh. [2025-09-23T18:55:11.409987] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-05. [2025-09-23T18:55:11.526528] [INFO ] [REMOTE ] FSK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:55:12.139346] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-23T18:55:12.202232] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-01. [2025-09-23T18:55:13.007333] [INFO ] [REMOTE ] FSK: Fetching primary data for 2024-12. [2025-09-23T18:55:13.025167] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-23T18:55:13.380233] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-23T18:55:13.802189] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-02. [2025-09-23T18:55:14.270888] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-23T18:55:14.602196] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-01. [2025-09-23T18:55:15.123960] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-23T18:55:15.402199] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-03. [2025-09-23T18:55:15.891934] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-23T18:55:16.202193] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-01. [2025-09-23T18:55:16.437398] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-23T18:55:17.002198] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-06. [2025-09-23T18:55:17.553934] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-23T18:55:17.802202] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-02. [2025-09-23T18:55:18.602294] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-02. [2025-09-23T18:55:18.830535] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-23T18:55:18.899705] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-23T18:55:19.402249] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-07. [2025-09-23T18:55:20.031971] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-23T18:55:20.202193] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-04. [2025-09-23T18:55:20.779742] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-23T18:55:21.002260] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-03. [2025-09-23T18:55:21.338296] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-23T18:55:21.802271] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-08. [2025-09-23T18:55:22.602166] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-03. [2025-09-23T18:55:22.783413] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-23T18:55:23.295845] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-23T18:55:23.402244] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-09. [2025-09-23T18:55:24.062306] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-23T18:55:24.202203] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-04. [2025-09-23T18:55:24.856825] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-23T18:55:24.865611] [INFO ] [REMOTE ] FRO: Full fetch complete (75434 records). [2025-09-23T18:55:24.865838] [DEBUG] [VALIDATOR ] FRO: Validating primary data. [2025-09-23T18:55:25.007351] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-05. [2025-09-23T18:55:25.261303] [DEBUG] [VALIDATOR ] FRO: All expected trading days are present. [2025-09-23T18:55:25.261384] [DEBUG] [VALIDATOR ] FRO: Primary data validation passed. [2025-09-23T18:55:25.262261] [INFO ] [MAIN ] FRO: Fetched primary data is valid. [2025-09-23T18:55:25.262327] [DEBUG] [LOCAL ] FRO: Saving primary data. [2025-09-23T18:55:25.266592] [DEBUG] [LOCAL ] FRO: Trimmed 75434 records to 51894 (keeping 200 days of data) [2025-09-23T18:55:25.530394] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-23T18:55:25.633687] [DEBUG] [LOCAL ] FRO: Primary data saved (51894 records). [2025-09-23T18:55:25.633833] [INFO ] [MAIN ] FRO: Full history saved. [2025-09-23T18:55:25.633916] [INFO ] [MAIN ] Update Progress: 871/2372 symbols completed. FRO took 31.9s. Estimated remaining: 3h 18m 49s. Rate: 7.5 symbols/min [2025-09-23T18:55:25.800924] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:55:25.802225] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-05. [2025-09-23T18:55:25.853039] [DEBUG] [LOCAL ] FSLY: Loaded 51270 existing records from primary storage. [2025-09-23T18:55:25.853188] [INFO ] [MAIN ] FSLY: Loaded 51270 existing records. [2025-09-23T18:55:26.032358] [WARN ] [MAIN ] FSLY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:55:26.032602] [INFO ] [MAIN ] FSLY: Wiping existing primary data before full refresh. [2025-09-23T18:55:26.032673] [INFO ] [LOCAL ] FSLY: Starting deletion of primary data. [2025-09-23T18:55:26.033710] [DEBUG] [LOCAL ] FSLY: Deleted primary data file. [2025-09-23T18:55:26.033769] [INFO ] [MAIN ] FSLY: Starting full primary refresh. [2025-09-23T18:55:26.394612] [INFO ] [REMOTE ] FSLY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:55:26.420409] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-23T18:55:26.602152] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2024-12. [2025-09-23T18:55:27.071699] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-23T18:55:27.402229] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-04. [2025-09-23T18:55:28.202206] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-06. [2025-09-23T18:55:28.580684] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-23T18:55:28.918441] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-23T18:55:29.002148] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-05. [2025-09-23T18:55:29.090083] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-23T18:55:29.802246] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-01. [2025-09-23T18:55:30.602194] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-06. [2025-09-23T18:55:30.702414] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-23T18:55:31.113561] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-23T18:55:31.402269] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-06. [2025-09-23T18:55:31.829721] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-23T18:55:32.202302] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-02. [2025-09-23T18:55:32.645102] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-23T18:55:33.002203] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-07. [2025-09-23T18:55:33.802201] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-07. [2025-09-23T18:55:34.105568] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-23T18:55:34.505243] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-23T18:55:34.602173] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-08. [2025-09-23T18:55:35.402244] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-07. [2025-09-23T18:55:35.465131] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-23T18:55:35.648137] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-23T18:55:36.202326] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-09. [2025-09-23T18:55:36.714190] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-23T18:55:37.002254] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-03. [2025-09-23T18:55:37.376187] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-23T18:55:37.384443] [INFO ] [REMOTE ] FSCO: Full fetch complete (53892 records). [2025-09-23T18:55:37.384738] [DEBUG] [VALIDATOR ] FSCO: Validating primary data. [2025-09-23T18:55:37.796593] [DEBUG] [VALIDATOR ] FSCO: All expected trading days are present. [2025-09-23T18:55:37.796801] [DEBUG] [VALIDATOR ] FSCO: Primary data validation passed. [2025-09-23T18:55:37.797870] [INFO ] [MAIN ] FSCO: Fetched primary data is valid. [2025-09-23T18:55:37.797945] [DEBUG] [LOCAL ] FSCO: Saving primary data. [2025-09-23T18:55:37.799761] [DEBUG] [LOCAL ] FSCO: Trimmed 53892 records to 36851 (keeping 200 days of data) [2025-09-23T18:55:37.802230] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-08. [2025-09-23T18:55:38.030454] [DEBUG] [LOCAL ] FSCO: Primary data saved (36851 records). [2025-09-23T18:55:38.030619] [INFO ] [MAIN ] FSCO: Full history saved. [2025-09-23T18:55:38.030746] [INFO ] [MAIN ] Update Progress: 872/2372 symbols completed. FSCO took 28.7s. Estimated remaining: 3h 18m 49s. Rate: 7.5 symbols/min [2025-09-23T18:55:38.208948] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:55:38.261452] [DEBUG] [LOCAL ] FSM: Loaded 53288 existing records from primary storage. [2025-09-23T18:55:38.261618] [INFO ] [MAIN ] FSM: Loaded 53288 existing records. [2025-09-23T18:55:38.460088] [WARN ] [MAIN ] FSM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:55:38.460547] [INFO ] [MAIN ] FSM: Wiping existing primary data before full refresh. [2025-09-23T18:55:38.460618] [INFO ] [LOCAL ] FSM: Starting deletion of primary data. [2025-09-23T18:55:38.461832] [DEBUG] [LOCAL ] FSM: Deleted primary data file. [2025-09-23T18:55:38.461897] [INFO ] [MAIN ] FSM: Starting full primary refresh. [2025-09-23T18:55:38.619395] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-08. [2025-09-23T18:55:38.695300] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-23T18:55:38.920830] [INFO ] [REMOTE ] FSM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:55:39.402211] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-04. [2025-09-23T18:55:39.718561] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-23T18:55:40.202159] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-09. [2025-09-23T18:55:40.243096] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-23T18:55:40.796623] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-23T18:55:41.002192] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-05. [2025-09-23T18:55:41.684473] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-23T18:55:41.698556] [INFO ] [REMOTE ] FSK: Full fetch complete (71390 records). [2025-09-23T18:55:41.698750] [DEBUG] [VALIDATOR ] FSK: Validating primary data. [2025-09-23T18:55:41.803963] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-09. [2025-09-23T18:55:42.100350] [DEBUG] [VALIDATOR ] FSK: All expected trading days are present. [2025-09-23T18:55:42.100464] [DEBUG] [VALIDATOR ] FSK: Primary data validation passed. [2025-09-23T18:55:42.101346] [INFO ] [MAIN ] FSK: Fetched primary data is valid. [2025-09-23T18:55:42.101411] [DEBUG] [LOCAL ] FSK: Saving primary data. [2025-09-23T18:55:42.102835] [DEBUG] [LOCAL ] FSK: Trimmed 71390 records to 49398 (keeping 200 days of data) [2025-09-23T18:55:42.409745] [DEBUG] [LOCAL ] FSK: Primary data saved (49398 records). [2025-09-23T18:55:42.409876] [INFO ] [MAIN ] FSK: Full history saved. [2025-09-23T18:55:42.410014] [INFO ] [MAIN ] Update Progress: 873/2372 symbols completed. FSK took 31.7s. Estimated remaining: 3h 18m 35s. Rate: 7.5 symbols/min [2025-09-23T18:55:42.599497] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:55:42.609059] [INFO ] [REMOTE ] FSM: Fetching primary data for 2024-12. [2025-09-23T18:55:42.613368] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-23T18:55:42.656394] [DEBUG] [LOCAL ] FSS: Loaded 34636 existing records from primary storage. [2025-09-23T18:55:42.656528] [INFO ] [MAIN ] FSS: Loaded 34636 existing records. [2025-09-23T18:55:42.835302] [WARN ] [MAIN ] FSS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:55:42.835603] [INFO ] [MAIN ] FSS: Wiping existing primary data before full refresh. [2025-09-23T18:55:42.835687] [INFO ] [LOCAL ] FSS: Starting deletion of primary data. [2025-09-23T18:55:42.836477] [DEBUG] [LOCAL ] FSS: Deleted primary data file. [2025-09-23T18:55:42.836536] [INFO ] [MAIN ] FSS: Starting full primary refresh. [2025-09-23T18:55:43.189104] [INFO ] [REMOTE ] FSS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:55:43.389667] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-23T18:55:43.397213] [INFO ] [REMOTE ] FRT: Full fetch complete (60261 records). [2025-09-23T18:55:43.397357] [DEBUG] [VALIDATOR ] FRT: Validating primary data. [2025-09-23T18:55:43.409288] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-06. [2025-09-23T18:55:43.790200] [DEBUG] [VALIDATOR ] FRT: All expected trading days are present. [2025-09-23T18:55:43.790315] [DEBUG] [VALIDATOR ] FRT: Primary data validation passed. [2025-09-23T18:55:43.791047] [INFO ] [MAIN ] FRT: Fetched primary data is valid. [2025-09-23T18:55:43.791109] [DEBUG] [LOCAL ] FRT: Saving primary data. [2025-09-23T18:55:43.792380] [DEBUG] [LOCAL ] FRT: Trimmed 60261 records to 42360 (keeping 200 days of data) [2025-09-23T18:55:44.037695] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-23T18:55:44.091049] [DEBUG] [LOCAL ] FRT: Primary data saved (42360 records). [2025-09-23T18:55:44.091173] [INFO ] [MAIN ] FRT: Full history saved. [2025-09-23T18:55:44.091271] [INFO ] [MAIN ] Update Progress: 874/2372 symbols completed. FRT took 36.0s. Estimated remaining: 3h 18m 16s. Rate: 7.6 symbols/min [2025-09-23T18:55:44.207307] [INFO ] [REMOTE ] FSS: Fetching primary data for 2024-12. [2025-09-23T18:55:44.266587] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:55:44.274511] [DEBUG] [LOCAL ] FT: Loaded 6280 existing records from primary storage. [2025-09-23T18:55:44.274624] [INFO ] [MAIN ] FT: Loaded 6280 existing records. [2025-09-23T18:55:44.527199] [WARN ] [MAIN ] FT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:55:44.527542] [INFO ] [MAIN ] FT: Wiping existing primary data before full refresh. [2025-09-23T18:55:44.527598] [INFO ] [LOCAL ] FT: Starting deletion of primary data. [2025-09-23T18:55:44.527921] [DEBUG] [LOCAL ] FT: Deleted primary data file. [2025-09-23T18:55:44.527981] [INFO ] [MAIN ] FT: Starting full primary refresh. [2025-09-23T18:55:44.915741] [INFO ] [REMOTE ] FT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:55:44.949612] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-23T18:55:45.002207] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-07. [2025-09-23T18:55:45.368744] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-23T18:55:45.802210] [INFO ] [REMOTE ] FT: Fetching primary data for 2024-12. [2025-09-23T18:55:46.234231] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-23T18:55:46.602192] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-01. [2025-09-23T18:55:46.877338] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-23T18:55:47.402217] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-01. [2025-09-23T18:55:48.202172] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-01. [2025-09-23T18:55:48.451557] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-23T18:55:48.498228] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-23T18:55:48.611977] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-23T18:55:49.002249] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-02. [2025-09-23T18:55:49.802197] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-08. [2025-09-23T18:55:50.339586] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-23T18:55:50.602220] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-02. [2025-09-23T18:55:51.159265] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-23T18:55:51.228286] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-23T18:55:51.402205] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-09. [2025-09-23T18:55:52.202258] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-03. [2025-09-23T18:55:52.796511] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-23T18:55:52.809878] [INFO ] [REMOTE ] FSLY: Full fetch complete (74980 records). [2025-09-23T18:55:52.810093] [DEBUG] [VALIDATOR ] FSLY: Validating primary data. [2025-09-23T18:55:53.011462] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-03. [2025-09-23T18:55:53.217407] [DEBUG] [VALIDATOR ] FSLY: All expected trading days are present. [2025-09-23T18:55:53.217489] [DEBUG] [VALIDATOR ] FSLY: Primary data validation passed. [2025-09-23T18:55:53.218418] [INFO ] [MAIN ] FSLY: Fetched primary data is valid. [2025-09-23T18:55:53.218485] [DEBUG] [LOCAL ] FSLY: Saving primary data. [2025-09-23T18:55:53.219992] [DEBUG] [LOCAL ] FSLY: Trimmed 74980 records to 51274 (keeping 200 days of data) [2025-09-23T18:55:53.516337] [DEBUG] [LOCAL ] FSLY: Primary data saved (51274 records). [2025-09-23T18:55:53.516476] [INFO ] [MAIN ] FSLY: Full history saved. [2025-09-23T18:55:53.516565] [INFO ] [MAIN ] Update Progress: 875/2372 symbols completed. FSLY took 27.9s. Estimated remaining: 3h 18m 11s. Rate: 7.6 symbols/min [2025-09-23T18:55:53.694774] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:55:53.701492] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-23T18:55:53.731493] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-23T18:55:53.745015] [DEBUG] [LOCAL ] FTHY: Loaded 11687 existing records from primary storage. [2025-09-23T18:55:53.745512] [INFO ] [MAIN ] FTHY: Loaded 11687 existing records. [2025-09-23T18:55:53.809627] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-04. [2025-09-23T18:55:53.932484] [WARN ] [MAIN ] FTHY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:55:53.932769] [INFO ] [MAIN ] FTHY: Wiping existing primary data before full refresh. [2025-09-23T18:55:53.932824] [INFO ] [LOCAL ] FTHY: Starting deletion of primary data. [2025-09-23T18:55:53.933254] [DEBUG] [LOCAL ] FTHY: Deleted primary data file. [2025-09-23T18:55:53.933317] [INFO ] [MAIN ] FTHY: Starting full primary refresh. [2025-09-23T18:55:54.313612] [INFO ] [REMOTE ] FTHY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:55:54.335459] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-23T18:55:54.602204] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2024-12. [2025-09-23T18:55:55.402202] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-02. [2025-09-23T18:55:55.551858] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-23T18:55:56.202219] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-05. [2025-09-23T18:55:56.625725] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-23T18:55:56.767781] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-23T18:55:57.002194] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-03. [2025-09-23T18:55:57.802209] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-04. [2025-09-23T18:55:58.428877] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-23T18:55:58.602225] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-04. [2025-09-23T18:55:59.402218] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-01. [2025-09-23T18:55:59.551961] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-23T18:55:59.982688] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-23T18:56:00.038001] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-23T18:56:00.202189] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-05. [2025-09-23T18:56:01.002203] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-05. [2025-09-23T18:56:01.651065] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-23T18:56:01.802197] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-02. [2025-09-23T18:56:02.293784] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-23T18:56:02.510821] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-23T18:56:02.602205] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-03. [2025-09-23T18:56:03.249167] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-23T18:56:03.402204] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-06. [2025-09-23T18:56:04.202197] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-06. [2025-09-23T18:56:05.002189] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-04. [2025-09-23T18:56:05.163022] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-23T18:56:05.256738] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-23T18:56:05.802196] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-07. [2025-09-23T18:56:06.098328] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-23T18:56:06.602197] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-07. [2025-09-23T18:56:07.286727] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-23T18:56:07.402206] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-08. [2025-09-23T18:56:08.101111] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-23T18:56:08.202192] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-08. [2025-09-23T18:56:08.325095] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-23T18:56:09.002218] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-09. [2025-09-23T18:56:09.748715] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-23T18:56:09.802221] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-06. [2025-09-23T18:56:10.495794] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-23T18:56:10.500988] [INFO ] [REMOTE ] FSS: Full fetch complete (48090 records). [2025-09-23T18:56:10.501137] [DEBUG] [VALIDATOR ] FSS: Validating primary data. [2025-09-23T18:56:10.608211] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-09. [2025-09-23T18:56:10.621885] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-23T18:56:10.911438] [DEBUG] [VALIDATOR ] FSS: All expected trading days are present. [2025-09-23T18:56:10.911531] [DEBUG] [VALIDATOR ] FSS: Primary data validation passed. [2025-09-23T18:56:10.912238] [INFO ] [MAIN ] FSS: Fetched primary data is valid. [2025-09-23T18:56:10.912306] [DEBUG] [LOCAL ] FSS: Saving primary data. [2025-09-23T18:56:10.913567] [DEBUG] [LOCAL ] FSS: Trimmed 48090 records to 34552 (keeping 200 days of data) [2025-09-23T18:56:11.162705] [DEBUG] [LOCAL ] FSS: Primary data saved (34552 records). [2025-09-23T18:56:11.162860] [INFO ] [MAIN ] FSS: Full history saved. [2025-09-23T18:56:11.162951] [INFO ] [MAIN ] Update Progress: 876/2372 symbols completed. FSS took 28.8s. Estimated remaining: 3h 18m 20s. Rate: 7.5 symbols/min [2025-09-23T18:56:11.344698] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:56:11.397415] [DEBUG] [LOCAL ] FTI: Loaded 53303 existing records from primary storage. [2025-09-23T18:56:11.397587] [INFO ] [MAIN ] FTI: Loaded 53303 existing records. [2025-09-23T18:56:11.408895] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-07. [2025-09-23T18:56:11.582326] [WARN ] [MAIN ] FTI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:56:11.582602] [INFO ] [MAIN ] FTI: Wiping existing primary data before full refresh. [2025-09-23T18:56:11.582683] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-09-23T18:56:11.583835] [DEBUG] [LOCAL ] FTI: Deleted primary data file. [2025-09-23T18:56:11.583898] [INFO ] [MAIN ] FTI: Starting full primary refresh. [2025-09-23T18:56:12.007616] [INFO ] [REMOTE ] FTI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:56:12.202199] [INFO ] [REMOTE ] FTI: Fetching primary data for 2024-12. [2025-09-23T18:56:12.233783] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-23T18:56:12.501887] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-23T18:56:12.512345] [INFO ] [REMOTE ] FSM: Full fetch complete (76683 records). [2025-09-23T18:56:12.512495] [DEBUG] [VALIDATOR ] FSM: Validating primary data. [2025-09-23T18:56:12.935809] [DEBUG] [VALIDATOR ] FSM: All expected trading days are present. [2025-09-23T18:56:12.935901] [DEBUG] [VALIDATOR ] FSM: Primary data validation passed. [2025-09-23T18:56:12.936813] [INFO ] [MAIN ] FSM: Fetched primary data is valid. [2025-09-23T18:56:12.936880] [DEBUG] [LOCAL ] FSM: Saving primary data. [2025-09-23T18:56:12.938402] [DEBUG] [LOCAL ] FSM: Trimmed 76683 records to 53288 (keeping 200 days of data) [2025-09-23T18:56:13.026007] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-08. [2025-09-23T18:56:13.257216] [DEBUG] [LOCAL ] FSM: Primary data saved (53288 records). [2025-09-23T18:56:13.257374] [INFO ] [MAIN ] FSM: Full history saved. [2025-09-23T18:56:13.257461] [INFO ] [MAIN ] Update Progress: 877/2372 symbols completed. FSM took 35.2s. Estimated remaining: 3h 18m 2s. Rate: 7.5 symbols/min [2025-09-23T18:56:13.648216] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-23T18:56:13.802174] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-09. [2025-09-23T18:56:13.952812] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-23T18:56:14.434273] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-23T18:56:14.436016] [INFO ] [REMOTE ] FT: Full fetch complete (9040 records). [2025-09-23T18:56:14.436086] [DEBUG] [VALIDATOR ] FT: Validating primary data. [2025-09-23T18:56:14.620137] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-01. [2025-09-23T18:56:14.815332] [DEBUG] [VALIDATOR ] FT: All expected trading days are present. [2025-09-23T18:56:14.815412] [DEBUG] [VALIDATOR ] FT: Primary data validation passed. [2025-09-23T18:56:14.815634] [INFO ] [MAIN ] FT: Fetched primary data is valid. [2025-09-23T18:56:14.815713] [DEBUG] [LOCAL ] FT: Saving primary data. [2025-09-23T18:56:14.816150] [DEBUG] [LOCAL ] FT: Trimmed 9040 records to 6291 (keeping 200 days of data) [2025-09-23T18:56:14.853441] [DEBUG] [LOCAL ] FT: Primary data saved (6291 records). [2025-09-23T18:56:14.853573] [INFO ] [MAIN ] FT: Full history saved. [2025-09-23T18:56:14.853683] [INFO ] [MAIN ] Update Progress: 878/2372 symbols completed. FT took 30.8s. Estimated remaining: 3h 17m 43s. Rate: 7.6 symbols/min [2025-09-23T18:56:15.402200] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-05. [2025-09-23T18:56:16.146449] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-23T18:56:16.172805] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-23T18:56:16.202160] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-06. [2025-09-23T18:56:16.962695] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-23T18:56:17.002184] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-07. [2025-09-23T18:56:17.805244] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-02. [2025-09-23T18:56:17.806253] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-23T18:56:18.602200] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-08. [2025-09-23T18:56:19.039482] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-23T18:56:19.395364] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-23T18:56:19.402138] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-09. [2025-09-23T18:56:20.202270] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-03. [2025-09-23T18:56:20.354201] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-23T18:56:20.356757] [INFO ] [REMOTE ] FTHY: Full fetch complete (17649 records). [2025-09-23T18:56:20.356854] [DEBUG] [VALIDATOR ] FTHY: Validating primary data. [2025-09-23T18:56:20.743784] [DEBUG] [VALIDATOR ] FTHY: All expected trading days are present. [2025-09-23T18:56:20.743869] [DEBUG] [VALIDATOR ] FTHY: Primary data validation passed. [2025-09-23T18:56:20.744286] [INFO ] [MAIN ] FTHY: Fetched primary data is valid. [2025-09-23T18:56:20.744326] [DEBUG] [LOCAL ] FTHY: Saving primary data. [2025-09-23T18:56:20.744959] [DEBUG] [LOCAL ] FTHY: Trimmed 17649 records to 11693 (keeping 200 days of data) [2025-09-23T18:56:20.821857] [DEBUG] [LOCAL ] FTHY: Primary data saved (11693 records). [2025-09-23T18:56:20.822047] [INFO ] [MAIN ] FTHY: Full history saved. [2025-09-23T18:56:20.822190] [INFO ] [MAIN ] Update Progress: 879/2372 symbols completed. FTHY took 27.3s. Estimated remaining: 3h 17m 32s. Rate: 7.6 symbols/min [2025-09-23T18:56:21.577554] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-23T18:56:21.588694] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-04. [2025-09-23T18:56:22.969740] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-23T18:56:22.981793] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-05. [2025-09-23T18:56:24.274038] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-23T18:56:24.285799] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-06. [2025-09-23T18:56:25.573825] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-23T18:56:25.585055] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-07. [2025-09-23T18:56:27.437775] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-23T18:56:27.449814] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-08. [2025-09-23T18:56:29.246266] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-23T18:56:29.258326] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-09. [2025-09-23T18:56:31.071395] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-23T18:56:31.080485] [INFO ] [REMOTE ] FTI: Full fetch complete (77127 records). [2025-09-23T18:56:31.080630] [DEBUG] [VALIDATOR ] FTI: Validating primary data. [2025-09-23T18:56:31.478759] [DEBUG] [VALIDATOR ] FTI: All expected trading days are present. [2025-09-23T18:56:31.478870] [DEBUG] [VALIDATOR ] FTI: Primary data validation passed. [2025-09-23T18:56:31.479805] [INFO ] [MAIN ] FTI: Fetched primary data is valid. [2025-09-23T18:56:31.479872] [DEBUG] [LOCAL ] FTI: Saving primary data. [2025-09-23T18:56:31.481413] [DEBUG] [LOCAL ] FTI: Trimmed 77127 records to 53303 (keeping 200 days of data) [2025-09-23T18:56:31.818087] [DEBUG] [LOCAL ] FTI: Primary data saved (53303 records). [2025-09-23T18:56:31.818245] [INFO ] [MAIN ] FTI: Full history saved. [2025-09-23T18:56:31.818333] [INFO ] [MAIN ] Update Progress: 880/2372 symbols completed. FTI took 20.7s. Estimated remaining: 3h 17m 29s. Rate: 7.6 symbols/min [2025-09-23T18:56:32.474873] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:56:32.498021] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:56:32.559344] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:56:32.555668] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:56:32.563591] [DEBUG] [LOCAL ] FTWO: Loaded 1779 existing records from primary storage. [2025-09-23T18:56:32.563966] [INFO ] [MAIN ] FTWO: Loaded 1779 existing records. [2025-09-23T18:56:32.799925] [WARN ] [MAIN ] FTWO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:56:32.816340] [DEBUG] [LOCAL ] FTK: Loaded 32110 existing records from primary storage. [2025-09-23T18:56:32.816898] [INFO ] [MAIN ] FTWO: Wiping existing primary data before full refresh. [2025-09-23T18:56:32.816962] [INFO ] [LOCAL ] FTWO: Starting deletion of primary data. [2025-09-23T18:56:32.817070] [INFO ] [MAIN ] FTK: Loaded 32110 existing records. [2025-09-23T18:56:32.828371] [DEBUG] [LOCAL ] FTWO: Deleted primary data file. [2025-09-23T18:56:32.848320] [INFO ] [MAIN ] FTWO: Starting full primary refresh. [2025-09-23T18:56:32.981992] [DEBUG] [LOCAL ] FTS: Loaded 42110 existing records from primary storage. [2025-09-23T18:56:33.050423] [INFO ] [MAIN ] FTS: Loaded 42110 existing records. [2025-09-23T18:56:33.075022] [DEBUG] [LOCAL ] FTV: Loaded 52917 existing records from primary storage. [2025-09-23T18:56:33.124800] [INFO ] [MAIN ] FTV: Loaded 52917 existing records. [2025-09-23T18:56:33.298061] [WARN ] [MAIN ] FTK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:56:33.380075] [INFO ] [MAIN ] FTK: Wiping existing primary data before full refresh. [2025-09-23T18:56:33.460067] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-09-23T18:56:33.593784] [DEBUG] [LOCAL ] FTK: Deleted primary data file. [2025-09-23T18:56:33.664430] [WARN ] [MAIN ] FTS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:56:33.702157] [INFO ] [MAIN ] FTK: Starting full primary refresh. [2025-09-23T18:56:33.745998] [INFO ] [MAIN ] FTS: Wiping existing primary data before full refresh. [2025-09-23T18:56:33.723111] [WARN ] [MAIN ] FTV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:56:33.794759] [INFO ] [MAIN ] FTV: Wiping existing primary data before full refresh. [2025-09-23T18:56:33.783859] [INFO ] [LOCAL ] FTS: Starting deletion of primary data. [2025-09-23T18:56:33.814350] [INFO ] [LOCAL ] FTV: Starting deletion of primary data. [2025-09-23T18:56:33.908498] [DEBUG] [LOCAL ] FTS: Deleted primary data file. [2025-09-23T18:56:33.908756] [INFO ] [MAIN ] FTS: Starting full primary refresh. [2025-09-23T18:56:33.927317] [DEBUG] [LOCAL ] FTV: Deleted primary data file. [2025-09-23T18:56:33.927449] [INFO ] [MAIN ] FTV: Starting full primary refresh. [2025-09-23T18:56:33.899719] [INFO ] [REMOTE ] FTWO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:56:33.961937] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2024-12. [2025-09-23T18:56:34.717212] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-23T18:56:34.796040] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-01. [2025-09-23T18:56:34.838523] [INFO ] [REMOTE ] FTK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:56:34.855950] [INFO ] [REMOTE ] FTK: Fetching primary data for 2024-12. [2025-09-23T18:56:34.956424] [INFO ] [REMOTE ] FTS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:56:34.957428] [INFO ] [REMOTE ] FTS: Fetching primary data for 2024-12. [2025-09-23T18:56:35.033165] [INFO ] [REMOTE ] FTV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:56:35.033451] [INFO ] [REMOTE ] FTV: Fetching primary data for 2024-12. [2025-09-23T18:56:35.580129] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-23T18:56:35.581839] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-02. [2025-09-23T18:56:35.794824] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-23T18:56:35.799871] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-01. [2025-09-23T18:56:35.898401] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-23T18:56:35.899825] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-03. [2025-09-23T18:56:36.048131] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-23T18:56:36.056340] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-01. [2025-09-23T18:56:36.207200] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-23T18:56:36.208432] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-04. [2025-09-23T18:56:36.381592] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-23T18:56:36.396466] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-01. [2025-09-23T18:56:36.550753] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-23T18:56:36.553271] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-23T18:56:36.559939] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-05. [2025-09-23T18:56:36.560218] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-02. [2025-09-23T18:56:36.885944] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-23T18:56:36.887315] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-06. [2025-09-23T18:56:37.077321] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-23T18:56:37.088350] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-02. [2025-09-23T18:56:37.184007] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-09-23T18:56:37.256870] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-23T18:56:37.716266] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-23T18:56:37.802206] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-02. [2025-09-23T18:56:38.163453] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-23T18:56:38.602200] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-07. [2025-09-23T18:56:39.051778] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-23T18:56:39.058370] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-23T18:56:39.402251] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-08. [2025-09-23T18:56:39.921381] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-23T18:56:40.202189] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-09. [2025-09-23T18:56:40.612804] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-23T18:56:40.613931] [INFO ] [REMOTE ] FTWO: Full fetch complete (3506 records). [2025-09-23T18:56:40.614022] [DEBUG] [VALIDATOR ] FTWO: Validating primary data. [2025-09-23T18:56:40.985274] [DEBUG] [VALIDATOR ] FTWO: All expected trading days are present. [2025-09-23T18:56:40.985382] [DEBUG] [VALIDATOR ] FTWO: Primary data validation passed. [2025-09-23T18:56:40.985532] [INFO ] [MAIN ] FTWO: Fetched primary data is valid. [2025-09-23T18:56:40.985573] [DEBUG] [LOCAL ] FTWO: Saving primary data. [2025-09-23T18:56:40.985952] [DEBUG] [LOCAL ] FTWO: Trimmed 3506 records to 1776 (keeping 200 days of data) [2025-09-23T18:56:40.997204] [DEBUG] [LOCAL ] FTWO: Primary data saved (1776 records). [2025-09-23T18:56:40.997269] [INFO ] [MAIN ] FTWO: Full history saved. [2025-09-23T18:56:40.997362] [INFO ] [MAIN ] Update Progress: 881/2372 symbols completed. FTWO took 9.2s. Estimated remaining: 3h 17m 23s. Rate: 7.6 symbols/min [2025-09-23T18:56:41.008296] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-03. [2025-09-23T18:56:41.187963] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:56:41.249419] [DEBUG] [LOCAL ] FUBO: Loaded 53700 existing records from primary storage. [2025-09-23T18:56:41.249598] [INFO ] [MAIN ] FUBO: Loaded 53700 existing records. [2025-09-23T18:56:41.427131] [WARN ] [MAIN ] FUBO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:56:41.427455] [INFO ] [MAIN ] FUBO: Wiping existing primary data before full refresh. [2025-09-23T18:56:41.427528] [INFO ] [LOCAL ] FUBO: Starting deletion of primary data. [2025-09-23T18:56:41.428962] [DEBUG] [LOCAL ] FUBO: Deleted primary data file. [2025-09-23T18:56:41.429023] [INFO ] [MAIN ] FUBO: Starting full primary refresh. [2025-09-23T18:56:41.796927] [INFO ] [REMOTE ] FUBO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:56:41.802185] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-03. [2025-09-23T18:56:42.132938] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-23T18:56:42.602199] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-04. [2025-09-23T18:56:42.716892] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-23T18:56:43.402200] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-03. [2025-09-23T18:56:44.202171] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2024-12. [2025-09-23T18:56:44.309710] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-23T18:56:45.002206] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-04. [2025-09-23T18:56:45.208868] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-23T18:56:45.762686] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-23T18:56:45.802163] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-05. [2025-09-23T18:56:46.326243] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-23T18:56:46.602204] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-01. [2025-09-23T18:56:47.170933] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-23T18:56:47.402223] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-05. [2025-09-23T18:56:48.202276] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-04. [2025-09-23T18:56:48.691403] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-23T18:56:48.809077] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-09-23T18:56:49.002179] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-02. [2025-09-23T18:56:49.723448] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-23T18:56:49.802156] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-05. [2025-09-23T18:56:50.602196] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-06. [2025-09-23T18:56:50.930153] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-23T18:56:51.402173] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-03. [2025-09-23T18:56:51.646430] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-23T18:56:51.687591] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-23T18:56:52.202257] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-06. [2025-09-23T18:56:53.002194] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-06. [2025-09-23T18:56:53.257557] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-23T18:56:53.770962] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-23T18:56:53.802168] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-07. [2025-09-23T18:56:54.447771] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-23T18:56:54.602166] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-07. [2025-09-23T18:56:54.956326] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-23T18:56:55.402247] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-07. [2025-09-23T18:56:56.202241] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-08. [2025-09-23T18:56:56.430293] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-23T18:56:56.866327] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-23T18:56:57.002192] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-08. [2025-09-23T18:56:57.693132] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-23T18:56:57.802234] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-04. [2025-09-23T18:56:58.382085] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-23T18:56:58.602200] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-08. [2025-09-23T18:56:59.402207] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-09. [2025-09-23T18:56:59.746945] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-23T18:57:00.202163] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-05. [2025-09-23T18:57:00.313380] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-23T18:57:00.664414] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-23T18:57:00.671109] [INFO ] [REMOTE ] FTS: Full fetch complete (60060 records). [2025-09-23T18:57:00.671257] [DEBUG] [VALIDATOR ] FTS: Validating primary data. [2025-09-23T18:57:01.016149] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-09. [2025-09-23T18:57:01.082508] [DEBUG] [VALIDATOR ] FTS: All expected trading days are present. [2025-09-23T18:57:01.082603] [DEBUG] [VALIDATOR ] FTS: Primary data validation passed. [2025-09-23T18:57:01.083778] [INFO ] [MAIN ] FTS: Fetched primary data is valid. [2025-09-23T18:57:01.083932] [DEBUG] [LOCAL ] FTS: Saving primary data. [2025-09-23T18:57:01.085816] [DEBUG] [LOCAL ] FTS: Trimmed 60060 records to 42123 (keeping 200 days of data) [2025-09-23T18:57:01.361950] [DEBUG] [LOCAL ] FTS: Primary data saved (42123 records). [2025-09-23T18:57:01.362086] [INFO ] [MAIN ] FTS: Full history saved. [2025-09-23T18:57:01.362250] [INFO ] [MAIN ] Update Progress: 882/2372 symbols completed. FTS took 29.5s. Estimated remaining: 3h 17m 36s. Rate: 7.5 symbols/min [2025-09-23T18:57:01.532880] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:57:01.571678] [DEBUG] [LOCAL ] FUL: Loaded 33021 existing records from primary storage. [2025-09-23T18:57:01.571815] [INFO ] [MAIN ] FUL: Loaded 33021 existing records. [2025-09-23T18:57:01.766252] [WARN ] [MAIN ] FUL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:57:01.766704] [INFO ] [MAIN ] FUL: Wiping existing primary data before full refresh. [2025-09-23T18:57:01.766771] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-09-23T18:57:01.768032] [DEBUG] [LOCAL ] FUL: Deleted primary data file. [2025-09-23T18:57:01.768121] [INFO ] [MAIN ] FUL: Starting full primary refresh. [2025-09-23T18:57:01.816573] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-09. [2025-09-23T18:57:02.140884] [INFO ] [REMOTE ] FUL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:57:02.602258] [INFO ] [REMOTE ] FUL: Fetching primary data for 2024-12. [2025-09-23T18:57:03.178470] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-05 (2.98 seconds). [2025-09-23T18:57:03.205010] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-23T18:57:03.212416] [INFO ] [REMOTE ] FTK: Full fetch complete (42448 records). [2025-09-23T18:57:03.212519] [DEBUG] [VALIDATOR ] FTK: Validating primary data. [2025-09-23T18:57:03.412696] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-06. [2025-09-23T18:57:03.611878] [DEBUG] [VALIDATOR ] FTK: All expected trading days are present. [2025-09-23T18:57:03.611957] [DEBUG] [VALIDATOR ] FTK: Primary data validation passed. [2025-09-23T18:57:03.612738] [INFO ] [MAIN ] FTK: Fetched primary data is valid. [2025-09-23T18:57:03.612802] [DEBUG] [LOCAL ] FTK: Saving primary data. [2025-09-23T18:57:03.613861] [DEBUG] [LOCAL ] FTK: Trimmed 42448 records to 32220 (keeping 200 days of data) [2025-09-23T18:57:03.804245] [DEBUG] [LOCAL ] FTK: Primary data saved (32220 records). [2025-09-23T18:57:03.804388] [INFO ] [MAIN ] FTK: Full history saved. [2025-09-23T18:57:03.804533] [INFO ] [MAIN ] Update Progress: 883/2372 symbols completed. FTK took 32.0s. Estimated remaining: 3h 17m 19s. Rate: 7.5 symbols/min [2025-09-23T18:57:03.977105] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:57:04.032099] [DEBUG] [LOCAL ] FUN: Loaded 51566 existing records from primary storage. [2025-09-23T18:57:04.032247] [INFO ] [MAIN ] FUN: Loaded 51566 existing records. [2025-09-23T18:57:04.218163] [WARN ] [MAIN ] FUN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:57:04.218852] [INFO ] [MAIN ] FUN: Wiping existing primary data before full refresh. [2025-09-23T18:57:04.218926] [INFO ] [LOCAL ] FUN: Starting deletion of primary data. [2025-09-23T18:57:04.220475] [DEBUG] [LOCAL ] FUN: Deleted primary data file. [2025-09-23T18:57:04.220538] [INFO ] [MAIN ] FUN: Starting full primary refresh. [2025-09-23T18:57:04.590992] [INFO ] [REMOTE ] FUN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:57:04.591293] [INFO ] [REMOTE ] FUN: Fetching primary data for 2024-12. [2025-09-23T18:57:04.790560] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-23T18:57:05.002226] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-01. [2025-09-23T18:57:05.355800] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-23T18:57:05.395636] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-09 (3.58 seconds). [2025-09-23T18:57:05.408635] [INFO ] [REMOTE ] FTV: Full fetch complete (76251 records). [2025-09-23T18:57:05.408825] [DEBUG] [VALIDATOR ] FTV: Validating primary data. [2025-09-23T18:57:05.804588] [DEBUG] [VALIDATOR ] FTV: All expected trading days are present. [2025-09-23T18:57:05.804990] [DEBUG] [VALIDATOR ] FTV: Primary data validation passed. [2025-09-23T18:57:05.806112] [INFO ] [MAIN ] FTV: Fetched primary data is valid. [2025-09-23T18:57:05.804748] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-07. [2025-09-23T18:57:05.806364] [DEBUG] [LOCAL ] FTV: Saving primary data. [2025-09-23T18:57:05.812557] [DEBUG] [LOCAL ] FTV: Trimmed 76251 records to 52917 (keeping 200 days of data) [2025-09-23T18:57:05.996065] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-23T18:57:06.234722] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-23T18:57:06.249504] [DEBUG] [LOCAL ] FTV: Primary data saved (52917 records). [2025-09-23T18:57:06.257238] [INFO ] [MAIN ] FTV: Full history saved. [2025-09-23T18:57:06.257440] [INFO ] [MAIN ] Update Progress: 884/2372 symbols completed. FTV took 34.4s. Estimated remaining: 3h 17m 2s. Rate: 7.6 symbols/min [2025-09-23T18:57:06.439923] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:57:06.467736] [DEBUG] [LOCAL ] FVR: Loaded 22151 existing records from primary storage. [2025-09-23T18:57:06.467893] [INFO ] [MAIN ] FVR: Loaded 22151 existing records. [2025-09-23T18:57:06.617623] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-02. [2025-09-23T18:57:06.663302] [WARN ] [MAIN ] FVR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:57:06.663546] [INFO ] [MAIN ] FVR: Wiping existing primary data before full refresh. [2025-09-23T18:57:06.663595] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-09-23T18:57:06.664363] [DEBUG] [LOCAL ] FVR: Deleted primary data file. [2025-09-23T18:57:06.664426] [INFO ] [MAIN ] FVR: Starting full primary refresh. [2025-09-23T18:57:07.053417] [INFO ] [REMOTE ] FVR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:57:07.402240] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-01. [2025-09-23T18:57:07.669987] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-23T18:57:07.968498] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-23T18:57:08.202198] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-03. [2025-09-23T18:57:08.559685] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-23T18:57:09.002258] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-02. [2025-09-23T18:57:09.802424] [INFO ] [REMOTE ] FVR: Fetching primary data for 2024-12. [2025-09-23T18:57:09.827290] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-23T18:57:10.185121] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-23T18:57:10.602198] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-03. [2025-09-23T18:57:11.258315] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-23T18:57:11.402200] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-01. [2025-09-23T18:57:11.844390] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-23T18:57:12.202162] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-04. [2025-09-23T18:57:12.365273] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-23T18:57:13.002192] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-08. [2025-09-23T18:57:13.515547] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-23T18:57:13.802223] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-04. [2025-09-23T18:57:14.602181] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-05. [2025-09-23T18:57:15.402215] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-02. [2025-09-23T18:57:16.238470] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-09-23T18:57:16.249291] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-05. [2025-09-23T18:57:16.280228] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-08 (3.28 seconds). [2025-09-23T18:57:16.339555] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-23T18:57:16.495229] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-23T18:57:17.002207] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-09. [2025-09-23T18:57:17.802223] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-06. [2025-09-23T18:57:18.048286] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-23T18:57:18.602235] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-06. [2025-09-23T18:57:18.977099] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-23T18:57:18.988450] [INFO ] [REMOTE ] FUBO: Full fetch complete (77753 records). [2025-09-23T18:57:18.988591] [DEBUG] [VALIDATOR ] FUBO: Validating primary data. [2025-09-23T18:57:19.300875] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-23T18:57:19.407331] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-03. [2025-09-23T18:57:19.433193] [DEBUG] [VALIDATOR ] FUBO: All expected trading days are present. [2025-09-23T18:57:19.433287] [DEBUG] [VALIDATOR ] FUBO: Primary data validation passed. [2025-09-23T18:57:19.434199] [INFO ] [MAIN ] FUBO: Fetched primary data is valid. [2025-09-23T18:57:19.434264] [DEBUG] [LOCAL ] FUBO: Saving primary data. [2025-09-23T18:57:19.436041] [DEBUG] [LOCAL ] FUBO: Trimmed 77753 records to 53700 (keeping 200 days of data) [2025-09-23T18:57:19.752840] [DEBUG] [LOCAL ] FUBO: Primary data saved (53700 records). [2025-09-23T18:57:19.752982] [INFO ] [MAIN ] FUBO: Full history saved. [2025-09-23T18:57:19.753089] [INFO ] [MAIN ] Update Progress: 885/2372 symbols completed. FUBO took 38.8s. Estimated remaining: 3h 17m 3s. Rate: 7.5 symbols/min [2025-09-23T18:57:19.933184] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:57:19.966897] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-23T18:57:20.011757] [DEBUG] [LOCAL ] FVRR: Loaded 40203 existing records from primary storage. [2025-09-23T18:57:20.011945] [INFO ] [MAIN ] FVRR: Loaded 40203 existing records. [2025-09-23T18:57:20.195176] [WARN ] [MAIN ] FVRR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:57:20.195452] [INFO ] [MAIN ] FVRR: Wiping existing primary data before full refresh. [2025-09-23T18:57:20.195518] [INFO ] [LOCAL ] FVRR: Starting deletion of primary data. [2025-09-23T18:57:20.196722] [DEBUG] [LOCAL ] FVRR: Deleted primary data file. [2025-09-23T18:57:20.196786] [INFO ] [MAIN ] FVRR: Starting full primary refresh. [2025-09-23T18:57:20.208015] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-07. [2025-09-23T18:57:20.567090] [INFO ] [REMOTE ] FVRR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:57:20.581872] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-23T18:57:21.002247] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2024-12. [2025-09-23T18:57:21.377227] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-23T18:57:21.802259] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-04. [2025-09-23T18:57:22.540184] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-23T18:57:22.599743] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-23T18:57:22.604504] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-08. [2025-09-23T18:57:23.402235] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-07. [2025-09-23T18:57:23.835092] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-23T18:57:24.202209] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-01. [2025-09-23T18:57:24.832859] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-23T18:57:25.002197] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-05. [2025-09-23T18:57:25.350949] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-23T18:57:25.802171] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-08. [2025-09-23T18:57:25.935119] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-23T18:57:26.602199] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-02. [2025-09-23T18:57:27.310823] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-23T18:57:27.402150] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-09. [2025-09-23T18:57:28.156776] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-23T18:57:28.202152] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-03. [2025-09-23T18:57:28.780751] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-23T18:57:28.789757] [INFO ] [REMOTE ] FUN: Full fetch complete (72373 records). [2025-09-23T18:57:28.789894] [DEBUG] [VALIDATOR ] FUN: Validating primary data. [2025-09-23T18:57:29.007372] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-09. [2025-09-23T18:57:29.197528] [DEBUG] [VALIDATOR ] FUN: All expected trading days are present. [2025-09-23T18:57:29.197619] [DEBUG] [VALIDATOR ] FUN: Primary data validation passed. [2025-09-23T18:57:29.198615] [INFO ] [MAIN ] FUN: Fetched primary data is valid. [2025-09-23T18:57:29.198703] [DEBUG] [LOCAL ] FUN: Saving primary data. [2025-09-23T18:57:29.200295] [DEBUG] [LOCAL ] FUN: Trimmed 72373 records to 51566 (keeping 200 days of data) [2025-09-23T18:57:29.431170] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-23T18:57:29.544184] [DEBUG] [LOCAL ] FUN: Primary data saved (51566 records). [2025-09-23T18:57:29.544354] [INFO ] [MAIN ] FUN: Full history saved. [2025-09-23T18:57:29.544464] [INFO ] [MAIN ] Update Progress: 886/2372 symbols completed. FUN took 25.7s. Estimated remaining: 3h 16m 58s. Rate: 7.5 symbols/min [2025-09-23T18:57:29.726900] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:57:29.730077] [DEBUG] [LOCAL ] FXED: Loaded 1217 existing records from primary storage. [2025-09-23T18:57:29.730152] [INFO ] [MAIN ] FXED: Loaded 1217 existing records. [2025-09-23T18:57:29.807379] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-04. [2025-09-23T18:57:29.919545] [WARN ] [MAIN ] FXED: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:57:29.919844] [INFO ] [MAIN ] FXED: Wiping existing primary data before full refresh. [2025-09-23T18:57:29.919895] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-09-23T18:57:29.920180] [DEBUG] [LOCAL ] FXED: Deleted primary data file. [2025-09-23T18:57:29.920240] [INFO ] [MAIN ] FXED: Starting full primary refresh. [2025-09-23T18:57:30.299565] [INFO ] [REMOTE ] FXED: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:57:30.553289] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-23T18:57:30.559506] [INFO ] [REMOTE ] FUL: Full fetch complete (46780 records). [2025-09-23T18:57:30.559612] [DEBUG] [VALIDATOR ] FUL: Validating primary data. [2025-09-23T18:57:30.607304] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-06. [2025-09-23T18:57:30.939693] [DEBUG] [VALIDATOR ] FUL: All expected trading days are present. [2025-09-23T18:57:30.939783] [DEBUG] [VALIDATOR ] FUL: Primary data validation passed. [2025-09-23T18:57:30.940435] [INFO ] [MAIN ] FUL: Fetched primary data is valid. [2025-09-23T18:57:30.940475] [DEBUG] [LOCAL ] FUL: Saving primary data. [2025-09-23T18:57:30.941511] [DEBUG] [LOCAL ] FUL: Trimmed 46780 records to 32980 (keeping 200 days of data) [2025-09-23T18:57:31.143226] [DEBUG] [LOCAL ] FUL: Primary data saved (32980 records). [2025-09-23T18:57:31.143360] [INFO ] [MAIN ] FUL: Full history saved. [2025-09-23T18:57:31.143444] [INFO ] [MAIN ] Update Progress: 887/2372 symbols completed. FUL took 29.8s. Estimated remaining: 3h 16m 40s. Rate: 7.6 symbols/min [2025-09-23T18:57:31.321050] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:57:31.347412] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-23T18:57:31.397447] [DEBUG] [LOCAL ] G: Loaded 49754 existing records from primary storage. [2025-09-23T18:57:31.397635] [INFO ] [MAIN ] G: Loaded 49754 existing records. [2025-09-23T18:57:31.409114] [INFO ] [REMOTE ] FXED: Fetching primary data for 2024-12. [2025-09-23T18:57:31.580880] [WARN ] [MAIN ] G: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:57:31.581106] [INFO ] [MAIN ] G: Wiping existing primary data before full refresh. [2025-09-23T18:57:31.581153] [INFO ] [LOCAL ] G: Starting deletion of primary data. [2025-09-23T18:57:31.582326] [DEBUG] [LOCAL ] G: Deleted primary data file. [2025-09-23T18:57:31.582387] [INFO ] [MAIN ] G: Starting full primary refresh. [2025-09-23T18:57:31.837502] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-23T18:57:31.944920] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-23T18:57:31.983186] [INFO ] [REMOTE ] G: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:57:32.202200] [INFO ] [REMOTE ] G: Fetching primary data for 2024-12. [2025-09-23T18:57:33.002249] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-01. [2025-09-23T18:57:33.422706] [INFO ] [REMOTE ] G: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-23T18:57:33.435305] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-23T18:57:33.802241] [INFO ] [REMOTE ] G: Fetching primary data for 2025-01. [2025-09-23T18:57:34.602205] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-05. [2025-09-23T18:57:35.335008] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-23T18:57:35.402191] [INFO ] [REMOTE ] G: Fetching primary data for 2025-02. [2025-09-23T18:57:35.825138] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-23T18:57:36.202216] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-02. [2025-09-23T18:57:36.454378] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-02 (0.25 seconds). [2025-09-23T18:57:36.641175] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-23T18:57:37.002251] [INFO ] [REMOTE ] G: Fetching primary data for 2025-03. [2025-09-23T18:57:37.802240] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-07. [2025-09-23T18:57:38.582500] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-23T18:57:38.602143] [INFO ] [REMOTE ] G: Fetching primary data for 2025-04. [2025-09-23T18:57:38.764394] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-23T18:57:39.402238] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-03. [2025-09-23T18:57:39.737134] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-23T18:57:40.202281] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-06. [2025-09-23T18:57:40.423034] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-23T18:57:41.002239] [INFO ] [REMOTE ] G: Fetching primary data for 2025-05. [2025-09-23T18:57:41.652249] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-23T18:57:41.802246] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-08. [2025-09-23T18:57:42.543375] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-23T18:57:42.579106] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-23T18:57:42.602164] [INFO ] [REMOTE ] G: Fetching primary data for 2025-06. [2025-09-23T18:57:43.402197] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-04. [2025-09-23T18:57:43.725333] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-09-23T18:57:44.161319] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-23T18:57:44.202204] [INFO ] [REMOTE ] G: Fetching primary data for 2025-07. [2025-09-23T18:57:45.002245] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-09. [2025-09-23T18:57:45.549740] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-23T18:57:45.802206] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-05. [2025-09-23T18:57:46.085800] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-09-23T18:57:46.132554] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-23T18:57:46.136141] [INFO ] [REMOTE ] FVR: Full fetch complete (30643 records). [2025-09-23T18:57:46.136227] [DEBUG] [VALIDATOR ] FVR: Validating primary data. [2025-09-23T18:57:46.509891] [DEBUG] [VALIDATOR ] FVR: All expected trading days are present. [2025-09-23T18:57:46.509978] [DEBUG] [VALIDATOR ] FVR: Primary data validation passed. [2025-09-23T18:57:46.510504] [INFO ] [MAIN ] FVR: Fetched primary data is valid. [2025-09-23T18:57:46.510544] [DEBUG] [LOCAL ] FVR: Saving primary data. [2025-09-23T18:57:46.512042] [DEBUG] [LOCAL ] FVR: Trimmed 30643 records to 22125 (keeping 200 days of data) [2025-09-23T18:57:46.606874] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-07. [2025-09-23T18:57:46.647547] [DEBUG] [LOCAL ] FVR: Primary data saved (22125 records). [2025-09-23T18:57:46.647706] [INFO ] [MAIN ] FVR: Full history saved. [2025-09-23T18:57:46.647802] [INFO ] [MAIN ] Update Progress: 888/2372 symbols completed. FVR took 40.4s. Estimated remaining: 3h 16m 44s. Rate: 7.5 symbols/min [2025-09-23T18:57:46.818682] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:57:46.845705] [DEBUG] [LOCAL ] GAB: Loaded 27907 existing records from primary storage. [2025-09-23T18:57:46.845874] [INFO ] [MAIN ] GAB: Loaded 27907 existing records. [2025-09-23T18:57:47.033609] [WARN ] [MAIN ] GAB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:57:47.033895] [INFO ] [MAIN ] GAB: Wiping existing primary data before full refresh. [2025-09-23T18:57:47.033946] [INFO ] [LOCAL ] GAB: Starting deletion of primary data. [2025-09-23T18:57:47.034719] [DEBUG] [LOCAL ] GAB: Deleted primary data file. [2025-09-23T18:57:47.034781] [INFO ] [MAIN ] GAB: Starting full primary refresh. [2025-09-23T18:57:47.407322] [INFO ] [REMOTE ] G: Fetching primary data for 2025-08. [2025-09-23T18:57:47.445750] [INFO ] [REMOTE ] GAB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:57:48.202159] [INFO ] [REMOTE ] GAB: Fetching primary data for 2024-12. [2025-09-23T18:57:48.317117] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-23T18:57:48.753539] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-23T18:57:49.002195] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-08. [2025-09-23T18:57:49.111489] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-23T18:57:49.802195] [INFO ] [REMOTE ] G: Fetching primary data for 2025-09. [2025-09-23T18:57:50.602172] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-06. [2025-09-23T18:57:50.658062] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-23T18:57:51.015711] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-23T18:57:51.119460] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-23T18:57:51.127903] [INFO ] [REMOTE ] G: Full fetch complete (71569 records). [2025-09-23T18:57:51.128057] [DEBUG] [VALIDATOR ] G: Validating primary data. [2025-09-23T18:57:51.407374] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-07. [2025-09-23T18:57:51.523808] [DEBUG] [VALIDATOR ] G: All expected trading days are present. [2025-09-23T18:57:51.523912] [DEBUG] [VALIDATOR ] G: Primary data validation passed. [2025-09-23T18:57:51.524911] [INFO ] [MAIN ] G: Fetched primary data is valid. [2025-09-23T18:57:51.525026] [DEBUG] [LOCAL ] G: Saving primary data. [2025-09-23T18:57:51.527124] [DEBUG] [LOCAL ] G: Trimmed 71569 records to 49763 (keeping 200 days of data) [2025-09-23T18:57:51.843197] [DEBUG] [LOCAL ] G: Primary data saved (49763 records). [2025-09-23T18:57:51.843357] [INFO ] [MAIN ] G: Full history saved. [2025-09-23T18:57:51.843447] [INFO ] [MAIN ] Update Progress: 889/2372 symbols completed. G took 20.7s. Estimated remaining: 3h 16m 32s. Rate: 7.5 symbols/min [2025-09-23T18:57:51.929232] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-23T18:57:52.027316] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:57:52.033873] [DEBUG] [LOCAL ] GAM: Loaded 4217 existing records from primary storage. [2025-09-23T18:57:52.034026] [INFO ] [MAIN ] GAM: Loaded 4217 existing records. [2025-09-23T18:57:52.211496] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-01. [2025-09-23T18:57:52.219084] [WARN ] [MAIN ] GAM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:57:52.219476] [INFO ] [MAIN ] GAM: Wiping existing primary data before full refresh. [2025-09-23T18:57:52.219535] [INFO ] [LOCAL ] GAM: Starting deletion of primary data. [2025-09-23T18:57:52.219837] [DEBUG] [LOCAL ] GAM: Deleted primary data file. [2025-09-23T18:57:52.219900] [INFO ] [MAIN ] GAM: Starting full primary refresh. [2025-09-23T18:57:52.590440] [INFO ] [REMOTE ] GAM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:57:53.002210] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-09. [2025-09-23T18:57:53.408137] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-23T18:57:53.802247] [INFO ] [REMOTE ] GAM: Fetching primary data for 2024-12. [2025-09-23T18:57:54.220727] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-23T18:57:54.287096] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-23T18:57:54.294426] [INFO ] [REMOTE ] FVRR: Full fetch complete (58839 records). [2025-09-23T18:57:54.294531] [DEBUG] [VALIDATOR ] FVRR: Validating primary data. [2025-09-23T18:57:54.607294] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-08. [2025-09-23T18:57:54.693897] [DEBUG] [VALIDATOR ] FVRR: All expected trading days are present. [2025-09-23T18:57:54.693983] [DEBUG] [VALIDATOR ] FVRR: Primary data validation passed. [2025-09-23T18:57:54.694757] [INFO ] [MAIN ] FVRR: Fetched primary data is valid. [2025-09-23T18:57:54.694820] [DEBUG] [LOCAL ] FVRR: Saving primary data. [2025-09-23T18:57:54.696194] [DEBUG] [LOCAL ] FVRR: Trimmed 58839 records to 40210 (keeping 200 days of data) [2025-09-23T18:57:54.922234] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-23T18:57:54.939159] [DEBUG] [LOCAL ] FVRR: Primary data saved (40210 records). [2025-09-23T18:57:54.939290] [INFO ] [MAIN ] FVRR: Full history saved. [2025-09-23T18:57:54.939373] [INFO ] [MAIN ] Update Progress: 890/2372 symbols completed. FVRR took 35.2s. Estimated remaining: 3h 16m 16s. Rate: 7.6 symbols/min [2025-09-23T18:57:55.131037] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:57:55.181983] [DEBUG] [LOCAL ] GAP: Loaded 53655 existing records from primary storage. [2025-09-23T18:57:55.182154] [INFO ] [MAIN ] GAP: Loaded 53655 existing records. [2025-09-23T18:57:55.372855] [WARN ] [MAIN ] GAP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:57:55.373148] [INFO ] [MAIN ] GAP: Wiping existing primary data before full refresh. [2025-09-23T18:57:55.373197] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-09-23T18:57:55.374359] [DEBUG] [LOCAL ] GAP: Deleted primary data file. [2025-09-23T18:57:55.374422] [INFO ] [MAIN ] GAP: Starting full primary refresh. [2025-09-23T18:57:55.407315] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-01. [2025-09-23T18:57:55.761989] [INFO ] [REMOTE ] GAP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:57:55.853434] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-23T18:57:56.202192] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-02. [2025-09-23T18:57:57.002229] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-02. [2025-09-23T18:57:57.297572] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-23T18:57:57.421400] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-23T18:57:57.802212] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-03. [2025-09-23T18:57:58.602181] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-03. [2025-09-23T18:57:58.697514] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-23T18:57:59.298989] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-23T18:57:59.402227] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-04. [2025-09-23T18:58:00.050267] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-23T18:58:00.202209] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-09. [2025-09-23T18:58:00.803433] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-23T18:58:00.804329] [INFO ] [REMOTE ] FXED: Full fetch complete (1786 records). [2025-09-23T18:58:00.804400] [DEBUG] [VALIDATOR ] FXED: Validating primary data. [2025-09-23T18:58:01.007848] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-04. [2025-09-23T18:58:01.174775] [DEBUG] [VALIDATOR ] FXED: All expected trading days are present. [2025-09-23T18:58:01.174856] [DEBUG] [VALIDATOR ] FXED: Primary data validation passed. [2025-09-23T18:58:01.174946] [INFO ] [MAIN ] FXED: Fetched primary data is valid. [2025-09-23T18:58:01.175037] [DEBUG] [LOCAL ] FXED: Saving primary data. [2025-09-23T18:58:01.175404] [DEBUG] [LOCAL ] FXED: Trimmed 1786 records to 1225 (keeping 200 days of data) [2025-09-23T18:58:01.183452] [DEBUG] [LOCAL ] FXED: Primary data saved (1225 records). [2025-09-23T18:58:01.183514] [INFO ] [MAIN ] FXED: Full history saved. [2025-09-23T18:58:01.183595] [INFO ] [MAIN ] Update Progress: 891/2372 symbols completed. FXED took 31.6s. Estimated remaining: 3h 16m 5s. Rate: 7.6 symbols/min [2025-09-23T18:58:01.358036] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:58:01.377537] [DEBUG] [LOCAL ] GATX: Loaded 18149 existing records from primary storage. [2025-09-23T18:58:01.377705] [INFO ] [MAIN ] GATX: Loaded 18149 existing records. [2025-09-23T18:58:01.564835] [WARN ] [MAIN ] GATX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:58:01.565144] [INFO ] [MAIN ] GATX: Wiping existing primary data before full refresh. [2025-09-23T18:58:01.565196] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-09-23T18:58:01.565818] [DEBUG] [LOCAL ] GATX: Deleted primary data file. [2025-09-23T18:58:01.565904] [INFO ] [MAIN ] GATX: Starting full primary refresh. [2025-09-23T18:58:01.807356] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-05. [2025-09-23T18:58:01.963594] [INFO ] [REMOTE ] GATX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:58:02.498159] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-23T18:58:02.595800] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-23T18:58:02.602358] [INFO ] [REMOTE ] GATX: Fetching primary data for 2024-12. [2025-09-23T18:58:03.402196] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-05. [2025-09-23T18:58:03.419996] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-23T18:58:04.202211] [INFO ] [REMOTE ] GAP: Fetching primary data for 2024-12. [2025-09-23T18:58:04.656060] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-23T18:58:05.002239] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-06. [2025-09-23T18:58:05.608442] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-23T18:58:05.802224] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-01. [2025-09-23T18:58:06.094453] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-23T18:58:06.602177] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-07. [2025-09-23T18:58:07.402249] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-06. [2025-09-23T18:58:07.626975] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-23T18:58:07.657571] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-23T18:58:08.013893] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-23T18:58:08.202191] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-08. [2025-09-23T18:58:08.994800] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-23T18:58:09.002139] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-09. [2025-09-23T18:58:09.802196] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-02. [2025-09-23T18:58:10.224013] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-23T18:58:10.229363] [INFO ] [REMOTE ] GAB: Full fetch complete (39478 records). [2025-09-23T18:58:10.229460] [DEBUG] [VALIDATOR ] GAB: Validating primary data. [2025-09-23T18:58:10.609149] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-07. [2025-09-23T18:58:10.625776] [DEBUG] [VALIDATOR ] GAB: All expected trading days are present. [2025-09-23T18:58:10.625867] [DEBUG] [VALIDATOR ] GAB: Primary data validation passed. [2025-09-23T18:58:10.626631] [INFO ] [MAIN ] GAB: Fetched primary data is valid. [2025-09-23T18:58:10.626712] [DEBUG] [LOCAL ] GAB: Saving primary data. [2025-09-23T18:58:10.627884] [DEBUG] [LOCAL ] GAB: Trimmed 39478 records to 27947 (keeping 200 days of data) [2025-09-23T18:58:10.800323] [DEBUG] [LOCAL ] GAB: Primary data saved (27947 records). [2025-09-23T18:58:10.800495] [INFO ] [MAIN ] GAB: Full history saved. [2025-09-23T18:58:10.800597] [INFO ] [MAIN ] Update Progress: 892/2372 symbols completed. GAB took 24.2s. Estimated remaining: 3h 15m 60s. Rate: 7.6 symbols/min [2025-09-23T18:58:10.970021] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:58:10.984300] [DEBUG] [LOCAL ] GBAB: Loaded 13020 existing records from primary storage. [2025-09-23T18:58:10.984413] [INFO ] [MAIN ] GBAB: Loaded 13020 existing records. [2025-09-23T18:58:11.166173] [WARN ] [MAIN ] GBAB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:58:11.166709] [INFO ] [MAIN ] GBAB: Wiping existing primary data before full refresh. [2025-09-23T18:58:11.166769] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-09-23T18:58:11.196267] [DEBUG] [LOCAL ] GBAB: Deleted primary data file. [2025-09-23T18:58:11.196363] [INFO ] [MAIN ] GBAB: Starting full primary refresh. [2025-09-23T18:58:11.276101] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-23T18:58:11.410116] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-01. [2025-09-23T18:58:11.402261] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-23T18:58:11.590978] [INFO ] [REMOTE ] GBAB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:58:12.202153] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2024-12. [2025-09-23T18:58:12.439073] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-23T18:58:13.002167] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-08. [2025-09-23T18:58:13.303005] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-23T18:58:13.352162] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-23T18:58:13.802215] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-09. [2025-09-23T18:58:14.252679] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-23T18:58:14.253837] [INFO ] [REMOTE ] GAM: Full fetch complete (6903 records). [2025-09-23T18:58:14.253913] [DEBUG] [VALIDATOR ] GAM: Validating primary data. [2025-09-23T18:58:14.639359] [DEBUG] [VALIDATOR ] GAM: All expected trading days are present. [2025-09-23T18:58:14.628895] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-01. [2025-09-23T18:58:14.639501] [DEBUG] [VALIDATOR ] GAM: Primary data validation passed. [2025-09-23T18:58:14.640684] [INFO ] [MAIN ] GAM: Fetched primary data is valid. [2025-09-23T18:58:14.640752] [DEBUG] [LOCAL ] GAM: Saving primary data. [2025-09-23T18:58:14.641347] [DEBUG] [LOCAL ] GAM: Trimmed 6903 records to 4195 (keeping 200 days of data) [2025-09-23T18:58:14.666179] [DEBUG] [LOCAL ] GAM: Primary data saved (4195 records). [2025-09-23T18:58:14.666269] [INFO ] [MAIN ] GAM: Full history saved. [2025-09-23T18:58:14.666354] [INFO ] [MAIN ] Update Progress: 893/2372 symbols completed. GAM took 22.8s. Estimated remaining: 3h 15m 45s. Rate: 7.6 symbols/min [2025-09-23T18:58:14.839030] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:58:14.876339] [DEBUG] [LOCAL ] GBCI: Loaded 40084 existing records from primary storage. [2025-09-23T18:58:14.876484] [INFO ] [MAIN ] GBCI: Loaded 40084 existing records. [2025-09-23T18:58:15.050870] [WARN ] [MAIN ] GBCI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:58:15.051140] [INFO ] [MAIN ] GBCI: Wiping existing primary data before full refresh. [2025-09-23T18:58:15.051188] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-09-23T18:58:15.052319] [DEBUG] [LOCAL ] GBCI: Deleted primary data file. [2025-09-23T18:58:15.052381] [INFO ] [MAIN ] GBCI: Starting full primary refresh. [2025-09-23T18:58:15.404700] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-02. [2025-09-23T18:58:15.438495] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-23T18:58:15.442706] [INFO ] [REMOTE ] GBCI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:58:16.202171] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-03. [2025-09-23T18:58:16.277843] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-23T18:58:17.002239] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-02. [2025-09-23T18:58:17.802240] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-03. [2025-09-23T18:58:17.945191] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-23T18:58:18.215061] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-23T18:58:18.480008] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-23T18:58:18.602174] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-04. [2025-09-23T18:58:19.402211] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-03. [2025-09-23T18:58:19.781584] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-23T18:58:20.202156] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-05. [2025-09-23T18:58:20.431090] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-23T18:58:20.898122] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-23T18:58:21.002241] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-04. [2025-09-23T18:58:21.802196] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2024-12. [2025-09-23T18:58:22.602217] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-04. [2025-09-23T18:58:22.955539] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-23T18:58:22.989709] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-23T18:58:23.151569] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-23T18:58:23.402219] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-05. [2025-09-23T18:58:24.202269] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-01. [2025-09-23T18:58:25.002167] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-06. [2025-09-23T18:58:25.082938] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-23T18:58:25.462921] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-23T18:58:25.713365] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-23T18:58:25.802238] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-07. [2025-09-23T18:58:26.469818] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-23T18:58:26.602193] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-08. [2025-09-23T18:58:27.402187] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-06. [2025-09-23T18:58:27.431345] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-23T18:58:28.202220] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-05. [2025-09-23T18:58:28.696763] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-23T18:58:29.002182] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-06. [2025-09-23T18:58:29.301761] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-23T18:58:29.621562] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-23T18:58:29.802204] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-07. [2025-09-23T18:58:30.602241] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-02. [2025-09-23T18:58:31.402218] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-07. [2025-09-23T18:58:31.735561] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-23T18:58:32.062821] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-23T18:58:32.110814] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-23T18:58:32.202241] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-09. [2025-09-23T18:58:33.002288] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-08. [2025-09-23T18:58:33.384320] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-23T18:58:33.388498] [INFO ] [REMOTE ] GATX: Full fetch complete (25399 records). [2025-09-23T18:58:33.388721] [DEBUG] [VALIDATOR ] GATX: Validating primary data. [2025-09-23T18:58:33.676054] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-23T18:58:33.801837] [DEBUG] [VALIDATOR ] GATX: All expected trading days are present. [2025-09-23T18:58:33.801916] [DEBUG] [VALIDATOR ] GATX: Primary data validation passed. [2025-09-23T18:58:33.802419] [INFO ] [MAIN ] GATX: Fetched primary data is valid. [2025-09-23T18:58:33.802495] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-03. [2025-09-23T18:58:33.802712] [DEBUG] [LOCAL ] GATX: Saving primary data. [2025-09-23T18:58:33.804389] [DEBUG] [LOCAL ] GATX: Trimmed 25399 records to 18146 (keeping 200 days of data) [2025-09-23T18:58:33.929271] [DEBUG] [LOCAL ] GATX: Primary data saved (18146 records). [2025-09-23T18:58:33.929418] [INFO ] [MAIN ] GATX: Full history saved. [2025-09-23T18:58:33.929506] [INFO ] [MAIN ] Update Progress: 894/2372 symbols completed. GATX took 32.7s. Estimated remaining: 3h 15m 56s. Rate: 7.5 symbols/min [2025-09-23T18:58:34.117368] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:58:34.117690] [DEBUG] [LOCAL ] GBLI: No existing data file found in primary storage. [2025-09-23T18:58:34.117748] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-09-23T18:58:34.117913] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-09-23T18:58:34.117978] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-09-23T18:58:34.118072] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-09-23T18:58:34.118143] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-09-23T18:58:34.515940] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:58:34.602178] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-09. [2025-09-23T18:58:35.270109] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-23T18:58:35.273043] [INFO ] [REMOTE ] GBAB: Full fetch complete (20339 records). [2025-09-23T18:58:35.273132] [DEBUG] [VALIDATOR ] GBAB: Validating primary data. [2025-09-23T18:58:35.396123] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-23T18:58:35.406778] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-08. [2025-09-23T18:58:35.673404] [DEBUG] [VALIDATOR ] GBAB: All expected trading days are present. [2025-09-23T18:58:35.673512] [DEBUG] [VALIDATOR ] GBAB: Primary data validation passed. [2025-09-23T18:58:35.674009] [INFO ] [MAIN ] GBAB: Fetched primary data is valid. [2025-09-23T18:58:35.674071] [DEBUG] [LOCAL ] GBAB: Saving primary data. [2025-09-23T18:58:35.674636] [DEBUG] [LOCAL ] GBAB: Trimmed 20339 records to 13017 (keeping 200 days of data) [2025-09-23T18:58:35.755377] [DEBUG] [LOCAL ] GBAB: Primary data saved (13017 records). [2025-09-23T18:58:35.755531] [INFO ] [MAIN ] GBAB: Full history saved. [2025-09-23T18:58:35.755623] [INFO ] [MAIN ] Update Progress: 895/2372 symbols completed. GBAB took 25.0s. Estimated remaining: 3h 15m 38s. Rate: 7.6 symbols/min [2025-09-23T18:58:35.925968] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:58:35.972136] [DEBUG] [LOCAL ] GBTG: Loaded 40434 existing records from primary storage. [2025-09-23T18:58:35.972308] [INFO ] [MAIN ] GBTG: Loaded 40434 existing records. [2025-09-23T18:58:36.157376] [WARN ] [MAIN ] GBTG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:58:36.157736] [INFO ] [MAIN ] GBTG: Wiping existing primary data before full refresh. [2025-09-23T18:58:36.157794] [INFO ] [LOCAL ] GBTG: Starting deletion of primary data. [2025-09-23T18:58:36.158850] [DEBUG] [LOCAL ] GBTG: Deleted primary data file. [2025-09-23T18:58:36.158927] [INFO ] [MAIN ] GBTG: Starting full primary refresh. [2025-09-23T18:58:36.214776] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2024-12. [2025-09-23T18:58:36.543537] [INFO ] [REMOTE ] GBTG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:58:36.567215] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-09-23T18:58:36.977135] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-23T18:58:37.002160] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-01. [2025-09-23T18:58:37.339419] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-23T18:58:37.802193] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-09. [2025-09-23T18:58:38.602189] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2024-12. [2025-09-23T18:58:39.402246] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-09-23T18:58:39.836721] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-23T18:58:39.846208] [INFO ] [REMOTE ] GAP: Full fetch complete (77634 records). [2025-09-23T18:58:39.846349] [DEBUG] [VALIDATOR ] GAP: Validating primary data. [2025-09-23T18:58:40.083371] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-23T18:58:40.208866] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-04. [2025-09-23T18:58:40.321997] [DEBUG] [VALIDATOR ] GAP: All expected trading days are present. [2025-09-23T18:58:40.318159] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-23T18:58:40.322165] [DEBUG] [VALIDATOR ] GAP: Primary data validation passed. [2025-09-23T18:58:40.331363] [INFO ] [MAIN ] GAP: Fetched primary data is valid. [2025-09-23T18:58:40.332053] [DEBUG] [LOCAL ] GAP: Saving primary data. [2025-09-23T18:58:40.333490] [DEBUG] [LOCAL ] GAP: Trimmed 77634 records to 53655 (keeping 200 days of data) [2025-09-23T18:58:40.665498] [DEBUG] [LOCAL ] GAP: Primary data saved (53655 records). [2025-09-23T18:58:40.665676] [INFO ] [MAIN ] GAP: Full history saved. [2025-09-23T18:58:40.665791] [INFO ] [MAIN ] Update Progress: 896/2372 symbols completed. GAP took 45.7s. Estimated remaining: 3h 15m 25s. Rate: 7.6 symbols/min [2025-09-23T18:58:40.833475] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:58:40.862977] [DEBUG] [LOCAL ] GBX: Loaded 29314 existing records from primary storage. [2025-09-23T18:58:40.863113] [INFO ] [MAIN ] GBX: Loaded 29314 existing records. [2025-09-23T18:58:41.011083] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-01. [2025-09-23T18:58:41.042593] [WARN ] [MAIN ] GBX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:58:41.042874] [INFO ] [MAIN ] GBX: Wiping existing primary data before full refresh. [2025-09-23T18:58:41.042935] [INFO ] [LOCAL ] GBX: Starting deletion of primary data. [2025-09-23T18:58:41.043743] [DEBUG] [LOCAL ] GBX: Deleted primary data file. [2025-09-23T18:58:41.043805] [INFO ] [MAIN ] GBX: Starting full primary refresh. [2025-09-23T18:58:41.404892] [INFO ] [REMOTE ] GBX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:58:41.802162] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-09-23T18:58:41.839585] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-23T18:58:42.304435] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-23T18:58:42.329850] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-23T18:58:42.602188] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-02. [2025-09-23T18:58:43.402193] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-09-23T18:58:43.479790] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-23T18:58:43.715726] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-09-23T18:58:44.202227] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-05. [2025-09-23T18:58:45.002192] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-09-23T18:58:45.605592] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-23T18:58:45.632923] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-23T18:58:45.802170] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-06. [2025-09-23T18:58:46.602238] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-03. [2025-09-23T18:58:47.277250] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-23T18:58:47.402189] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-07. [2025-09-23T18:58:47.713978] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-23T18:58:48.202217] [INFO ] [REMOTE ] GBX: Fetching primary data for 2024-12. [2025-09-23T18:58:48.979464] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-23T18:58:49.002160] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-08. [2025-09-23T18:58:49.326035] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-23T18:58:49.802201] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-04. [2025-09-23T18:58:50.201570] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-23T18:58:50.602186] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-01. [2025-09-23T18:58:51.297612] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-23T18:58:51.402208] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-05. [2025-09-23T18:58:51.553700] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-23T18:58:52.202209] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-09-23T18:58:52.457902] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-09-23T18:58:52.535241] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-23T18:58:53.002296] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-09-23T18:58:53.277765] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-09-23T18:58:53.802200] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-09-23T18:58:54.148302] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-23T18:58:54.602200] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-02. [2025-09-23T18:58:55.402214] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-09. [2025-09-23T18:58:55.868950] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-23T18:58:56.202231] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-03. [2025-09-23T18:58:56.689054] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-23T18:58:56.695863] [INFO ] [REMOTE ] GBCI: Full fetch complete (57781 records). [2025-09-23T18:58:56.696038] [DEBUG] [VALIDATOR ] GBCI: Validating primary data. [2025-09-23T18:58:57.007263] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-09-23T18:58:57.088267] [DEBUG] [VALIDATOR ] GBCI: All expected trading days are present. [2025-09-23T18:58:57.088355] [DEBUG] [VALIDATOR ] GBCI: Primary data validation passed. [2025-09-23T18:58:57.089175] [INFO ] [MAIN ] GBCI: Fetched primary data is valid. [2025-09-23T18:58:57.089239] [DEBUG] [LOCAL ] GBCI: Saving primary data. [2025-09-23T18:58:57.090556] [DEBUG] [LOCAL ] GBCI: Trimmed 57781 records to 40099 (keeping 200 days of data) [2025-09-23T18:58:57.188409] [DEBUG] [REMOTE ] GBLI: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-09-23T18:58:57.190121] [WARN ] [REMOTE ] GBLI: No data returned for month 2025-09 [2025-09-23T18:58:57.190724] [INFO ] [REMOTE ] GBLI: Full fetch complete (1316 records). [2025-09-23T18:58:57.191450] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-09-23T18:58:57.194183] [FATAL] [VALIDATOR ] GBLI: Data is stale - most recent date (2025-08-29) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T18:58:57.195965] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-09-23T18:58:57.196582] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-09-23T18:58:57.197334] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-09-23T18:58:57.198102] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-09-23T18:58:57.198603] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-09-23T18:58:57.199057] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-09-23T18:58:57.199251] [INFO ] [MAIN ] Update Progress: 897/2372 symbols completed. GBLI took 23.3s. Estimated remaining: 3h 15m 31s. Rate: 7.5 symbols/min [2025-09-23T18:58:57.422791] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:58:57.532965] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-23T18:58:57.590330] [DEBUG] [LOCAL ] GCI: Loaded 44231 existing records from primary storage. [2025-09-23T18:58:57.596099] [DEBUG] [LOCAL ] GBCI: Primary data saved (40099 records). [2025-09-23T18:58:57.596174] [INFO ] [MAIN ] GCI: Loaded 44231 existing records. [2025-09-23T18:58:57.596346] [INFO ] [MAIN ] GBCI: Full history saved. [2025-09-23T18:58:57.628528] [INFO ] [MAIN ] Update Progress: 898/2372 symbols completed. GBCI took 43.0s. Estimated remaining: 3h 15m 11s. Rate: 7.6 symbols/min [2025-09-23T18:58:57.802424] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-06. [2025-09-23T18:58:57.926711] [WARN ] [MAIN ] GCI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:58:57.960029] [INFO ] [MAIN ] GCI: Wiping existing primary data before full refresh. [2025-09-23T18:58:57.959898] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:58:57.960309] [INFO ] [LOCAL ] GCI: Starting deletion of primary data. [2025-09-23T18:58:57.961681] [DEBUG] [LOCAL ] GCI: Deleted primary data file. [2025-09-23T18:58:57.961743] [INFO ] [MAIN ] GCI: Starting full primary refresh. [2025-09-23T18:58:58.159151] [DEBUG] [LOCAL ] GCO: Loaded 25807 existing records from primary storage. [2025-09-23T18:58:58.193576] [INFO ] [MAIN ] GCO: Loaded 25807 existing records. [2025-09-23T18:58:58.549043] [INFO ] [REMOTE ] GCI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:58:58.540297] [WARN ] [MAIN ] GCO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:58:58.550079] [INFO ] [MAIN ] GCO: Wiping existing primary data before full refresh. [2025-09-23T18:58:58.550181] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-09-23T18:58:58.550977] [DEBUG] [LOCAL ] GCO: Deleted primary data file. [2025-09-23T18:58:58.551056] [INFO ] [MAIN ] GCO: Starting full primary refresh. [2025-09-23T18:58:58.608275] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-04. [2025-09-23T18:58:58.937511] [INFO ] [REMOTE ] GCO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:58:58.962773] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-23T18:58:59.402219] [INFO ] [REMOTE ] GCI: Fetching primary data for 2024-12. [2025-09-23T18:59:00.202193] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-07. [2025-09-23T18:59:00.323415] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-23T18:59:00.539193] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-23T18:59:01.002192] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-01. [2025-09-23T18:59:01.378471] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-23T18:59:01.802239] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-08. [2025-09-23T18:59:02.061429] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-23T18:59:02.602186] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-02. [2025-09-23T18:59:02.851162] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-23T18:59:03.402280] [INFO ] [REMOTE ] GCO: Fetching primary data for 2024-12. [2025-09-23T18:59:04.038022] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-23T18:59:04.202166] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-03. [2025-09-23T18:59:04.244604] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-23T18:59:05.002214] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-09. [2025-09-23T18:59:05.342697] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-23T18:59:05.802191] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-01. [2025-09-23T18:59:06.117550] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-23T18:59:06.124609] [INFO ] [REMOTE ] GBTG: Full fetch complete (56658 records). [2025-09-23T18:59:06.124797] [DEBUG] [VALIDATOR ] GBTG: Validating primary data. [2025-09-23T18:59:06.525809] [DEBUG] [VALIDATOR ] GBTG: All expected trading days are present. [2025-09-23T18:59:06.525886] [DEBUG] [VALIDATOR ] GBTG: Primary data validation passed. [2025-09-23T18:59:06.526566] [INFO ] [MAIN ] GBTG: Fetched primary data is valid. [2025-09-23T18:59:06.526620] [DEBUG] [LOCAL ] GBTG: Saving primary data. [2025-09-23T18:59:06.527776] [DEBUG] [LOCAL ] GBTG: Trimmed 56658 records to 40353 (keeping 200 days of data) [2025-09-23T18:59:06.619332] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-04. [2025-09-23T18:59:06.718072] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-23T18:59:06.794133] [DEBUG] [LOCAL ] GBTG: Primary data saved (40353 records). [2025-09-23T18:59:06.794284] [INFO ] [MAIN ] GBTG: Full history saved. [2025-09-23T18:59:06.794485] [INFO ] [MAIN ] Update Progress: 899/2372 symbols completed. GBTG took 31.0s. Estimated remaining: 3h 15m 5s. Rate: 7.6 symbols/min [2025-09-23T18:59:06.975160] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:59:06.996510] [DEBUG] [LOCAL ] GCTS: Loaded 19736 existing records from primary storage. [2025-09-23T18:59:06.996677] [INFO ] [MAIN ] GCTS: Loaded 19736 existing records. [2025-09-23T18:59:07.185920] [WARN ] [MAIN ] GCTS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:59:07.186215] [INFO ] [MAIN ] GCTS: Wiping existing primary data before full refresh. [2025-09-23T18:59:07.186278] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-09-23T18:59:07.186792] [DEBUG] [LOCAL ] GCTS: Deleted primary data file. [2025-09-23T18:59:07.186854] [INFO ] [MAIN ] GCTS: Starting full primary refresh. [2025-09-23T18:59:07.412210] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-05. [2025-09-23T18:59:07.584235] [INFO ] [REMOTE ] GCTS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:59:07.883028] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-23T18:59:08.202167] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2024-12. [2025-09-23T18:59:08.676708] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-23T18:59:08.908580] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-23T18:59:09.002156] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-01. [2025-09-23T18:59:09.802244] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-02. [2025-09-23T18:59:10.078899] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-23T18:59:10.495115] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-23T18:59:10.602166] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-03. [2025-09-23T18:59:11.402188] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-06. [2025-09-23T18:59:11.964886] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-23T18:59:12.083862] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-23T18:59:12.202204] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-07. [2025-09-23T18:59:13.002211] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-04. [2025-09-23T18:59:13.290052] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-23T18:59:13.802210] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-08. [2025-09-23T18:59:14.010025] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-23T18:59:14.602239] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-05. [2025-09-23T18:59:14.950138] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-23T18:59:15.402270] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-02. [2025-09-23T18:59:15.493218] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-23T18:59:16.202184] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-06. [2025-09-23T18:59:16.367354] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-23T18:59:17.002164] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-09. [2025-09-23T18:59:17.043076] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-23T18:59:17.802197] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-07. [2025-09-23T18:59:18.265245] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-23T18:59:18.269920] [INFO ] [REMOTE ] GBX: Full fetch complete (42700 records). [2025-09-23T18:59:18.270058] [DEBUG] [VALIDATOR ] GBX: Validating primary data. [2025-09-23T18:59:18.614547] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-05. [2025-09-23T18:59:18.664625] [DEBUG] [VALIDATOR ] GBX: All expected trading days are present. [2025-09-23T18:59:18.664815] [DEBUG] [VALIDATOR ] GBX: Primary data validation passed. [2025-09-23T18:59:18.665833] [INFO ] [MAIN ] GBX: Fetched primary data is valid. [2025-09-23T18:59:18.665953] [DEBUG] [LOCAL ] GBX: Saving primary data. [2025-09-23T18:59:18.683017] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-23T18:59:18.688289] [DEBUG] [LOCAL ] GBX: Trimmed 42700 records to 29268 (keeping 200 days of data) [2025-09-23T18:59:18.888248] [DEBUG] [LOCAL ] GBX: Primary data saved (29268 records). [2025-09-23T18:59:18.888400] [INFO ] [MAIN ] GBX: Full history saved. [2025-09-23T18:59:18.888580] [INFO ] [MAIN ] Update Progress: 900/2372 symbols completed. GBX took 38.2s. Estimated remaining: 3h 15m 3s. Rate: 7.5 symbols/min [2025-09-23T18:59:19.072537] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:59:19.083736] [DEBUG] [LOCAL ] GCV: Loaded 7100 existing records from primary storage. [2025-09-23T18:59:19.083860] [INFO ] [MAIN ] GCV: Loaded 7100 existing records. [2025-09-23T18:59:19.271201] [WARN ] [MAIN ] GCV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:59:19.271440] [INFO ] [MAIN ] GCV: Wiping existing primary data before full refresh. [2025-09-23T18:59:19.271486] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-09-23T18:59:19.271865] [DEBUG] [LOCAL ] GCV: Deleted primary data file. [2025-09-23T18:59:19.271944] [INFO ] [MAIN ] GCV: Starting full primary refresh. [2025-09-23T18:59:19.417213] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-08. [2025-09-23T18:59:19.638964] [INFO ] [REMOTE ] GCV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:59:19.828365] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-23T18:59:20.202503] [INFO ] [REMOTE ] GCV: Fetching primary data for 2024-12. [2025-09-23T18:59:20.230188] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-23T18:59:20.861974] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-23T18:59:21.002232] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-01. [2025-09-23T18:59:21.622879] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-23T18:59:21.802231] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-09. [2025-09-23T18:59:22.592741] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-23T18:59:22.599141] [INFO ] [REMOTE ] GCO: Full fetch complete (36077 records). [2025-09-23T18:59:22.599244] [DEBUG] [VALIDATOR ] GCO: Validating primary data. [2025-09-23T18:59:22.610523] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-03. [2025-09-23T18:59:22.977119] [DEBUG] [VALIDATOR ] GCO: All expected trading days are present. [2025-09-23T18:59:22.977236] [DEBUG] [VALIDATOR ] GCO: Primary data validation passed. [2025-09-23T18:59:22.977836] [INFO ] [MAIN ] GCO: Fetched primary data is valid. [2025-09-23T18:59:22.977898] [DEBUG] [LOCAL ] GCO: Saving primary data. [2025-09-23T18:59:22.978755] [DEBUG] [LOCAL ] GCO: Trimmed 36077 records to 25688 (keeping 200 days of data) [2025-09-23T18:59:23.136147] [DEBUG] [LOCAL ] GCO: Primary data saved (25688 records). [2025-09-23T18:59:23.136282] [INFO ] [MAIN ] GCO: Full history saved. [2025-09-23T18:59:23.136394] [INFO ] [MAIN ] Update Progress: 901/2372 symbols completed. GCO took 25.5s. Estimated remaining: 3h 14m 49s. Rate: 7.6 symbols/min [2025-09-23T18:59:23.309571] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:59:23.374740] [DEBUG] [LOCAL ] GD: Loaded 47324 existing records from primary storage. [2025-09-23T18:59:23.375292] [INFO ] [MAIN ] GD: Loaded 47324 existing records. [2025-09-23T18:59:23.408110] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-02. [2025-09-23T18:59:23.566395] [WARN ] [MAIN ] GD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:59:23.566715] [INFO ] [MAIN ] GD: Wiping existing primary data before full refresh. [2025-09-23T18:59:23.566780] [INFO ] [LOCAL ] GD: Starting deletion of primary data. [2025-09-23T18:59:23.568194] [DEBUG] [LOCAL ] GD: Deleted primary data file. [2025-09-23T18:59:23.568254] [INFO ] [MAIN ] GD: Starting full primary refresh. [2025-09-23T18:59:23.738749] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-23T18:59:23.884911] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-23T18:59:23.962995] [INFO ] [REMOTE ] GD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:59:24.202192] [INFO ] [REMOTE ] GD: Fetching primary data for 2024-12. [2025-09-23T18:59:25.002286] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-06. [2025-09-23T18:59:25.764016] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-23T18:59:25.802232] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-04. [2025-09-23T18:59:26.220911] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-23T18:59:26.602242] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-03. [2025-09-23T18:59:26.793499] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-23T18:59:27.185446] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-23T18:59:27.402237] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-04. [2025-09-23T18:59:28.202200] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-05. [2025-09-23T18:59:28.239046] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-23T18:59:29.002266] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-05. [2025-09-23T18:59:29.185717] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-23T18:59:29.686703] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-23T18:59:29.802213] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-06. [2025-09-23T18:59:30.606118] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-01. [2025-09-23T18:59:30.607181] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-23T18:59:31.402248] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-07. [2025-09-23T18:59:31.827544] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-23T18:59:32.202256] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-06. [2025-09-23T18:59:32.410232] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-23T18:59:33.002234] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-07. [2025-09-23T18:59:33.183505] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-23T18:59:33.802200] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-07. [2025-09-23T18:59:34.468682] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-23T18:59:34.602160] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-08. [2025-09-23T18:59:34.744050] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-23T18:59:35.402206] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-08. [2025-09-23T18:59:35.859745] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-23T18:59:36.202212] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-02. [2025-09-23T18:59:36.392012] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-23T18:59:37.002205] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-09. [2025-09-23T18:59:37.731492] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-23T18:59:37.802208] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-09. [2025-09-23T18:59:38.239385] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-23T18:59:38.243409] [INFO ] [REMOTE ] GCTS: Full fetch complete (26948 records). [2025-09-23T18:59:38.243499] [DEBUG] [VALIDATOR ] GCTS: Validating primary data. [2025-09-23T18:59:38.608368] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-08. [2025-09-23T18:59:38.638181] [DEBUG] [VALIDATOR ] GCTS: All expected trading days are present. [2025-09-23T18:59:38.638250] [DEBUG] [VALIDATOR ] GCTS: Primary data validation passed. [2025-09-23T18:59:38.638843] [INFO ] [MAIN ] GCTS: Fetched primary data is valid. [2025-09-23T18:59:38.639071] [DEBUG] [LOCAL ] GCTS: Saving primary data. [2025-09-23T18:59:38.639860] [DEBUG] [LOCAL ] GCTS: Trimmed 26948 records to 19810 (keeping 200 days of data) [2025-09-23T18:59:38.758501] [DEBUG] [LOCAL ] GCTS: Primary data saved (19810 records). [2025-09-23T18:59:38.758661] [INFO ] [MAIN ] GCTS: Full history saved. [2025-09-23T18:59:38.758782] [INFO ] [MAIN ] Update Progress: 902/2372 symbols completed. GCTS took 32.0s. Estimated remaining: 3h 14m 54s. Rate: 7.5 symbols/min [2025-09-23T18:59:38.927915] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:59:38.983922] [DEBUG] [LOCAL ] GDDY: Loaded 49765 existing records from primary storage. [2025-09-23T18:59:38.984129] [INFO ] [MAIN ] GDDY: Loaded 49765 existing records. [2025-09-23T18:59:39.168984] [WARN ] [MAIN ] GDDY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:59:39.173789] [INFO ] [MAIN ] GDDY: Wiping existing primary data before full refresh. [2025-09-23T18:59:39.173962] [INFO ] [LOCAL ] GDDY: Starting deletion of primary data. [2025-09-23T18:59:39.176024] [DEBUG] [LOCAL ] GDDY: Deleted primary data file. [2025-09-23T18:59:39.176089] [INFO ] [MAIN ] GDDY: Starting full primary refresh. [2025-09-23T18:59:39.176290] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-23T18:59:39.407298] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-09. [2025-09-23T18:59:39.485535] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-23T18:59:39.514372] [INFO ] [REMOTE ] GCI: Full fetch complete (63063 records). [2025-09-23T18:59:39.529933] [DEBUG] [VALIDATOR ] GCI: Validating primary data. [2025-09-23T18:59:39.586345] [INFO ] [REMOTE ] GDDY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:59:39.990848] [DEBUG] [VALIDATOR ] GCI: All expected trading days are present. [2025-09-23T18:59:39.990936] [DEBUG] [VALIDATOR ] GCI: Primary data validation passed. [2025-09-23T18:59:39.991905] [INFO ] [MAIN ] GCI: Fetched primary data is valid. [2025-09-23T18:59:39.991990] [DEBUG] [LOCAL ] GCI: Saving primary data. [2025-09-23T18:59:39.995142] [DEBUG] [LOCAL ] GCI: Trimmed 63063 records to 44222 (keeping 200 days of data) [2025-09-23T18:59:40.108980] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-23T18:59:40.122065] [INFO ] [REMOTE ] GCV: Full fetch complete (9238 records). [2025-09-23T18:59:40.122816] [DEBUG] [VALIDATOR ] GCV: Validating primary data. [2025-09-23T18:59:40.218390] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2024-12. [2025-09-23T18:59:40.556803] [DEBUG] [LOCAL ] GCI: Primary data saved (44222 records). [2025-09-23T18:59:40.568098] [INFO ] [MAIN ] GCI: Full history saved. [2025-09-23T18:59:40.579717] [INFO ] [MAIN ] Update Progress: 903/2372 symbols completed. GCI took 43.4s. Estimated remaining: 3h 14m 36s. Rate: 7.5 symbols/min [2025-09-23T18:59:40.869962] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:59:40.870185] [DEBUG] [VALIDATOR ] GCV: All expected trading days are present. [2025-09-23T18:59:40.870289] [DEBUG] [VALIDATOR ] GCV: Primary data validation passed. [2025-09-23T18:59:40.870885] [INFO ] [MAIN ] GCV: Fetched primary data is valid. [2025-09-23T18:59:40.870947] [DEBUG] [LOCAL ] GCV: Saving primary data. [2025-09-23T18:59:40.871500] [DEBUG] [LOCAL ] GCV: Trimmed 9238 records to 7128 (keeping 200 days of data) [2025-09-23T18:59:40.909264] [DEBUG] [LOCAL ] GDIV: Loaded 3716 existing records from primary storage. [2025-09-23T18:59:40.909929] [INFO ] [MAIN ] GDIV: Loaded 3716 existing records. [2025-09-23T18:59:41.004750] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-03. [2025-09-23T18:59:41.020991] [DEBUG] [LOCAL ] GCV: Primary data saved (7128 records). [2025-09-23T18:59:41.027982] [INFO ] [MAIN ] GCV: Full history saved. [2025-09-23T18:59:41.033307] [INFO ] [MAIN ] Update Progress: 904/2372 symbols completed. GCV took 22.1s. Estimated remaining: 3h 14m 16s. Rate: 7.6 symbols/min [2025-09-23T18:59:41.201271] [WARN ] [MAIN ] GDIV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T18:59:41.212699] [INFO ] [MAIN ] GDIV: Wiping existing primary data before full refresh. [2025-09-23T18:59:41.218118] [INFO ] [LOCAL ] GDIV: Starting deletion of primary data. [2025-09-23T18:59:41.223597] [DEBUG] [LOCAL ] GDIV: Deleted primary data file. [2025-09-23T18:59:41.233926] [INFO ] [MAIN ] GDIV: Starting full primary refresh. [2025-09-23T18:59:41.377270] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T18:59:41.399541] [DEBUG] [LOCAL ] GDL: No existing data file found in primary storage. [2025-09-23T18:59:41.402238] [WARN ] [MAIN ] GDL: No existing data found, performing full refresh instead. [2025-09-23T18:59:41.418346] [INFO ] [MAIN ] GDL: Wiping existing primary data before full refresh. [2025-09-23T18:59:41.423521] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-09-23T18:59:41.442092] [DEBUG] [LOCAL ] GDL: No primary data file found to delete. [2025-09-23T18:59:41.447121] [INFO ] [MAIN ] GDL: Starting full primary refresh. [2025-09-23T18:59:41.976945] [INFO ] [REMOTE ] GDIV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:59:41.988224] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2024-12. [2025-09-23T18:59:42.060049] [INFO ] [REMOTE ] GDL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T18:59:42.087854] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-23T18:59:42.603529] [INFO ] [REMOTE ] GDL: Fetching primary data for 2024-12. [2025-09-23T18:59:42.603724] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-23T18:59:42.608541] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-23T18:59:42.928361] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-09-23T18:59:43.402213] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-01. [2025-09-23T18:59:43.745850] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-23T18:59:44.202195] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-01. [2025-09-23T18:59:44.521711] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-09-23T18:59:45.002226] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-01. [2025-09-23T18:59:45.802191] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-04. [2025-09-23T18:59:46.602166] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-02. [2025-09-23T18:59:46.782788] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-23T18:59:46.964578] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-23T18:59:47.274393] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-23T18:59:47.402204] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-05. [2025-09-23T18:59:48.202268] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-03. [2025-09-23T18:59:48.565115] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-23T18:59:48.825118] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-23T18:59:49.002195] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-06. [2025-09-23T18:59:49.802199] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-04. [2025-09-23T18:59:50.563935] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-23T18:59:50.602165] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-02. [2025-09-23T18:59:50.944495] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-23T18:59:50.959312] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-23T18:59:51.402207] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-05. [2025-09-23T18:59:51.779973] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-23T18:59:52.202198] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-02. [2025-09-23T18:59:53.002209] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-07. [2025-09-23T18:59:53.547577] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-23T18:59:53.802191] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-06. [2025-09-23T18:59:54.145091] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-23T18:59:54.602169] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-03. [2025-09-23T18:59:54.883636] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-09-23T18:59:54.924473] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-23T18:59:55.402201] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-07. [2025-09-23T18:59:55.719853] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-23T18:59:56.202206] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-04. [2025-09-23T18:59:56.739852] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-23T18:59:57.002195] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-05. [2025-09-23T18:59:57.351827] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-23T18:59:57.802204] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-06. [2025-09-23T18:59:58.214185] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-23T18:59:58.602191] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-08. [2025-09-23T18:59:58.925758] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-23T18:59:59.402246] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-03. [2025-09-23T19:00:00.202238] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-08. [2025-09-23T19:00:01.002182] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-09. [2025-09-23T19:00:01.249587] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-23T19:00:01.750460] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-23T19:00:01.802226] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-04. [2025-09-23T19:00:02.077745] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-23T19:00:02.079152] [INFO ] [REMOTE ] GDIV: Full fetch complete (5434 records). [2025-09-23T19:00:02.079241] [DEBUG] [VALIDATOR ] GDIV: Validating primary data. [2025-09-23T19:00:02.510987] [DEBUG] [VALIDATOR ] GDIV: All expected trading days are present. [2025-09-23T19:00:02.511113] [DEBUG] [VALIDATOR ] GDIV: Primary data validation passed. [2025-09-23T19:00:02.511391] [INFO ] [MAIN ] GDIV: Fetched primary data is valid. [2025-09-23T19:00:02.511459] [DEBUG] [LOCAL ] GDIV: Saving primary data. [2025-09-23T19:00:02.512170] [DEBUG] [LOCAL ] GDIV: Trimmed 5434 records to 3705 (keeping 200 days of data) [2025-09-23T19:00:02.538732] [DEBUG] [LOCAL ] GDIV: Primary data saved (3705 records). [2025-09-23T19:00:02.538917] [INFO ] [MAIN ] GDIV: Full history saved. [2025-09-23T19:00:02.539032] [INFO ] [MAIN ] Update Progress: 905/2372 symbols completed. GDIV took 22.0s. Estimated remaining: 3h 14m 30s. Rate: 7.5 symbols/min [2025-09-23T19:00:02.616297] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-09. [2025-09-23T19:00:02.762032] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:00:02.770250] [DEBUG] [LOCAL ] GDO: Loaded 6067 existing records from primary storage. [2025-09-23T19:00:02.770409] [INFO ] [MAIN ] GDO: Loaded 6067 existing records. [2025-09-23T19:00:02.981743] [WARN ] [MAIN ] GDO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:00:02.982035] [INFO ] [MAIN ] GDO: Wiping existing primary data before full refresh. [2025-09-23T19:00:02.982084] [INFO ] [LOCAL ] GDO: Starting deletion of primary data. [2025-09-23T19:00:02.982362] [DEBUG] [LOCAL ] GDO: Deleted primary data file. [2025-09-23T19:00:02.982423] [INFO ] [MAIN ] GDO: Starting full primary refresh. [2025-09-23T19:00:03.358252] [INFO ] [REMOTE ] GDO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:00:03.402196] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-07. [2025-09-23T19:00:04.202212] [INFO ] [REMOTE ] GDO: Fetching primary data for 2024-12. [2025-09-23T19:00:04.971985] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-23T19:00:05.002197] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-08. [2025-09-23T19:00:06.066479] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-23T19:00:06.067899] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-09. [2025-09-23T19:00:06.205988] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-09 (3.59 seconds). [2025-09-23T19:00:06.216494] [INFO ] [REMOTE ] GD: Full fetch complete (70504 records). [2025-09-23T19:00:06.216696] [DEBUG] [VALIDATOR ] GD: Validating primary data. [2025-09-23T19:00:06.604859] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-23T19:00:06.621526] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2024-12 (2.42 seconds). [2025-09-23T19:00:06.664548] [DEBUG] [VALIDATOR ] GD: All expected trading days are present. [2025-09-23T19:00:06.664409] [INFO ] [REMOTE ] GDL: Full fetch complete (3609 records). [2025-09-23T19:00:06.662471] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-01. [2025-09-23T19:00:06.666470] [DEBUG] [VALIDATOR ] GDL: Validating primary data. [2025-09-23T19:00:06.666573] [DEBUG] [VALIDATOR ] GD: Primary data validation passed. [2025-09-23T19:00:06.695379] [INFO ] [MAIN ] GD: Fetched primary data is valid. [2025-09-23T19:00:06.767542] [DEBUG] [LOCAL ] GD: Saving primary data. [2025-09-23T19:00:06.841405] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-04 (5.04 seconds). [2025-09-23T19:00:06.847257] [DEBUG] [LOCAL ] GD: Trimmed 70504 records to 47274 (keeping 200 days of data) [2025-09-23T19:00:07.254525] [DEBUG] [VALIDATOR ] GDL: All expected trading days are present. [2025-09-23T19:00:07.255303] [DEBUG] [VALIDATOR ] GDL: Primary data validation passed. [2025-09-23T19:00:07.259049] [INFO ] [MAIN ] GDL: Fetched primary data is valid. [2025-09-23T19:00:07.259135] [DEBUG] [LOCAL ] GDL: Saving primary data. [2025-09-23T19:00:07.261595] [DEBUG] [LOCAL ] GDL: Trimmed 3609 records to 2482 (keeping 200 days of data) [2025-09-23T19:00:07.283248] [DEBUG] [LOCAL ] GDL: Primary data saved (2482 records). [2025-09-23T19:00:07.285309] [INFO ] [MAIN ] GDL: Full history saved. [2025-09-23T19:00:07.285700] [INFO ] [MAIN ] Update Progress: 906/2372 symbols completed. GDL took 26.2s. Estimated remaining: 3h 14m 17s. Rate: 7.5 symbols/min [2025-09-23T19:00:07.404232] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-05. [2025-09-23T19:00:07.421016] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-23T19:00:07.570069] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:00:07.727709] [DEBUG] [LOCAL ] GD: Primary data saved (47274 records). [2025-09-23T19:00:07.727974] [INFO ] [MAIN ] GD: Full history saved. [2025-09-23T19:00:07.728142] [INFO ] [MAIN ] Update Progress: 907/2372 symbols completed. GD took 44.6s. Estimated remaining: 3h 13m 57s. Rate: 7.6 symbols/min [2025-09-23T19:00:07.864249] [DEBUG] [LOCAL ] GDOT: Loaded 38655 existing records from primary storage. [2025-09-23T19:00:07.885769] [INFO ] [MAIN ] GDOT: Loaded 38655 existing records. [2025-09-23T19:00:08.040618] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:00:08.143109] [WARN ] [MAIN ] GDOT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:00:08.143414] [INFO ] [MAIN ] GDOT: Wiping existing primary data before full refresh. [2025-09-23T19:00:08.143479] [INFO ] [LOCAL ] GDOT: Starting deletion of primary data. [2025-09-23T19:00:08.149724] [DEBUG] [LOCAL ] GDOT: Deleted primary data file. [2025-09-23T19:00:08.150926] [INFO ] [MAIN ] GDOT: Starting full primary refresh. [2025-09-23T19:00:08.151346] [DEBUG] [LOCAL ] GDV: Loaded 19856 existing records from primary storage. [2025-09-23T19:00:08.212152] [INFO ] [MAIN ] GDV: Loaded 19856 existing records. [2025-09-23T19:00:08.212023] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-02. [2025-09-23T19:00:08.671034] [WARN ] [MAIN ] GDV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:00:08.710347] [INFO ] [MAIN ] GDV: Wiping existing primary data before full refresh. [2025-09-23T19:00:08.735954] [INFO ] [REMOTE ] GDOT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:00:08.736033] [INFO ] [LOCAL ] GDV: Starting deletion of primary data. [2025-09-23T19:00:08.737215] [DEBUG] [LOCAL ] GDV: Deleted primary data file. [2025-09-23T19:00:08.737282] [INFO ] [MAIN ] GDV: Starting full primary refresh. [2025-09-23T19:00:08.843044] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-23T19:00:09.011204] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-03. [2025-09-23T19:00:09.143619] [INFO ] [REMOTE ] GDV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:00:09.172703] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-23T19:00:09.802243] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-06. [2025-09-23T19:00:09.826748] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-23T19:00:10.602236] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-04. [2025-09-23T19:00:11.009617] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-23T19:00:11.037517] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-23T19:00:11.402203] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-07. [2025-09-23T19:00:12.202232] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-05. [2025-09-23T19:00:12.946585] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-23T19:00:13.002204] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-06. [2025-09-23T19:00:13.184995] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-23T19:00:13.802218] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2024-12. [2025-09-23T19:00:14.602273] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-08. [2025-09-23T19:00:14.622501] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-23T19:00:15.014844] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-23T19:00:15.402236] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-07. [2025-09-23T19:00:15.830487] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-23T19:00:16.009201] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-23T19:00:16.202242] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-08. [2025-09-23T19:00:16.901868] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-23T19:00:17.002220] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-01. [2025-09-23T19:00:17.802283] [INFO ] [REMOTE ] GDV: Fetching primary data for 2024-12. [2025-09-23T19:00:17.899526] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-23T19:00:18.560168] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-23T19:00:18.602339] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-09. [2025-09-23T19:00:19.130701] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-23T19:00:19.132563] [INFO ] [REMOTE ] GDO: Full fetch complete (9518 records). [2025-09-23T19:00:19.132696] [DEBUG] [VALIDATOR ] GDO: Validating primary data. [2025-09-23T19:00:19.409074] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-09. [2025-09-23T19:00:19.567933] [DEBUG] [VALIDATOR ] GDO: All expected trading days are present. [2025-09-23T19:00:19.568024] [DEBUG] [VALIDATOR ] GDO: Primary data validation passed. [2025-09-23T19:00:19.568294] [INFO ] [MAIN ] GDO: Fetched primary data is valid. [2025-09-23T19:00:19.568333] [DEBUG] [LOCAL ] GDO: Saving primary data. [2025-09-23T19:00:19.568902] [DEBUG] [LOCAL ] GDO: Trimmed 9518 records to 6025 (keeping 200 days of data) [2025-09-23T19:00:19.606674] [DEBUG] [LOCAL ] GDO: Primary data saved (6025 records). [2025-09-23T19:00:19.606844] [INFO ] [MAIN ] GDO: Full history saved. [2025-09-23T19:00:19.606942] [INFO ] [MAIN ] Update Progress: 908/2372 symbols completed. GDO took 17.1s. Estimated remaining: 3h 13m 55s. Rate: 7.5 symbols/min [2025-09-23T19:00:19.781359] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:00:19.842382] [DEBUG] [LOCAL ] GE: Loaded 53713 existing records from primary storage. [2025-09-23T19:00:19.842595] [INFO ] [MAIN ] GE: Loaded 53713 existing records. [2025-09-23T19:00:20.022557] [WARN ] [MAIN ] GE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:00:20.022872] [INFO ] [MAIN ] GE: Wiping existing primary data before full refresh. [2025-09-23T19:00:20.022929] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-09-23T19:00:20.024480] [DEBUG] [LOCAL ] GE: Deleted primary data file. [2025-09-23T19:00:20.024544] [INFO ] [MAIN ] GE: Starting full primary refresh. [2025-09-23T19:00:20.212348] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-01. [2025-09-23T19:00:20.380289] [INFO ] [REMOTE ] GE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:00:21.002248] [INFO ] [REMOTE ] GE: Fetching primary data for 2024-12. [2025-09-23T19:00:21.199065] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-23T19:00:21.220050] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-23T19:00:21.220245] [INFO ] [REMOTE ] GDDY: Full fetch complete (71233 records). [2025-09-23T19:00:21.225130] [DEBUG] [VALIDATOR ] GDDY: Validating primary data. [2025-09-23T19:00:21.640432] [DEBUG] [VALIDATOR ] GDDY: All expected trading days are present. [2025-09-23T19:00:21.640523] [DEBUG] [VALIDATOR ] GDDY: Primary data validation passed. [2025-09-23T19:00:21.641441] [INFO ] [MAIN ] GDDY: Fetched primary data is valid. [2025-09-23T19:00:21.641552] [DEBUG] [LOCAL ] GDDY: Saving primary data. [2025-09-23T19:00:21.643064] [DEBUG] [LOCAL ] GDDY: Trimmed 71233 records to 49746 (keeping 200 days of data) [2025-09-23T19:00:21.814918] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-02. [2025-09-23T19:00:21.946534] [DEBUG] [LOCAL ] GDDY: Primary data saved (49746 records). [2025-09-23T19:00:21.946723] [INFO ] [MAIN ] GDDY: Full history saved. [2025-09-23T19:00:21.946827] [INFO ] [MAIN ] Update Progress: 909/2372 symbols completed. GDDY took 43.2s. Estimated remaining: 3h 13m 38s. Rate: 7.6 symbols/min [2025-09-23T19:00:22.120596] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:00:22.140452] [DEBUG] [LOCAL ] GEF: Loaded 20694 existing records from primary storage. [2025-09-23T19:00:22.140583] [INFO ] [MAIN ] GEF: Loaded 20694 existing records. [2025-09-23T19:00:22.319910] [WARN ] [MAIN ] GEF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:00:22.320168] [INFO ] [MAIN ] GEF: Wiping existing primary data before full refresh. [2025-09-23T19:00:22.320216] [INFO ] [LOCAL ] GEF: Starting deletion of primary data. [2025-09-23T19:00:22.320911] [DEBUG] [LOCAL ] GEF: Deleted primary data file. [2025-09-23T19:00:22.320973] [INFO ] [MAIN ] GEF: Starting full primary refresh. [2025-09-23T19:00:22.607576] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-02. [2025-09-23T19:00:22.695637] [INFO ] [REMOTE ] GEF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:00:22.842172] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-23T19:00:22.877262] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-23T19:00:23.402248] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-01. [2025-09-23T19:00:23.774884] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-23T19:00:24.202244] [INFO ] [REMOTE ] GEF: Fetching primary data for 2024-12. [2025-09-23T19:00:25.002230] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-03. [2025-09-23T19:00:25.095542] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-23T19:00:25.208923] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-23T19:00:25.802230] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-03. [2025-09-23T19:00:26.072316] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-23T19:00:26.602201] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-04. [2025-09-23T19:00:27.314410] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-23T19:00:27.402161] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-04. [2025-09-23T19:00:27.483562] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-23T19:00:28.202265] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-02. [2025-09-23T19:00:28.889011] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-23T19:00:29.002193] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-05. [2025-09-23T19:00:29.802219] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-01. [2025-09-23T19:00:29.836014] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-23T19:00:30.423680] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-23T19:00:30.524139] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-23T19:00:30.602224] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-02. [2025-09-23T19:00:31.386371] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-23T19:00:31.402153] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-03. [2025-09-23T19:00:32.202233] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-03. [2025-09-23T19:00:32.601736] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-23T19:00:33.002231] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-06. [2025-09-23T19:00:33.802217] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-04. [2025-09-23T19:00:33.992506] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-23T19:00:34.063122] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-23T19:00:34.602197] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-05. [2025-09-23T19:00:34.708638] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-23T19:00:35.402178] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-05. [2025-09-23T19:00:35.449439] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-23T19:00:35.989456] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-23T19:00:36.202202] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-07. [2025-09-23T19:00:37.002217] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-06. [2025-09-23T19:00:37.638171] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-23T19:00:37.807356] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-08. [2025-09-23T19:00:37.817393] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-23T19:00:38.602204] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-07. [2025-09-23T19:00:39.284717] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-23T19:00:39.402207] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-09. [2025-09-23T19:00:39.917687] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-23T19:00:40.202200] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-08. [2025-09-23T19:00:40.780601] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-23T19:00:40.788032] [INFO ] [REMOTE ] GDOT: Full fetch complete (52534 records). [2025-09-23T19:00:40.788154] [DEBUG] [VALIDATOR ] GDOT: Validating primary data. [2025-09-23T19:00:41.007293] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-06. [2025-09-23T19:00:41.200940] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-23T19:00:41.199983] [DEBUG] [VALIDATOR ] GDOT: All expected trading days are present. [2025-09-23T19:00:41.201109] [DEBUG] [VALIDATOR ] GDOT: Primary data validation passed. [2025-09-23T19:00:41.206598] [INFO ] [MAIN ] GDOT: Fetched primary data is valid. [2025-09-23T19:00:41.206822] [DEBUG] [LOCAL ] GDOT: Saving primary data. [2025-09-23T19:00:41.208199] [DEBUG] [LOCAL ] GDOT: Trimmed 52534 records to 38662 (keeping 200 days of data) [2025-09-23T19:00:41.442346] [DEBUG] [LOCAL ] GDOT: Primary data saved (38662 records). [2025-09-23T19:00:41.442512] [INFO ] [MAIN ] GDOT: Full history saved. [2025-09-23T19:00:41.442600] [INFO ] [MAIN ] Update Progress: 910/2372 symbols completed. GDOT took 34.2s. Estimated remaining: 3h 13m 49s. Rate: 7.5 symbols/min [2025-09-23T19:00:41.611540] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:00:41.646298] [DEBUG] [LOCAL ] GEL: Loaded 34191 existing records from primary storage. [2025-09-23T19:00:41.646437] [INFO ] [MAIN ] GEL: Loaded 34191 existing records. [2025-09-23T19:00:41.807862] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-09. [2025-09-23T19:00:41.833547] [WARN ] [MAIN ] GEL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:00:41.834081] [INFO ] [MAIN ] GEL: Wiping existing primary data before full refresh. [2025-09-23T19:00:41.834177] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-09-23T19:00:41.875197] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-23T19:00:41.879058] [DEBUG] [LOCAL ] GEL: Deleted primary data file. [2025-09-23T19:00:41.879553] [INFO ] [MAIN ] GEL: Starting full primary refresh. [2025-09-23T19:00:42.250668] [INFO ] [REMOTE ] GEL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:00:42.602194] [INFO ] [REMOTE ] GEL: Fetching primary data for 2024-12. [2025-09-23T19:00:42.681423] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-23T19:00:42.686599] [INFO ] [REMOTE ] GEF: Full fetch complete (29480 records). [2025-09-23T19:00:42.686828] [DEBUG] [VALIDATOR ] GEF: Validating primary data. [2025-09-23T19:00:43.078829] [DEBUG] [VALIDATOR ] GEF: All expected trading days are present. [2025-09-23T19:00:43.078912] [DEBUG] [VALIDATOR ] GEF: Primary data validation passed. [2025-09-23T19:00:43.079419] [INFO ] [MAIN ] GEF: Fetched primary data is valid. [2025-09-23T19:00:43.079459] [DEBUG] [LOCAL ] GEF: Saving primary data. [2025-09-23T19:00:43.080192] [DEBUG] [LOCAL ] GEF: Trimmed 29480 records to 20743 (keeping 200 days of data) [2025-09-23T19:00:43.208879] [DEBUG] [LOCAL ] GEF: Primary data saved (20743 records). [2025-09-23T19:00:43.209008] [INFO ] [MAIN ] GEF: Full history saved. [2025-09-23T19:00:43.209101] [INFO ] [MAIN ] Update Progress: 911/2372 symbols completed. GEF took 21.3s. Estimated remaining: 3h 13m 31s. Rate: 7.5 symbols/min [2025-09-23T19:00:43.382493] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:00:43.414716] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-07. [2025-09-23T19:00:43.437497] [DEBUG] [LOCAL ] GENI: Loaded 52914 existing records from primary storage. [2025-09-23T19:00:43.437686] [INFO ] [MAIN ] GENI: Loaded 52914 existing records. [2025-09-23T19:00:43.616260] [WARN ] [MAIN ] GENI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:00:43.616475] [INFO ] [MAIN ] GENI: Wiping existing primary data before full refresh. [2025-09-23T19:00:43.616527] [INFO ] [LOCAL ] GENI: Starting deletion of primary data. [2025-09-23T19:00:43.617541] [DEBUG] [LOCAL ] GENI: Deleted primary data file. [2025-09-23T19:00:43.617602] [INFO ] [MAIN ] GENI: Starting full primary refresh. [2025-09-23T19:00:44.008177] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-23T19:00:44.013317] [INFO ] [REMOTE ] GENI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:00:44.207280] [INFO ] [REMOTE ] GENI: Fetching primary data for 2024-12. [2025-09-23T19:00:44.217336] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-23T19:00:45.002209] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-04. [2025-09-23T19:00:45.802209] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-08. [2025-09-23T19:00:45.949783] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-23T19:00:46.602163] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-01. [2025-09-23T19:00:46.763087] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-23T19:00:46.810431] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-23T19:00:47.402247] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-09. [2025-09-23T19:00:47.461287] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-23T19:00:48.169212] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-23T19:00:48.172509] [INFO ] [REMOTE ] GDV: Full fetch complete (28825 records). [2025-09-23T19:00:48.172590] [DEBUG] [VALIDATOR ] GDV: Validating primary data. [2025-09-23T19:00:48.207274] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-01. [2025-09-23T19:00:48.552018] [DEBUG] [VALIDATOR ] GDV: All expected trading days are present. [2025-09-23T19:00:48.552147] [DEBUG] [VALIDATOR ] GDV: Primary data validation passed. [2025-09-23T19:00:48.552675] [INFO ] [MAIN ] GDV: Fetched primary data is valid. [2025-09-23T19:00:48.552737] [DEBUG] [LOCAL ] GDV: Saving primary data. [2025-09-23T19:00:48.553412] [DEBUG] [LOCAL ] GDV: Trimmed 28825 records to 19729 (keeping 200 days of data) [2025-09-23T19:00:48.671892] [DEBUG] [LOCAL ] GDV: Primary data saved (19729 records). [2025-09-23T19:00:48.672032] [INFO ] [MAIN ] GDV: Full history saved. [2025-09-23T19:00:48.672118] [INFO ] [MAIN ] Update Progress: 912/2372 symbols completed. GDV took 40.9s. Estimated remaining: 3h 13m 19s. Rate: 7.6 symbols/min [2025-09-23T19:00:48.838454] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:00:48.891576] [DEBUG] [LOCAL ] GEO: Loaded 52179 existing records from primary storage. [2025-09-23T19:00:48.891749] [INFO ] [MAIN ] GEO: Loaded 52179 existing records. [2025-09-23T19:00:49.007338] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-05. [2025-09-23T19:00:49.068939] [WARN ] [MAIN ] GEO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:00:49.069218] [INFO ] [MAIN ] GEO: Wiping existing primary data before full refresh. [2025-09-23T19:00:49.069264] [INFO ] [LOCAL ] GEO: Starting deletion of primary data. [2025-09-23T19:00:49.070343] [DEBUG] [LOCAL ] GEO: Deleted primary data file. [2025-09-23T19:00:49.070404] [INFO ] [MAIN ] GEO: Starting full primary refresh. [2025-09-23T19:00:49.420468] [INFO ] [REMOTE ] GEO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:00:49.802189] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-02. [2025-09-23T19:00:49.922953] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-23T19:00:50.602206] [INFO ] [REMOTE ] GEO: Fetching primary data for 2024-12. [2025-09-23T19:00:50.808036] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-23T19:00:51.402180] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-03. [2025-09-23T19:00:51.445221] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-09-23T19:00:52.037404] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-23T19:00:52.202246] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-01. [2025-09-23T19:00:52.496259] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-23T19:00:53.002200] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-04. [2025-09-23T19:00:53.802173] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-06. [2025-09-23T19:00:53.870011] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-23T19:00:54.026993] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-23T19:00:54.602199] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-05. [2025-09-23T19:00:55.402198] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-02. [2025-09-23T19:00:55.568621] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-23T19:00:55.944182] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-23T19:00:56.202213] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-07. [2025-09-23T19:00:56.555252] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-23T19:00:57.002213] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-02. [2025-09-23T19:00:57.802193] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-03. [2025-09-23T19:00:58.125704] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-23T19:00:58.549587] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-23T19:00:58.602198] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-03. [2025-09-23T19:00:59.402197] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-08. [2025-09-23T19:00:59.547138] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-23T19:01:00.202234] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-04. [2025-09-23T19:01:00.208733] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-23T19:01:01.002217] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-06. [2025-09-23T19:01:01.319085] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-23T19:01:01.802316] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-09. [2025-09-23T19:01:02.384385] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-23T19:01:02.453502] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-23T19:01:02.602210] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-05. [2025-09-23T19:01:03.402201] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-04. [2025-09-23T19:01:03.739328] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-23T19:01:03.749712] [INFO ] [REMOTE ] GE: Full fetch complete (77780 records). [2025-09-23T19:01:03.749899] [DEBUG] [VALIDATOR ] GE: Validating primary data. [2025-09-23T19:01:04.176175] [DEBUG] [VALIDATOR ] GE: All expected trading days are present. [2025-09-23T19:01:04.176369] [DEBUG] [VALIDATOR ] GE: Primary data validation passed. [2025-09-23T19:01:04.177958] [INFO ] [MAIN ] GE: Fetched primary data is valid. [2025-09-23T19:01:04.178048] [DEBUG] [LOCAL ] GE: Saving primary data. [2025-09-23T19:01:04.179844] [DEBUG] [LOCAL ] GE: Trimmed 77780 records to 53713 (keeping 200 days of data) [2025-09-23T19:01:04.237696] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-07. [2025-09-23T19:01:04.326604] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-23T19:01:04.601169] [DEBUG] [LOCAL ] GE: Primary data saved (53713 records). [2025-09-23T19:01:04.601322] [INFO ] [MAIN ] GE: Full history saved. [2025-09-23T19:01:04.601409] [INFO ] [MAIN ] Update Progress: 913/2372 symbols completed. GE took 45.0s. Estimated remaining: 3h 13m 24s. Rate: 7.5 symbols/min [2025-09-23T19:01:04.770758] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:01:04.812947] [DEBUG] [LOCAL ] GES: Loaded 40196 existing records from primary storage. [2025-09-23T19:01:04.813171] [INFO ] [MAIN ] GES: Loaded 40196 existing records. [2025-09-23T19:01:05.006155] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-06. [2025-09-23T19:01:05.006075] [WARN ] [MAIN ] GES: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:01:05.007535] [INFO ] [MAIN ] GES: Wiping existing primary data before full refresh. [2025-09-23T19:01:05.007603] [INFO ] [LOCAL ] GES: Starting deletion of primary data. [2025-09-23T19:01:05.008623] [DEBUG] [LOCAL ] GES: Deleted primary data file. [2025-09-23T19:01:05.008719] [INFO ] [MAIN ] GES: Starting full primary refresh. [2025-09-23T19:01:05.230212] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-23T19:01:05.434209] [INFO ] [REMOTE ] GES: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:01:05.496815] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-23T19:01:05.802211] [INFO ] [REMOTE ] GES: Fetching primary data for 2024-12. [2025-09-23T19:01:06.461280] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-23T19:01:06.602197] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-08. [2025-09-23T19:01:07.186341] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-23T19:01:07.402203] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-01. [2025-09-23T19:01:08.063468] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-23T19:01:08.202182] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-09. [2025-09-23T19:01:08.600520] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-23T19:01:09.002218] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-07. [2025-09-23T19:01:09.043846] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-23T19:01:09.048570] [INFO ] [REMOTE ] GEL: Full fetch complete (48685 records). [2025-09-23T19:01:09.048729] [DEBUG] [VALIDATOR ] GEL: Validating primary data. [2025-09-23T19:01:09.446075] [DEBUG] [VALIDATOR ] GEL: All expected trading days are present. [2025-09-23T19:01:09.446202] [DEBUG] [VALIDATOR ] GEL: Primary data validation passed. [2025-09-23T19:01:09.448162] [INFO ] [MAIN ] GEL: Fetched primary data is valid. [2025-09-23T19:01:09.448227] [DEBUG] [LOCAL ] GEL: Saving primary data. [2025-09-23T19:01:09.450237] [DEBUG] [LOCAL ] GEL: Trimmed 48685 records to 34033 (keeping 200 days of data) [2025-09-23T19:01:09.663556] [DEBUG] [LOCAL ] GEL: Primary data saved (34033 records). [2025-09-23T19:01:09.663737] [INFO ] [MAIN ] GEL: Full history saved. [2025-09-23T19:01:09.663860] [INFO ] [MAIN ] Update Progress: 914/2372 symbols completed. GEL took 28.2s. Estimated remaining: 3h 13m 11s. Rate: 7.5 symbols/min [2025-09-23T19:01:09.809537] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-02. [2025-09-23T19:01:09.835237] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:01:09.881511] [DEBUG] [LOCAL ] GETY: Loaded 36102 existing records from primary storage. [2025-09-23T19:01:09.881747] [INFO ] [MAIN ] GETY: Loaded 36102 existing records. [2025-09-23T19:01:10.090317] [WARN ] [MAIN ] GETY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:01:10.090730] [INFO ] [MAIN ] GETY: Wiping existing primary data before full refresh. [2025-09-23T19:01:10.090810] [INFO ] [LOCAL ] GETY: Starting deletion of primary data. [2025-09-23T19:01:10.091619] [DEBUG] [LOCAL ] GETY: Deleted primary data file. [2025-09-23T19:01:10.091723] [INFO ] [MAIN ] GETY: Starting full primary refresh. [2025-09-23T19:01:10.498920] [INFO ] [REMOTE ] GETY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:01:10.602221] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-05. [2025-09-23T19:01:10.665715] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-23T19:01:11.356444] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-23T19:01:11.402146] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-03. [2025-09-23T19:01:12.185967] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-23T19:01:12.202133] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-06. [2025-09-23T19:01:12.729440] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-23T19:01:13.002218] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-04. [2025-09-23T19:01:13.561081] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-23T19:01:13.802187] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-07. [2025-09-23T19:01:14.320122] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-23T19:01:14.602241] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-08. [2025-09-23T19:01:15.339561] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-23T19:01:15.402208] [INFO ] [REMOTE ] GETY: Fetching primary data for 2024-12. [2025-09-23T19:01:16.042975] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-23T19:01:16.202228] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-09. [2025-09-23T19:01:16.486396] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-23T19:01:17.002198] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-08. [2025-09-23T19:01:17.802166] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-01. [2025-09-23T19:01:17.959579] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-23T19:01:17.970541] [INFO ] [REMOTE ] GENI: Full fetch complete (75438 records). [2025-09-23T19:01:17.970777] [DEBUG] [VALIDATOR ] GENI: Validating primary data. [2025-09-23T19:01:18.405579] [DEBUG] [VALIDATOR ] GENI: All expected trading days are present. [2025-09-23T19:01:18.405740] [DEBUG] [VALIDATOR ] GENI: Primary data validation passed. [2025-09-23T19:01:18.406826] [INFO ] [MAIN ] GENI: Fetched primary data is valid. [2025-09-23T19:01:18.407229] [DEBUG] [LOCAL ] GENI: Saving primary data. [2025-09-23T19:01:18.410555] [DEBUG] [LOCAL ] GENI: Trimmed 75438 records to 52913 (keeping 200 days of data) [2025-09-23T19:01:18.573634] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-23T19:01:18.602190] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-05. [2025-09-23T19:01:18.798293] [DEBUG] [LOCAL ] GENI: Primary data saved (52913 records). [2025-09-23T19:01:18.798461] [INFO ] [MAIN ] GENI: Full history saved. [2025-09-23T19:01:18.798632] [INFO ] [MAIN ] Update Progress: 915/2372 symbols completed. GENI took 35.6s. Estimated remaining: 3h 13m 5s. Rate: 7.5 symbols/min [2025-09-23T19:01:18.973364] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:01:19.032492] [DEBUG] [LOCAL ] GEV: Loaded 53150 existing records from primary storage. [2025-09-23T19:01:19.032683] [INFO ] [MAIN ] GEV: Loaded 53150 existing records. [2025-09-23T19:01:19.216093] [WARN ] [MAIN ] GEV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:01:19.216477] [INFO ] [MAIN ] GEV: Wiping existing primary data before full refresh. [2025-09-23T19:01:19.216556] [INFO ] [LOCAL ] GEV: Starting deletion of primary data. [2025-09-23T19:01:19.217991] [DEBUG] [LOCAL ] GEV: Deleted primary data file. [2025-09-23T19:01:19.218073] [INFO ] [MAIN ] GEV: Starting full primary refresh. [2025-09-23T19:01:19.411432] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-09. [2025-09-23T19:01:19.604231] [INFO ] [REMOTE ] GEV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:01:19.809956] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-23T19:01:19.847420] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-09-23T19:01:20.202204] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-06. [2025-09-23T19:01:20.866703] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-23T19:01:20.880415] [INFO ] [REMOTE ] GEO: Full fetch complete (75607 records). [2025-09-23T19:01:20.880670] [DEBUG] [VALIDATOR ] GEO: Validating primary data. [2025-09-23T19:01:21.007330] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-02. [2025-09-23T19:01:21.288021] [DEBUG] [VALIDATOR ] GEO: All expected trading days are present. [2025-09-23T19:01:21.288156] [DEBUG] [VALIDATOR ] GEO: Primary data validation passed. [2025-09-23T19:01:21.289160] [INFO ] [MAIN ] GEO: Fetched primary data is valid. [2025-09-23T19:01:21.289249] [DEBUG] [LOCAL ] GEO: Saving primary data. [2025-09-23T19:01:21.291673] [DEBUG] [LOCAL ] GEO: Trimmed 75607 records to 52152 (keeping 200 days of data) [2025-09-23T19:01:21.620801] [DEBUG] [LOCAL ] GEO: Primary data saved (52152 records). [2025-09-23T19:01:21.620996] [INFO ] [MAIN ] GEO: Full history saved. [2025-09-23T19:01:21.621145] [INFO ] [MAIN ] Update Progress: 916/2372 symbols completed. GEO took 32.9s. Estimated remaining: 3h 12m 49s. Rate: 7.6 symbols/min [2025-09-23T19:01:21.810927] [INFO ] [REMOTE ] GEV: Fetching primary data for 2024-12. [2025-09-23T19:01:21.851412] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:01:21.847240] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-23T19:01:21.865576] [DEBUG] [LOCAL ] GF: Loaded 3368 existing records from primary storage. [2025-09-23T19:01:21.865722] [INFO ] [MAIN ] GF: Loaded 3368 existing records. [2025-09-23T19:01:22.042151] [WARN ] [MAIN ] GF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:01:22.042444] [INFO ] [MAIN ] GF: Wiping existing primary data before full refresh. [2025-09-23T19:01:22.042533] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-09-23T19:01:22.042850] [DEBUG] [LOCAL ] GF: Deleted primary data file. [2025-09-23T19:01:22.042922] [INFO ] [MAIN ] GF: Starting full primary refresh. [2025-09-23T19:01:22.403718] [INFO ] [REMOTE ] GF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:01:22.561611] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-23T19:01:22.602200] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-07. [2025-09-23T19:01:23.402245] [INFO ] [REMOTE ] GF: Fetching primary data for 2024-12. [2025-09-23T19:01:23.927069] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-23T19:01:24.025667] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-09-23T19:01:24.061870] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-23T19:01:24.202198] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-01. [2025-09-23T19:01:24.613205] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-23T19:01:25.002221] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-01. [2025-09-23T19:01:25.802262] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-08. [2025-09-23T19:01:26.602250] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-03. [2025-09-23T19:01:26.931017] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-23T19:01:27.045623] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-23T19:01:27.402220] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-02. [2025-09-23T19:01:27.851552] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-23T19:01:28.202261] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-02. [2025-09-23T19:01:28.574812] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-23T19:01:29.002253] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-03. [2025-09-23T19:01:29.322924] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-23T19:01:29.782598] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-23T19:01:29.802162] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-03. [2025-09-23T19:01:30.602236] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-09. [2025-09-23T19:01:31.402242] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-04. [2025-09-23T19:01:31.682331] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-23T19:01:31.688732] [INFO ] [REMOTE ] GES: Full fetch complete (60092 records). [2025-09-23T19:01:31.688905] [DEBUG] [VALIDATOR ] GES: Validating primary data. [2025-09-23T19:01:32.174346] [DEBUG] [VALIDATOR ] GES: All expected trading days are present. [2025-09-23T19:01:32.174506] [DEBUG] [VALIDATOR ] GES: Primary data validation passed. [2025-09-23T19:01:32.175327] [INFO ] [MAIN ] GES: Fetched primary data is valid. [2025-09-23T19:01:32.175462] [DEBUG] [LOCAL ] GES: Saving primary data. [2025-09-23T19:01:32.177080] [DEBUG] [LOCAL ] GES: Trimmed 60092 records to 40095 (keeping 200 days of data) [2025-09-23T19:01:32.204831] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-04. [2025-09-23T19:01:32.276714] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-09-23T19:01:32.480122] [DEBUG] [LOCAL ] GES: Primary data saved (40095 records). [2025-09-23T19:01:32.480470] [INFO ] [MAIN ] GES: Full history saved. [2025-09-23T19:01:32.480635] [INFO ] [MAIN ] Update Progress: 917/2372 symbols completed. GES took 27.9s. Estimated remaining: 3h 12m 46s. Rate: 7.5 symbols/min [2025-09-23T19:01:32.525735] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-23T19:01:32.653333] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-23T19:01:33.002249] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-04. [2025-09-23T19:01:33.802267] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-05. [2025-09-23T19:01:34.389178] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-23T19:01:34.602215] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-06. [2025-09-23T19:01:35.109737] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-23T19:01:35.156215] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-23T19:01:35.402262] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-05. [2025-09-23T19:01:36.202197] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-07. [2025-09-23T19:01:36.484779] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-23T19:01:36.515522] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-23T19:01:37.002200] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-05. [2025-09-23T19:01:37.802199] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-08. [2025-09-23T19:01:38.199533] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-23T19:01:38.602217] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-06. [2025-09-23T19:01:39.402209] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-09. [2025-09-23T19:01:39.446074] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-09-23T19:01:39.698787] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-23T19:01:39.772554] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-23T19:01:39.773468] [INFO ] [REMOTE ] GF: Full fetch complete (5392 records). [2025-09-23T19:01:39.773539] [DEBUG] [VALIDATOR ] GF: Validating primary data. [2025-09-23T19:01:40.165256] [DEBUG] [VALIDATOR ] GF: All expected trading days are present. [2025-09-23T19:01:40.165353] [DEBUG] [VALIDATOR ] GF: Primary data validation passed. [2025-09-23T19:01:40.165522] [INFO ] [MAIN ] GF: Fetched primary data is valid. [2025-09-23T19:01:40.165561] [DEBUG] [LOCAL ] GF: Saving primary data. [2025-09-23T19:01:40.165977] [DEBUG] [LOCAL ] GF: Trimmed 5392 records to 3269 (keeping 200 days of data) [2025-09-23T19:01:40.185750] [DEBUG] [LOCAL ] GF: Primary data saved (3269 records). [2025-09-23T19:01:40.185835] [INFO ] [MAIN ] GF: Full history saved. [2025-09-23T19:01:40.185924] [INFO ] [MAIN ] Update Progress: 918/2372 symbols completed. GF took 18.6s. Estimated remaining: 3h 12m 38s. Rate: 7.5 symbols/min [2025-09-23T19:01:40.202156] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-06. [2025-09-23T19:01:41.002229] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-07. [2025-09-23T19:01:42.047583] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-23T19:01:42.058417] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-08. [2025-09-23T19:01:42.451700] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-23T19:01:42.602188] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-07. [2025-09-23T19:01:43.103322] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-23T19:01:43.402230] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-09. [2025-09-23T19:01:45.088108] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-09-23T19:01:45.100697] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-08. [2025-09-23T19:01:45.118922] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-23T19:01:45.125507] [INFO ] [REMOTE ] GETY: Full fetch complete (55891 records). [2025-09-23T19:01:45.125621] [DEBUG] [VALIDATOR ] GETY: Validating primary data. [2025-09-23T19:01:45.542419] [DEBUG] [VALIDATOR ] GETY: All expected trading days are present. [2025-09-23T19:01:45.542785] [DEBUG] [VALIDATOR ] GETY: Primary data validation passed. [2025-09-23T19:01:45.543691] [INFO ] [MAIN ] GETY: Fetched primary data is valid. [2025-09-23T19:01:45.543756] [DEBUG] [LOCAL ] GETY: Saving primary data. [2025-09-23T19:01:45.545023] [DEBUG] [LOCAL ] GETY: Trimmed 55891 records to 36040 (keeping 200 days of data) [2025-09-23T19:01:45.765212] [DEBUG] [LOCAL ] GETY: Primary data saved (36040 records). [2025-09-23T19:01:45.765369] [INFO ] [MAIN ] GETY: Full history saved. [2025-09-23T19:01:45.765488] [INFO ] [MAIN ] Update Progress: 919/2372 symbols completed. GETY took 36.1s. Estimated remaining: 3h 12m 26s. Rate: 7.6 symbols/min [2025-09-23T19:01:47.538475] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-09-23T19:01:47.549957] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-09. [2025-09-23T19:01:50.001120] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-09-23T19:01:50.009939] [INFO ] [REMOTE ] GEV: Full fetch complete (77004 records). [2025-09-23T19:01:50.010085] [DEBUG] [VALIDATOR ] GEV: Validating primary data. [2025-09-23T19:01:50.409713] [DEBUG] [VALIDATOR ] GEV: All expected trading days are present. [2025-09-23T19:01:50.409818] [DEBUG] [VALIDATOR ] GEV: Primary data validation passed. [2025-09-23T19:01:50.410804] [INFO ] [MAIN ] GEV: Fetched primary data is valid. [2025-09-23T19:01:50.410873] [DEBUG] [LOCAL ] GEV: Saving primary data. [2025-09-23T19:01:50.412483] [DEBUG] [LOCAL ] GEV: Trimmed 77004 records to 53146 (keeping 200 days of data) [2025-09-23T19:01:50.762986] [DEBUG] [LOCAL ] GEV: Primary data saved (53146 records). [2025-09-23T19:01:50.763134] [INFO ] [MAIN ] GEV: Full history saved. [2025-09-23T19:01:50.763231] [INFO ] [MAIN ] Update Progress: 920/2372 symbols completed. GEV took 32.0s. Estimated remaining: 3h 12m 13s. Rate: 7.6 symbols/min [2025-09-23T19:01:51.291269] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:01:51.522818] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:01:51.527085] [DEBUG] [LOCAL ] GFR: Loaded 8382 existing records from primary storage. [2025-09-23T19:01:51.549462] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:01:51.550843] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:01:51.551111] [INFO ] [MAIN ] GFR: Loaded 8382 existing records. [2025-09-23T19:01:51.783855] [WARN ] [MAIN ] GFR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:01:51.795348] [INFO ] [MAIN ] GFR: Wiping existing primary data before full refresh. [2025-09-23T19:01:51.795413] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-09-23T19:01:51.795853] [DEBUG] [LOCAL ] GFR: Deleted primary data file. [2025-09-23T19:01:51.795918] [INFO ] [MAIN ] GFR: Starting full primary refresh. [2025-09-23T19:01:51.794868] [DEBUG] [LOCAL ] GFF: Loaded 30950 existing records from primary storage. [2025-09-23T19:01:51.855765] [INFO ] [MAIN ] GFF: Loaded 30950 existing records. [2025-09-23T19:01:52.004928] [DEBUG] [LOCAL ] GFL: Loaded 48052 existing records from primary storage. [2025-09-23T19:01:52.030541] [INFO ] [MAIN ] GFL: Loaded 48052 existing records. [2025-09-23T19:01:52.121114] [DEBUG] [LOCAL ] GFI: Loaded 53104 existing records from primary storage. [2025-09-23T19:01:52.146818] [INFO ] [MAIN ] GFI: Loaded 53104 existing records. [2025-09-23T19:01:52.486339] [WARN ] [MAIN ] GFF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:01:52.580943] [INFO ] [MAIN ] GFF: Wiping existing primary data before full refresh. [2025-09-23T19:01:52.610733] [INFO ] [LOCAL ] GFF: Starting deletion of primary data. [2025-09-23T19:01:52.695711] [WARN ] [MAIN ] GFL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:01:52.743344] [WARN ] [MAIN ] GFI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:01:52.754064] [INFO ] [MAIN ] GFL: Wiping existing primary data before full refresh. [2025-09-23T19:01:52.776441] [INFO ] [LOCAL ] GFL: Starting deletion of primary data. [2025-09-23T19:01:52.695802] [DEBUG] [LOCAL ] GFF: Deleted primary data file. [2025-09-23T19:01:52.776576] [INFO ] [MAIN ] GFI: Wiping existing primary data before full refresh. [2025-09-23T19:01:52.787639] [INFO ] [LOCAL ] GFI: Starting deletion of primary data. [2025-09-23T19:01:52.799968] [DEBUG] [LOCAL ] GFI: Deleted primary data file. [2025-09-23T19:01:52.820787] [INFO ] [REMOTE ] GFR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:01:52.816829] [INFO ] [MAIN ] GFI: Starting full primary refresh. [2025-09-23T19:01:52.799919] [INFO ] [MAIN ] GFF: Starting full primary refresh. [2025-09-23T19:01:52.832184] [INFO ] [REMOTE ] GFR: Fetching primary data for 2024-12. [2025-09-23T19:01:52.831926] [DEBUG] [LOCAL ] GFL: Deleted primary data file. [2025-09-23T19:01:52.923063] [INFO ] [MAIN ] GFL: Starting full primary refresh. [2025-09-23T19:01:53.947235] [INFO ] [REMOTE ] GFF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:01:53.950785] [INFO ] [REMOTE ] GFI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:01:53.947745] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-23T19:01:53.968856] [INFO ] [REMOTE ] GFI: Fetching primary data for 2024-12. [2025-09-23T19:01:53.979442] [INFO ] [REMOTE ] GFF: Fetching primary data for 2024-12. [2025-09-23T19:01:53.982362] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-01. [2025-09-23T19:01:53.987268] [INFO ] [REMOTE ] GFL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:01:53.988344] [INFO ] [REMOTE ] GFL: Fetching primary data for 2024-12. [2025-09-23T19:01:54.456679] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-23T19:01:54.459120] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-02. [2025-09-23T19:01:54.905011] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-23T19:01:54.907989] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-03. [2025-09-23T19:01:55.337985] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-23T19:01:55.344801] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-01. [2025-09-23T19:01:55.421286] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-23T19:01:55.424836] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-04. [2025-09-23T19:01:55.518205] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-23T19:01:55.527059] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-01. [2025-09-23T19:01:55.655596] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-23T19:01:55.666433] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-01. [2025-09-23T19:01:55.991472] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-23T19:01:55.994876] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-05. [2025-09-23T19:01:56.390250] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-23T19:01:56.396977] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-02. [2025-09-23T19:01:56.571660] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-23T19:01:56.574513] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-06. [2025-09-23T19:01:56.748085] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-23T19:01:57.002208] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-02. [2025-09-23T19:01:57.155806] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-23T19:01:57.249970] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-23T19:01:57.339204] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-23T19:01:57.802190] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-03. [2025-09-23T19:01:58.379851] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-23T19:01:58.602215] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-07. [2025-09-23T19:01:58.719926] [DEBUG] [REMOTE ] GFR: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-09-23T19:01:58.720228] [WARN ] [REMOTE ] GFR: No data returned for month 2025-07 [2025-09-23T19:01:58.755152] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-23T19:01:59.402208] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-02. [2025-09-23T19:02:00.202195] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-04. [2025-09-23T19:02:01.002195] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-03. [2025-09-23T19:02:01.100387] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-23T19:02:01.442498] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-23T19:02:01.802230] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-08. [2025-09-23T19:02:02.474262] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-23T19:02:02.602199] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-05. [2025-09-23T19:02:02.812914] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-23T19:02:03.402195] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-09. [2025-09-23T19:02:03.667286] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-23T19:02:03.891912] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-23T19:02:03.893686] [INFO ] [REMOTE ] GFR: Full fetch complete (12100 records). [2025-09-23T19:02:03.893761] [DEBUG] [VALIDATOR ] GFR: Validating primary data. [2025-09-23T19:02:04.076544] [WARN ] [VALIDATOR ] GFR: Validation failed - insufficient historical data. Have 178 unique days, need 200 days [2025-09-23T19:02:04.076825] [FATAL] [MAIN ] GFR: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:02:04.076894] [WARN ] [MAIN ] GFR: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:02:04.076965] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-09-23T19:02:04.077030] [DEBUG] [LOCAL ] GFR: No primary data file found to delete. [2025-09-23T19:02:04.077104] [INFO ] [LOCAL ] GFR: Starting deletion of derivative data. [2025-09-23T19:02:04.077570] [DEBUG] [LOCAL ] GFR: Deleted derivative data file. [2025-09-23T19:02:04.077702] [INFO ] [MAIN ] Update Progress: 921/2372 symbols completed. GFR took 13.3s. Estimated remaining: 3h 12m 14s. Rate: 7.5 symbols/min [2025-09-23T19:02:04.216133] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-04. [2025-09-23T19:02:04.253059] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:02:04.310690] [DEBUG] [LOCAL ] GGB: Loaded 51011 existing records from primary storage. [2025-09-23T19:02:04.310854] [INFO ] [MAIN ] GGB: Loaded 51011 existing records. [2025-09-23T19:02:04.491960] [WARN ] [MAIN ] GGB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:02:04.492269] [INFO ] [MAIN ] GGB: Wiping existing primary data before full refresh. [2025-09-23T19:02:04.492352] [INFO ] [LOCAL ] GGB: Starting deletion of primary data. [2025-09-23T19:02:04.493535] [DEBUG] [LOCAL ] GGB: Deleted primary data file. [2025-09-23T19:02:04.493601] [INFO ] [MAIN ] GGB: Starting full primary refresh. [2025-09-23T19:02:04.856702] [INFO ] [REMOTE ] GGB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:02:05.002194] [INFO ] [REMOTE ] GGB: Fetching primary data for 2024-12. [2025-09-23T19:02:05.802193] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-03. [2025-09-23T19:02:06.049260] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-23T19:02:06.349796] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-23T19:02:06.602197] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-05. [2025-09-23T19:02:07.402226] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-01. [2025-09-23T19:02:07.446312] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-23T19:02:08.202224] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-06. [2025-09-23T19:02:08.250595] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-23T19:02:09.002212] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-06. [2025-09-23T19:02:09.127856] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-23T19:02:09.175135] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-23T19:02:09.802218] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-02. [2025-09-23T19:02:10.203912] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-23T19:02:10.602222] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-07. [2025-09-23T19:02:11.402184] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-04. [2025-09-23T19:02:11.510857] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-23T19:02:11.537148] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-23T19:02:12.202260] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-07. [2025-09-23T19:02:13.002223] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-08. [2025-09-23T19:02:13.304286] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-23T19:02:13.459034] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-23T19:02:13.802245] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-05. [2025-09-23T19:02:14.101371] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-23T19:02:14.602261] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-09. [2025-09-23T19:02:15.402163] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-08. [2025-09-23T19:02:15.535099] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-23T19:02:15.541738] [INFO ] [REMOTE ] GFF: Full fetch complete (44243 records). [2025-09-23T19:02:15.541831] [DEBUG] [VALIDATOR ] GFF: Validating primary data. [2025-09-23T19:02:15.733283] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-23T19:02:15.972320] [DEBUG] [VALIDATOR ] GFF: All expected trading days are present. [2025-09-23T19:02:15.972418] [DEBUG] [VALIDATOR ] GFF: Primary data validation passed. [2025-09-23T19:02:15.973074] [INFO ] [MAIN ] GFF: Fetched primary data is valid. [2025-09-23T19:02:15.973136] [DEBUG] [LOCAL ] GFF: Saving primary data. [2025-09-23T19:02:15.974103] [DEBUG] [LOCAL ] GFF: Trimmed 44243 records to 30900 (keeping 200 days of data) [2025-09-23T19:02:16.170428] [DEBUG] [LOCAL ] GFF: Primary data saved (30900 records). [2025-09-23T19:02:16.170579] [INFO ] [MAIN ] GFF: Full history saved. [2025-09-23T19:02:16.170697] [INFO ] [MAIN ] Update Progress: 922/2372 symbols completed. GFF took 25.4s. Estimated remaining: 3h 12m 12s. Rate: 7.5 symbols/min [2025-09-23T19:02:16.202822] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-06. [2025-09-23T19:02:16.351628] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:02:16.391192] [DEBUG] [LOCAL ] GGG: Loaded 41029 existing records from primary storage. [2025-09-23T19:02:16.391330] [INFO ] [MAIN ] GGG: Loaded 41029 existing records. [2025-09-23T19:02:16.580355] [WARN ] [MAIN ] GGG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:02:16.580619] [INFO ] [MAIN ] GGG: Wiping existing primary data before full refresh. [2025-09-23T19:02:16.580700] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-09-23T19:02:16.581573] [DEBUG] [LOCAL ] GGG: Deleted primary data file. [2025-09-23T19:02:16.581635] [INFO ] [MAIN ] GGG: Starting full primary refresh. [2025-09-23T19:02:16.983600] [INFO ] [REMOTE ] GGG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:02:17.003150] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-23T19:02:17.003227] [INFO ] [REMOTE ] GGG: Fetching primary data for 2024-12. [2025-09-23T19:02:17.802212] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-03. [2025-09-23T19:02:18.138475] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-23T19:02:18.245382] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-23T19:02:18.602263] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-01. [2025-09-23T19:02:19.402361] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-09. [2025-09-23T19:02:19.447838] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-23T19:02:19.863907] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-23T19:02:20.202191] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-04. [2025-09-23T19:02:21.002289] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-02. [2025-09-23T19:02:21.266708] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-23T19:02:21.282154] [INFO ] [REMOTE ] GFL: Full fetch complete (68702 records). [2025-09-23T19:02:21.282417] [DEBUG] [VALIDATOR ] GFL: Validating primary data. [2025-09-23T19:02:21.803534] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-07. [2025-09-23T19:02:21.879254] [DEBUG] [VALIDATOR ] GFL: All expected trading days are present. [2025-09-23T19:02:21.879669] [DEBUG] [VALIDATOR ] GFL: Primary data validation passed. [2025-09-23T19:02:21.880824] [INFO ] [MAIN ] GFL: Fetched primary data is valid. [2025-09-23T19:02:21.880983] [DEBUG] [LOCAL ] GFL: Saving primary data. [2025-09-23T19:02:21.916245] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-23T19:02:21.914411] [DEBUG] [LOCAL ] GFL: Trimmed 68702 records to 48045 (keeping 200 days of data) [2025-09-23T19:02:22.207706] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-23T19:02:22.321727] [DEBUG] [LOCAL ] GFL: Primary data saved (48045 records). [2025-09-23T19:02:22.321898] [INFO ] [MAIN ] GFL: Full history saved. [2025-09-23T19:02:22.322022] [INFO ] [MAIN ] Update Progress: 923/2372 symbols completed. GFL took 31.6s. Estimated remaining: 3h 12m 2s. Rate: 7.5 symbols/min [2025-09-23T19:02:22.505853] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:02:22.521976] [DEBUG] [LOCAL ] GGT: Loaded 14114 existing records from primary storage. [2025-09-23T19:02:22.522158] [INFO ] [MAIN ] GGT: Loaded 14114 existing records. [2025-09-23T19:02:22.607372] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-03. [2025-09-23T19:02:22.720904] [WARN ] [MAIN ] GGT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:02:22.721151] [INFO ] [MAIN ] GGT: Wiping existing primary data before full refresh. [2025-09-23T19:02:22.721199] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-09-23T19:02:22.721701] [DEBUG] [LOCAL ] GGT: Deleted primary data file. [2025-09-23T19:02:22.721763] [INFO ] [MAIN ] GGT: Starting full primary refresh. [2025-09-23T19:02:23.076722] [INFO ] [REMOTE ] GGT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:02:23.402217] [INFO ] [REMOTE ] GGT: Fetching primary data for 2024-12. [2025-09-23T19:02:23.754230] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-23T19:02:24.061407] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-23T19:02:24.152954] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-23T19:02:24.202253] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-01. [2025-09-23T19:02:25.002225] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-08. [2025-09-23T19:02:25.108359] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-23T19:02:25.802203] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-02. [2025-09-23T19:02:26.571834] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-23T19:02:26.602201] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-05. [2025-09-23T19:02:26.852849] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-23T19:02:27.402238] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-03. [2025-09-23T19:02:27.936176] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-23T19:02:27.957146] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-23T19:02:28.202233] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-04. [2025-09-23T19:02:29.002209] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-09. [2025-09-23T19:02:29.721447] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-23T19:02:29.802256] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-04. [2025-09-23T19:02:30.602221] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-06. [2025-09-23T19:02:30.620937] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-23T19:02:30.976500] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-23T19:02:30.985864] [INFO ] [REMOTE ] GFI: Full fetch complete (76286 records). [2025-09-23T19:02:30.986033] [DEBUG] [VALIDATOR ] GFI: Validating primary data. [2025-09-23T19:02:31.398243] [DEBUG] [VALIDATOR ] GFI: All expected trading days are present. [2025-09-23T19:02:31.398363] [DEBUG] [VALIDATOR ] GFI: Primary data validation passed. [2025-09-23T19:02:31.399406] [INFO ] [MAIN ] GFI: Fetched primary data is valid. [2025-09-23T19:02:31.399476] [DEBUG] [LOCAL ] GFI: Saving primary data. [2025-09-23T19:02:31.402215] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-05. [2025-09-23T19:02:31.402848] [DEBUG] [LOCAL ] GFI: Trimmed 76286 records to 53106 (keeping 200 days of data) [2025-09-23T19:02:31.744089] [DEBUG] [LOCAL ] GFI: Primary data saved (53106 records). [2025-09-23T19:02:31.744241] [INFO ] [MAIN ] GFI: Full history saved. [2025-09-23T19:02:31.744330] [INFO ] [MAIN ] Update Progress: 924/2372 symbols completed. GFI took 41.0s. Estimated remaining: 3h 11m 56s. Rate: 7.5 symbols/min [2025-09-23T19:02:31.920250] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:02:31.954841] [DEBUG] [LOCAL ] GGZ: Loaded 2460 existing records from primary storage. [2025-09-23T19:02:31.955086] [INFO ] [MAIN ] GGZ: Loaded 2460 existing records. [2025-09-23T19:02:32.004685] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-23T19:02:32.163205] [WARN ] [MAIN ] GGZ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:02:32.163511] [INFO ] [MAIN ] GGZ: Wiping existing primary data before full refresh. [2025-09-23T19:02:32.163566] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-09-23T19:02:32.163879] [DEBUG] [LOCAL ] GGZ: Deleted primary data file. [2025-09-23T19:02:32.163940] [INFO ] [MAIN ] GGZ: Starting full primary refresh. [2025-09-23T19:02:32.207301] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-05. [2025-09-23T19:02:32.525682] [INFO ] [REMOTE ] GGZ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:02:32.952485] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-23T19:02:32.980284] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-23T19:02:33.002220] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-06. [2025-09-23T19:02:33.607475] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-23T19:02:33.802216] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-06. [2025-09-23T19:02:34.602284] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-07. [2025-09-23T19:02:35.260743] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-23T19:02:35.402199] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-07. [2025-09-23T19:02:36.202168] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2024-12. [2025-09-23T19:02:36.363521] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-23T19:02:36.592299] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-09-23T19:02:36.627886] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-23T19:02:37.002208] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-08. [2025-09-23T19:02:37.802224] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-08. [2025-09-23T19:02:38.129579] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-23T19:02:38.602241] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-09. [2025-09-23T19:02:39.304914] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-23T19:02:39.402241] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-01. [2025-09-23T19:02:39.804267] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-23T19:02:39.814172] [INFO ] [REMOTE ] GGG: Full fetch complete (59255 records). [2025-09-23T19:02:39.814408] [DEBUG] [VALIDATOR ] GGG: Validating primary data. [2025-09-23T19:02:40.043934] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-23T19:02:40.215314] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-02. [2025-09-23T19:02:40.280566] [DEBUG] [VALIDATOR ] GGG: All expected trading days are present. [2025-09-23T19:02:40.280689] [DEBUG] [VALIDATOR ] GGG: Primary data validation passed. [2025-09-23T19:02:40.281590] [INFO ] [MAIN ] GGG: Fetched primary data is valid. [2025-09-23T19:02:40.281688] [DEBUG] [LOCAL ] GGG: Saving primary data. [2025-09-23T19:02:40.283194] [DEBUG] [LOCAL ] GGG: Trimmed 59255 records to 40996 (keeping 200 days of data) [2025-09-23T19:02:40.548945] [DEBUG] [LOCAL ] GGG: Primary data saved (40996 records). [2025-09-23T19:02:40.549079] [INFO ] [MAIN ] GGG: Full history saved. [2025-09-23T19:02:40.549161] [INFO ] [MAIN ] Update Progress: 925/2372 symbols completed. GGG took 24.4s. Estimated remaining: 3h 11m 49s. Rate: 7.5 symbols/min [2025-09-23T19:02:40.740140] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-23T19:02:40.744375] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:02:40.751339] [DEBUG] [LOCAL ] GHC: Loaded 2629 existing records from primary storage. [2025-09-23T19:02:40.751428] [INFO ] [MAIN ] GHC: Loaded 2629 existing records. [2025-09-23T19:02:40.948915] [WARN ] [MAIN ] GHC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:02:40.949192] [INFO ] [MAIN ] GHC: Wiping existing primary data before full refresh. [2025-09-23T19:02:40.949241] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-09-23T19:02:40.949498] [DEBUG] [LOCAL ] GHC: Deleted primary data file. [2025-09-23T19:02:40.949559] [INFO ] [MAIN ] GHC: Starting full primary refresh. [2025-09-23T19:02:41.007493] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-07. [2025-09-23T19:02:41.339696] [INFO ] [REMOTE ] GHC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:02:41.616460] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-23T19:02:41.802228] [INFO ] [REMOTE ] GHC: Fetching primary data for 2024-12. [2025-09-23T19:02:42.226478] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-23T19:02:42.602245] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-08. [2025-09-23T19:02:43.402198] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-03. [2025-09-23T19:02:43.456148] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-23T19:02:43.720288] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-23T19:02:44.202217] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-09. [2025-09-23T19:02:45.002246] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-04. [2025-09-23T19:02:45.344032] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-23T19:02:45.702953] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-23T19:02:45.711601] [INFO ] [REMOTE ] GGB: Full fetch complete (73992 records). [2025-09-23T19:02:45.711776] [DEBUG] [VALIDATOR ] GGB: Validating primary data. [2025-09-23T19:02:45.810796] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-01. [2025-09-23T19:02:46.117942] [DEBUG] [VALIDATOR ] GGB: All expected trading days are present. [2025-09-23T19:02:46.118045] [DEBUG] [VALIDATOR ] GGB: Primary data validation passed. [2025-09-23T19:02:46.119069] [INFO ] [MAIN ] GGB: Fetched primary data is valid. [2025-09-23T19:02:46.119140] [DEBUG] [LOCAL ] GGB: Saving primary data. [2025-09-23T19:02:46.120830] [DEBUG] [LOCAL ] GGB: Trimmed 73992 records to 51019 (keeping 200 days of data) [2025-09-23T19:02:46.402977] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-23T19:02:46.441354] [DEBUG] [LOCAL ] GGB: Primary data saved (51019 records). [2025-09-23T19:02:46.441513] [INFO ] [MAIN ] GGB: Full history saved. [2025-09-23T19:02:46.441827] [INFO ] [MAIN ] Update Progress: 926/2372 symbols completed. GGB took 42.4s. Estimated remaining: 3h 11m 38s. Rate: 7.5 symbols/min [2025-09-23T19:02:46.610405] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-05. [2025-09-23T19:02:46.635855] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:02:46.641761] [DEBUG] [LOCAL ] GHG: Loaded 3157 existing records from primary storage. [2025-09-23T19:02:46.641864] [INFO ] [MAIN ] GHG: Loaded 3157 existing records. [2025-09-23T19:02:46.832291] [WARN ] [MAIN ] GHG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:02:46.832795] [INFO ] [MAIN ] GHG: Wiping existing primary data before full refresh. [2025-09-23T19:02:46.832856] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-09-23T19:02:46.833095] [DEBUG] [LOCAL ] GHG: Deleted primary data file. [2025-09-23T19:02:46.833156] [INFO ] [MAIN ] GHG: Starting full primary refresh. [2025-09-23T19:02:47.155911] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-23T19:02:47.248847] [INFO ] [REMOTE ] GHG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:02:47.402202] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-09. [2025-09-23T19:02:48.163563] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-23T19:02:48.166833] [INFO ] [REMOTE ] GGT: Full fetch complete (18714 records). [2025-09-23T19:02:48.166910] [DEBUG] [VALIDATOR ] GGT: Validating primary data. [2025-09-23T19:02:48.207266] [INFO ] [REMOTE ] GHG: Fetching primary data for 2024-12. [2025-09-23T19:02:48.584039] [DEBUG] [VALIDATOR ] GGT: All expected trading days are present. [2025-09-23T19:02:48.584309] [DEBUG] [VALIDATOR ] GGT: Primary data validation passed. [2025-09-23T19:02:48.585107] [INFO ] [MAIN ] GGT: Fetched primary data is valid. [2025-09-23T19:02:48.585174] [DEBUG] [LOCAL ] GGT: Saving primary data. [2025-09-23T19:02:48.585847] [DEBUG] [LOCAL ] GGT: Trimmed 18714 records to 14153 (keeping 200 days of data) [2025-09-23T19:02:48.675450] [DEBUG] [LOCAL ] GGT: Primary data saved (14153 records). [2025-09-23T19:02:48.675632] [INFO ] [MAIN ] GGT: Full history saved. [2025-09-23T19:02:48.675786] [INFO ] [MAIN ] Update Progress: 927/2372 symbols completed. GGT took 26.4s. Estimated remaining: 3h 11m 21s. Rate: 7.6 symbols/min [2025-09-23T19:02:48.782133] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-23T19:02:48.853489] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:02:48.862143] [DEBUG] [LOCAL ] GHI: Loaded 6952 existing records from primary storage. [2025-09-23T19:02:48.862357] [INFO ] [MAIN ] GHI: Loaded 6952 existing records. [2025-09-23T19:02:49.009616] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-01. [2025-09-23T19:02:49.040803] [WARN ] [MAIN ] GHI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:02:49.041043] [INFO ] [MAIN ] GHI: Wiping existing primary data before full refresh. [2025-09-23T19:02:49.041093] [INFO ] [LOCAL ] GHI: Starting deletion of primary data. [2025-09-23T19:02:49.041484] [DEBUG] [LOCAL ] GHI: Deleted primary data file. [2025-09-23T19:02:49.041544] [INFO ] [MAIN ] GHI: Starting full primary refresh. [2025-09-23T19:02:49.426896] [INFO ] [REMOTE ] GHI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:02:49.431494] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-23T19:02:49.802194] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-02. [2025-09-23T19:02:50.126339] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-23T19:02:50.602191] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-03. [2025-09-23T19:02:51.059077] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-23T19:02:51.402202] [INFO ] [REMOTE ] GHI: Fetching primary data for 2024-12. [2025-09-23T19:02:52.202190] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-02. [2025-09-23T19:02:52.341709] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-23T19:02:52.590004] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-23T19:02:53.002247] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-04. [2025-09-23T19:02:53.575037] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-23T19:02:53.802200] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-05. [2025-09-23T19:02:54.371343] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-23T19:02:54.602205] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-01. [2025-09-23T19:02:55.247685] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-23T19:02:55.402193] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-02. [2025-09-23T19:02:55.818166] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-23T19:02:56.202243] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-06. [2025-09-23T19:02:56.514931] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-23T19:02:57.002196] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-06. [2025-09-23T19:02:57.380303] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-23T19:02:57.802215] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-07. [2025-09-23T19:02:58.116677] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-23T19:02:58.602207] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-08. [2025-09-23T19:02:59.078143] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-23T19:02:59.402196] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-07. [2025-09-23T19:02:59.514777] [DEBUG] [REMOTE ] GHG: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-09-23T19:02:59.515068] [WARN ] [REMOTE ] GHG: No data returned for month 2025-07 [2025-09-23T19:03:00.202195] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-08. [2025-09-23T19:03:00.704464] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-23T19:03:01.002196] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-09. [2025-09-23T19:03:01.802180] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-09. [2025-09-23T19:03:01.878895] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-23T19:03:01.880197] [INFO ] [REMOTE ] GHG: Full fetch complete (3452 records). [2025-09-23T19:03:01.880268] [DEBUG] [VALIDATOR ] GHG: Validating primary data. [2025-09-23T19:03:02.071860] [WARN ] [VALIDATOR ] GHG: Validation failed - insufficient historical data. Have 178 unique days, need 200 days [2025-09-23T19:03:02.072110] [FATAL] [MAIN ] GHG: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:03:02.072194] [WARN ] [MAIN ] GHG: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:03:02.072280] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-09-23T19:03:02.072362] [DEBUG] [LOCAL ] GHG: No primary data file found to delete. [2025-09-23T19:03:02.072414] [INFO ] [LOCAL ] GHG: Starting deletion of derivative data. [2025-09-23T19:03:02.072922] [DEBUG] [LOCAL ] GHG: Deleted derivative data file. [2025-09-23T19:03:02.073024] [INFO ] [MAIN ] Update Progress: 928/2372 symbols completed. GHG took 15.6s. Estimated remaining: 3h 11m 22s. Rate: 7.5 symbols/min [2025-09-23T19:03:02.244713] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:03:02.252156] [DEBUG] [LOCAL ] GHLD: Loaded 4078 existing records from primary storage. [2025-09-23T19:03:02.252269] [INFO ] [MAIN ] GHLD: Loaded 4078 existing records. [2025-09-23T19:03:02.428806] [WARN ] [MAIN ] GHLD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:03:02.429047] [INFO ] [MAIN ] GHLD: Wiping existing primary data before full refresh. [2025-09-23T19:03:02.429095] [INFO ] [LOCAL ] GHLD: Starting deletion of primary data. [2025-09-23T19:03:02.429387] [DEBUG] [LOCAL ] GHLD: Deleted primary data file. [2025-09-23T19:03:02.429448] [INFO ] [MAIN ] GHLD: Starting full primary refresh. [2025-09-23T19:03:02.608070] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-03. [2025-09-23T19:03:02.798065] [INFO ] [REMOTE ] GHLD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:03:03.402216] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-03. [2025-09-23T19:03:03.953046] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-23T19:03:03.954111] [INFO ] [REMOTE ] GGZ: Full fetch complete (4157 records). [2025-09-23T19:03:03.954180] [DEBUG] [VALIDATOR ] GGZ: Validating primary data. [2025-09-23T19:03:04.212465] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2024-12. [2025-09-23T19:03:04.321120] [DEBUG] [VALIDATOR ] GGZ: All expected trading days are present. [2025-09-23T19:03:04.321207] [DEBUG] [VALIDATOR ] GGZ: Primary data validation passed. [2025-09-23T19:03:04.321349] [INFO ] [MAIN ] GGZ: Fetched primary data is valid. [2025-09-23T19:03:04.321388] [DEBUG] [LOCAL ] GGZ: Saving primary data. [2025-09-23T19:03:04.321796] [DEBUG] [LOCAL ] GGZ: Trimmed 4157 records to 2462 (keeping 200 days of data) [2025-09-23T19:03:04.337745] [DEBUG] [LOCAL ] GGZ: Primary data saved (2462 records). [2025-09-23T19:03:04.337813] [INFO ] [MAIN ] GGZ: Full history saved. [2025-09-23T19:03:04.337909] [INFO ] [MAIN ] Update Progress: 929/2372 symbols completed. GGZ took 32.6s. Estimated remaining: 3h 11m 5s. Rate: 7.6 symbols/min [2025-09-23T19:03:04.444562] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-23T19:03:04.514405] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:03:04.529896] [DEBUG] [LOCAL ] GHM: Loaded 14159 existing records from primary storage. [2025-09-23T19:03:04.530020] [INFO ] [MAIN ] GHM: Loaded 14159 existing records. [2025-09-23T19:03:04.666743] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-23T19:03:04.722766] [WARN ] [MAIN ] GHM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:03:04.723002] [INFO ] [MAIN ] GHM: Wiping existing primary data before full refresh. [2025-09-23T19:03:04.723050] [INFO ] [LOCAL ] GHM: Starting deletion of primary data. [2025-09-23T19:03:04.723517] [DEBUG] [LOCAL ] GHM: Deleted primary data file. [2025-09-23T19:03:04.723611] [INFO ] [MAIN ] GHM: Starting full primary refresh. [2025-09-23T19:03:04.831154] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-23T19:03:05.007371] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-04. [2025-09-23T19:03:05.101675] [INFO ] [REMOTE ] GHM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:03:05.511784] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-23T19:03:05.802263] [INFO ] [REMOTE ] GHM: Fetching primary data for 2024-12. [2025-09-23T19:03:06.468808] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-23T19:03:06.602209] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-04. [2025-09-23T19:03:07.301706] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-23T19:03:07.402195] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-05. [2025-09-23T19:03:08.029078] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-23T19:03:08.202218] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-01. [2025-09-23T19:03:09.002237] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-05. [2025-09-23T19:03:09.124922] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-23T19:03:09.357737] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-23T19:03:09.802283] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-01. [2025-09-23T19:03:10.289131] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-23T19:03:10.602215] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-06. [2025-09-23T19:03:11.303987] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-23T19:03:11.402212] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-02. [2025-09-23T19:03:12.202224] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-07. [2025-09-23T19:03:12.751063] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-23T19:03:12.948287] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-23T19:03:13.002267] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-02. [2025-09-23T19:03:13.802266] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-06. [2025-09-23T19:03:14.602248] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-03. [2025-09-23T19:03:14.640625] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-23T19:03:15.027668] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-23T19:03:15.402263] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-07. [2025-09-23T19:03:15.426740] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-23T19:03:15.931223] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-23T19:03:16.202253] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-08. [2025-09-23T19:03:16.578453] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-23T19:03:17.002202] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-09. [2025-09-23T19:03:17.657835] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-23T19:03:17.659131] [INFO ] [REMOTE ] GHC: Full fetch complete (3246 records). [2025-09-23T19:03:17.659208] [DEBUG] [VALIDATOR ] GHC: Validating primary data. [2025-09-23T19:03:17.807584] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-03. [2025-09-23T19:03:18.081244] [DEBUG] [VALIDATOR ] GHC: All expected trading days are present. [2025-09-23T19:03:18.081364] [DEBUG] [VALIDATOR ] GHC: Primary data validation passed. [2025-09-23T19:03:18.081571] [INFO ] [MAIN ] GHC: Fetched primary data is valid. [2025-09-23T19:03:18.081613] [DEBUG] [LOCAL ] GHC: Saving primary data. [2025-09-23T19:03:18.082107] [DEBUG] [LOCAL ] GHC: Trimmed 3246 records to 2627 (keeping 200 days of data) [2025-09-23T19:03:18.101964] [DEBUG] [LOCAL ] GHC: Primary data saved (2627 records). [2025-09-23T19:03:18.102149] [INFO ] [MAIN ] GHC: Full history saved. [2025-09-23T19:03:18.102337] [INFO ] [MAIN ] Update Progress: 930/2372 symbols completed. GHC took 37.6s. Estimated remaining: 3h 11m 6s. Rate: 7.5 symbols/min [2025-09-23T19:03:18.293008] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:03:18.320036] [DEBUG] [LOCAL ] GHY: Loaded 20934 existing records from primary storage. [2025-09-23T19:03:18.320233] [INFO ] [MAIN ] GHY: Loaded 20934 existing records. [2025-09-23T19:03:18.526404] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-23T19:03:18.531879] [WARN ] [MAIN ] GHY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:03:18.535801] [INFO ] [MAIN ] GHY: Wiping existing primary data before full refresh. [2025-09-23T19:03:18.535926] [INFO ] [LOCAL ] GHY: Starting deletion of primary data. [2025-09-23T19:03:18.537043] [DEBUG] [LOCAL ] GHY: Deleted primary data file. [2025-09-23T19:03:18.537121] [INFO ] [MAIN ] GHY: Starting full primary refresh. [2025-09-23T19:03:18.607424] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-08. [2025-09-23T19:03:18.913747] [INFO ] [REMOTE ] GHY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:03:19.158898] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-23T19:03:19.402242] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-04. [2025-09-23T19:03:19.762912] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-23T19:03:20.202203] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-05. [2025-09-23T19:03:20.626374] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-23T19:03:21.002211] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-06. [2025-09-23T19:03:21.400125] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-23T19:03:21.802215] [INFO ] [REMOTE ] GHY: Fetching primary data for 2024-12. [2025-09-23T19:03:22.456187] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-23T19:03:22.602212] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-07. [2025-09-23T19:03:23.256675] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-23T19:03:23.402217] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-04. [2025-09-23T19:03:24.157177] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-23T19:03:24.202240] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-01. [2025-09-23T19:03:25.002206] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-05. [2025-09-23T19:03:25.469761] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-23T19:03:25.600058] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-23T19:03:25.802209] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-06. [2025-09-23T19:03:26.453517] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-23T19:03:26.602201] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-08. [2025-09-23T19:03:27.353400] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-23T19:03:27.402212] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-09. [2025-09-23T19:03:27.993119] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-23T19:03:27.994635] [INFO ] [REMOTE ] GHLD: Full fetch complete (4734 records). [2025-09-23T19:03:27.994734] [DEBUG] [VALIDATOR ] GHLD: Validating primary data. [2025-09-23T19:03:28.207317] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-09. [2025-09-23T19:03:28.371503] [DEBUG] [VALIDATOR ] GHLD: All expected trading days are present. [2025-09-23T19:03:28.371674] [DEBUG] [VALIDATOR ] GHLD: Primary data validation passed. [2025-09-23T19:03:28.371867] [INFO ] [MAIN ] GHLD: Fetched primary data is valid. [2025-09-23T19:03:28.371966] [DEBUG] [LOCAL ] GHLD: Saving primary data. [2025-09-23T19:03:28.372441] [DEBUG] [LOCAL ] GHLD: Trimmed 4734 records to 4110 (keeping 200 days of data) [2025-09-23T19:03:28.402224] [DEBUG] [LOCAL ] GHLD: Primary data saved (4110 records). [2025-09-23T19:03:28.402361] [INFO ] [MAIN ] GHLD: Full history saved. [2025-09-23T19:03:28.402562] [INFO ] [MAIN ] Update Progress: 931/2372 symbols completed. GHLD took 26.3s. Estimated remaining: 3h 11m 2s. Rate: 7.5 symbols/min [2025-09-23T19:03:28.571194] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:03:28.615795] [DEBUG] [LOCAL ] GIB: Loaded 32195 existing records from primary storage. [2025-09-23T19:03:28.615956] [INFO ] [MAIN ] GIB: Loaded 32195 existing records. [2025-09-23T19:03:28.791803] [WARN ] [MAIN ] GIB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:03:28.792058] [INFO ] [MAIN ] GIB: Wiping existing primary data before full refresh. [2025-09-23T19:03:28.792110] [INFO ] [LOCAL ] GIB: Starting deletion of primary data. [2025-09-23T19:03:28.793369] [DEBUG] [LOCAL ] GIB: Deleted primary data file. [2025-09-23T19:03:28.793432] [INFO ] [MAIN ] GIB: Starting full primary refresh. [2025-09-23T19:03:29.007922] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-07. [2025-09-23T19:03:29.070518] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-23T19:03:29.092728] [INFO ] [REMOTE ] GHI: Full fetch complete (11805 records). [2025-09-23T19:03:29.098072] [DEBUG] [VALIDATOR ] GHI: Validating primary data. [2025-09-23T19:03:29.271282] [INFO ] [REMOTE ] GIB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:03:29.607099] [DEBUG] [VALIDATOR ] GHI: All expected trading days are present. [2025-09-23T19:03:29.607186] [DEBUG] [VALIDATOR ] GHI: Primary data validation passed. [2025-09-23T19:03:29.607523] [INFO ] [MAIN ] GHI: Fetched primary data is valid. [2025-09-23T19:03:29.607621] [DEBUG] [LOCAL ] GHI: Saving primary data. [2025-09-23T19:03:29.608206] [DEBUG] [LOCAL ] GHI: Trimmed 11805 records to 6895 (keeping 200 days of data) [2025-09-23T19:03:29.658783] [DEBUG] [LOCAL ] GHI: Primary data saved (6895 records). [2025-09-23T19:03:29.658963] [INFO ] [MAIN ] GHI: Full history saved. [2025-09-23T19:03:29.659168] [INFO ] [MAIN ] Update Progress: 932/2372 symbols completed. GHI took 41.0s. Estimated remaining: 3h 10m 43s. Rate: 7.6 symbols/min [2025-09-23T19:03:29.807260] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-02. [2025-09-23T19:03:29.860975] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:03:29.882915] [DEBUG] [LOCAL ] GIC: Loaded 13763 existing records from primary storage. [2025-09-23T19:03:29.883054] [INFO ] [MAIN ] GIC: Loaded 13763 existing records. [2025-09-23T19:03:30.068446] [WARN ] [MAIN ] GIC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:03:30.068736] [INFO ] [MAIN ] GIC: Wiping existing primary data before full refresh. [2025-09-23T19:03:30.068793] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-09-23T19:03:30.069323] [DEBUG] [LOCAL ] GIC: Deleted primary data file. [2025-09-23T19:03:30.069400] [INFO ] [MAIN ] GIC: Starting full primary refresh. [2025-09-23T19:03:30.236048] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-23T19:03:30.462526] [INFO ] [REMOTE ] GIC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:03:30.524628] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-23T19:03:30.602161] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-03. [2025-09-23T19:03:31.388059] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-23T19:03:31.402150] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-04. [2025-09-23T19:03:32.202161] [INFO ] [REMOTE ] GIC: Fetching primary data for 2024-12. [2025-09-23T19:03:32.596234] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-23T19:03:32.791956] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-23T19:03:33.002234] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-01. [2025-09-23T19:03:33.802215] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-05. [2025-09-23T19:03:33.930269] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-23T19:03:34.602267] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-08. [2025-09-23T19:03:35.040669] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-23T19:03:35.402202] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-02. [2025-09-23T19:03:35.474700] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-23T19:03:36.202258] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-09. [2025-09-23T19:03:36.376952] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-23T19:03:36.885053] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-23T19:03:36.889136] [INFO ] [REMOTE ] GHM: Full fetch complete (21551 records). [2025-09-23T19:03:36.889239] [DEBUG] [VALIDATOR ] GHM: Validating primary data. [2025-09-23T19:03:37.007809] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-06. [2025-09-23T19:03:37.276398] [DEBUG] [VALIDATOR ] GHM: All expected trading days are present. [2025-09-23T19:03:37.276477] [DEBUG] [VALIDATOR ] GHM: Primary data validation passed. [2025-09-23T19:03:37.276937] [INFO ] [MAIN ] GHM: Fetched primary data is valid. [2025-09-23T19:03:37.276999] [DEBUG] [LOCAL ] GHM: Saving primary data. [2025-09-23T19:03:37.278070] [DEBUG] [LOCAL ] GHM: Trimmed 21551 records to 14136 (keeping 200 days of data) [2025-09-23T19:03:37.373240] [DEBUG] [LOCAL ] GHM: Primary data saved (14136 records). [2025-09-23T19:03:37.373380] [INFO ] [MAIN ] GHM: Full history saved. [2025-09-23T19:03:37.373494] [INFO ] [MAIN ] Update Progress: 933/2372 symbols completed. GHM took 33.0s. Estimated remaining: 3h 10m 35s. Rate: 7.6 symbols/min [2025-09-23T19:03:37.549478] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:03:37.609025] [DEBUG] [LOCAL ] GIL: Loaded 43097 existing records from primary storage. [2025-09-23T19:03:37.609173] [INFO ] [MAIN ] GIL: Loaded 43097 existing records. [2025-09-23T19:03:37.794555] [WARN ] [MAIN ] GIL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:03:37.794871] [INFO ] [MAIN ] GIL: Wiping existing primary data before full refresh. [2025-09-23T19:03:37.794957] [INFO ] [LOCAL ] GIL: Starting deletion of primary data. [2025-09-23T19:03:37.796239] [DEBUG] [LOCAL ] GIL: Deleted primary data file. [2025-09-23T19:03:37.796302] [INFO ] [MAIN ] GIL: Starting full primary refresh. [2025-09-23T19:03:37.807518] [INFO ] [REMOTE ] GIB: Fetching primary data for 2024-12. [2025-09-23T19:03:37.927237] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-23T19:03:38.192311] [INFO ] [REMOTE ] GIL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:03:38.602225] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-03. [2025-09-23T19:03:38.667172] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-23T19:03:39.402187] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-07. [2025-09-23T19:03:39.544517] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-23T19:03:40.202188] [INFO ] [REMOTE ] GIL: Fetching primary data for 2024-12. [2025-09-23T19:03:40.592459] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-23T19:03:41.002209] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-08. [2025-09-23T19:03:41.349419] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-23T19:03:41.679436] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-23T19:03:41.802246] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-04. [2025-09-23T19:03:42.602211] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-01. [2025-09-23T19:03:43.051423] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-23T19:03:43.402226] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-01. [2025-09-23T19:03:43.869235] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-23T19:03:44.202196] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-02. [2025-09-23T19:03:44.316197] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-23T19:03:45.002200] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-05. [2025-09-23T19:03:45.245102] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-23T19:03:45.802212] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-02. [2025-09-23T19:03:45.823777] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-23T19:03:46.602256] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-06. [2025-09-23T19:03:47.141465] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-23T19:03:47.195283] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-23T19:03:47.402280] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-03. [2025-09-23T19:03:48.202237] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-03. [2025-09-23T19:03:48.610408] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-23T19:03:49.002249] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-04. [2025-09-23T19:03:49.648262] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-23T19:03:49.802194] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-07. [2025-09-23T19:03:50.377721] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-23T19:03:50.406459] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-23T19:03:50.602203] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-04. [2025-09-23T19:03:51.402245] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-09. [2025-09-23T19:03:51.769535] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-23T19:03:52.074048] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-23T19:03:52.077616] [INFO ] [REMOTE ] GHY: Full fetch complete (31834 records). [2025-09-23T19:03:52.077744] [DEBUG] [VALIDATOR ] GHY: Validating primary data. [2025-09-23T19:03:52.217763] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-05. [2025-09-23T19:03:52.454855] [DEBUG] [VALIDATOR ] GHY: All expected trading days are present. [2025-09-23T19:03:52.454935] [DEBUG] [VALIDATOR ] GHY: Primary data validation passed. [2025-09-23T19:03:52.455539] [INFO ] [MAIN ] GHY: Fetched primary data is valid. [2025-09-23T19:03:52.455583] [DEBUG] [LOCAL ] GHY: Saving primary data. [2025-09-23T19:03:52.457037] [DEBUG] [LOCAL ] GHY: Trimmed 31834 records to 20835 (keeping 200 days of data) [2025-09-23T19:03:52.591744] [DEBUG] [LOCAL ] GHY: Primary data saved (20835 records). [2025-09-23T19:03:52.591874] [INFO ] [MAIN ] GHY: Full history saved. [2025-09-23T19:03:52.591955] [INFO ] [MAIN ] Update Progress: 934/2372 symbols completed. GHY took 34.5s. Estimated remaining: 3h 10m 38s. Rate: 7.5 symbols/min [2025-09-23T19:03:52.766512] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:03:52.828065] [DEBUG] [LOCAL ] GIS: Loaded 53675 existing records from primary storage. [2025-09-23T19:03:52.828230] [INFO ] [MAIN ] GIS: Loaded 53675 existing records. [2025-09-23T19:03:53.003977] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-05. [2025-09-23T19:03:53.004329] [WARN ] [MAIN ] GIS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:03:53.005757] [INFO ] [MAIN ] GIS: Wiping existing primary data before full refresh. [2025-09-23T19:03:53.005815] [INFO ] [LOCAL ] GIS: Starting deletion of primary data. [2025-09-23T19:03:53.007295] [DEBUG] [LOCAL ] GIS: Deleted primary data file. [2025-09-23T19:03:53.007361] [INFO ] [MAIN ] GIS: Starting full primary refresh. [2025-09-23T19:03:53.359675] [INFO ] [REMOTE ] GIS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:03:53.424902] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-23T19:03:53.802168] [INFO ] [REMOTE ] GIS: Fetching primary data for 2024-12. [2025-09-23T19:03:54.413600] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-23T19:03:54.602165] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-06. [2025-09-23T19:03:55.390777] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-23T19:03:55.402219] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-01. [2025-09-23T19:03:55.589496] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-23T19:03:56.202244] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-07. [2025-09-23T19:03:57.002271] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-06. [2025-09-23T19:03:57.209281] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-23T19:03:57.241464] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-23T19:03:57.802203] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-08. [2025-09-23T19:03:58.079639] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-23T19:03:58.602201] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-02. [2025-09-23T19:03:58.767266] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-23T19:03:59.402194] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-09. [2025-09-23T19:03:59.932191] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-23T19:04:00.202206] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-08. [2025-09-23T19:04:00.833431] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-23T19:04:00.899683] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-23T19:04:00.905009] [INFO ] [REMOTE ] GIB: Full fetch complete (44971 records). [2025-09-23T19:04:00.905108] [DEBUG] [VALIDATOR ] GIB: Validating primary data. [2025-09-23T19:04:01.004783] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-07. [2025-09-23T19:04:01.318073] [DEBUG] [VALIDATOR ] GIB: All expected trading days are present. [2025-09-23T19:04:01.318400] [DEBUG] [VALIDATOR ] GIB: Primary data validation passed. [2025-09-23T19:04:01.319687] [INFO ] [MAIN ] GIB: Fetched primary data is valid. [2025-09-23T19:04:01.319759] [DEBUG] [LOCAL ] GIB: Saving primary data. [2025-09-23T19:04:01.321951] [DEBUG] [LOCAL ] GIB: Trimmed 44971 records to 32109 (keeping 200 days of data) [2025-09-23T19:04:01.540806] [DEBUG] [LOCAL ] GIB: Primary data saved (32109 records). [2025-09-23T19:04:01.540957] [INFO ] [MAIN ] GIB: Full history saved. [2025-09-23T19:04:01.541069] [INFO ] [MAIN ] Update Progress: 935/2372 symbols completed. GIB took 33.1s. Estimated remaining: 3h 10m 32s. Rate: 7.5 symbols/min [2025-09-23T19:04:01.726041] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:04:01.776915] [DEBUG] [LOCAL ] GKOS: Loaded 43097 existing records from primary storage. [2025-09-23T19:04:01.777117] [INFO ] [MAIN ] GKOS: Loaded 43097 existing records. [2025-09-23T19:04:01.808957] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-09. [2025-09-23T19:04:01.978028] [WARN ] [MAIN ] GKOS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:04:01.978392] [INFO ] [MAIN ] GKOS: Wiping existing primary data before full refresh. [2025-09-23T19:04:01.978481] [INFO ] [LOCAL ] GKOS: Starting deletion of primary data. [2025-09-23T19:04:01.980076] [DEBUG] [LOCAL ] GKOS: Deleted primary data file. [2025-09-23T19:04:01.980149] [INFO ] [MAIN ] GKOS: Starting full primary refresh. [2025-09-23T19:04:02.360326] [INFO ] [REMOTE ] GKOS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:04:02.573495] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-23T19:04:02.602144] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-08. [2025-09-23T19:04:02.620885] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-23T19:04:02.623924] [INFO ] [REMOTE ] GIC: Full fetch complete (20387 records). [2025-09-23T19:04:02.624011] [DEBUG] [VALIDATOR ] GIC: Validating primary data. [2025-09-23T19:04:03.078563] [DEBUG] [VALIDATOR ] GIC: All expected trading days are present. [2025-09-23T19:04:03.078676] [DEBUG] [VALIDATOR ] GIC: Primary data validation passed. [2025-09-23T19:04:03.079187] [INFO ] [MAIN ] GIC: Fetched primary data is valid. [2025-09-23T19:04:03.079250] [DEBUG] [LOCAL ] GIC: Saving primary data. [2025-09-23T19:04:03.080015] [DEBUG] [LOCAL ] GIC: Trimmed 20387 records to 13706 (keeping 200 days of data) [2025-09-23T19:04:03.172255] [DEBUG] [LOCAL ] GIC: Primary data saved (13706 records). [2025-09-23T19:04:03.172391] [INFO ] [MAIN ] GIC: Full history saved. [2025-09-23T19:04:03.172475] [INFO ] [MAIN ] Update Progress: 936/2372 symbols completed. GIC took 33.5s. Estimated remaining: 3h 10m 14s. Rate: 7.5 symbols/min [2025-09-23T19:04:03.346839] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:04:03.397701] [DEBUG] [LOCAL ] GL: Loaded 37985 existing records from primary storage. [2025-09-23T19:04:03.397844] [INFO ] [MAIN ] GL: Loaded 37985 existing records. [2025-09-23T19:04:03.409492] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2024-12. [2025-09-23T19:04:03.591028] [WARN ] [MAIN ] GL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:04:03.591258] [INFO ] [MAIN ] GL: Wiping existing primary data before full refresh. [2025-09-23T19:04:03.591306] [INFO ] [LOCAL ] GL: Starting deletion of primary data. [2025-09-23T19:04:03.592559] [DEBUG] [LOCAL ] GL: Deleted primary data file. [2025-09-23T19:04:03.592621] [INFO ] [MAIN ] GL: Starting full primary refresh. [2025-09-23T19:04:03.973892] [INFO ] [REMOTE ] GL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:04:04.001977] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-23T19:04:04.202191] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-09. [2025-09-23T19:04:04.590968] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-23T19:04:05.002207] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-01. [2025-09-23T19:04:05.802294] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-03. [2025-09-23T19:04:05.930304] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-23T19:04:05.942699] [INFO ] [REMOTE ] GIL: Full fetch complete (61250 records). [2025-09-23T19:04:05.942922] [DEBUG] [VALIDATOR ] GIL: Validating primary data. [2025-09-23T19:04:06.515318] [DEBUG] [VALIDATOR ] GIL: All expected trading days are present. [2025-09-23T19:04:06.515811] [DEBUG] [VALIDATOR ] GIL: Primary data validation passed. [2025-09-23T19:04:06.517838] [INFO ] [MAIN ] GIL: Fetched primary data is valid. [2025-09-23T19:04:06.518698] [DEBUG] [LOCAL ] GIL: Saving primary data. [2025-09-23T19:04:06.521431] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-23T19:04:06.532519] [DEBUG] [LOCAL ] GIL: Trimmed 61250 records to 43161 (keeping 200 days of data) [2025-09-23T19:04:06.609565] [INFO ] [REMOTE ] GL: Fetching primary data for 2024-12. [2025-09-23T19:04:06.808405] [DEBUG] [LOCAL ] GIL: Primary data saved (43161 records). [2025-09-23T19:04:06.808543] [INFO ] [MAIN ] GIL: Full history saved. [2025-09-23T19:04:06.808627] [INFO ] [MAIN ] Update Progress: 937/2372 symbols completed. GIL took 29.4s. Estimated remaining: 3h 9m 60s. Rate: 7.6 symbols/min [2025-09-23T19:04:06.984236] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:04:07.029764] [DEBUG] [LOCAL ] GLOB: Loaded 47283 existing records from primary storage. [2025-09-23T19:04:07.029917] [INFO ] [MAIN ] GLOB: Loaded 47283 existing records. [2025-09-23T19:04:07.207380] [WARN ] [MAIN ] GLOB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:04:07.207627] [INFO ] [MAIN ] GLOB: Wiping existing primary data before full refresh. [2025-09-23T19:04:07.207707] [INFO ] [LOCAL ] GLOB: Starting deletion of primary data. [2025-09-23T19:04:07.209016] [DEBUG] [LOCAL ] GLOB: Deleted primary data file. [2025-09-23T19:04:07.209078] [INFO ] [MAIN ] GLOB: Starting full primary refresh. [2025-09-23T19:04:07.408036] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-02. [2025-09-23T19:04:07.586308] [INFO ] [REMOTE ] GLOB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:04:07.625356] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-23T19:04:08.202204] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2024-12. [2025-09-23T19:04:08.318041] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-23T19:04:08.613211] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-23T19:04:09.002265] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-01. [2025-09-23T19:04:09.281326] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-23T19:04:09.802235] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-01. [2025-09-23T19:04:10.135194] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-23T19:04:10.602222] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-03. [2025-09-23T19:04:11.282722] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-23T19:04:11.402253] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-02. [2025-09-23T19:04:11.859812] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-23T19:04:12.202226] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-02. [2025-09-23T19:04:12.542867] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-23T19:04:13.002196] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-04. [2025-09-23T19:04:13.598133] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-23T19:04:13.802241] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-03. [2025-09-23T19:04:14.382252] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-23T19:04:14.602196] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-03. [2025-09-23T19:04:15.230738] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-23T19:04:15.402218] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-05. [2025-09-23T19:04:15.730178] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-23T19:04:16.202204] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-04. [2025-09-23T19:04:16.597004] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-23T19:04:17.002258] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-04. [2025-09-23T19:04:17.431579] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-23T19:04:17.802260] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-04. [2025-09-23T19:04:18.602166] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-05. [2025-09-23T19:04:18.657258] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-23T19:04:19.335067] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-23T19:04:19.402177] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-05. [2025-09-23T19:04:20.017475] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-23T19:04:20.202255] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-05. [2025-09-23T19:04:20.555748] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-23T19:04:21.002195] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-06. [2025-09-23T19:04:21.802200] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-06. [2025-09-23T19:04:22.058094] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-23T19:04:22.120812] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-23T19:04:22.602208] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-06. [2025-09-23T19:04:22.894868] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-23T19:04:23.402247] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-07. [2025-09-23T19:04:24.081221] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-23T19:04:24.202181] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-07. [2025-09-23T19:04:24.545160] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-23T19:04:25.002227] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-07. [2025-09-23T19:04:25.802196] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-08. [2025-09-23T19:04:25.842448] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-23T19:04:26.233025] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-23T19:04:26.602197] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-08. [2025-09-23T19:04:27.013470] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-23T19:04:27.402218] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-08. [2025-09-23T19:04:27.773372] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-23T19:04:28.202205] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-09. [2025-09-23T19:04:29.002188] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-06. [2025-09-23T19:04:29.303539] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-23T19:04:29.406140] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-23T19:04:29.412539] [INFO ] [REMOTE ] GL: Full fetch complete (55698 records). [2025-09-23T19:04:29.412726] [DEBUG] [VALIDATOR ] GL: Validating primary data. [2025-09-23T19:04:29.808116] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-09. [2025-09-23T19:04:29.811546] [DEBUG] [VALIDATOR ] GL: All expected trading days are present. [2025-09-23T19:04:29.812355] [DEBUG] [VALIDATOR ] GL: Primary data validation passed. [2025-09-23T19:04:29.813283] [INFO ] [MAIN ] GL: Fetched primary data is valid. [2025-09-23T19:04:29.813468] [DEBUG] [LOCAL ] GL: Saving primary data. [2025-09-23T19:04:29.815004] [DEBUG] [LOCAL ] GL: Trimmed 55698 records to 37987 (keeping 200 days of data) [2025-09-23T19:04:30.063486] [DEBUG] [LOCAL ] GL: Primary data saved (37987 records). [2025-09-23T19:04:30.063667] [INFO ] [MAIN ] GL: Full history saved. [2025-09-23T19:04:30.063775] [INFO ] [MAIN ] Update Progress: 938/2372 symbols completed. GL took 26.9s. Estimated remaining: 3h 10m 15s. Rate: 7.5 symbols/min [2025-09-23T19:04:30.240329] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:04:30.251402] [DEBUG] [LOCAL ] GLP: Loaded 9519 existing records from primary storage. [2025-09-23T19:04:30.251533] [INFO ] [MAIN ] GLP: Loaded 9519 existing records. [2025-09-23T19:04:30.443982] [WARN ] [MAIN ] GLP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:04:30.444368] [INFO ] [MAIN ] GLP: Wiping existing primary data before full refresh. [2025-09-23T19:04:30.444567] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-09-23T19:04:30.454361] [DEBUG] [LOCAL ] GLP: Deleted primary data file. [2025-09-23T19:04:30.459563] [INFO ] [MAIN ] GLP: Starting full primary refresh. [2025-09-23T19:04:30.556442] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-23T19:04:30.604795] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-09. [2025-09-23T19:04:30.853130] [INFO ] [REMOTE ] GLP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:04:31.400151] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-23T19:04:31.407060] [INFO ] [REMOTE ] GLP: Fetching primary data for 2024-12. [2025-09-23T19:04:31.409034] [INFO ] [REMOTE ] GKOS: Full fetch complete (59933 records). [2025-09-23T19:04:31.409194] [DEBUG] [VALIDATOR ] GKOS: Validating primary data. [2025-09-23T19:04:31.799361] [DEBUG] [VALIDATOR ] GKOS: All expected trading days are present. [2025-09-23T19:04:31.799458] [DEBUG] [VALIDATOR ] GKOS: Primary data validation passed. [2025-09-23T19:04:31.800254] [INFO ] [MAIN ] GKOS: Fetched primary data is valid. [2025-09-23T19:04:31.800321] [DEBUG] [LOCAL ] GKOS: Saving primary data. [2025-09-23T19:04:31.801734] [DEBUG] [LOCAL ] GKOS: Trimmed 59933 records to 43115 (keeping 200 days of data) [2025-09-23T19:04:32.062275] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-23T19:04:32.065178] [DEBUG] [LOCAL ] GKOS: Primary data saved (43115 records). [2025-09-23T19:04:32.065563] [INFO ] [MAIN ] GKOS: Full history saved. [2025-09-23T19:04:32.068473] [INFO ] [MAIN ] Update Progress: 939/2372 symbols completed. GKOS took 30.5s. Estimated remaining: 3h 9m 58s. Rate: 7.5 symbols/min [2025-09-23T19:04:32.205635] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-01. [2025-09-23T19:04:32.255080] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:04:32.309045] [DEBUG] [LOCAL ] GLW: Loaded 53635 existing records from primary storage. [2025-09-23T19:04:32.309282] [INFO ] [MAIN ] GLW: Loaded 53635 existing records. [2025-09-23T19:04:32.524157] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-23T19:04:32.529820] [WARN ] [MAIN ] GLW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:04:32.539727] [INFO ] [MAIN ] GLW: Wiping existing primary data before full refresh. [2025-09-23T19:04:32.540042] [INFO ] [LOCAL ] GLW: Starting deletion of primary data. [2025-09-23T19:04:32.540588] [INFO ] [REMOTE ] GIS: Full fetch complete (77650 records). [2025-09-23T19:04:32.540813] [DEBUG] [VALIDATOR ] GIS: Validating primary data. [2025-09-23T19:04:32.547277] [DEBUG] [LOCAL ] GLW: Deleted primary data file. [2025-09-23T19:04:32.615326] [INFO ] [MAIN ] GLW: Starting full primary refresh. [2025-09-23T19:04:33.007066] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-07. [2025-09-23T19:04:33.102997] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-23T19:04:33.402114] [INFO ] [REMOTE ] GLW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:04:33.402576] [DEBUG] [VALIDATOR ] GIS: All expected trading days are present. [2025-09-23T19:04:33.403024] [DEBUG] [VALIDATOR ] GIS: Primary data validation passed. [2025-09-23T19:04:33.404606] [INFO ] [MAIN ] GIS: Fetched primary data is valid. [2025-09-23T19:04:33.404709] [DEBUG] [LOCAL ] GIS: Saving primary data. [2025-09-23T19:04:33.407061] [DEBUG] [LOCAL ] GIS: Trimmed 77650 records to 53675 (keeping 200 days of data) [2025-09-23T19:04:33.763186] [DEBUG] [LOCAL ] GIS: Primary data saved (53675 records). [2025-09-23T19:04:33.763351] [INFO ] [MAIN ] GIS: Full history saved. [2025-09-23T19:04:33.763443] [INFO ] [MAIN ] Update Progress: 940/2372 symbols completed. GIS took 41.2s. Estimated remaining: 3h 9m 41s. Rate: 7.5 symbols/min [2025-09-23T19:04:33.807357] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-02. [2025-09-23T19:04:33.941195] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:04:33.993294] [DEBUG] [LOCAL ] GM: Loaded 53728 existing records from primary storage. [2025-09-23T19:04:33.993457] [INFO ] [MAIN ] GM: Loaded 53728 existing records. [2025-09-23T19:04:34.173576] [WARN ] [MAIN ] GM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:04:34.173906] [INFO ] [MAIN ] GM: Wiping existing primary data before full refresh. [2025-09-23T19:04:34.173985] [INFO ] [LOCAL ] GM: Starting deletion of primary data. [2025-09-23T19:04:34.175471] [DEBUG] [LOCAL ] GM: Deleted primary data file. [2025-09-23T19:04:34.175541] [INFO ] [MAIN ] GM: Starting full primary refresh. [2025-09-23T19:04:34.537075] [INFO ] [REMOTE ] GM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:04:34.545736] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-23T19:04:34.602166] [INFO ] [REMOTE ] GM: Fetching primary data for 2024-12. [2025-09-23T19:04:34.702098] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-23T19:04:35.402217] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-08. [2025-09-23T19:04:36.202184] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-03. [2025-09-23T19:04:36.470417] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-23T19:04:36.732607] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-23T19:04:36.884767] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-23T19:04:37.002233] [INFO ] [REMOTE ] GLW: Fetching primary data for 2024-12. [2025-09-23T19:04:37.802203] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-01. [2025-09-23T19:04:38.602165] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-09. [2025-09-23T19:04:38.830108] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-23T19:04:39.402242] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-04. [2025-09-23T19:04:39.545058] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-23T19:04:39.887918] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-23T19:04:39.988977] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-23T19:04:39.997870] [INFO ] [REMOTE ] GLOB: Full fetch complete (63254 records). [2025-09-23T19:04:39.998020] [DEBUG] [VALIDATOR ] GLOB: Validating primary data. [2025-09-23T19:04:40.208577] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-02. [2025-09-23T19:04:40.440340] [DEBUG] [VALIDATOR ] GLOB: All expected trading days are present. [2025-09-23T19:04:40.440467] [DEBUG] [VALIDATOR ] GLOB: Primary data validation passed. [2025-09-23T19:04:40.441343] [INFO ] [MAIN ] GLOB: Fetched primary data is valid. [2025-09-23T19:04:40.441414] [DEBUG] [LOCAL ] GLOB: Saving primary data. [2025-09-23T19:04:40.442923] [DEBUG] [LOCAL ] GLOB: Trimmed 63254 records to 47351 (keeping 200 days of data) [2025-09-23T19:04:40.733079] [DEBUG] [LOCAL ] GLOB: Primary data saved (47351 records). [2025-09-23T19:04:40.733231] [INFO ] [MAIN ] GLOB: Full history saved. [2025-09-23T19:04:40.733320] [INFO ] [MAIN ] Update Progress: 941/2372 symbols completed. GLOB took 33.9s. Estimated remaining: 3h 9m 31s. Rate: 7.6 symbols/min [2025-09-23T19:04:40.907048] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:04:40.961780] [DEBUG] [LOCAL ] GME: Loaded 53761 existing records from primary storage. [2025-09-23T19:04:40.961939] [INFO ] [MAIN ] GME: Loaded 53761 existing records. [2025-09-23T19:04:41.007441] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-01. [2025-09-23T19:04:41.158328] [WARN ] [MAIN ] GME: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:04:41.158566] [INFO ] [MAIN ] GME: Wiping existing primary data before full refresh. [2025-09-23T19:04:41.158614] [INFO ] [LOCAL ] GME: Starting deletion of primary data. [2025-09-23T19:04:41.159911] [DEBUG] [LOCAL ] GME: Deleted primary data file. [2025-09-23T19:04:41.159972] [INFO ] [MAIN ] GME: Starting full primary refresh. [2025-09-23T19:04:41.511929] [INFO ] [REMOTE ] GME: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:04:41.802202] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-05. [2025-09-23T19:04:41.999503] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-23T19:04:42.307244] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-23T19:04:42.602197] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-03. [2025-09-23T19:04:43.144716] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-09-23T19:04:43.402197] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-02. [2025-09-23T19:04:44.202242] [INFO ] [REMOTE ] GME: Fetching primary data for 2024-12. [2025-09-23T19:04:44.351941] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-23T19:04:44.812100] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-23T19:04:45.002256] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-03. [2025-09-23T19:04:45.802217] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-04. [2025-09-23T19:04:46.501707] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-23T19:04:46.591523] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-09-23T19:04:46.602184] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-04. [2025-09-23T19:04:47.402196] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-06. [2025-09-23T19:04:47.681915] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-23T19:04:47.878671] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-23T19:04:48.202230] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-05. [2025-09-23T19:04:48.577871] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-23T19:04:49.002256] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-07. [2025-09-23T19:04:49.721285] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-23T19:04:49.803047] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-08. [2025-09-23T19:04:49.806176] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-23T19:04:50.393242] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-23T19:04:50.602227] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-01. [2025-09-23T19:04:51.402226] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-06. [2025-09-23T19:04:52.202204] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-05. [2025-09-23T19:04:52.973411] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-09-23T19:04:53.002161] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-02. [2025-09-23T19:04:53.383243] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-23T19:04:53.654516] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-23T19:04:53.802148] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-06. [2025-09-23T19:04:54.602188] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-07. [2025-09-23T19:04:55.103402] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-23T19:04:55.402187] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-03. [2025-09-23T19:04:55.648293] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-23T19:04:56.202283] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-09. [2025-09-23T19:04:56.896236] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-23T19:04:56.899084] [INFO ] [REMOTE ] GLP: Full fetch complete (14411 records). [2025-09-23T19:04:56.899180] [DEBUG] [VALIDATOR ] GLP: Validating primary data. [2025-09-23T19:04:57.010662] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-07. [2025-09-23T19:04:57.276412] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-07 (2.67 seconds). [2025-09-23T19:04:57.363712] [DEBUG] [VALIDATOR ] GLP: All expected trading days are present. [2025-09-23T19:04:57.363863] [DEBUG] [VALIDATOR ] GLP: Primary data validation passed. [2025-09-23T19:04:57.364259] [INFO ] [MAIN ] GLP: Fetched primary data is valid. [2025-09-23T19:04:57.364305] [DEBUG] [LOCAL ] GLP: Saving primary data. [2025-09-23T19:04:57.364913] [DEBUG] [LOCAL ] GLP: Trimmed 14411 records to 9512 (keeping 200 days of data) [2025-09-23T19:04:57.423149] [DEBUG] [LOCAL ] GLP: Primary data saved (9512 records). [2025-09-23T19:04:57.423355] [INFO ] [MAIN ] GLP: Full history saved. [2025-09-23T19:04:57.423478] [INFO ] [MAIN ] Update Progress: 942/2372 symbols completed. GLP took 27.4s. Estimated remaining: 3h 9m 37s. Rate: 7.5 symbols/min [2025-09-23T19:04:57.604631] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:04:57.654477] [DEBUG] [LOCAL ] GMED: Loaded 48319 existing records from primary storage. [2025-09-23T19:04:57.654631] [INFO ] [MAIN ] GMED: Loaded 48319 existing records. [2025-09-23T19:04:57.806108] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-08. [2025-09-23T19:04:57.843460] [WARN ] [MAIN ] GMED: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:04:57.844930] [INFO ] [MAIN ] GMED: Wiping existing primary data before full refresh. [2025-09-23T19:04:57.845124] [INFO ] [LOCAL ] GMED: Starting deletion of primary data. [2025-09-23T19:04:57.856836] [DEBUG] [LOCAL ] GMED: Deleted primary data file. [2025-09-23T19:04:57.873919] [INFO ] [MAIN ] GMED: Starting full primary refresh. [2025-09-23T19:04:57.985840] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-03 (2.58 seconds). [2025-09-23T19:04:58.260537] [INFO ] [REMOTE ] GMED: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:04:58.603691] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-04. [2025-09-23T19:04:58.613763] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-23T19:04:59.399110] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-23T19:04:59.409190] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-08. [2025-09-23T19:05:00.202184] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-09. [2025-09-23T19:05:01.002182] [INFO ] [REMOTE ] GMED: Fetching primary data for 2024-12. [2025-09-23T19:05:01.124129] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-23T19:05:01.184067] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-09-23T19:05:01.802240] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-05. [2025-09-23T19:05:02.528613] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-09-23T19:05:02.539714] [INFO ] [REMOTE ] GM: Full fetch complete (77821 records). [2025-09-23T19:05:02.539875] [DEBUG] [VALIDATOR ] GM: Validating primary data. [2025-09-23T19:05:02.608819] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-09. [2025-09-23T19:05:03.046303] [DEBUG] [VALIDATOR ] GM: All expected trading days are present. [2025-09-23T19:05:03.050725] [DEBUG] [VALIDATOR ] GM: Primary data validation passed. [2025-09-23T19:05:03.051839] [INFO ] [MAIN ] GM: Fetched primary data is valid. [2025-09-23T19:05:03.052197] [DEBUG] [LOCAL ] GM: Saving primary data. [2025-09-23T19:05:03.055732] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-23T19:05:03.067156] [DEBUG] [LOCAL ] GM: Trimmed 77821 records to 53728 (keeping 200 days of data) [2025-09-23T19:05:03.402195] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-01. [2025-09-23T19:05:03.420463] [DEBUG] [LOCAL ] GM: Primary data saved (53728 records). [2025-09-23T19:05:03.420559] [INFO ] [MAIN ] GM: Full history saved. [2025-09-23T19:05:03.420638] [INFO ] [MAIN ] Update Progress: 943/2372 symbols completed. GM took 29.7s. Estimated remaining: 3h 9m 26s. Rate: 7.5 symbols/min [2025-09-23T19:05:03.625771] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:05:03.663841] [DEBUG] [LOCAL ] GMRE: Loaded 37625 existing records from primary storage. [2025-09-23T19:05:03.664021] [INFO ] [MAIN ] GMRE: Loaded 37625 existing records. [2025-09-23T19:05:03.854259] [WARN ] [MAIN ] GMRE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:05:03.854565] [INFO ] [MAIN ] GMRE: Wiping existing primary data before full refresh. [2025-09-23T19:05:03.854618] [INFO ] [LOCAL ] GMRE: Starting deletion of primary data. [2025-09-23T19:05:03.855559] [DEBUG] [LOCAL ] GMRE: Deleted primary data file. [2025-09-23T19:05:03.855625] [INFO ] [MAIN ] GMRE: Starting full primary refresh. [2025-09-23T19:05:04.260362] [INFO ] [REMOTE ] GMRE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:05:04.260851] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2024-12. [2025-09-23T19:05:04.294784] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-09-23T19:05:04.731618] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-23T19:05:04.741223] [INFO ] [REMOTE ] GLW: Full fetch complete (77614 records). [2025-09-23T19:05:04.766824] [DEBUG] [VALIDATOR ] GLW: Validating primary data. [2025-09-23T19:05:04.801707] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-23T19:05:05.007359] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-06. [2025-09-23T19:05:05.191520] [DEBUG] [VALIDATOR ] GLW: All expected trading days are present. [2025-09-23T19:05:05.191717] [DEBUG] [VALIDATOR ] GLW: Primary data validation passed. [2025-09-23T19:05:05.192723] [INFO ] [MAIN ] GLW: Fetched primary data is valid. [2025-09-23T19:05:05.192957] [DEBUG] [LOCAL ] GLW: Saving primary data. [2025-09-23T19:05:05.194737] [DEBUG] [LOCAL ] GLW: Trimmed 77614 records to 53635 (keeping 200 days of data) [2025-09-23T19:05:05.327164] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-23T19:05:05.561502] [DEBUG] [LOCAL ] GLW: Primary data saved (53635 records). [2025-09-23T19:05:05.561669] [INFO ] [MAIN ] GLW: Full history saved. [2025-09-23T19:05:05.561773] [INFO ] [MAIN ] Update Progress: 944/2372 symbols completed. GLW took 33.5s. Estimated remaining: 3h 9m 9s. Rate: 7.5 symbols/min [2025-09-23T19:05:05.740469] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:05:05.761210] [DEBUG] [LOCAL ] GNE: Loaded 17531 existing records from primary storage. [2025-09-23T19:05:05.761337] [INFO ] [MAIN ] GNE: Loaded 17531 existing records. [2025-09-23T19:05:05.807468] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-01. [2025-09-23T19:05:05.948424] [WARN ] [MAIN ] GNE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:05:05.948720] [INFO ] [MAIN ] GNE: Wiping existing primary data before full refresh. [2025-09-23T19:05:05.948775] [INFO ] [LOCAL ] GNE: Starting deletion of primary data. [2025-09-23T19:05:05.949368] [DEBUG] [LOCAL ] GNE: Deleted primary data file. [2025-09-23T19:05:05.949429] [INFO ] [MAIN ] GNE: Starting full primary refresh. [2025-09-23T19:05:06.307158] [INFO ] [REMOTE ] GNE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:05:06.602243] [INFO ] [REMOTE ] GNE: Fetching primary data for 2024-12. [2025-09-23T19:05:06.938910] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-23T19:05:07.207068] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-23T19:05:07.402186] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-02. [2025-09-23T19:05:07.441259] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-23T19:05:08.202234] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-01. [2025-09-23T19:05:08.707076] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-23T19:05:08.753462] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-23T19:05:09.002224] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-02. [2025-09-23T19:05:09.755072] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-23T19:05:09.802251] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-03. [2025-09-23T19:05:10.592667] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-23T19:05:10.602193] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-04. [2025-09-23T19:05:11.384049] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-23T19:05:11.402195] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-02. [2025-09-23T19:05:12.202201] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-07. [2025-09-23T19:05:12.660008] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-23T19:05:13.002206] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-05. [2025-09-23T19:05:13.802217] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-03. [2025-09-23T19:05:14.058449] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-23T19:05:14.465384] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-23T19:05:14.602172] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-06. [2025-09-23T19:05:15.068971] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-23T19:05:15.402174] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-04. [2025-09-23T19:05:15.435101] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-23T19:05:16.202241] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-07. [2025-09-23T19:05:16.883342] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-23T19:05:17.002196] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-03. [2025-09-23T19:05:17.042069] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-23T19:05:17.802202] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-08. [2025-09-23T19:05:18.602177] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-05. [2025-09-23T19:05:18.693833] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-23T19:05:19.402236] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-04. [2025-09-23T19:05:19.669240] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-23T19:05:19.985634] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-23T19:05:20.202201] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-06. [2025-09-23T19:05:20.739089] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-23T19:05:21.002267] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-08. [2025-09-23T19:05:21.642153] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-23T19:05:21.691171] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-23T19:05:21.802212] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-09. [2025-09-23T19:05:22.602213] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-07. [2025-09-23T19:05:23.152549] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-23T19:05:23.156401] [INFO ] [REMOTE ] GNE: Full fetch complete (22261 records). [2025-09-23T19:05:23.156497] [DEBUG] [VALIDATOR ] GNE: Validating primary data. [2025-09-23T19:05:23.407433] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-09. [2025-09-23T19:05:23.522261] [DEBUG] [VALIDATOR ] GNE: All expected trading days are present. [2025-09-23T19:05:23.522342] [DEBUG] [VALIDATOR ] GNE: Primary data validation passed. [2025-09-23T19:05:23.522824] [INFO ] [MAIN ] GNE: Fetched primary data is valid. [2025-09-23T19:05:23.522885] [DEBUG] [LOCAL ] GNE: Saving primary data. [2025-09-23T19:05:23.523520] [DEBUG] [LOCAL ] GNE: Trimmed 22261 records to 17661 (keeping 200 days of data) [2025-09-23T19:05:23.634756] [DEBUG] [LOCAL ] GNE: Primary data saved (17661 records). [2025-09-23T19:05:23.634898] [INFO ] [MAIN ] GNE: Full history saved. [2025-09-23T19:05:23.635012] [INFO ] [MAIN ] Update Progress: 945/2372 symbols completed. GNE took 18.1s. Estimated remaining: 3h 9m 16s. Rate: 7.5 symbols/min [2025-09-23T19:05:23.834674] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:05:23.861177] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-23T19:05:23.905931] [DEBUG] [LOCAL ] GNK: Loaded 40728 existing records from primary storage. [2025-09-23T19:05:23.906083] [INFO ] [MAIN ] GNK: Loaded 40728 existing records. [2025-09-23T19:05:24.104306] [WARN ] [MAIN ] GNK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:05:24.104599] [INFO ] [MAIN ] GNK: Wiping existing primary data before full refresh. [2025-09-23T19:05:24.104686] [INFO ] [LOCAL ] GNK: Starting deletion of primary data. [2025-09-23T19:05:24.105740] [DEBUG] [LOCAL ] GNK: Deleted primary data file. [2025-09-23T19:05:24.105802] [INFO ] [MAIN ] GNK: Starting full primary refresh. [2025-09-23T19:05:24.207356] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-05. [2025-09-23T19:05:24.485541] [INFO ] [REMOTE ] GNK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:05:25.002235] [INFO ] [REMOTE ] GNK: Fetching primary data for 2024-12. [2025-09-23T19:05:25.501815] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-23T19:05:25.514447] [INFO ] [REMOTE ] GME: Full fetch complete (77918 records). [2025-09-23T19:05:25.514634] [DEBUG] [VALIDATOR ] GME: Validating primary data. [2025-09-23T19:05:25.803087] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-08. [2025-09-23T19:05:25.968901] [DEBUG] [VALIDATOR ] GME: All expected trading days are present. [2025-09-23T19:05:25.969322] [DEBUG] [VALIDATOR ] GME: Primary data validation passed. [2025-09-23T19:05:25.972056] [INFO ] [MAIN ] GME: Fetched primary data is valid. [2025-09-23T19:05:25.972146] [DEBUG] [LOCAL ] GME: Saving primary data. [2025-09-23T19:05:25.973920] [DEBUG] [LOCAL ] GME: Trimmed 77918 records to 53762 (keeping 200 days of data) [2025-09-23T19:05:26.116401] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-23T19:05:26.273076] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-23T19:05:26.393035] [DEBUG] [LOCAL ] GME: Primary data saved (53762 records). [2025-09-23T19:05:26.393184] [INFO ] [MAIN ] GME: Full history saved. [2025-09-23T19:05:26.393270] [INFO ] [MAIN ] Update Progress: 946/2372 symbols completed. GME took 45.7s. Estimated remaining: 3h 9m 0s. Rate: 7.5 symbols/min [2025-09-23T19:05:26.561611] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:05:26.609495] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-06. [2025-09-23T19:05:26.616577] [DEBUG] [LOCAL ] GNL: Loaded 47345 existing records from primary storage. [2025-09-23T19:05:26.616782] [INFO ] [MAIN ] GNL: Loaded 47345 existing records. [2025-09-23T19:05:26.822632] [WARN ] [MAIN ] GNL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:05:26.823265] [INFO ] [MAIN ] GNL: Wiping existing primary data before full refresh. [2025-09-23T19:05:26.823358] [INFO ] [LOCAL ] GNL: Starting deletion of primary data. [2025-09-23T19:05:26.824515] [DEBUG] [LOCAL ] GNL: Deleted primary data file. [2025-09-23T19:05:26.824579] [INFO ] [MAIN ] GNL: Starting full primary refresh. [2025-09-23T19:05:27.134167] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-23T19:05:27.231462] [INFO ] [REMOTE ] GNL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:05:27.402188] [INFO ] [REMOTE ] GNL: Fetching primary data for 2024-12. [2025-09-23T19:05:27.912918] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-23T19:05:28.202196] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-07. [2025-09-23T19:05:29.013831] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-01. [2025-09-23T19:05:29.016572] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-23T19:05:29.612841] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-23T19:05:29.802283] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-01. [2025-09-23T19:05:30.396522] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-23T19:05:30.602229] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-09. [2025-09-23T19:05:31.119756] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-23T19:05:31.402193] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-02. [2025-09-23T19:05:31.775454] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-23T19:05:31.783875] [INFO ] [REMOTE ] GMRE: Full fetch complete (53610 records). [2025-09-23T19:05:31.784090] [DEBUG] [VALIDATOR ] GMRE: Validating primary data. [2025-09-23T19:05:32.186852] [DEBUG] [VALIDATOR ] GMRE: All expected trading days are present. [2025-09-23T19:05:32.186957] [DEBUG] [VALIDATOR ] GMRE: Primary data validation passed. [2025-09-23T19:05:32.188164] [INFO ] [MAIN ] GMRE: Fetched primary data is valid. [2025-09-23T19:05:32.188280] [DEBUG] [LOCAL ] GMRE: Saving primary data. [2025-09-23T19:05:32.191686] [DEBUG] [LOCAL ] GMRE: Trimmed 53610 records to 37709 (keeping 200 days of data) [2025-09-23T19:05:32.202220] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-02. [2025-09-23T19:05:32.462137] [DEBUG] [LOCAL ] GMRE: Primary data saved (37709 records). [2025-09-23T19:05:32.462431] [INFO ] [MAIN ] GMRE: Full history saved. [2025-09-23T19:05:32.462723] [INFO ] [MAIN ] Update Progress: 947/2372 symbols completed. GMRE took 29.0s. Estimated remaining: 3h 8m 50s. Rate: 7.5 symbols/min [2025-09-23T19:05:32.649448] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:05:32.704538] [DEBUG] [LOCAL ] GNRC: Loaded 45155 existing records from primary storage. [2025-09-23T19:05:32.704771] [INFO ] [MAIN ] GNRC: Loaded 45155 existing records. [2025-09-23T19:05:32.843160] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-23T19:05:32.922121] [WARN ] [MAIN ] GNRC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:05:32.922498] [INFO ] [MAIN ] GNRC: Wiping existing primary data before full refresh. [2025-09-23T19:05:32.922556] [INFO ] [LOCAL ] GNRC: Starting deletion of primary data. [2025-09-23T19:05:32.924008] [DEBUG] [LOCAL ] GNRC: Deleted primary data file. [2025-09-23T19:05:32.924088] [INFO ] [MAIN ] GNRC: Starting full primary refresh. [2025-09-23T19:05:33.007405] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-08. [2025-09-23T19:05:33.319263] [INFO ] [REMOTE ] GNRC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:05:33.419391] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-23T19:05:33.802254] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-03. [2025-09-23T19:05:34.345806] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-23T19:05:34.602309] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-03. [2025-09-23T19:05:35.010805] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-23T19:05:35.402284] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2024-12. [2025-09-23T19:05:35.924124] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-23T19:05:36.202213] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-04. [2025-09-23T19:05:36.701936] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-23T19:05:37.002221] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-04. [2025-09-23T19:05:37.565405] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-23T19:05:37.802203] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-01. [2025-09-23T19:05:38.602223] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-09. [2025-09-23T19:05:38.683102] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-23T19:05:39.358954] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-23T19:05:39.402206] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-05. [2025-09-23T19:05:39.974336] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-23T19:05:39.986835] [INFO ] [REMOTE ] GMED: Full fetch complete (69093 records). [2025-09-23T19:05:39.987050] [DEBUG] [VALIDATOR ] GMED: Validating primary data. [2025-09-23T19:05:40.211896] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-02. [2025-09-23T19:05:40.407670] [DEBUG] [VALIDATOR ] GMED: All expected trading days are present. [2025-09-23T19:05:40.407774] [DEBUG] [VALIDATOR ] GMED: Primary data validation passed. [2025-09-23T19:05:40.408795] [INFO ] [MAIN ] GMED: Fetched primary data is valid. [2025-09-23T19:05:40.408863] [DEBUG] [LOCAL ] GMED: Saving primary data. [2025-09-23T19:05:40.410462] [DEBUG] [LOCAL ] GMED: Trimmed 69093 records to 48308 (keeping 200 days of data) [2025-09-23T19:05:40.689530] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-23T19:05:40.765215] [DEBUG] [LOCAL ] GMED: Primary data saved (48308 records). [2025-09-23T19:05:40.765379] [INFO ] [MAIN ] GMED: Full history saved. [2025-09-23T19:05:40.765499] [INFO ] [MAIN ] Update Progress: 948/2372 symbols completed. GMED took 43.3s. Estimated remaining: 3h 8m 42s. Rate: 7.5 symbols/min [2025-09-23T19:05:40.940186] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:05:40.951704] [DEBUG] [LOCAL ] GNT: Loaded 7946 existing records from primary storage. [2025-09-23T19:05:40.951821] [INFO ] [MAIN ] GNT: Loaded 7946 existing records. [2025-09-23T19:05:41.014792] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-05. [2025-09-23T19:05:41.133432] [WARN ] [MAIN ] GNT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:05:41.133683] [INFO ] [MAIN ] GNT: Wiping existing primary data before full refresh. [2025-09-23T19:05:41.133768] [INFO ] [LOCAL ] GNT: Starting deletion of primary data. [2025-09-23T19:05:41.134128] [DEBUG] [LOCAL ] GNT: Deleted primary data file. [2025-09-23T19:05:41.134197] [INFO ] [MAIN ] GNT: Starting full primary refresh. [2025-09-23T19:05:41.508806] [INFO ] [REMOTE ] GNT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:05:41.564999] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-23T19:05:41.802204] [INFO ] [REMOTE ] GNT: Fetching primary data for 2024-12. [2025-09-23T19:05:42.280189] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-23T19:05:42.401970] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-23T19:05:42.602192] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-06. [2025-09-23T19:05:43.402199] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-03. [2025-09-23T19:05:43.711432] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-23T19:05:44.202217] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-06. [2025-09-23T19:05:45.003714] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-01. [2025-09-23T19:05:45.006855] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-23T19:05:45.444715] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-23T19:05:45.487346] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-23T19:05:45.802194] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-07. [2025-09-23T19:05:46.602193] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-04. [2025-09-23T19:05:46.892431] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-23T19:05:47.402211] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-07. [2025-09-23T19:05:47.974597] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-23T19:05:48.202206] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-05. [2025-09-23T19:05:48.620081] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-23T19:05:49.002216] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-08. [2025-09-23T19:05:49.802164] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-02. [2025-09-23T19:05:49.837385] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-23T19:05:50.099362] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-23T19:05:50.458044] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-23T19:05:50.602197] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-06. [2025-09-23T19:05:51.402201] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-08. [2025-09-23T19:05:51.827754] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-23T19:05:52.202212] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-09. [2025-09-23T19:05:52.991217] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-23T19:05:53.002153] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-09. [2025-09-23T19:05:53.802236] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-07. [2025-09-23T19:05:53.872416] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-23T19:05:53.881700] [INFO ] [REMOTE ] GNK: Full fetch complete (56996 records). [2025-09-23T19:05:53.881839] [DEBUG] [VALIDATOR ] GNK: Validating primary data. [2025-09-23T19:05:54.303338] [DEBUG] [VALIDATOR ] GNK: All expected trading days are present. [2025-09-23T19:05:54.303484] [DEBUG] [VALIDATOR ] GNK: Primary data validation passed. [2025-09-23T19:05:54.304259] [INFO ] [MAIN ] GNK: Fetched primary data is valid. [2025-09-23T19:05:54.304322] [DEBUG] [LOCAL ] GNK: Saving primary data. [2025-09-23T19:05:54.305534] [DEBUG] [LOCAL ] GNK: Trimmed 56996 records to 40652 (keeping 200 days of data) [2025-09-23T19:05:54.569537] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-23T19:05:54.579965] [INFO ] [REMOTE ] GNL: Full fetch complete (68538 records). [2025-09-23T19:05:54.580581] [DEBUG] [VALIDATOR ] GNL: Validating primary data. [2025-09-23T19:05:54.612820] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-03. [2025-09-23T19:05:54.992022] [DEBUG] [LOCAL ] GNK: Primary data saved (40652 records). [2025-09-23T19:05:55.011581] [INFO ] [MAIN ] GNK: Full history saved. [2025-09-23T19:05:55.015040] [INFO ] [MAIN ] Update Progress: 949/2372 symbols completed. GNK took 31.4s. Estimated remaining: 3h 8m 44s. Rate: 7.5 symbols/min [2025-09-23T19:05:55.015171] [DEBUG] [VALIDATOR ] GNL: All expected trading days are present. [2025-09-23T19:05:55.015246] [DEBUG] [VALIDATOR ] GNL: Primary data validation passed. [2025-09-23T19:05:55.016325] [INFO ] [MAIN ] GNL: Fetched primary data is valid. [2025-09-23T19:05:55.016502] [DEBUG] [LOCAL ] GNL: Saving primary data. [2025-09-23T19:05:55.117680] [DEBUG] [LOCAL ] GNL: Trimmed 68538 records to 47288 (keeping 200 days of data) [2025-09-23T19:05:55.250942] [INFO ] [MAIN ] GNTY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:05:55.261075] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-23T19:05:55.327557] [DEBUG] [LOCAL ] GNTY: Loaded 7079 existing records from primary storage. [2025-09-23T19:05:55.328000] [INFO ] [MAIN ] GNTY: Loaded 7079 existing records. [2025-09-23T19:05:55.421458] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-04. [2025-09-23T19:05:55.630297] [WARN ] [MAIN ] GNTY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:05:55.658853] [INFO ] [MAIN ] GNTY: Wiping existing primary data before full refresh. [2025-09-23T19:05:55.661491] [INFO ] [LOCAL ] GNTY: Starting deletion of primary data. [2025-09-23T19:05:55.664639] [DEBUG] [LOCAL ] GNTY: Deleted primary data file. [2025-09-23T19:05:55.665427] [INFO ] [MAIN ] GNTY: Starting full primary refresh. [2025-09-23T19:05:55.664588] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-23T19:05:55.958803] [DEBUG] [LOCAL ] GNL: Primary data saved (47288 records). [2025-09-23T19:05:55.959061] [INFO ] [MAIN ] GNL: Full history saved. [2025-09-23T19:05:55.959181] [INFO ] [MAIN ] Update Progress: 950/2372 symbols completed. GNL took 29.6s. Estimated remaining: 3h 8m 25s. Rate: 7.5 symbols/min [2025-09-23T19:05:56.097300] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-23T19:05:56.212804] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-08. [2025-09-23T19:05:56.227582] [INFO ] [REMOTE ] GNTY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:05:56.278181] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:05:56.330639] [DEBUG] [LOCAL ] GNW: Loaded 51338 existing records from primary storage. [2025-09-23T19:05:56.330820] [INFO ] [MAIN ] GNW: Loaded 51338 existing records. [2025-09-23T19:05:56.510889] [WARN ] [MAIN ] GNW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:05:56.511151] [INFO ] [MAIN ] GNW: Wiping existing primary data before full refresh. [2025-09-23T19:05:56.511199] [INFO ] [LOCAL ] GNW: Starting deletion of primary data. [2025-09-23T19:05:56.512258] [DEBUG] [LOCAL ] GNW: Deleted primary data file. [2025-09-23T19:05:56.512318] [INFO ] [MAIN ] GNW: Starting full primary refresh. [2025-09-23T19:05:56.867627] [INFO ] [REMOTE ] GNW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:05:57.002207] [INFO ] [REMOTE ] GNW: Fetching primary data for 2024-12. [2025-09-23T19:05:57.591249] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-23T19:05:57.802232] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-05. [2025-09-23T19:05:58.270339] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-23T19:05:58.491567] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-23T19:05:58.602206] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-01. [2025-09-23T19:05:59.402211] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-09. [2025-09-23T19:05:59.929883] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-23T19:06:00.202200] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-06. [2025-09-23T19:06:00.707460] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-23T19:06:01.002197] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-07. [2025-09-23T19:06:01.239000] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-23T19:06:01.246955] [INFO ] [REMOTE ] GNRC: Full fetch complete (65215 records). [2025-09-23T19:06:01.247103] [DEBUG] [VALIDATOR ] GNRC: Validating primary data. [2025-09-23T19:06:01.602106] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-23T19:06:01.668877] [DEBUG] [VALIDATOR ] GNRC: All expected trading days are present. [2025-09-23T19:06:01.668990] [DEBUG] [VALIDATOR ] GNRC: Primary data validation passed. [2025-09-23T19:06:01.670296] [INFO ] [MAIN ] GNRC: Fetched primary data is valid. [2025-09-23T19:06:01.670384] [DEBUG] [LOCAL ] GNRC: Saving primary data. [2025-09-23T19:06:01.672325] [DEBUG] [LOCAL ] GNRC: Trimmed 65215 records to 45194 (keeping 200 days of data) [2025-09-23T19:06:01.803619] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-02. [2025-09-23T19:06:02.003108] [DEBUG] [LOCAL ] GNRC: Primary data saved (45194 records). [2025-09-23T19:06:02.003292] [INFO ] [MAIN ] GNRC: Full history saved. [2025-09-23T19:06:02.003451] [INFO ] [MAIN ] Update Progress: 951/2372 symbols completed. GNRC took 29.5s. Estimated remaining: 3h 8m 14s. Rate: 7.5 symbols/min [2025-09-23T19:06:02.194372] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:06:02.238084] [DEBUG] [LOCAL ] GOF: Loaded 42926 existing records from primary storage. [2025-09-23T19:06:02.238236] [INFO ] [MAIN ] GOF: Loaded 42926 existing records. [2025-09-23T19:06:02.437512] [WARN ] [MAIN ] GOF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:06:02.437850] [INFO ] [MAIN ] GOF: Wiping existing primary data before full refresh. [2025-09-23T19:06:02.437907] [INFO ] [LOCAL ] GOF: Starting deletion of primary data. [2025-09-23T19:06:02.439074] [DEBUG] [LOCAL ] GOF: Deleted primary data file. [2025-09-23T19:06:02.439154] [INFO ] [MAIN ] GOF: Starting full primary refresh. [2025-09-23T19:06:02.607507] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-08. [2025-09-23T19:06:02.837122] [INFO ] [REMOTE ] GOF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:06:03.402205] [INFO ] [REMOTE ] GOF: Fetching primary data for 2024-12. [2025-09-23T19:06:04.202280] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2024-12. [2025-09-23T19:06:04.487909] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-23T19:06:04.734422] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-02 (2.93 seconds). [2025-09-23T19:06:04.781041] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-23T19:06:04.851619] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-23T19:06:05.002201] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-09. [2025-09-23T19:06:05.802240] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-03. [2025-09-23T19:06:05.893405] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-23T19:06:05.896100] [INFO ] [REMOTE ] GNT: Full fetch complete (10546 records). [2025-09-23T19:06:05.896263] [DEBUG] [VALIDATOR ] GNT: Validating primary data. [2025-09-23T19:06:06.322517] [DEBUG] [VALIDATOR ] GNT: All expected trading days are present. [2025-09-23T19:06:06.322599] [DEBUG] [VALIDATOR ] GNT: Primary data validation passed. [2025-09-23T19:06:06.322908] [INFO ] [MAIN ] GNT: Fetched primary data is valid. [2025-09-23T19:06:06.322971] [DEBUG] [LOCAL ] GNT: Saving primary data. [2025-09-23T19:06:06.323448] [DEBUG] [LOCAL ] GNT: Trimmed 10546 records to 8021 (keeping 200 days of data) [2025-09-23T19:06:06.370992] [DEBUG] [LOCAL ] GNT: Primary data saved (8021 records). [2025-09-23T19:06:06.371140] [INFO ] [MAIN ] GNT: Full history saved. [2025-09-23T19:06:06.371230] [INFO ] [MAIN ] Update Progress: 952/2372 symbols completed. GNT took 25.6s. Estimated remaining: 3h 8m 1s. Rate: 7.6 symbols/min [2025-09-23T19:06:06.561152] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:06:06.598208] [DEBUG] [LOCAL ] GOLF: Loaded 31784 existing records from primary storage. [2025-09-23T19:06:06.598363] [INFO ] [MAIN ] GOLF: Loaded 31784 existing records. [2025-09-23T19:06:06.612241] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-01. [2025-09-23T19:06:06.789570] [WARN ] [MAIN ] GOLF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:06:06.789815] [INFO ] [MAIN ] GOLF: Wiping existing primary data before full refresh. [2025-09-23T19:06:06.789865] [INFO ] [LOCAL ] GOLF: Starting deletion of primary data. [2025-09-23T19:06:06.790637] [DEBUG] [LOCAL ] GOLF: Deleted primary data file. [2025-09-23T19:06:06.790726] [INFO ] [MAIN ] GOLF: Starting full primary refresh. [2025-09-23T19:06:07.148496] [INFO ] [REMOTE ] GOLF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:06:07.210183] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-23T19:06:07.402220] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-04. [2025-09-23T19:06:08.108117] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-23T19:06:08.202222] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-02. [2025-09-23T19:06:09.002190] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-01. [2025-09-23T19:06:09.130224] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-23T19:06:09.507127] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-23T19:06:09.567885] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-23T19:06:09.802268] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-02. [2025-09-23T19:06:10.177634] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-23T19:06:10.602216] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-05. [2025-09-23T19:06:11.402214] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-03. [2025-09-23T19:06:11.789790] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-23T19:06:12.202175] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-03. [2025-09-23T19:06:12.284079] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-23T19:06:13.002211] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-06. [2025-09-23T19:06:13.550873] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-23T19:06:13.802215] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-04. [2025-09-23T19:06:14.602201] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2024-12. [2025-09-23T19:06:14.975097] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-23T19:06:15.381088] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-23T19:06:15.402154] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-05. [2025-09-23T19:06:15.440687] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-23T19:06:16.202195] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-07. [2025-09-23T19:06:16.645319] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-23T19:06:17.002217] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-04. [2025-09-23T19:06:17.472355] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-23T19:06:17.802185] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-05. [2025-09-23T19:06:18.044749] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-23T19:06:18.602249] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-08. [2025-09-23T19:06:19.119587] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-23T19:06:19.402217] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-06. [2025-09-23T19:06:20.202216] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-06. [2025-09-23T19:06:20.431730] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-23T19:06:21.002254] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-09. [2025-09-23T19:06:21.072272] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-23T19:06:21.074764] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-23T19:06:21.802295] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-07. [2025-09-23T19:06:22.430792] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-23T19:06:22.439207] [INFO ] [REMOTE ] GNW: Full fetch complete (73423 records). [2025-09-23T19:06:22.439341] [DEBUG] [VALIDATOR ] GNW: Validating primary data. [2025-09-23T19:06:22.619479] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-07. [2025-09-23T19:06:22.840241] [DEBUG] [VALIDATOR ] GNW: All expected trading days are present. [2025-09-23T19:06:22.840364] [DEBUG] [VALIDATOR ] GNW: Primary data validation passed. [2025-09-23T19:06:22.841396] [INFO ] [MAIN ] GNW: Fetched primary data is valid. [2025-09-23T19:06:22.841464] [DEBUG] [LOCAL ] GNW: Saving primary data. [2025-09-23T19:06:22.843114] [DEBUG] [LOCAL ] GNW: Trimmed 73423 records to 51348 (keeping 200 days of data) [2025-09-23T19:06:23.127241] [DEBUG] [LOCAL ] GNW: Primary data saved (51348 records). [2025-09-23T19:06:23.127371] [INFO ] [MAIN ] GNW: Full history saved. [2025-09-23T19:06:23.127467] [INFO ] [MAIN ] Update Progress: 953/2372 symbols completed. GNW took 27.2s. Estimated remaining: 3h 8m 6s. Rate: 7.5 symbols/min [2025-09-23T19:06:23.307049] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:06:23.315277] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-23T19:06:23.359973] [DEBUG] [LOCAL ] GOOS: Loaded 45674 existing records from primary storage. [2025-09-23T19:06:23.360110] [INFO ] [MAIN ] GOOS: Loaded 45674 existing records. [2025-09-23T19:06:23.413971] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-08. [2025-09-23T19:06:23.543069] [WARN ] [MAIN ] GOOS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:06:23.543424] [INFO ] [MAIN ] GOOS: Wiping existing primary data before full refresh. [2025-09-23T19:06:23.543506] [INFO ] [LOCAL ] GOOS: Starting deletion of primary data. [2025-09-23T19:06:23.552543] [DEBUG] [LOCAL ] GOOS: Deleted primary data file. [2025-09-23T19:06:23.567356] [INFO ] [MAIN ] GOOS: Starting full primary refresh. [2025-09-23T19:06:23.643354] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-23T19:06:23.974832] [INFO ] [REMOTE ] GOOS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:06:23.982217] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-23T19:06:24.202203] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2024-12. [2025-09-23T19:06:25.002198] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-09. [2025-09-23T19:06:25.802175] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-01. [2025-09-23T19:06:25.839308] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-23T19:06:25.841237] [INFO ] [REMOTE ] GNTY: Full fetch complete (10259 records). [2025-09-23T19:06:25.841308] [DEBUG] [VALIDATOR ] GNTY: Validating primary data. [2025-09-23T19:06:26.032672] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-23T19:06:26.242108] [DEBUG] [VALIDATOR ] GNTY: All expected trading days are present. [2025-09-23T19:06:26.242183] [DEBUG] [VALIDATOR ] GNTY: Primary data validation passed. [2025-09-23T19:06:26.242406] [INFO ] [MAIN ] GNTY: Fetched primary data is valid. [2025-09-23T19:06:26.242443] [DEBUG] [LOCAL ] GNTY: Saving primary data. [2025-09-23T19:06:26.242905] [DEBUG] [LOCAL ] GNTY: Trimmed 10259 records to 7173 (keeping 200 days of data) [2025-09-23T19:06:26.286792] [DEBUG] [LOCAL ] GNTY: Primary data saved (7173 records). [2025-09-23T19:06:26.286895] [INFO ] [MAIN ] GNTY: Full history saved. [2025-09-23T19:06:26.286975] [INFO ] [MAIN ] Update Progress: 954/2372 symbols completed. GNTY took 31.3s. Estimated remaining: 3h 7m 51s. Rate: 7.5 symbols/min [2025-09-23T19:06:26.459849] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:06:26.498168] [DEBUG] [LOCAL ] GOTU: Loaded 39180 existing records from primary storage. [2025-09-23T19:06:26.498306] [INFO ] [MAIN ] GOTU: Loaded 39180 existing records. [2025-09-23T19:06:26.604142] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-08. [2025-09-23T19:06:26.698966] [WARN ] [MAIN ] GOTU: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:06:26.699300] [INFO ] [MAIN ] GOTU: Wiping existing primary data before full refresh. [2025-09-23T19:06:26.699368] [INFO ] [LOCAL ] GOTU: Starting deletion of primary data. [2025-09-23T19:06:26.705435] [DEBUG] [LOCAL ] GOTU: Deleted primary data file. [2025-09-23T19:06:26.714747] [INFO ] [MAIN ] GOTU: Starting full primary refresh. [2025-09-23T19:06:26.715218] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-23T19:06:27.108174] [INFO ] [REMOTE ] GOTU: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:06:27.402189] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-02. [2025-09-23T19:06:27.860380] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-23T19:06:28.202214] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-09. [2025-09-23T19:06:28.807893] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-23T19:06:29.002250] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-03. [2025-09-23T19:06:29.672291] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-23T19:06:29.679433] [INFO ] [REMOTE ] GOF: Full fetch complete (62264 records). [2025-09-23T19:06:29.679568] [DEBUG] [VALIDATOR ] GOF: Validating primary data. [2025-09-23T19:06:29.807321] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2024-12. [2025-09-23T19:06:30.098280] [DEBUG] [VALIDATOR ] GOF: All expected trading days are present. [2025-09-23T19:06:30.098472] [DEBUG] [VALIDATOR ] GOF: Primary data validation passed. [2025-09-23T19:06:30.099350] [INFO ] [MAIN ] GOF: Fetched primary data is valid. [2025-09-23T19:06:30.099540] [DEBUG] [LOCAL ] GOF: Saving primary data. [2025-09-23T19:06:30.101350] [DEBUG] [LOCAL ] GOF: Trimmed 62264 records to 42873 (keeping 200 days of data) [2025-09-23T19:06:30.211069] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-23T19:06:30.394205] [DEBUG] [LOCAL ] GOF: Primary data saved (42873 records). [2025-09-23T19:06:30.394353] [INFO ] [MAIN ] GOF: Full history saved. [2025-09-23T19:06:30.394442] [INFO ] [MAIN ] Update Progress: 955/2372 symbols completed. GOF took 28.4s. Estimated remaining: 3h 7m 38s. Rate: 7.6 symbols/min [2025-09-23T19:06:30.564374] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:06:30.609847] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-04. [2025-09-23T19:06:30.612627] [DEBUG] [LOCAL ] GPC: Loaded 46710 existing records from primary storage. [2025-09-23T19:06:30.612795] [INFO ] [MAIN ] GPC: Loaded 46710 existing records. [2025-09-23T19:06:30.792848] [WARN ] [MAIN ] GPC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:06:30.793107] [INFO ] [MAIN ] GPC: Wiping existing primary data before full refresh. [2025-09-23T19:06:30.793191] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-09-23T19:06:30.794363] [DEBUG] [LOCAL ] GPC: Deleted primary data file. [2025-09-23T19:06:30.794424] [INFO ] [MAIN ] GPC: Starting full primary refresh. [2025-09-23T19:06:31.150048] [INFO ] [REMOTE ] GPC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:06:31.402206] [INFO ] [REMOTE ] GPC: Fetching primary data for 2024-12. [2025-09-23T19:06:31.465514] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-23T19:06:31.782130] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-23T19:06:32.202195] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-05. [2025-09-23T19:06:33.002243] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-01. [2025-09-23T19:06:33.080822] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-23T19:06:33.618691] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-23T19:06:33.802207] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-01. [2025-09-23T19:06:34.513465] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-23T19:06:34.602213] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-01. [2025-09-23T19:06:35.402223] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-06. [2025-09-23T19:06:35.573389] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-23T19:06:35.816966] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-23T19:06:36.202160] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-02. [2025-09-23T19:06:36.660863] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-23T19:06:37.002213] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-02. [2025-09-23T19:06:37.443053] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-23T19:06:37.802217] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-02. [2025-09-23T19:06:38.602161] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-07. [2025-09-23T19:06:38.642531] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-23T19:06:38.894774] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-23T19:06:39.402166] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-03. [2025-09-23T19:06:39.472180] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-23T19:06:40.202233] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-03. [2025-09-23T19:06:40.705540] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-23T19:06:41.002200] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-03. [2025-09-23T19:06:41.396920] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-23T19:06:41.802224] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-04. [2025-09-23T19:06:42.567622] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-23T19:06:42.602160] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-04. [2025-09-23T19:06:43.278464] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-23T19:06:43.402197] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-05. [2025-09-23T19:06:44.073234] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-23T19:06:44.202232] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-05. [2025-09-23T19:06:44.681775] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-23T19:06:45.002232] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-06. [2025-09-23T19:06:45.802184] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-04. [2025-09-23T19:06:45.840583] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-23T19:06:46.533731] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-23T19:06:46.602224] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-08. [2025-09-23T19:06:46.969622] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-23T19:06:47.402205] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-05. [2025-09-23T19:06:47.668969] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-23T19:06:48.202193] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-06. [2025-09-23T19:06:48.789594] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-23T19:06:49.002213] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-09. [2025-09-23T19:06:49.258774] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-23T19:06:49.802190] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-07. [2025-09-23T19:06:50.361761] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-23T19:06:50.366740] [INFO ] [REMOTE ] GOLF: Full fetch complete (44881 records). [2025-09-23T19:06:50.366876] [DEBUG] [VALIDATOR ] GOLF: Validating primary data. [2025-09-23T19:06:50.607290] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-06. [2025-09-23T19:06:50.774211] [DEBUG] [VALIDATOR ] GOLF: All expected trading days are present. [2025-09-23T19:06:50.774301] [DEBUG] [VALIDATOR ] GOLF: Primary data validation passed. [2025-09-23T19:06:50.775088] [INFO ] [MAIN ] GOLF: Fetched primary data is valid. [2025-09-23T19:06:50.775156] [DEBUG] [LOCAL ] GOLF: Saving primary data. [2025-09-23T19:06:50.776332] [DEBUG] [LOCAL ] GOLF: Trimmed 44881 records to 31727 (keeping 200 days of data) [2025-09-23T19:06:50.982525] [DEBUG] [LOCAL ] GOLF: Primary data saved (31727 records). [2025-09-23T19:06:50.982705] [INFO ] [MAIN ] GOLF: Full history saved. [2025-09-23T19:06:50.982809] [INFO ] [MAIN ] Update Progress: 956/2372 symbols completed. GOLF took 44.6s. Estimated remaining: 3h 7m 48s. Rate: 7.5 symbols/min [2025-09-23T19:06:51.158974] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:06:51.176116] [DEBUG] [LOCAL ] GPI: Loaded 14915 existing records from primary storage. [2025-09-23T19:06:51.176252] [INFO ] [MAIN ] GPI: Loaded 14915 existing records. [2025-09-23T19:06:51.403450] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-07. [2025-09-23T19:06:51.403274] [WARN ] [MAIN ] GPI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:06:51.405079] [INFO ] [MAIN ] GPI: Wiping existing primary data before full refresh. [2025-09-23T19:06:51.405389] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-09-23T19:06:51.408989] [DEBUG] [LOCAL ] GPI: Deleted primary data file. [2025-09-23T19:06:51.408890] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-23T19:06:51.409191] [INFO ] [MAIN ] GPI: Starting full primary refresh. [2025-09-23T19:06:51.784070] [INFO ] [REMOTE ] GPI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:06:51.837976] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-23T19:06:52.202204] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-08. [2025-09-23T19:06:52.865626] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-23T19:06:53.002192] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-08. [2025-09-23T19:06:53.802173] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-07. [2025-09-23T19:06:54.010804] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-23T19:06:54.478954] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-23T19:06:54.602217] [INFO ] [REMOTE ] GPI: Fetching primary data for 2024-12. [2025-09-23T19:06:55.066736] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-23T19:06:55.169972] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-23T19:06:55.402196] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-09. [2025-09-23T19:06:56.202197] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-01. [2025-09-23T19:06:56.459883] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-23T19:06:56.466155] [INFO ] [REMOTE ] GOTU: Full fetch complete (59866 records). [2025-09-23T19:06:56.466285] [DEBUG] [VALIDATOR ] GOTU: Validating primary data. [2025-09-23T19:06:56.843615] [DEBUG] [VALIDATOR ] GOTU: All expected trading days are present. [2025-09-23T19:06:56.843770] [DEBUG] [VALIDATOR ] GOTU: Primary data validation passed. [2025-09-23T19:06:56.844537] [INFO ] [MAIN ] GOTU: Fetched primary data is valid. [2025-09-23T19:06:56.844579] [DEBUG] [LOCAL ] GOTU: Saving primary data. [2025-09-23T19:06:56.845880] [DEBUG] [LOCAL ] GOTU: Trimmed 59866 records to 39025 (keeping 200 days of data) [2025-09-23T19:06:57.006508] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-09. [2025-09-23T19:06:57.067807] [DEBUG] [LOCAL ] GOTU: Primary data saved (39025 records). [2025-09-23T19:06:57.067941] [INFO ] [MAIN ] GOTU: Full history saved. [2025-09-23T19:06:57.068025] [INFO ] [MAIN ] Update Progress: 957/2372 symbols completed. GOTU took 30.8s. Estimated remaining: 3h 7m 38s. Rate: 7.5 symbols/min [2025-09-23T19:06:57.156955] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-23T19:06:57.802217] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-02. [2025-09-23T19:06:58.352505] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-23T19:06:58.608729] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-03. [2025-09-23T19:06:58.626631] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-23T19:06:58.635593] [INFO ] [REMOTE ] GPC: Full fetch complete (69156 records). [2025-09-23T19:06:58.635821] [DEBUG] [VALIDATOR ] GPC: Validating primary data. [2025-09-23T19:06:59.039407] [DEBUG] [VALIDATOR ] GPC: All expected trading days are present. [2025-09-23T19:06:59.039496] [DEBUG] [VALIDATOR ] GPC: Primary data validation passed. [2025-09-23T19:06:59.040455] [INFO ] [MAIN ] GPC: Fetched primary data is valid. [2025-09-23T19:06:59.040520] [DEBUG] [LOCAL ] GPC: Saving primary data. [2025-09-23T19:06:59.042075] [DEBUG] [LOCAL ] GPC: Trimmed 69156 records to 46703 (keeping 200 days of data) [2025-09-23T19:06:59.373184] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-23T19:06:59.381237] [DEBUG] [LOCAL ] GPC: Primary data saved (46703 records). [2025-09-23T19:06:59.381394] [INFO ] [MAIN ] GPC: Full history saved. [2025-09-23T19:06:59.381486] [INFO ] [MAIN ] Update Progress: 958/2372 symbols completed. GPC took 29.0s. Estimated remaining: 3h 7m 21s. Rate: 7.5 symbols/min [2025-09-23T19:06:59.402173] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-04. [2025-09-23T19:07:00.165040] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-23T19:07:00.202149] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-05. [2025-09-23T19:07:00.829398] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-23T19:07:01.002277] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-06. [2025-09-23T19:07:01.116377] [DEBUG] [REMOTE ] GPI: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-09-23T19:07:01.116769] [WARN ] [REMOTE ] GPI: No data returned for month 2025-06 [2025-09-23T19:07:01.802267] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-08. [2025-09-23T19:07:02.602263] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-07. [2025-09-23T19:07:03.156363] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-23T19:07:03.402219] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-09. [2025-09-23T19:07:03.834689] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-23T19:07:04.202250] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-08. [2025-09-23T19:07:04.863548] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-23T19:07:04.870731] [INFO ] [REMOTE ] GOOS: Full fetch complete (66041 records). [2025-09-23T19:07:04.870839] [DEBUG] [VALIDATOR ] GOOS: Validating primary data. [2025-09-23T19:07:05.258603] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-23T19:07:05.282536] [DEBUG] [VALIDATOR ] GOOS: All expected trading days are present. [2025-09-23T19:07:05.282342] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-09. [2025-09-23T19:07:05.283478] [DEBUG] [VALIDATOR ] GOOS: Primary data validation passed. [2025-09-23T19:07:05.284454] [INFO ] [MAIN ] GOOS: Fetched primary data is valid. [2025-09-23T19:07:05.284686] [DEBUG] [LOCAL ] GOOS: Saving primary data. [2025-09-23T19:07:05.286208] [DEBUG] [LOCAL ] GOOS: Trimmed 66041 records to 45569 (keeping 200 days of data) [2025-09-23T19:07:05.557824] [DEBUG] [LOCAL ] GOOS: Primary data saved (45569 records). [2025-09-23T19:07:05.557975] [INFO ] [MAIN ] GOOS: Full history saved. [2025-09-23T19:07:05.558081] [INFO ] [MAIN ] Update Progress: 959/2372 symbols completed. GOOS took 42.4s. Estimated remaining: 3h 7m 11s. Rate: 7.5 symbols/min [2025-09-23T19:07:07.932766] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-09 (2.65 seconds). [2025-09-23T19:07:07.935715] [INFO ] [REMOTE ] GPI: Full fetch complete (18643 records). [2025-09-23T19:07:07.935811] [DEBUG] [VALIDATOR ] GPI: Validating primary data. [2025-09-23T19:07:08.121467] [WARN ] [VALIDATOR ] GPI: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-23T19:07:08.121803] [FATAL] [MAIN ] GPI: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:07:08.121873] [WARN ] [MAIN ] GPI: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:07:08.121943] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-09-23T19:07:08.122034] [DEBUG] [LOCAL ] GPI: No primary data file found to delete. [2025-09-23T19:07:08.122132] [INFO ] [LOCAL ] GPI: Starting deletion of derivative data. [2025-09-23T19:07:08.122798] [DEBUG] [LOCAL ] GPI: Deleted derivative data file. [2025-09-23T19:07:08.122924] [INFO ] [MAIN ] Update Progress: 960/2372 symbols completed. GPI took 17.1s. Estimated remaining: 3h 6m 55s. Rate: 7.6 symbols/min [2025-09-23T19:07:08.709914] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:07:08.810374] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:07:08.832376] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:07:08.814239] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:07:08.840347] [DEBUG] [LOCAL ] GPJA: Loaded 4078 existing records from primary storage. [2025-09-23T19:07:08.840589] [INFO ] [MAIN ] GPJA: Loaded 4078 existing records. [2025-09-23T19:07:09.009244] [DEBUG] [LOCAL ] GPMT: Loaded 26820 existing records from primary storage. [2025-09-23T19:07:09.053333] [INFO ] [MAIN ] GPMT: Loaded 26820 existing records. [2025-09-23T19:07:09.083164] [WARN ] [MAIN ] GPJA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:07:09.095572] [INFO ] [MAIN ] GPJA: Wiping existing primary data before full refresh. [2025-09-23T19:07:09.125710] [INFO ] [LOCAL ] GPJA: Starting deletion of primary data. [2025-09-23T19:07:09.175479] [DEBUG] [LOCAL ] GPJA: Deleted primary data file. [2025-09-23T19:07:09.216197] [INFO ] [MAIN ] GPJA: Starting full primary refresh. [2025-09-23T19:07:09.217127] [DEBUG] [LOCAL ] GPK: Loaded 52695 existing records from primary storage. [2025-09-23T19:07:09.218399] [DEBUG] [LOCAL ] GPN: Loaded 52107 existing records from primary storage. [2025-09-23T19:07:09.221630] [INFO ] [MAIN ] GPK: Loaded 52695 existing records. [2025-09-23T19:07:09.243173] [INFO ] [MAIN ] GPN: Loaded 52107 existing records. [2025-09-23T19:07:09.567413] [WARN ] [MAIN ] GPMT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:07:09.680436] [INFO ] [MAIN ] GPMT: Wiping existing primary data before full refresh. [2025-09-23T19:07:09.790945] [INFO ] [LOCAL ] GPMT: Starting deletion of primary data. [2025-09-23T19:07:09.892625] [DEBUG] [LOCAL ] GPMT: Deleted primary data file. [2025-09-23T19:07:09.906965] [WARN ] [MAIN ] GPK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:07:09.932807] [INFO ] [MAIN ] GPMT: Starting full primary refresh. [2025-09-23T19:07:10.027125] [INFO ] [MAIN ] GPK: Wiping existing primary data before full refresh. [2025-09-23T19:07:10.048083] [INFO ] [LOCAL ] GPK: Starting deletion of primary data. [2025-09-23T19:07:10.047740] [WARN ] [MAIN ] GPN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:07:10.093552] [INFO ] [MAIN ] GPN: Wiping existing primary data before full refresh. [2025-09-23T19:07:10.093606] [DEBUG] [LOCAL ] GPK: Deleted primary data file. [2025-09-23T19:07:10.171222] [INFO ] [REMOTE ] GPJA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:07:10.188668] [INFO ] [MAIN ] GPK: Starting full primary refresh. [2025-09-23T19:07:10.193024] [INFO ] [LOCAL ] GPN: Starting deletion of primary data. [2025-09-23T19:07:10.188577] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2024-12. [2025-09-23T19:07:10.261793] [DEBUG] [LOCAL ] GPN: Deleted primary data file. [2025-09-23T19:07:10.283207] [INFO ] [MAIN ] GPN: Starting full primary refresh. [2025-09-23T19:07:10.995806] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-23T19:07:10.992792] [INFO ] [REMOTE ] GPMT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:07:11.021082] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-01. [2025-09-23T19:07:10.997828] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2024-12. [2025-09-23T19:07:11.186300] [INFO ] [REMOTE ] GPK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:07:11.210170] [INFO ] [REMOTE ] GPK: Fetching primary data for 2024-12. [2025-09-23T19:07:11.306313] [INFO ] [REMOTE ] GPN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:07:11.307022] [INFO ] [REMOTE ] GPN: Fetching primary data for 2024-12. [2025-09-23T19:07:11.694556] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-23T19:07:11.697844] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-02. [2025-09-23T19:07:11.995056] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-23T19:07:12.001200] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-01. [2025-09-23T19:07:12.047420] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-23T19:07:12.048840] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-03. [2025-09-23T19:07:12.385377] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-23T19:07:12.387210] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-04. [2025-09-23T19:07:12.486233] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-23T19:07:12.716324] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-23T19:07:12.766772] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-23T19:07:12.839984] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-23T19:07:13.002186] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-02. [2025-09-23T19:07:13.802172] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-01. [2025-09-23T19:07:14.042961] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-23T19:07:14.602238] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-01. [2025-09-23T19:07:15.202842] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-23T19:07:15.402190] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-02. [2025-09-23T19:07:16.022782] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-23T19:07:16.202215] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-02. [2025-09-23T19:07:16.656812] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-23T19:07:17.002206] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-05. [2025-09-23T19:07:17.323315] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-23T19:07:17.410245] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-23T19:07:17.802209] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-06. [2025-09-23T19:07:18.227214] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-23T19:07:18.602199] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-03. [2025-09-23T19:07:19.402214] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-03. [2025-09-23T19:07:20.202193] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-03. [2025-09-23T19:07:21.002251] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-07. [2025-09-23T19:07:21.387400] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-03 (2.79 seconds). [2025-09-23T19:07:21.720254] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-23T19:07:21.807321] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-04. [2025-09-23T19:07:21.819259] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-23T19:07:21.922044] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-03 (2.52 seconds). [2025-09-23T19:07:22.602193] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-04. [2025-09-23T19:07:23.313936] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-23T19:07:23.402210] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-05. [2025-09-23T19:07:23.902883] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-23T19:07:24.202233] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-04. [2025-09-23T19:07:25.002207] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-05. [2025-09-23T19:07:25.439346] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-23T19:07:25.802170] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-06. [2025-09-23T19:07:25.971490] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-23T19:07:25.999941] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-23T19:07:26.602201] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-08. [2025-09-23T19:07:26.960995] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-23T19:07:27.336367] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-23T19:07:27.402155] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-07. [2025-09-23T19:07:28.202193] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-09. [2025-09-23T19:07:28.724421] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-23T19:07:28.725870] [INFO ] [REMOTE ] GPJA: Full fetch complete (7292 records). [2025-09-23T19:07:28.725940] [DEBUG] [VALIDATOR ] GPJA: Validating primary data. [2025-09-23T19:07:29.014491] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-05. [2025-09-23T19:07:29.110171] [DEBUG] [VALIDATOR ] GPJA: All expected trading days are present. [2025-09-23T19:07:29.110398] [DEBUG] [VALIDATOR ] GPJA: Primary data validation passed. [2025-09-23T19:07:29.110695] [INFO ] [MAIN ] GPJA: Fetched primary data is valid. [2025-09-23T19:07:29.110815] [DEBUG] [LOCAL ] GPJA: Saving primary data. [2025-09-23T19:07:29.111384] [DEBUG] [LOCAL ] GPJA: Trimmed 7292 records to 4086 (keeping 200 days of data) [2025-09-23T19:07:29.139371] [DEBUG] [LOCAL ] GPJA: Primary data saved (4086 records). [2025-09-23T19:07:29.139575] [INFO ] [MAIN ] GPJA: Full history saved. [2025-09-23T19:07:29.139718] [INFO ] [MAIN ] Update Progress: 961/2372 symbols completed. GPJA took 21.0s. Estimated remaining: 3h 7m 6s. Rate: 7.5 symbols/min [2025-09-23T19:07:29.402860] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-23T19:07:29.408877] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:07:29.447722] [DEBUG] [LOCAL ] GPOR: Loaded 22934 existing records from primary storage. [2025-09-23T19:07:29.447877] [INFO ] [MAIN ] GPOR: Loaded 22934 existing records. [2025-09-23T19:07:29.634632] [WARN ] [MAIN ] GPOR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:07:29.634901] [INFO ] [MAIN ] GPOR: Wiping existing primary data before full refresh. [2025-09-23T19:07:29.634972] [INFO ] [LOCAL ] GPOR: Starting deletion of primary data. [2025-09-23T19:07:29.635914] [DEBUG] [LOCAL ] GPOR: Deleted primary data file. [2025-09-23T19:07:29.635976] [INFO ] [MAIN ] GPOR: Starting full primary refresh. [2025-09-23T19:07:29.807307] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-08. [2025-09-23T19:07:29.989820] [INFO ] [REMOTE ] GPOR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:07:30.385708] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-23T19:07:30.602231] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2024-12. [2025-09-23T19:07:31.337897] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-23T19:07:31.402238] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-09. [2025-09-23T19:07:31.735409] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-23T19:07:32.202211] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-01. [2025-09-23T19:07:32.931622] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-23T19:07:32.940105] [INFO ] [REMOTE ] GPN: Full fetch complete (74803 records). [2025-09-23T19:07:32.940233] [DEBUG] [VALIDATOR ] GPN: Validating primary data. [2025-09-23T19:07:33.007440] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-06. [2025-09-23T19:07:33.342444] [DEBUG] [VALIDATOR ] GPN: All expected trading days are present. [2025-09-23T19:07:33.342561] [DEBUG] [VALIDATOR ] GPN: Primary data validation passed. [2025-09-23T19:07:33.343582] [INFO ] [MAIN ] GPN: Fetched primary data is valid. [2025-09-23T19:07:33.343695] [DEBUG] [LOCAL ] GPN: Saving primary data. [2025-09-23T19:07:33.345739] [DEBUG] [LOCAL ] GPN: Trimmed 74803 records to 52113 (keeping 200 days of data) [2025-09-23T19:07:33.452847] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-23T19:07:33.702483] [DEBUG] [LOCAL ] GPN: Primary data saved (52113 records). [2025-09-23T19:07:33.702697] [INFO ] [MAIN ] GPN: Full history saved. [2025-09-23T19:07:33.702886] [INFO ] [MAIN ] Update Progress: 962/2372 symbols completed. GPN took 25.6s. Estimated remaining: 3h 6m 53s. Rate: 7.5 symbols/min [2025-09-23T19:07:33.809450] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-06. [2025-09-23T19:07:33.884421] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:07:33.922735] [DEBUG] [LOCAL ] GPRK: Loaded 39112 existing records from primary storage. [2025-09-23T19:07:33.922939] [INFO ] [MAIN ] GPRK: Loaded 39112 existing records. [2025-09-23T19:07:34.100455] [WARN ] [MAIN ] GPRK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:07:34.100730] [INFO ] [MAIN ] GPRK: Wiping existing primary data before full refresh. [2025-09-23T19:07:34.100785] [INFO ] [LOCAL ] GPRK: Starting deletion of primary data. [2025-09-23T19:07:34.102098] [DEBUG] [LOCAL ] GPRK: Deleted primary data file. [2025-09-23T19:07:34.102160] [INFO ] [MAIN ] GPRK: Starting full primary refresh. [2025-09-23T19:07:34.473980] [INFO ] [REMOTE ] GPRK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:07:34.499412] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-23T19:07:34.602151] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-07. [2025-09-23T19:07:35.169176] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-23T19:07:35.330367] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-23T19:07:35.402163] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-08. [2025-09-23T19:07:36.095603] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-23T19:07:36.202168] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2024-12. [2025-09-23T19:07:37.002230] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-09. [2025-09-23T19:07:37.194962] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-23T19:07:37.714495] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-23T19:07:37.717796] [INFO ] [REMOTE ] GPMT: Full fetch complete (37877 records). [2025-09-23T19:07:37.717877] [DEBUG] [VALIDATOR ] GPMT: Validating primary data. [2025-09-23T19:07:37.807402] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-02. [2025-09-23T19:07:38.091297] [DEBUG] [VALIDATOR ] GPMT: All expected trading days are present. [2025-09-23T19:07:38.091378] [DEBUG] [VALIDATOR ] GPMT: Primary data validation passed. [2025-09-23T19:07:38.091985] [INFO ] [MAIN ] GPMT: Fetched primary data is valid. [2025-09-23T19:07:38.092064] [DEBUG] [LOCAL ] GPMT: Saving primary data. [2025-09-23T19:07:38.093050] [DEBUG] [LOCAL ] GPMT: Trimmed 37877 records to 26759 (keeping 200 days of data) [2025-09-23T19:07:38.250538] [DEBUG] [LOCAL ] GPMT: Primary data saved (26759 records). [2025-09-23T19:07:38.250701] [INFO ] [MAIN ] GPMT: Full history saved. [2025-09-23T19:07:38.250799] [INFO ] [MAIN ] Update Progress: 963/2372 symbols completed. GPMT took 30.1s. Estimated remaining: 3h 6m 40s. Rate: 7.5 symbols/min [2025-09-23T19:07:38.426631] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:07:38.459150] [DEBUG] [LOCAL ] GRBK: Loaded 27108 existing records from primary storage. [2025-09-23T19:07:38.459282] [INFO ] [MAIN ] GRBK: Loaded 27108 existing records. [2025-09-23T19:07:38.607288] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-01. [2025-09-23T19:07:38.637150] [WARN ] [MAIN ] GRBK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:07:38.639502] [INFO ] [MAIN ] GRBK: Wiping existing primary data before full refresh. [2025-09-23T19:07:38.639667] [INFO ] [LOCAL ] GRBK: Starting deletion of primary data. [2025-09-23T19:07:38.640824] [DEBUG] [LOCAL ] GRBK: Deleted primary data file. [2025-09-23T19:07:38.641025] [INFO ] [MAIN ] GRBK: Starting full primary refresh. [2025-09-23T19:07:38.930864] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-23T19:07:39.032078] [INFO ] [REMOTE ] GRBK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:07:39.402199] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2024-12. [2025-09-23T19:07:39.898083] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-23T19:07:40.202237] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-03. [2025-09-23T19:07:40.379364] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-23T19:07:41.002194] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-01. [2025-09-23T19:07:41.033771] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-23T19:07:41.802199] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-07. [2025-09-23T19:07:42.082734] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-23T19:07:42.602219] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-02. [2025-09-23T19:07:43.402199] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-04. [2025-09-23T19:07:43.672046] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-23T19:07:43.701815] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-23T19:07:44.202207] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-08. [2025-09-23T19:07:44.277525] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-23T19:07:45.002195] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-05. [2025-09-23T19:07:45.573881] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-23T19:07:45.810291] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-03. [2025-09-23T19:07:45.812535] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-23T19:07:46.602213] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-02. [2025-09-23T19:07:46.763064] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-23T19:07:47.402498] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-06. [2025-09-23T19:07:47.843708] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-23T19:07:48.202191] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-04. [2025-09-23T19:07:48.445064] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-23T19:07:49.002206] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-03. [2025-09-23T19:07:49.155283] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-23T19:07:49.802220] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-07. [2025-09-23T19:07:50.539357] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-23T19:07:50.602158] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-04. [2025-09-23T19:07:50.622759] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-23T19:07:51.402185] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-05. [2025-09-23T19:07:51.719870] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-23T19:07:52.202247] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-05. [2025-09-23T19:07:52.399160] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-23T19:07:53.002219] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-06. [2025-09-23T19:07:53.362592] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-23T19:07:53.802164] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-06. [2025-09-23T19:07:53.831067] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-23T19:07:54.602252] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-07. [2025-09-23T19:07:55.402280] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-09. [2025-09-23T19:07:55.481470] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-23T19:07:55.843925] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-23T19:07:56.202268] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-07. [2025-09-23T19:07:56.905574] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-23T19:07:56.914469] [INFO ] [REMOTE ] GPK: Full fetch complete (75409 records). [2025-09-23T19:07:56.914598] [DEBUG] [VALIDATOR ] GPK: Validating primary data. [2025-09-23T19:07:57.009668] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-08. [2025-09-23T19:07:57.342192] [DEBUG] [VALIDATOR ] GPK: All expected trading days are present. [2025-09-23T19:07:57.342367] [DEBUG] [VALIDATOR ] GPK: Primary data validation passed. [2025-09-23T19:07:57.343388] [INFO ] [MAIN ] GPK: Fetched primary data is valid. [2025-09-23T19:07:57.343585] [DEBUG] [LOCAL ] GPK: Saving primary data. [2025-09-23T19:07:57.369328] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-23T19:07:57.368209] [DEBUG] [LOCAL ] GPK: Trimmed 75409 records to 52678 (keeping 200 days of data) [2025-09-23T19:07:57.733874] [DEBUG] [LOCAL ] GPK: Primary data saved (52678 records). [2025-09-23T19:07:57.734019] [INFO ] [MAIN ] GPK: Full history saved. [2025-09-23T19:07:57.734157] [INFO ] [MAIN ] Update Progress: 964/2372 symbols completed. GPK took 49.6s. Estimated remaining: 3h 6m 49s. Rate: 7.5 symbols/min [2025-09-23T19:07:57.808921] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-08. [2025-09-23T19:07:57.913178] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:07:57.924573] [DEBUG] [LOCAL ] GRC: Loaded 8788 existing records from primary storage. [2025-09-23T19:07:57.924727] [INFO ] [MAIN ] GRC: Loaded 8788 existing records. [2025-09-23T19:07:58.133458] [WARN ] [MAIN ] GRC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:07:58.133847] [INFO ] [MAIN ] GRC: Wiping existing primary data before full refresh. [2025-09-23T19:07:58.133983] [INFO ] [LOCAL ] GRC: Starting deletion of primary data. [2025-09-23T19:07:58.134485] [DEBUG] [LOCAL ] GRC: Deleted primary data file. [2025-09-23T19:07:58.134562] [INFO ] [MAIN ] GRC: Starting full primary refresh. [2025-09-23T19:07:58.448413] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-23T19:07:58.559924] [INFO ] [REMOTE ] GRC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:07:58.602159] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-09. [2025-09-23T19:07:58.629419] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-23T19:07:59.402254] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-09. [2025-09-23T19:07:59.599060] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-23T19:07:59.603708] [INFO ] [REMOTE ] GRBK: Full fetch complete (40713 records). [2025-09-23T19:07:59.603847] [DEBUG] [VALIDATOR ] GRBK: Validating primary data. [2025-09-23T19:07:59.992829] [DEBUG] [VALIDATOR ] GRBK: All expected trading days are present. [2025-09-23T19:07:59.992913] [DEBUG] [VALIDATOR ] GRBK: Primary data validation passed. [2025-09-23T19:07:59.993561] [INFO ] [MAIN ] GRBK: Fetched primary data is valid. [2025-09-23T19:07:59.993623] [DEBUG] [LOCAL ] GRBK: Saving primary data. [2025-09-23T19:07:59.994559] [DEBUG] [LOCAL ] GRBK: Trimmed 40713 records to 27075 (keeping 200 days of data) [2025-09-23T19:08:00.164418] [DEBUG] [LOCAL ] GRBK: Primary data saved (27075 records). [2025-09-23T19:08:00.164740] [INFO ] [MAIN ] GRBK: Full history saved. [2025-09-23T19:08:00.165035] [INFO ] [MAIN ] Update Progress: 965/2372 symbols completed. GRBK took 21.9s. Estimated remaining: 3h 6m 33s. Rate: 7.5 symbols/min [2025-09-23T19:08:00.211010] [INFO ] [REMOTE ] GRC: Fetching primary data for 2024-12. [2025-09-23T19:08:00.364574] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:08:00.397712] [DEBUG] [LOCAL ] GRDN: Loaded 19640 existing records from primary storage. [2025-09-23T19:08:00.397897] [INFO ] [MAIN ] GRDN: Loaded 19640 existing records. [2025-09-23T19:08:00.591679] [WARN ] [MAIN ] GRDN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:08:00.592028] [INFO ] [MAIN ] GRDN: Wiping existing primary data before full refresh. [2025-09-23T19:08:00.592090] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-09-23T19:08:00.593002] [DEBUG] [LOCAL ] GRDN: Deleted primary data file. [2025-09-23T19:08:00.593092] [INFO ] [MAIN ] GRDN: Starting full primary refresh. [2025-09-23T19:08:00.908917] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-23T19:08:00.978181] [INFO ] [REMOTE ] GPOR: Full fetch complete (34985 records). [2025-09-23T19:08:01.025990] [INFO ] [REMOTE ] GRDN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:08:01.022177] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-23T19:08:01.021097] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-08. [2025-09-23T19:08:01.028083] [DEBUG] [VALIDATOR ] GPOR: Validating primary data. [2025-09-23T19:08:01.464439] [DEBUG] [VALIDATOR ] GPOR: All expected trading days are present. [2025-09-23T19:08:01.464523] [DEBUG] [VALIDATOR ] GPOR: Primary data validation passed. [2025-09-23T19:08:01.465185] [INFO ] [MAIN ] GPOR: Fetched primary data is valid. [2025-09-23T19:08:01.465248] [DEBUG] [LOCAL ] GPOR: Saving primary data. [2025-09-23T19:08:01.466164] [DEBUG] [LOCAL ] GPOR: Trimmed 34985 records to 22959 (keeping 200 days of data) [2025-09-23T19:08:01.627462] [DEBUG] [LOCAL ] GPOR: Primary data saved (22959 records). [2025-09-23T19:08:01.627629] [INFO ] [MAIN ] GPOR: Full history saved. [2025-09-23T19:08:01.627833] [INFO ] [MAIN ] Update Progress: 966/2372 symbols completed. GPOR took 32.5s. Estimated remaining: 3h 6m 16s. Rate: 7.5 symbols/min [2025-09-23T19:08:01.811303] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:08:01.807318] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2024-12. [2025-09-23T19:08:01.870748] [DEBUG] [LOCAL ] GRMN: Loaded 41568 existing records from primary storage. [2025-09-23T19:08:01.870908] [INFO ] [MAIN ] GRMN: Loaded 41568 existing records. [2025-09-23T19:08:02.084174] [WARN ] [MAIN ] GRMN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:08:02.084668] [INFO ] [MAIN ] GRMN: Wiping existing primary data before full refresh. [2025-09-23T19:08:02.084777] [INFO ] [LOCAL ] GRMN: Starting deletion of primary data. [2025-09-23T19:08:02.086863] [DEBUG] [LOCAL ] GRMN: Deleted primary data file. [2025-09-23T19:08:02.087013] [INFO ] [MAIN ] GRMN: Starting full primary refresh. [2025-09-23T19:08:02.275848] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-23T19:08:02.575684] [INFO ] [REMOTE ] GRMN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:08:02.602462] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-23T19:08:02.602542] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2024-12. [2025-09-23T19:08:03.402216] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-09. [2025-09-23T19:08:03.801669] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-23T19:08:04.202202] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-01. [2025-09-23T19:08:04.936798] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-23T19:08:04.943976] [INFO ] [REMOTE ] GPRK: Full fetch complete (57185 records). [2025-09-23T19:08:04.944108] [DEBUG] [VALIDATOR ] GPRK: Validating primary data. [2025-09-23T19:08:05.009703] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-01. [2025-09-23T19:08:05.353408] [DEBUG] [VALIDATOR ] GPRK: All expected trading days are present. [2025-09-23T19:08:05.353497] [DEBUG] [VALIDATOR ] GPRK: Primary data validation passed. [2025-09-23T19:08:05.354338] [INFO ] [MAIN ] GPRK: Fetched primary data is valid. [2025-09-23T19:08:05.354417] [DEBUG] [LOCAL ] GPRK: Saving primary data. [2025-09-23T19:08:05.358346] [DEBUG] [LOCAL ] GPRK: Trimmed 57185 records to 39112 (keeping 200 days of data) [2025-09-23T19:08:05.627481] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-23T19:08:05.630426] [DEBUG] [LOCAL ] GPRK: Primary data saved (39112 records). [2025-09-23T19:08:05.639421] [INFO ] [MAIN ] GPRK: Full history saved. [2025-09-23T19:08:05.640063] [INFO ] [MAIN ] Update Progress: 967/2372 symbols completed. GPRK took 31.9s. Estimated remaining: 3h 6m 2s. Rate: 7.6 symbols/min [2025-09-23T19:08:05.723009] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-23T19:08:05.807301] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-01. [2025-09-23T19:08:05.835294] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:08:05.888486] [DEBUG] [LOCAL ] GRND: Loaded 50065 existing records from primary storage. [2025-09-23T19:08:05.888830] [INFO ] [MAIN ] GRND: Loaded 50065 existing records. [2025-09-23T19:08:06.071903] [WARN ] [MAIN ] GRND: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:08:06.072232] [INFO ] [MAIN ] GRND: Wiping existing primary data before full refresh. [2025-09-23T19:08:06.072329] [INFO ] [LOCAL ] GRND: Starting deletion of primary data. [2025-09-23T19:08:06.073855] [DEBUG] [LOCAL ] GRND: Deleted primary data file. [2025-09-23T19:08:06.073918] [INFO ] [MAIN ] GRND: Starting full primary refresh. [2025-09-23T19:08:06.440275] [INFO ] [REMOTE ] GRND: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:08:06.463976] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-23T19:08:06.602224] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-02. [2025-09-23T19:08:07.101066] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-23T19:08:07.402274] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-03. [2025-09-23T19:08:07.870959] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-23T19:08:08.202209] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-04. [2025-09-23T19:08:08.808578] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-23T19:08:09.002263] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-05. [2025-09-23T19:08:09.471818] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-23T19:08:09.802220] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-06. [2025-09-23T19:08:10.311269] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-23T19:08:10.602220] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-07. [2025-09-23T19:08:11.386350] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-23T19:08:11.402146] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-08. [2025-09-23T19:08:11.909821] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-23T19:08:12.202213] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-09. [2025-09-23T19:08:12.753303] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-23T19:08:12.755590] [INFO ] [REMOTE ] GRC: Full fetch complete (13047 records). [2025-09-23T19:08:12.755689] [DEBUG] [VALIDATOR ] GRC: Validating primary data. [2025-09-23T19:08:13.007490] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-02. [2025-09-23T19:08:13.117118] [DEBUG] [VALIDATOR ] GRC: All expected trading days are present. [2025-09-23T19:08:13.117215] [DEBUG] [VALIDATOR ] GRC: Primary data validation passed. [2025-09-23T19:08:13.117613] [INFO ] [MAIN ] GRC: Fetched primary data is valid. [2025-09-23T19:08:13.117684] [DEBUG] [LOCAL ] GRC: Saving primary data. [2025-09-23T19:08:13.118194] [DEBUG] [LOCAL ] GRC: Trimmed 13047 records to 8886 (keeping 200 days of data) [2025-09-23T19:08:13.172389] [DEBUG] [LOCAL ] GRC: Primary data saved (8886 records). [2025-09-23T19:08:13.172536] [INFO ] [MAIN ] GRC: Full history saved. [2025-09-23T19:08:13.172629] [INFO ] [MAIN ] Update Progress: 968/2372 symbols completed. GRC took 15.4s. Estimated remaining: 3h 5m 54s. Rate: 7.6 symbols/min [2025-09-23T19:08:13.338180] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:08:13.373270] [DEBUG] [LOCAL ] GRNT: Loaded 33861 existing records from primary storage. [2025-09-23T19:08:13.373419] [INFO ] [MAIN ] GRNT: Loaded 33861 existing records. [2025-09-23T19:08:13.556421] [WARN ] [MAIN ] GRNT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:08:13.556738] [INFO ] [MAIN ] GRNT: Wiping existing primary data before full refresh. [2025-09-23T19:08:13.556794] [INFO ] [LOCAL ] GRNT: Starting deletion of primary data. [2025-09-23T19:08:13.557888] [DEBUG] [LOCAL ] GRNT: Deleted primary data file. [2025-09-23T19:08:13.557949] [INFO ] [MAIN ] GRNT: Starting full primary refresh. [2025-09-23T19:08:13.808966] [INFO ] [REMOTE ] GRND: Fetching primary data for 2024-12. [2025-09-23T19:08:13.913628] [INFO ] [REMOTE ] GRNT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:08:14.274993] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-23T19:08:14.602195] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2024-12. [2025-09-23T19:08:15.079293] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-23T19:08:15.402265] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-01. [2025-09-23T19:08:15.583576] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-23T19:08:16.202225] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-03. [2025-09-23T19:08:16.747209] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-23T19:08:17.002223] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-02. [2025-09-23T19:08:17.481535] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-23T19:08:17.618459] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-23T19:08:17.802258] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-03. [2025-09-23T19:08:18.424453] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-23T19:08:18.602222] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-04. [2025-09-23T19:08:19.214839] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-23T19:08:19.402225] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-04. [2025-09-23T19:08:20.202214] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-05. [2025-09-23T19:08:20.792391] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-23T19:08:21.002177] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-01. [2025-09-23T19:08:21.276356] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-23T19:08:21.802238] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-06. [2025-09-23T19:08:22.305090] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-23T19:08:22.487189] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-23T19:08:22.602200] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-02. [2025-09-23T19:08:23.402231] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-07. [2025-09-23T19:08:23.474895] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-23T19:08:24.116237] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-23T19:08:24.202219] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-08. [2025-09-23T19:08:25.002200] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-02. [2025-09-23T19:08:25.218261] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-23T19:08:25.802268] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-09. [2025-09-23T19:08:26.198875] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-23T19:08:26.602220] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-05. [2025-09-23T19:08:26.774819] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-23T19:08:26.781060] [INFO ] [REMOTE ] GRDN: Full fetch complete (25893 records). [2025-09-23T19:08:26.781272] [DEBUG] [VALIDATOR ] GRDN: Validating primary data. [2025-09-23T19:08:27.179156] [DEBUG] [VALIDATOR ] GRDN: All expected trading days are present. [2025-09-23T19:08:27.179253] [DEBUG] [VALIDATOR ] GRDN: Primary data validation passed. [2025-09-23T19:08:27.179842] [INFO ] [MAIN ] GRDN: Fetched primary data is valid. [2025-09-23T19:08:27.179906] [DEBUG] [LOCAL ] GRDN: Saving primary data. [2025-09-23T19:08:27.180804] [DEBUG] [LOCAL ] GRDN: Trimmed 25893 records to 19693 (keeping 200 days of data) [2025-09-23T19:08:27.308010] [DEBUG] [LOCAL ] GRDN: Primary data saved (19693 records). [2025-09-23T19:08:27.308152] [INFO ] [MAIN ] GRDN: Full history saved. [2025-09-23T19:08:27.308238] [INFO ] [MAIN ] Update Progress: 969/2372 symbols completed. GRDN took 27.1s. Estimated remaining: 3h 5m 55s. Rate: 7.5 symbols/min [2025-09-23T19:08:27.409435] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-03. [2025-09-23T19:08:27.497950] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:08:27.509407] [DEBUG] [LOCAL ] GROV: Loaded 9089 existing records from primary storage. [2025-09-23T19:08:27.509527] [INFO ] [MAIN ] GROV: Loaded 9089 existing records. [2025-09-23T19:08:27.689479] [WARN ] [MAIN ] GROV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:08:27.689773] [INFO ] [MAIN ] GROV: Wiping existing primary data before full refresh. [2025-09-23T19:08:27.689847] [INFO ] [LOCAL ] GROV: Starting deletion of primary data. [2025-09-23T19:08:27.690343] [DEBUG] [LOCAL ] GROV: Deleted primary data file. [2025-09-23T19:08:27.690404] [INFO ] [MAIN ] GROV: Starting full primary refresh. [2025-09-23T19:08:28.089489] [INFO ] [REMOTE ] GROV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:08:28.141135] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-23T19:08:28.202208] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-03. [2025-09-23T19:08:28.806569] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-23T19:08:29.002226] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-06. [2025-09-23T19:08:29.247507] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-23T19:08:29.802289] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-04. [2025-09-23T19:08:30.124118] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-23T19:08:30.602225] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-04. [2025-09-23T19:08:31.142513] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-23T19:08:31.402198] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-07. [2025-09-23T19:08:31.571058] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-23T19:08:32.202230] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-05. [2025-09-23T19:08:32.704333] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-23T19:08:33.007352] [INFO ] [REMOTE ] GROV: Fetching primary data for 2024-12. [2025-09-23T19:08:33.018794] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-23T19:08:33.659555] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-23T19:08:33.802215] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-01. [2025-09-23T19:08:34.410832] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-23T19:08:34.602229] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-08. [2025-09-23T19:08:35.402212] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-05. [2025-09-23T19:08:36.202200] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-02. [2025-09-23T19:08:36.268293] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-23T19:08:36.702526] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-23T19:08:36.859852] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-23T19:08:37.002159] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-06. [2025-09-23T19:08:37.802242] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-03. [2025-09-23T19:08:38.207924] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-23T19:08:38.361762] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-23T19:08:38.602259] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-07. [2025-09-23T19:08:39.402195] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-09. [2025-09-23T19:08:39.919585] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-23T19:08:40.202243] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-06. [2025-09-23T19:08:40.581686] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-23T19:08:40.588940] [INFO ] [REMOTE ] GRMN: Full fetch complete (60267 records). [2025-09-23T19:08:40.589142] [DEBUG] [VALIDATOR ] GRMN: Validating primary data. [2025-09-23T19:08:40.990795] [DEBUG] [VALIDATOR ] GRMN: All expected trading days are present. [2025-09-23T19:08:40.990940] [DEBUG] [VALIDATOR ] GRMN: Primary data validation passed. [2025-09-23T19:08:40.991910] [INFO ] [MAIN ] GRMN: Fetched primary data is valid. [2025-09-23T19:08:40.991984] [DEBUG] [LOCAL ] GRMN: Saving primary data. [2025-09-23T19:08:40.993469] [DEBUG] [LOCAL ] GRMN: Trimmed 60267 records to 41489 (keeping 200 days of data) [2025-09-23T19:08:41.054112] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-04. [2025-09-23T19:08:41.264679] [DEBUG] [LOCAL ] GRMN: Primary data saved (41489 records). [2025-09-23T19:08:41.264827] [INFO ] [MAIN ] GRMN: Full history saved. [2025-09-23T19:08:41.264914] [INFO ] [MAIN ] Update Progress: 970/2372 symbols completed. GRMN took 39.6s. Estimated remaining: 3h 5m 55s. Rate: 7.5 symbols/min [2025-09-23T19:08:41.439552] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:08:41.446161] [DEBUG] [LOCAL ] GRX: Loaded 4423 existing records from primary storage. [2025-09-23T19:08:41.446273] [INFO ] [MAIN ] GRX: Loaded 4423 existing records. [2025-09-23T19:08:41.638340] [WARN ] [MAIN ] GRX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:08:41.638845] [INFO ] [MAIN ] GRX: Wiping existing primary data before full refresh. [2025-09-23T19:08:41.638920] [INFO ] [LOCAL ] GRX: Starting deletion of primary data. [2025-09-23T19:08:41.639262] [DEBUG] [LOCAL ] GRX: Deleted primary data file. [2025-09-23T19:08:41.639328] [INFO ] [MAIN ] GRX: Starting full primary refresh. [2025-09-23T19:08:41.850477] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-23T19:08:41.842248] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-08. [2025-09-23T19:08:41.901504] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-23T19:08:42.129761] [INFO ] [REMOTE ] GRX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:08:42.602188] [INFO ] [REMOTE ] GRX: Fetching primary data for 2024-12. [2025-09-23T19:08:43.051483] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-23T19:08:43.402185] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-07. [2025-09-23T19:08:43.577633] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-23T19:08:44.202189] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-09. [2025-09-23T19:08:44.489975] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-23T19:08:45.002200] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-05. [2025-09-23T19:08:45.498125] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-23T19:08:45.802223] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-06. [2025-09-23T19:08:45.853638] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-23T19:08:45.862159] [INFO ] [REMOTE ] GRND: Full fetch complete (70230 records). [2025-09-23T19:08:45.862324] [DEBUG] [VALIDATOR ] GRND: Validating primary data. [2025-09-23T19:08:46.253062] [DEBUG] [VALIDATOR ] GRND: All expected trading days are present. [2025-09-23T19:08:46.253161] [DEBUG] [VALIDATOR ] GRND: Primary data validation passed. [2025-09-23T19:08:46.254057] [INFO ] [MAIN ] GRND: Fetched primary data is valid. [2025-09-23T19:08:46.254125] [DEBUG] [LOCAL ] GRND: Saving primary data. [2025-09-23T19:08:46.255606] [DEBUG] [LOCAL ] GRND: Trimmed 70230 records to 50047 (keeping 200 days of data) [2025-09-23T19:08:46.387749] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-23T19:08:46.564266] [DEBUG] [LOCAL ] GRND: Primary data saved (50047 records). [2025-09-23T19:08:46.564412] [INFO ] [MAIN ] GRND: Full history saved. [2025-09-23T19:08:46.564499] [INFO ] [MAIN ] Update Progress: 971/2372 symbols completed. GRND took 40.9s. Estimated remaining: 3h 5m 44s. Rate: 7.5 symbols/min [2025-09-23T19:08:46.607363] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-01. [2025-09-23T19:08:46.743635] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:08:46.796289] [DEBUG] [LOCAL ] GS: Loaded 52088 existing records from primary storage. [2025-09-23T19:08:46.796432] [INFO ] [MAIN ] GS: Loaded 52088 existing records. [2025-09-23T19:08:46.973326] [WARN ] [MAIN ] GS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:08:46.973597] [INFO ] [MAIN ] GS: Wiping existing primary data before full refresh. [2025-09-23T19:08:46.973666] [INFO ] [LOCAL ] GS: Starting deletion of primary data. [2025-09-23T19:08:46.974993] [DEBUG] [LOCAL ] GS: Deleted primary data file. [2025-09-23T19:08:46.975059] [INFO ] [MAIN ] GS: Starting full primary refresh. [2025-09-23T19:08:47.225149] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-23T19:08:47.341720] [INFO ] [REMOTE ] GS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:08:47.402143] [INFO ] [REMOTE ] GS: Fetching primary data for 2024-12. [2025-09-23T19:08:48.202208] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-07. [2025-09-23T19:08:48.829476] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-23T19:08:49.002169] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-08. [2025-09-23T19:08:49.068228] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-23T19:08:49.520744] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-23T19:08:49.802191] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-08. [2025-09-23T19:08:50.602196] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-01. [2025-09-23T19:08:50.876208] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-23T19:08:51.402208] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-09. [2025-09-23T19:08:51.871686] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-23T19:08:51.873589] [INFO ] [REMOTE ] GROV: Full fetch complete (14615 records). [2025-09-23T19:08:51.873770] [DEBUG] [VALIDATOR ] GROV: Validating primary data. [2025-09-23T19:08:52.207330] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-02. [2025-09-23T19:08:52.265272] [DEBUG] [VALIDATOR ] GROV: All expected trading days are present. [2025-09-23T19:08:52.265465] [DEBUG] [VALIDATOR ] GROV: Primary data validation passed. [2025-09-23T19:08:52.266055] [INFO ] [MAIN ] GROV: Fetched primary data is valid. [2025-09-23T19:08:52.266217] [DEBUG] [LOCAL ] GROV: Saving primary data. [2025-09-23T19:08:52.267194] [DEBUG] [LOCAL ] GROV: Trimmed 14615 records to 9074 (keeping 200 days of data) [2025-09-23T19:08:52.321432] [DEBUG] [LOCAL ] GROV: Primary data saved (9074 records). [2025-09-23T19:08:52.321581] [INFO ] [MAIN ] GROV: Full history saved. [2025-09-23T19:08:52.321705] [INFO ] [MAIN ] Update Progress: 972/2372 symbols completed. GROV took 25.0s. Estimated remaining: 3h 5m 32s. Rate: 7.5 symbols/min [2025-09-23T19:08:52.496450] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:08:52.525754] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-23T19:08:52.574803] [DEBUG] [LOCAL ] GSBD: Loaded 39134 existing records from primary storage. [2025-09-23T19:08:52.574971] [INFO ] [MAIN ] GSBD: Loaded 39134 existing records. [2025-09-23T19:08:52.679245] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-23T19:08:52.760499] [WARN ] [MAIN ] GSBD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:08:52.760794] [INFO ] [MAIN ] GSBD: Wiping existing primary data before full refresh. [2025-09-23T19:08:52.760847] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-09-23T19:08:52.761856] [DEBUG] [LOCAL ] GSBD: Deleted primary data file. [2025-09-23T19:08:52.761917] [INFO ] [MAIN ] GSBD: Starting full primary refresh. [2025-09-23T19:08:53.007757] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-09. [2025-09-23T19:08:53.127162] [INFO ] [REMOTE ] GSBD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:08:53.802205] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-03. [2025-09-23T19:08:54.134258] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-23T19:08:54.140133] [INFO ] [REMOTE ] GRNT: Full fetch complete (48462 records). [2025-09-23T19:08:54.140238] [DEBUG] [VALIDATOR ] GRNT: Validating primary data. [2025-09-23T19:08:54.422806] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-23T19:08:54.537313] [DEBUG] [VALIDATOR ] GRNT: All expected trading days are present. [2025-09-23T19:08:54.537409] [DEBUG] [VALIDATOR ] GRNT: Primary data validation passed. [2025-09-23T19:08:54.538102] [INFO ] [MAIN ] GRNT: Fetched primary data is valid. [2025-09-23T19:08:54.538164] [DEBUG] [LOCAL ] GRNT: Saving primary data. [2025-09-23T19:08:54.539252] [DEBUG] [LOCAL ] GRNT: Trimmed 48462 records to 33785 (keeping 200 days of data) [2025-09-23T19:08:54.620821] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-02. [2025-09-23T19:08:54.738619] [DEBUG] [LOCAL ] GRNT: Primary data saved (33785 records). [2025-09-23T19:08:54.738826] [INFO ] [MAIN ] GRNT: Full history saved. [2025-09-23T19:08:54.738960] [INFO ] [MAIN ] Update Progress: 973/2372 symbols completed. GRNT took 41.6s. Estimated remaining: 3h 5m 17s. Rate: 7.6 symbols/min [2025-09-23T19:08:54.917814] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:08:54.970340] [DEBUG] [LOCAL ] GSK: Loaded 53495 existing records from primary storage. [2025-09-23T19:08:54.970504] [INFO ] [MAIN ] GSK: Loaded 53495 existing records. [2025-09-23T19:08:55.150105] [WARN ] [MAIN ] GSK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:08:55.150405] [INFO ] [MAIN ] GSK: Wiping existing primary data before full refresh. [2025-09-23T19:08:55.150458] [INFO ] [LOCAL ] GSK: Starting deletion of primary data. [2025-09-23T19:08:55.152070] [DEBUG] [LOCAL ] GSK: Deleted primary data file. [2025-09-23T19:08:55.152130] [INFO ] [MAIN ] GSK: Starting full primary refresh. [2025-09-23T19:08:55.407364] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-04. [2025-09-23T19:08:55.520704] [INFO ] [REMOTE ] GSK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:08:55.827614] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-23T19:08:56.202214] [INFO ] [REMOTE ] GSK: Fetching primary data for 2024-12. [2025-09-23T19:08:56.307269] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-23T19:08:57.002249] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-03. [2025-09-23T19:08:57.789858] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-23T19:08:57.805088] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-05. [2025-09-23T19:08:58.153970] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-23T19:08:58.602195] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2024-12. [2025-09-23T19:08:58.843717] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-23T19:08:59.402221] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-04. [2025-09-23T19:08:59.895283] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-23T19:09:00.202224] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-06. [2025-09-23T19:09:00.783233] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-23T19:09:01.002237] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-01. [2025-09-23T19:09:01.512713] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-23T19:09:01.802219] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-07. [2025-09-23T19:09:02.602290] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-01. [2025-09-23T19:09:02.730707] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-23T19:09:03.009513] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-23T19:09:03.402316] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-02. [2025-09-23T19:09:04.202235] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-08. [2025-09-23T19:09:05.002358] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-05. [2025-09-23T19:09:05.036191] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-23T19:09:05.140950] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-23T19:09:05.802277] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-03. [2025-09-23T19:09:06.059703] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-01 (3.46 seconds). [2025-09-23T19:09:06.602299] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-09. [2025-09-23T19:09:06.890997] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-23T19:09:07.402199] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-06. [2025-09-23T19:09:07.451271] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-23T19:09:07.453219] [INFO ] [REMOTE ] GRX: Full fetch complete (6403 records). [2025-09-23T19:09:07.453399] [DEBUG] [VALIDATOR ] GRX: Validating primary data. [2025-09-23T19:09:07.661136] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-23T19:09:07.887244] [DEBUG] [VALIDATOR ] GRX: All expected trading days are present. [2025-09-23T19:09:07.887420] [DEBUG] [VALIDATOR ] GRX: Primary data validation passed. [2025-09-23T19:09:07.887715] [INFO ] [MAIN ] GRX: Fetched primary data is valid. [2025-09-23T19:09:07.887779] [DEBUG] [LOCAL ] GRX: Saving primary data. [2025-09-23T19:09:07.888181] [DEBUG] [LOCAL ] GRX: Trimmed 6403 records to 4444 (keeping 200 days of data) [2025-09-23T19:09:07.921349] [DEBUG] [LOCAL ] GRX: Primary data saved (4444 records). [2025-09-23T19:09:07.921504] [INFO ] [MAIN ] GRX: Full history saved. [2025-09-23T19:09:07.921609] [INFO ] [MAIN ] Update Progress: 974/2372 symbols completed. GRX took 26.7s. Estimated remaining: 3h 5m 16s. Rate: 7.5 symbols/min [2025-09-23T19:09:08.099566] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:09:08.137508] [DEBUG] [LOCAL ] GSL: Loaded 33677 existing records from primary storage. [2025-09-23T19:09:08.137684] [INFO ] [MAIN ] GSL: Loaded 33677 existing records. [2025-09-23T19:09:08.211357] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-02. [2025-09-23T19:09:08.339901] [WARN ] [MAIN ] GSL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:09:08.340196] [INFO ] [MAIN ] GSL: Wiping existing primary data before full refresh. [2025-09-23T19:09:08.340248] [INFO ] [LOCAL ] GSL: Starting deletion of primary data. [2025-09-23T19:09:08.341184] [DEBUG] [LOCAL ] GSL: Deleted primary data file. [2025-09-23T19:09:08.341247] [INFO ] [MAIN ] GSL: Starting full primary refresh. [2025-09-23T19:09:08.710683] [INFO ] [REMOTE ] GSL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:09:09.002210] [INFO ] [REMOTE ] GSL: Fetching primary data for 2024-12. [2025-09-23T19:09:09.127128] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-23T19:09:09.692570] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-23T19:09:09.802197] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-04. [2025-09-23T19:09:09.986139] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-23T19:09:10.602205] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-03. [2025-09-23T19:09:11.402229] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-07. [2025-09-23T19:09:11.434988] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-23T19:09:12.202220] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-05. [2025-09-23T19:09:12.587213] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-23T19:09:13.002215] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-01. [2025-09-23T19:09:13.220693] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-23T19:09:13.328933] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-23T19:09:13.802242] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-08. [2025-09-23T19:09:14.339397] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-23T19:09:14.602219] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-02. [2025-09-23T19:09:15.402241] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-06. [2025-09-23T19:09:15.696889] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-23T19:09:16.167980] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-23T19:09:16.202151] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-03. [2025-09-23T19:09:16.410745] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-23T19:09:17.002174] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-07. [2025-09-23T19:09:17.235005] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-23T19:09:17.802254] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-09. [2025-09-23T19:09:18.091365] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-23T19:09:18.602270] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-04. [2025-09-23T19:09:19.402225] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-04. [2025-09-23T19:09:19.509574] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-23T19:09:19.518703] [INFO ] [REMOTE ] GS: Full fetch complete (75845 records). [2025-09-23T19:09:19.518873] [DEBUG] [VALIDATOR ] GS: Validating primary data. [2025-09-23T19:09:19.924275] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-23T19:09:19.955281] [DEBUG] [VALIDATOR ] GS: All expected trading days are present. [2025-09-23T19:09:19.955721] [DEBUG] [VALIDATOR ] GS: Primary data validation passed. [2025-09-23T19:09:19.956620] [INFO ] [MAIN ] GS: Fetched primary data is valid. [2025-09-23T19:09:19.956706] [DEBUG] [LOCAL ] GS: Saving primary data. [2025-09-23T19:09:19.958140] [DEBUG] [LOCAL ] GS: Trimmed 75845 records to 52068 (keeping 200 days of data) [2025-09-23T19:09:20.202275] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-08. [2025-09-23T19:09:20.290272] [DEBUG] [LOCAL ] GS: Primary data saved (52068 records). [2025-09-23T19:09:20.290404] [INFO ] [MAIN ] GS: Full history saved. [2025-09-23T19:09:20.290481] [INFO ] [MAIN ] Update Progress: 975/2372 symbols completed. GS took 33.7s. Estimated remaining: 3h 5m 14s. Rate: 7.5 symbols/min [2025-09-23T19:09:20.459199] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:09:20.511000] [DEBUG] [LOCAL ] GTES: Loaded 50703 existing records from primary storage. [2025-09-23T19:09:20.511154] [INFO ] [MAIN ] GTES: Loaded 50703 existing records. [2025-09-23T19:09:20.693768] [WARN ] [MAIN ] GTES: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:09:20.694028] [INFO ] [MAIN ] GTES: Wiping existing primary data before full refresh. [2025-09-23T19:09:20.694078] [INFO ] [LOCAL ] GTES: Starting deletion of primary data. [2025-09-23T19:09:20.695465] [DEBUG] [LOCAL ] GTES: Deleted primary data file. [2025-09-23T19:09:20.695525] [INFO ] [MAIN ] GTES: Starting full primary refresh. [2025-09-23T19:09:21.005795] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-05. [2025-09-23T19:09:21.072632] [INFO ] [REMOTE ] GTES: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:09:21.162168] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-23T19:09:21.699935] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-23T19:09:21.802205] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-09. [2025-09-23T19:09:22.070205] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-23T19:09:22.602215] [INFO ] [REMOTE ] GTES: Fetching primary data for 2024-12. [2025-09-23T19:09:22.933763] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-23T19:09:22.940222] [INFO ] [REMOTE ] GSBD: Full fetch complete (58419 records). [2025-09-23T19:09:22.940320] [DEBUG] [VALIDATOR ] GSBD: Validating primary data. [2025-09-23T19:09:23.336400] [DEBUG] [VALIDATOR ] GSBD: All expected trading days are present. [2025-09-23T19:09:23.336479] [DEBUG] [VALIDATOR ] GSBD: Primary data validation passed. [2025-09-23T19:09:23.337235] [INFO ] [MAIN ] GSBD: Fetched primary data is valid. [2025-09-23T19:09:23.337297] [DEBUG] [LOCAL ] GSBD: Saving primary data. [2025-09-23T19:09:23.338427] [DEBUG] [LOCAL ] GSBD: Trimmed 58419 records to 39136 (keeping 200 days of data) [2025-09-23T19:09:23.402485] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-05. [2025-09-23T19:09:23.580239] [DEBUG] [LOCAL ] GSBD: Primary data saved (39136 records). [2025-09-23T19:09:23.580390] [INFO ] [MAIN ] GSBD: Full history saved. [2025-09-23T19:09:23.580477] [INFO ] [MAIN ] Update Progress: 976/2372 symbols completed. GSBD took 31.3s. Estimated remaining: 3h 4m 60s. Rate: 7.5 symbols/min [2025-09-23T19:09:23.753550] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:09:23.798571] [DEBUG] [LOCAL ] GTLS: Loaded 43065 existing records from primary storage. [2025-09-23T19:09:23.798751] [INFO ] [MAIN ] GTLS: Loaded 43065 existing records. [2025-09-23T19:09:23.981161] [WARN ] [MAIN ] GTLS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:09:23.981534] [INFO ] [MAIN ] GTLS: Wiping existing primary data before full refresh. [2025-09-23T19:09:23.981612] [INFO ] [LOCAL ] GTLS: Starting deletion of primary data. [2025-09-23T19:09:23.982459] [DEBUG] [LOCAL ] GTLS: Deleted primary data file. [2025-09-23T19:09:23.982519] [INFO ] [MAIN ] GTLS: Starting full primary refresh. [2025-09-23T19:09:24.170471] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-23T19:09:24.213708] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-06. [2025-09-23T19:09:24.385570] [INFO ] [REMOTE ] GTLS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:09:24.971458] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-23T19:09:25.002148] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-06. [2025-09-23T19:09:25.242587] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-23T19:09:25.802242] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2024-12. [2025-09-23T19:09:26.602255] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-07. [2025-09-23T19:09:27.402261] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-01. [2025-09-23T19:09:27.819208] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-06 (2.82 seconds). [2025-09-23T19:09:28.202162] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-07. [2025-09-23T19:09:28.320385] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2024-12 (2.52 seconds). [2025-09-23T19:09:28.321584] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-23T19:09:28.772469] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-23T19:09:29.002269] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-01. [2025-09-23T19:09:29.796922] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-23T19:09:29.807458] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-08. [2025-09-23T19:09:30.314507] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-23T19:09:30.602274] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-02. [2025-09-23T19:09:30.813903] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-23T19:09:31.402268] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-09. [2025-09-23T19:09:32.047102] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-23T19:09:32.202193] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-02. [2025-09-23T19:09:32.391918] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-23T19:09:32.398164] [INFO ] [REMOTE ] GSL: Full fetch complete (48022 records). [2025-09-23T19:09:32.398291] [DEBUG] [VALIDATOR ] GSL: Validating primary data. [2025-09-23T19:09:32.794368] [DEBUG] [VALIDATOR ] GSL: All expected trading days are present. [2025-09-23T19:09:32.794464] [DEBUG] [VALIDATOR ] GSL: Primary data validation passed. [2025-09-23T19:09:32.795292] [INFO ] [MAIN ] GSL: Fetched primary data is valid. [2025-09-23T19:09:32.795357] [DEBUG] [LOCAL ] GSL: Saving primary data. [2025-09-23T19:09:32.797107] [DEBUG] [LOCAL ] GSL: Trimmed 48022 records to 33536 (keeping 200 days of data) [2025-09-23T19:09:33.001100] [DEBUG] [LOCAL ] GSL: Primary data saved (33536 records). [2025-09-23T19:09:33.001242] [INFO ] [MAIN ] GSL: Full history saved. [2025-09-23T19:09:33.001329] [INFO ] [MAIN ] Update Progress: 977/2372 symbols completed. GSL took 25.1s. Estimated remaining: 3h 4m 54s. Rate: 7.5 symbols/min [2025-09-23T19:09:33.013098] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-08. [2025-09-23T19:09:33.178990] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:09:33.222596] [DEBUG] [LOCAL ] GTN: Loaded 45674 existing records from primary storage. [2025-09-23T19:09:33.222798] [INFO ] [MAIN ] GTN: Loaded 45674 existing records. [2025-09-23T19:09:33.407864] [WARN ] [MAIN ] GTN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:09:33.408298] [INFO ] [MAIN ] GTN: Wiping existing primary data before full refresh. [2025-09-23T19:09:33.408372] [INFO ] [LOCAL ] GTN: Starting deletion of primary data. [2025-09-23T19:09:33.409418] [DEBUG] [LOCAL ] GTN: Deleted primary data file. [2025-09-23T19:09:33.409480] [INFO ] [MAIN ] GTN: Starting full primary refresh. [2025-09-23T19:09:33.656360] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-23T19:09:33.807314] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-03. [2025-09-23T19:09:33.860302] [INFO ] [REMOTE ] GTN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:09:34.602156] [INFO ] [REMOTE ] GTN: Fetching primary data for 2024-12. [2025-09-23T19:09:34.815039] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-23T19:09:35.147442] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-23T19:09:35.402209] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-09. [2025-09-23T19:09:35.920419] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-23T19:09:36.202201] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-03. [2025-09-23T19:09:36.827197] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-23T19:09:36.836387] [INFO ] [REMOTE ] GSK: Full fetch complete (77472 records). [2025-09-23T19:09:36.836564] [DEBUG] [VALIDATOR ] GSK: Validating primary data. [2025-09-23T19:09:37.014885] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-01. [2025-09-23T19:09:37.238970] [DEBUG] [VALIDATOR ] GSK: All expected trading days are present. [2025-09-23T19:09:37.239081] [DEBUG] [VALIDATOR ] GSK: Primary data validation passed. [2025-09-23T19:09:37.240012] [INFO ] [MAIN ] GSK: Fetched primary data is valid. [2025-09-23T19:09:37.240077] [DEBUG] [LOCAL ] GSK: Saving primary data. [2025-09-23T19:09:37.242191] [DEBUG] [LOCAL ] GSK: Trimmed 77472 records to 53493 (keeping 200 days of data) [2025-09-23T19:09:37.490981] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-23T19:09:37.609432] [DEBUG] [LOCAL ] GSK: Primary data saved (53493 records). [2025-09-23T19:09:37.609581] [INFO ] [MAIN ] GSK: Full history saved. [2025-09-23T19:09:37.609693] [INFO ] [MAIN ] Update Progress: 978/2372 symbols completed. GSK took 42.9s. Estimated remaining: 3h 4m 41s. Rate: 7.5 symbols/min [2025-09-23T19:09:37.779242] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:09:37.807477] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-04. [2025-09-23T19:09:37.810188] [DEBUG] [LOCAL ] GTY: Loaded 30384 existing records from primary storage. [2025-09-23T19:09:37.810350] [INFO ] [MAIN ] GTY: Loaded 30384 existing records. [2025-09-23T19:09:37.990242] [WARN ] [MAIN ] GTY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:09:37.990560] [INFO ] [MAIN ] GTY: Wiping existing primary data before full refresh. [2025-09-23T19:09:37.990613] [INFO ] [LOCAL ] GTY: Starting deletion of primary data. [2025-09-23T19:09:37.991497] [DEBUG] [LOCAL ] GTY: Deleted primary data file. [2025-09-23T19:09:37.991560] [INFO ] [MAIN ] GTY: Starting full primary refresh. [2025-09-23T19:09:38.351235] [INFO ] [REMOTE ] GTY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:09:38.386880] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-23T19:09:38.602215] [INFO ] [REMOTE ] GTY: Fetching primary data for 2024-12. [2025-09-23T19:09:39.402184] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-04. [2025-09-23T19:09:39.452633] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-23T19:09:39.578006] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-23T19:09:40.202202] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-01. [2025-09-23T19:09:41.010484] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-05. [2025-09-23T19:09:41.031355] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-23T19:09:41.095476] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-23T19:09:41.802256] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-02. [2025-09-23T19:09:42.075553] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-23T19:09:42.602232] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-02. [2025-09-23T19:09:42.699071] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-23T19:09:43.402194] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-03. [2025-09-23T19:09:43.758310] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-23T19:09:44.202209] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-05. [2025-09-23T19:09:44.388513] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-23T19:09:45.002223] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-03. [2025-09-23T19:09:45.397256] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-23T19:09:45.802208] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-06. [2025-09-23T19:09:46.602222] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-04. [2025-09-23T19:09:46.660187] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-23T19:09:47.042396] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-23T19:09:47.402279] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-04. [2025-09-23T19:09:47.582088] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-23T19:09:48.202205] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-05. [2025-09-23T19:09:48.686617] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-23T19:09:49.002261] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-05. [2025-09-23T19:09:49.084846] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-23T19:09:49.802284] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-06. [2025-09-23T19:09:50.233123] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-23T19:09:50.602236] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-06. [2025-09-23T19:09:51.009947] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-23T19:09:51.402196] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-07. [2025-09-23T19:09:51.693167] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-23T19:09:52.202250] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-07. [2025-09-23T19:09:52.639737] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-23T19:09:53.002244] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-07. [2025-09-23T19:09:53.477990] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-23T19:09:53.802199] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-08. [2025-09-23T19:09:54.602194] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-06. [2025-09-23T19:09:54.657873] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-23T19:09:54.977050] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-23T19:09:55.402203] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-08. [2025-09-23T19:09:55.450566] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-23T19:09:56.202195] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-08. [2025-09-23T19:09:56.703179] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-23T19:09:57.002237] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-09. [2025-09-23T19:09:57.802213] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-07. [2025-09-23T19:09:58.147547] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-23T19:09:58.275787] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-23T19:09:58.288370] [INFO ] [REMOTE ] GTES: Full fetch complete (73991 records). [2025-09-23T19:09:58.288595] [DEBUG] [VALIDATOR ] GTES: Validating primary data. [2025-09-23T19:09:58.607547] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-09. [2025-09-23T19:09:58.791859] [DEBUG] [VALIDATOR ] GTES: All expected trading days are present. [2025-09-23T19:09:58.792004] [DEBUG] [VALIDATOR ] GTES: Primary data validation passed. [2025-09-23T19:09:58.793220] [INFO ] [MAIN ] GTES: Fetched primary data is valid. [2025-09-23T19:09:58.793357] [DEBUG] [LOCAL ] GTES: Saving primary data. [2025-09-23T19:09:58.795343] [DEBUG] [LOCAL ] GTES: Trimmed 73991 records to 50681 (keeping 200 days of data) [2025-09-23T19:09:58.912618] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-23T19:09:59.136976] [DEBUG] [LOCAL ] GTES: Primary data saved (50681 records). [2025-09-23T19:09:59.137175] [INFO ] [MAIN ] GTES: Full history saved. [2025-09-23T19:09:59.137305] [INFO ] [MAIN ] Update Progress: 979/2372 symbols completed. GTES took 38.8s. Estimated remaining: 3h 4m 53s. Rate: 7.5 symbols/min [2025-09-23T19:09:59.345021] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:09:59.359498] [DEBUG] [LOCAL ] GUG: Loaded 12212 existing records from primary storage. [2025-09-23T19:09:59.359664] [INFO ] [MAIN ] GUG: Loaded 12212 existing records. [2025-09-23T19:09:59.407473] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-08. [2025-09-23T19:09:59.559749] [WARN ] [MAIN ] GUG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:09:59.560197] [INFO ] [MAIN ] GUG: Wiping existing primary data before full refresh. [2025-09-23T19:09:59.560250] [INFO ] [LOCAL ] GUG: Starting deletion of primary data. [2025-09-23T19:09:59.560836] [DEBUG] [LOCAL ] GUG: Deleted primary data file. [2025-09-23T19:09:59.560902] [INFO ] [MAIN ] GUG: Starting full primary refresh. [2025-09-23T19:09:59.942353] [INFO ] [REMOTE ] GUG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:09:59.981947] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-23T19:09:59.990125] [INFO ] [REMOTE ] GTLS: Full fetch complete (61429 records). [2025-09-23T19:09:59.990287] [DEBUG] [VALIDATOR ] GTLS: Validating primary data. [2025-09-23T19:10:00.210597] [INFO ] [REMOTE ] GUG: Fetching primary data for 2024-12. [2025-09-23T19:10:00.404210] [DEBUG] [VALIDATOR ] GTLS: All expected trading days are present. [2025-09-23T19:10:00.404325] [DEBUG] [VALIDATOR ] GTLS: Primary data validation passed. [2025-09-23T19:10:00.410930] [INFO ] [MAIN ] GTLS: Fetched primary data is valid. [2025-09-23T19:10:00.421029] [DEBUG] [LOCAL ] GTLS: Saving primary data. [2025-09-23T19:10:00.422697] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-23T19:10:00.431174] [DEBUG] [LOCAL ] GTLS: Trimmed 61429 records to 42996 (keeping 200 days of data) [2025-09-23T19:10:00.693018] [DEBUG] [LOCAL ] GTLS: Primary data saved (42996 records). [2025-09-23T19:10:00.693161] [INFO ] [MAIN ] GTLS: Full history saved. [2025-09-23T19:10:00.693248] [INFO ] [MAIN ] Update Progress: 980/2372 symbols completed. GTLS took 37.1s. Estimated remaining: 3h 4m 36s. Rate: 7.5 symbols/min [2025-09-23T19:10:00.881108] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:10:00.898962] [DEBUG] [LOCAL ] GUT: Loaded 15525 existing records from primary storage. [2025-09-23T19:10:00.899092] [INFO ] [MAIN ] GUT: Loaded 15525 existing records. [2025-09-23T19:10:01.006639] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-09. [2025-09-23T19:10:01.092154] [WARN ] [MAIN ] GUT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:10:01.092786] [INFO ] [MAIN ] GUT: Wiping existing primary data before full refresh. [2025-09-23T19:10:01.092864] [INFO ] [LOCAL ] GUT: Starting deletion of primary data. [2025-09-23T19:10:01.093444] [DEBUG] [LOCAL ] GUT: Deleted primary data file. [2025-09-23T19:10:01.093506] [INFO ] [MAIN ] GUT: Starting full primary refresh. [2025-09-23T19:10:01.450434] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-23T19:10:01.556372] [INFO ] [REMOTE ] GUT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:10:01.802258] [INFO ] [REMOTE ] GUT: Fetching primary data for 2024-12. [2025-09-23T19:10:02.215911] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-23T19:10:02.220749] [INFO ] [REMOTE ] GTY: Full fetch complete (43164 records). [2025-09-23T19:10:02.220838] [DEBUG] [VALIDATOR ] GTY: Validating primary data. [2025-09-23T19:10:02.604348] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-01. [2025-09-23T19:10:02.628561] [DEBUG] [VALIDATOR ] GTY: All expected trading days are present. [2025-09-23T19:10:02.629229] [DEBUG] [VALIDATOR ] GTY: Primary data validation passed. [2025-09-23T19:10:02.629699] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-23T19:10:02.634476] [INFO ] [MAIN ] GTY: Fetched primary data is valid. [2025-09-23T19:10:02.635392] [DEBUG] [LOCAL ] GTY: Saving primary data. [2025-09-23T19:10:02.639783] [DEBUG] [LOCAL ] GTY: Trimmed 43164 records to 30403 (keeping 200 days of data) [2025-09-23T19:10:02.837898] [DEBUG] [LOCAL ] GTY: Primary data saved (30403 records). [2025-09-23T19:10:02.838060] [INFO ] [MAIN ] GTY: Full history saved. [2025-09-23T19:10:02.838202] [INFO ] [MAIN ] Update Progress: 981/2372 symbols completed. GTY took 25.2s. Estimated remaining: 3h 4m 19s. Rate: 7.5 symbols/min [2025-09-23T19:10:03.016502] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:10:03.052842] [DEBUG] [LOCAL ] GVA: Loaded 33963 existing records from primary storage. [2025-09-23T19:10:03.052989] [INFO ] [MAIN ] GVA: Loaded 33963 existing records. [2025-09-23T19:10:03.243211] [WARN ] [MAIN ] GVA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:10:03.243855] [INFO ] [MAIN ] GVA: Wiping existing primary data before full refresh. [2025-09-23T19:10:03.243943] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-09-23T19:10:03.244994] [DEBUG] [LOCAL ] GVA: Deleted primary data file. [2025-09-23T19:10:03.245059] [INFO ] [MAIN ] GVA: Starting full primary refresh. [2025-09-23T19:10:03.403442] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-01. [2025-09-23T19:10:03.447462] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-23T19:10:03.652216] [INFO ] [REMOTE ] GVA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:10:04.177627] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-23T19:10:04.202159] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-02. [2025-09-23T19:10:04.847370] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-23T19:10:05.002252] [INFO ] [REMOTE ] GVA: Fetching primary data for 2024-12. [2025-09-23T19:10:05.802278] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-03. [2025-09-23T19:10:06.039792] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-23T19:10:06.432263] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-23T19:10:06.602265] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-02. [2025-09-23T19:10:07.402282] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-04. [2025-09-23T19:10:07.419696] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-23T19:10:08.101566] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-23T19:10:08.202245] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-09. [2025-09-23T19:10:09.002229] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-03. [2025-09-23T19:10:09.329965] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-23T19:10:09.339090] [INFO ] [REMOTE ] GTN: Full fetch complete (66399 records). [2025-09-23T19:10:09.339317] [DEBUG] [VALIDATOR ] GTN: Validating primary data. [2025-09-23T19:10:09.685731] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-23T19:10:09.791083] [DEBUG] [VALIDATOR ] GTN: All expected trading days are present. [2025-09-23T19:10:09.791179] [DEBUG] [VALIDATOR ] GTN: Primary data validation passed. [2025-09-23T19:10:09.792035] [INFO ] [MAIN ] GTN: Fetched primary data is valid. [2025-09-23T19:10:09.792144] [DEBUG] [LOCAL ] GTN: Saving primary data. [2025-09-23T19:10:09.796460] [DEBUG] [LOCAL ] GTN: Trimmed 66399 records to 45680 (keeping 200 days of data) [2025-09-23T19:10:09.802169] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-04. [2025-09-23T19:10:10.083552] [DEBUG] [LOCAL ] GTN: Primary data saved (45680 records). [2025-09-23T19:10:10.083736] [INFO ] [MAIN ] GTN: Full history saved. [2025-09-23T19:10:10.083933] [INFO ] [MAIN ] Update Progress: 982/2372 symbols completed. GTN took 37.1s. Estimated remaining: 3h 4m 10s. Rate: 7.5 symbols/min [2025-09-23T19:10:10.264676] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:10:10.289286] [DEBUG] [LOCAL ] GWH: Loaded 15311 existing records from primary storage. [2025-09-23T19:10:10.289438] [INFO ] [MAIN ] GWH: Loaded 15311 existing records. [2025-09-23T19:10:10.483927] [WARN ] [MAIN ] GWH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:10:10.484522] [INFO ] [MAIN ] GWH: Wiping existing primary data before full refresh. [2025-09-23T19:10:10.484780] [INFO ] [LOCAL ] GWH: Starting deletion of primary data. [2025-09-23T19:10:10.493461] [DEBUG] [LOCAL ] GWH: Deleted primary data file. [2025-09-23T19:10:10.495542] [INFO ] [MAIN ] GWH: Starting full primary refresh. [2025-09-23T19:10:10.495862] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-23T19:10:10.604683] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-01. [2025-09-23T19:10:10.878251] [INFO ] [REMOTE ] GWH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:10:11.402212] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-05. [2025-09-23T19:10:11.567039] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-23T19:10:11.900551] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-23T19:10:12.202210] [INFO ] [REMOTE ] GWH: Fetching primary data for 2024-12. [2025-09-23T19:10:12.838160] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-23T19:10:13.002195] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-06. [2025-09-23T19:10:13.802189] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-01. [2025-09-23T19:10:13.965050] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-23T19:10:14.333209] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-23T19:10:14.602200] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-05. [2025-09-23T19:10:15.236225] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-23T19:10:15.402221] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-06. [2025-09-23T19:10:16.202198] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-02. [2025-09-23T19:10:16.404634] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-23T19:10:16.767425] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-23T19:10:17.002202] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-02. [2025-09-23T19:10:17.802303] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-07. [2025-09-23T19:10:17.995486] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-23T19:10:18.497575] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-23T19:10:18.602188] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-08. [2025-09-23T19:10:19.219167] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-23T19:10:19.402252] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-03. [2025-09-23T19:10:19.926523] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-23T19:10:20.202250] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-03. [2025-09-23T19:10:21.002266] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-09. [2025-09-23T19:10:21.358284] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-23T19:10:21.802237] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-07. [2025-09-23T19:10:21.866166] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-23T19:10:21.869086] [INFO ] [REMOTE ] GUT: Full fetch complete (23035 records). [2025-09-23T19:10:21.869182] [DEBUG] [VALIDATOR ] GUT: Validating primary data. [2025-09-23T19:10:22.240785] [DEBUG] [VALIDATOR ] GUT: All expected trading days are present. [2025-09-23T19:10:22.240864] [DEBUG] [VALIDATOR ] GUT: Primary data validation passed. [2025-09-23T19:10:22.241339] [INFO ] [MAIN ] GUT: Fetched primary data is valid. [2025-09-23T19:10:22.241377] [DEBUG] [LOCAL ] GUT: Saving primary data. [2025-09-23T19:10:22.242044] [DEBUG] [LOCAL ] GUT: Trimmed 23035 records to 15489 (keeping 200 days of data) [2025-09-23T19:10:22.355676] [DEBUG] [LOCAL ] GUT: Primary data saved (15489 records). [2025-09-23T19:10:22.355835] [INFO ] [MAIN ] GUT: Full history saved. [2025-09-23T19:10:22.355983] [INFO ] [MAIN ] Update Progress: 983/2372 symbols completed. GUT took 21.7s. Estimated remaining: 3h 4m 9s. Rate: 7.5 symbols/min [2025-09-23T19:10:22.538447] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:10:22.595882] [DEBUG] [LOCAL ] GWRE: Loaded 41190 existing records from primary storage. [2025-09-23T19:10:22.596028] [INFO ] [MAIN ] GWRE: Loaded 41190 existing records. [2025-09-23T19:10:22.607478] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-04. [2025-09-23T19:10:22.789634] [WARN ] [MAIN ] GWRE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:10:22.790106] [INFO ] [MAIN ] GWRE: Wiping existing primary data before full refresh. [2025-09-23T19:10:22.790164] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-09-23T19:10:22.791337] [DEBUG] [LOCAL ] GWRE: Deleted primary data file. [2025-09-23T19:10:22.791399] [INFO ] [MAIN ] GWRE: Starting full primary refresh. [2025-09-23T19:10:22.952624] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-23T19:10:23.166050] [INFO ] [REMOTE ] GWRE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:10:23.402201] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2024-12. [2025-09-23T19:10:23.819178] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-23T19:10:24.202254] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-08. [2025-09-23T19:10:24.706133] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-23T19:10:24.771550] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-23T19:10:25.002196] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-05. [2025-09-23T19:10:25.802235] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-01. [2025-09-23T19:10:26.146865] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-23T19:10:26.602229] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-09. [2025-09-23T19:10:27.190362] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-23T19:10:27.213875] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-23T19:10:27.217466] [INFO ] [REMOTE ] GUG: Full fetch complete (20081 records). [2025-09-23T19:10:27.217579] [DEBUG] [VALIDATOR ] GUG: Validating primary data. [2025-09-23T19:10:27.466848] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-04. [2025-09-23T19:10:27.683680] [DEBUG] [VALIDATOR ] GUG: All expected trading days are present. [2025-09-23T19:10:27.684010] [DEBUG] [VALIDATOR ] GUG: Primary data validation passed. [2025-09-23T19:10:27.684542] [INFO ] [MAIN ] GUG: Fetched primary data is valid. [2025-09-23T19:10:27.684606] [DEBUG] [LOCAL ] GUG: Saving primary data. [2025-09-23T19:10:27.685379] [DEBUG] [LOCAL ] GUG: Trimmed 20081 records to 12019 (keeping 200 days of data) [2025-09-23T19:10:27.774853] [DEBUG] [LOCAL ] GUG: Primary data saved (12019 records). [2025-09-23T19:10:27.775042] [INFO ] [MAIN ] GUG: Full history saved. [2025-09-23T19:10:27.775159] [INFO ] [MAIN ] Update Progress: 984/2372 symbols completed. GUG took 28.6s. Estimated remaining: 3h 3m 57s. Rate: 7.5 symbols/min [2025-09-23T19:10:27.957608] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:10:27.982048] [DEBUG] [LOCAL ] GWW: Loaded 19947 existing records from primary storage. [2025-09-23T19:10:27.982254] [INFO ] [MAIN ] GWW: Loaded 19947 existing records. [2025-09-23T19:10:28.164097] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-23T19:10:28.188098] [WARN ] [MAIN ] GWW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:10:28.188623] [INFO ] [MAIN ] GWW: Wiping existing primary data before full refresh. [2025-09-23T19:10:28.188717] [INFO ] [LOCAL ] GWW: Starting deletion of primary data. [2025-09-23T19:10:28.189623] [DEBUG] [LOCAL ] GWW: Deleted primary data file. [2025-09-23T19:10:28.189717] [INFO ] [MAIN ] GWW: Starting full primary refresh. [2025-09-23T19:10:28.210979] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-02. [2025-09-23T19:10:28.569687] [INFO ] [REMOTE ] GWW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:10:29.002200] [INFO ] [REMOTE ] GWW: Fetching primary data for 2024-12. [2025-09-23T19:10:29.468863] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-23T19:10:29.802178] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-05. [2025-09-23T19:10:30.060678] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-23T19:10:30.538794] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-23T19:10:30.602148] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-06. [2025-09-23T19:10:31.355988] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-23T19:10:31.402159] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-07. [2025-09-23T19:10:32.202193] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-06. [2025-09-23T19:10:32.675894] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-23T19:10:33.002199] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-01. [2025-09-23T19:10:33.084330] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-23T19:10:33.802217] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-07. [2025-09-23T19:10:33.929883] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-23T19:10:34.602207] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-03. [2025-09-23T19:10:34.772226] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-23T19:10:35.402197] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-08. [2025-09-23T19:10:36.202172] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-02. [2025-09-23T19:10:36.380137] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-23T19:10:36.410887] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-23T19:10:36.972120] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-23T19:10:37.002198] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-08. [2025-09-23T19:10:37.663730] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-23T19:10:37.802156] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-09. [2025-09-23T19:10:38.599684] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-23T19:10:38.602403] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-09. [2025-09-23T19:10:38.603812] [INFO ] [REMOTE ] GWH: Full fetch complete (20695 records). [2025-09-23T19:10:38.603885] [DEBUG] [VALIDATOR ] GWH: Validating primary data. [2025-09-23T19:10:38.973625] [DEBUG] [VALIDATOR ] GWH: All expected trading days are present. [2025-09-23T19:10:38.973741] [DEBUG] [VALIDATOR ] GWH: Primary data validation passed. [2025-09-23T19:10:38.974194] [INFO ] [MAIN ] GWH: Fetched primary data is valid. [2025-09-23T19:10:38.974235] [DEBUG] [LOCAL ] GWH: Saving primary data. [2025-09-23T19:10:38.975010] [DEBUG] [LOCAL ] GWH: Trimmed 20695 records to 15438 (keeping 200 days of data) [2025-09-23T19:10:39.072725] [DEBUG] [LOCAL ] GWH: Primary data saved (15438 records). [2025-09-23T19:10:39.072879] [INFO ] [MAIN ] GWH: Full history saved. [2025-09-23T19:10:39.072969] [INFO ] [MAIN ] Update Progress: 985/2372 symbols completed. GWH took 29.0s. Estimated remaining: 3h 3m 54s. Rate: 7.5 symbols/min [2025-09-23T19:10:39.254221] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:10:39.301677] [DEBUG] [LOCAL ] GXO: Loaded 47683 existing records from primary storage. [2025-09-23T19:10:39.301825] [INFO ] [MAIN ] GXO: Loaded 47683 existing records. [2025-09-23T19:10:39.402452] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-04. [2025-09-23T19:10:39.481777] [WARN ] [MAIN ] GXO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:10:39.482049] [INFO ] [MAIN ] GXO: Wiping existing primary data before full refresh. [2025-09-23T19:10:39.482097] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-09-23T19:10:39.483200] [DEBUG] [LOCAL ] GXO: Deleted primary data file. [2025-09-23T19:10:39.483261] [INFO ] [MAIN ] GXO: Starting full primary refresh. [2025-09-23T19:10:39.856532] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-23T19:10:39.860205] [INFO ] [REMOTE ] GXO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:10:39.867265] [INFO ] [REMOTE ] GVA: Full fetch complete (48849 records). [2025-09-23T19:10:39.867355] [DEBUG] [VALIDATOR ] GVA: Validating primary data. [2025-09-23T19:10:40.210399] [INFO ] [REMOTE ] GXO: Fetching primary data for 2024-12. [2025-09-23T19:10:40.252875] [DEBUG] [VALIDATOR ] GVA: All expected trading days are present. [2025-09-23T19:10:40.252955] [DEBUG] [VALIDATOR ] GVA: Primary data validation passed. [2025-09-23T19:10:40.253636] [INFO ] [MAIN ] GVA: Fetched primary data is valid. [2025-09-23T19:10:40.253726] [DEBUG] [LOCAL ] GVA: Saving primary data. [2025-09-23T19:10:40.254729] [DEBUG] [LOCAL ] GVA: Trimmed 48849 records to 33873 (keeping 200 days of data) [2025-09-23T19:10:40.465200] [DEBUG] [LOCAL ] GVA: Primary data saved (33873 records). [2025-09-23T19:10:40.465346] [INFO ] [MAIN ] GVA: Full history saved. [2025-09-23T19:10:40.465442] [INFO ] [MAIN ] Update Progress: 986/2372 symbols completed. GVA took 37.6s. Estimated remaining: 3h 3m 37s. Rate: 7.5 symbols/min [2025-09-23T19:10:40.635453] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:10:40.638952] [DEBUG] [LOCAL ] GYLD: Loaded 1553 existing records from primary storage. [2025-09-23T19:10:40.639290] [INFO ] [MAIN ] GYLD: Loaded 1553 existing records. [2025-09-23T19:10:40.819685] [WARN ] [MAIN ] GYLD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:10:40.820159] [INFO ] [MAIN ] GYLD: Wiping existing primary data before full refresh. [2025-09-23T19:10:40.820232] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-09-23T19:10:40.820547] [DEBUG] [LOCAL ] GYLD: Deleted primary data file. [2025-09-23T19:10:40.820611] [INFO ] [MAIN ] GYLD: Starting full primary refresh. [2025-09-23T19:10:41.008633] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-03. [2025-09-23T19:10:41.096696] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-23T19:10:41.246799] [INFO ] [REMOTE ] GYLD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:10:41.486535] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-23T19:10:41.802179] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2024-12. [2025-09-23T19:10:42.036339] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-23T19:10:42.095069] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2024-12 (0.29 seconds). [2025-09-23T19:10:42.602208] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-05. [2025-09-23T19:10:43.402185] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-04. [2025-09-23T19:10:43.775502] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-23T19:10:44.202263] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-01. [2025-09-23T19:10:44.477765] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-01 (0.28 seconds). [2025-09-23T19:10:44.673428] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-23T19:10:45.002198] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-02. [2025-09-23T19:10:45.276093] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-09-23T19:10:45.802194] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-01. [2025-09-23T19:10:46.602199] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-05. [2025-09-23T19:10:47.082116] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-23T19:10:47.297223] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-23T19:10:47.402237] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-02. [2025-09-23T19:10:48.202195] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-03. [2025-09-23T19:10:48.499156] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-09-23T19:10:48.686906] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-23T19:10:49.002208] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-04. [2025-09-23T19:10:49.362534] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-23T19:10:49.802198] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-06. [2025-09-23T19:10:50.543346] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-23T19:10:50.602205] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-07. [2025-09-23T19:10:51.402170] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-05. [2025-09-23T19:10:51.456612] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-23T19:10:51.693480] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-09-23T19:10:52.202258] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-08. [2025-09-23T19:10:53.002188] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-06. [2025-09-23T19:10:53.061622] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-23T19:10:53.802179] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-06. [2025-09-23T19:10:54.238134] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-23T19:10:54.349366] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-23T19:10:54.602218] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-09. [2025-09-23T19:10:55.385803] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-23T19:10:55.389510] [INFO ] [REMOTE ] GWW: Full fetch complete (29193 records). [2025-09-23T19:10:55.389597] [DEBUG] [VALIDATOR ] GWW: Validating primary data. [2025-09-23T19:10:55.411693] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-07. [2025-09-23T19:10:55.769942] [DEBUG] [VALIDATOR ] GWW: All expected trading days are present. [2025-09-23T19:10:55.770026] [DEBUG] [VALIDATOR ] GWW: Primary data validation passed. [2025-09-23T19:10:55.770552] [INFO ] [MAIN ] GWW: Fetched primary data is valid. [2025-09-23T19:10:55.770591] [DEBUG] [LOCAL ] GWW: Saving primary data. [2025-09-23T19:10:55.771312] [DEBUG] [LOCAL ] GWW: Trimmed 29193 records to 19907 (keeping 200 days of data) [2025-09-23T19:10:55.882083] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-23T19:10:55.925920] [DEBUG] [LOCAL ] GWW: Primary data saved (19907 records). [2025-09-23T19:10:55.926092] [INFO ] [MAIN ] GWW: Full history saved. [2025-09-23T19:10:55.926198] [INFO ] [MAIN ] Update Progress: 987/2372 symbols completed. GWW took 28.2s. Estimated remaining: 3h 3m 39s. Rate: 7.5 symbols/min [2025-09-23T19:10:56.096690] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:10:56.145358] [DEBUG] [LOCAL ] H: Loaded 44926 existing records from primary storage. [2025-09-23T19:10:56.145496] [INFO ] [MAIN ] H: Loaded 44926 existing records. [2025-09-23T19:10:56.207438] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-08. [2025-09-23T19:10:56.325470] [WARN ] [MAIN ] H: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:10:56.325759] [INFO ] [MAIN ] H: Wiping existing primary data before full refresh. [2025-09-23T19:10:56.325812] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-09-23T19:10:56.327799] [DEBUG] [LOCAL ] H: Deleted primary data file. [2025-09-23T19:10:56.327860] [INFO ] [MAIN ] H: Starting full primary refresh. [2025-09-23T19:10:56.607023] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-23T19:10:56.683967] [INFO ] [REMOTE ] H: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:10:57.002242] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-09. [2025-09-23T19:10:57.402156] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-23T19:10:57.404266] [INFO ] [REMOTE ] GYLD: Full fetch complete (2041 records). [2025-09-23T19:10:57.404513] [DEBUG] [VALIDATOR ] GYLD: Validating primary data. [2025-09-23T19:10:57.770403] [DEBUG] [VALIDATOR ] GYLD: All expected trading days are present. [2025-09-23T19:10:57.770484] [DEBUG] [VALIDATOR ] GYLD: Primary data validation passed. [2025-09-23T19:10:57.770582] [INFO ] [MAIN ] GYLD: Fetched primary data is valid. [2025-09-23T19:10:57.770620] [DEBUG] [LOCAL ] GYLD: Saving primary data. [2025-09-23T19:10:57.770980] [DEBUG] [LOCAL ] GYLD: Trimmed 2041 records to 1553 (keeping 200 days of data) [2025-09-23T19:10:57.781246] [DEBUG] [LOCAL ] GYLD: Primary data saved (1553 records). [2025-09-23T19:10:57.781311] [INFO ] [MAIN ] GYLD: Full history saved. [2025-09-23T19:10:57.781381] [INFO ] [MAIN ] Update Progress: 988/2372 symbols completed. GYLD took 17.3s. Estimated remaining: 3h 3m 23s. Rate: 7.5 symbols/min [2025-09-23T19:10:57.810554] [INFO ] [REMOTE ] H: Fetching primary data for 2024-12. [2025-09-23T19:10:57.952553] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:10:57.994558] [DEBUG] [LOCAL ] HAE: Loaded 39515 existing records from primary storage. [2025-09-23T19:10:57.994760] [INFO ] [MAIN ] HAE: Loaded 39515 existing records. [2025-09-23T19:10:58.178065] [WARN ] [MAIN ] HAE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:10:58.178334] [INFO ] [MAIN ] HAE: Wiping existing primary data before full refresh. [2025-09-23T19:10:58.178383] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-09-23T19:10:58.179502] [DEBUG] [LOCAL ] HAE: Deleted primary data file. [2025-09-23T19:10:58.179565] [INFO ] [MAIN ] HAE: Starting full primary refresh. [2025-09-23T19:10:58.547035] [INFO ] [REMOTE ] HAE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:10:58.602178] [INFO ] [REMOTE ] HAE: Fetching primary data for 2024-12. [2025-09-23T19:10:59.004413] [INFO ] [REMOTE ] H: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-23T19:10:59.402180] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-03. [2025-09-23T19:10:59.620183] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-23T19:11:00.202201] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-01. [2025-09-23T19:11:00.987786] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-23T19:11:01.002156] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-04. [2025-09-23T19:11:01.297825] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-23T19:11:01.802215] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-07. [2025-09-23T19:11:02.453027] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-23T19:11:02.602150] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-05. [2025-09-23T19:11:03.402398] [INFO ] [REMOTE ] H: Fetching primary data for 2025-01. [2025-09-23T19:11:03.402329] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-23T19:11:03.881450] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-23T19:11:04.202239] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-02. [2025-09-23T19:11:04.490264] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-23T19:11:05.002227] [INFO ] [REMOTE ] H: Fetching primary data for 2025-02. [2025-09-23T19:11:05.529127] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-23T19:11:05.802261] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-06. [2025-09-23T19:11:06.565199] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-23T19:11:06.602154] [INFO ] [REMOTE ] H: Fetching primary data for 2025-03. [2025-09-23T19:11:07.119662] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-23T19:11:07.402228] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-07. [2025-09-23T19:11:07.953864] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-23T19:11:08.202240] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-08. [2025-09-23T19:11:09.002182] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-03. [2025-09-23T19:11:09.043104] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-23T19:11:09.246553] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-23T19:11:09.802190] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-08. [2025-09-23T19:11:10.549618] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-23T19:11:10.602160] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-04. [2025-09-23T19:11:11.002083] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-23T19:11:11.402285] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-09. [2025-09-23T19:11:11.798158] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-23T19:11:12.202203] [INFO ] [REMOTE ] H: Fetching primary data for 2025-04. [2025-09-23T19:11:12.582324] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-23T19:11:12.591476] [INFO ] [REMOTE ] GXO: Full fetch complete (70125 records). [2025-09-23T19:11:12.591675] [DEBUG] [VALIDATOR ] GXO: Validating primary data. [2025-09-23T19:11:12.978322] [DEBUG] [VALIDATOR ] GXO: All expected trading days are present. [2025-09-23T19:11:12.978437] [DEBUG] [VALIDATOR ] GXO: Primary data validation passed. [2025-09-23T19:11:12.979297] [INFO ] [MAIN ] GXO: Fetched primary data is valid. [2025-09-23T19:11:12.979361] [DEBUG] [LOCAL ] GXO: Saving primary data. [2025-09-23T19:11:12.980852] [DEBUG] [LOCAL ] GXO: Trimmed 70125 records to 47612 (keeping 200 days of data) [2025-09-23T19:11:13.030420] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-09. [2025-09-23T19:11:13.257966] [DEBUG] [LOCAL ] GXO: Primary data saved (47612 records). [2025-09-23T19:11:13.258111] [INFO ] [MAIN ] GXO: Full history saved. [2025-09-23T19:11:13.258210] [INFO ] [MAIN ] Update Progress: 989/2372 symbols completed. GXO took 34.2s. Estimated remaining: 3h 3m 25s. Rate: 7.5 symbols/min [2025-09-23T19:11:13.426343] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:11:13.467511] [DEBUG] [LOCAL ] HAFN: Loaded 43630 existing records from primary storage. [2025-09-23T19:11:13.467715] [INFO ] [MAIN ] HAFN: Loaded 43630 existing records. [2025-09-23T19:11:13.650676] [WARN ] [MAIN ] HAFN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:11:13.651007] [INFO ] [MAIN ] HAFN: Wiping existing primary data before full refresh. [2025-09-23T19:11:13.651060] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-09-23T19:11:13.651968] [DEBUG] [LOCAL ] HAFN: Deleted primary data file. [2025-09-23T19:11:13.652028] [INFO ] [MAIN ] HAFN: Starting full primary refresh. [2025-09-23T19:11:13.825497] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-05. [2025-09-23T19:11:14.018540] [INFO ] [REMOTE ] HAFN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:11:14.051550] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-23T19:11:14.357850] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-23T19:11:14.364801] [INFO ] [REMOTE ] GWRE: Full fetch complete (61559 records). [2025-09-23T19:11:14.364955] [DEBUG] [VALIDATOR ] GWRE: Validating primary data. [2025-09-23T19:11:14.608289] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2024-12. [2025-09-23T19:11:14.763039] [DEBUG] [VALIDATOR ] GWRE: All expected trading days are present. [2025-09-23T19:11:14.763133] [DEBUG] [VALIDATOR ] GWRE: Primary data validation passed. [2025-09-23T19:11:14.763935] [INFO ] [MAIN ] GWRE: Fetched primary data is valid. [2025-09-23T19:11:14.764000] [DEBUG] [LOCAL ] GWRE: Saving primary data. [2025-09-23T19:11:14.766042] [DEBUG] [LOCAL ] GWRE: Trimmed 61559 records to 41107 (keeping 200 days of data) [2025-09-23T19:11:15.025814] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-23T19:11:15.051733] [DEBUG] [LOCAL ] GWRE: Primary data saved (41107 records). [2025-09-23T19:11:15.051867] [INFO ] [MAIN ] GWRE: Full history saved. [2025-09-23T19:11:15.051949] [INFO ] [MAIN ] Update Progress: 990/2372 symbols completed. GWRE took 52.7s. Estimated remaining: 3h 3m 9s. Rate: 7.5 symbols/min [2025-09-23T19:11:15.235990] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:11:15.295711] [DEBUG] [LOCAL ] HAL: Loaded 53718 existing records from primary storage. [2025-09-23T19:11:15.295869] [INFO ] [MAIN ] HAL: Loaded 53718 existing records. [2025-09-23T19:11:15.408796] [INFO ] [REMOTE ] H: Fetching primary data for 2025-05. [2025-09-23T19:11:15.499633] [WARN ] [MAIN ] HAL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:11:15.499918] [INFO ] [MAIN ] HAL: Wiping existing primary data before full refresh. [2025-09-23T19:11:15.499968] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-09-23T19:11:15.501259] [DEBUG] [LOCAL ] HAL: Deleted primary data file. [2025-09-23T19:11:15.501321] [INFO ] [MAIN ] HAL: Starting full primary refresh. [2025-09-23T19:11:15.901515] [INFO ] [REMOTE ] HAL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:11:16.202925] [INFO ] [REMOTE ] HAL: Fetching primary data for 2024-12. [2025-09-23T19:11:16.209379] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-23T19:11:16.827759] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-23T19:11:17.002201] [INFO ] [REMOTE ] H: Fetching primary data for 2025-06. [2025-09-23T19:11:17.802681] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-06. [2025-09-23T19:11:17.806049] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-23T19:11:18.162293] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-23T19:11:18.602194] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-01. [2025-09-23T19:11:18.825476] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-23T19:11:19.402237] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-01. [2025-09-23T19:11:20.199796] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-23T19:11:20.209718] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-07. [2025-09-23T19:11:20.846503] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-23T19:11:21.002228] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-02. [2025-09-23T19:11:21.221710] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-23T19:11:21.802191] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-08. [2025-09-23T19:11:22.466129] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-23T19:11:22.602170] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-03. [2025-09-23T19:11:22.998008] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-23T19:11:23.402202] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-02. [2025-09-23T19:11:24.107232] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-23T19:11:24.202164] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-04. [2025-09-23T19:11:24.751086] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-23T19:11:25.002201] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-03. [2025-09-23T19:11:25.802192] [INFO ] [REMOTE ] H: Fetching primary data for 2025-07. [2025-09-23T19:11:26.269717] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-23T19:11:26.492985] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-23T19:11:26.602214] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-09. [2025-09-23T19:11:27.057366] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-23T19:11:27.402214] [INFO ] [REMOTE ] H: Fetching primary data for 2025-08. [2025-09-23T19:11:27.920865] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-23T19:11:27.931464] [INFO ] [REMOTE ] HAE: Full fetch complete (57770 records). [2025-09-23T19:11:27.931677] [DEBUG] [VALIDATOR ] HAE: Validating primary data. [2025-09-23T19:11:28.208057] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-05. [2025-09-23T19:11:28.328492] [DEBUG] [VALIDATOR ] HAE: All expected trading days are present. [2025-09-23T19:11:28.328593] [DEBUG] [VALIDATOR ] HAE: Primary data validation passed. [2025-09-23T19:11:28.329371] [INFO ] [MAIN ] HAE: Fetched primary data is valid. [2025-09-23T19:11:28.329440] [DEBUG] [LOCAL ] HAE: Saving primary data. [2025-09-23T19:11:28.330834] [DEBUG] [LOCAL ] HAE: Trimmed 57770 records to 39544 (keeping 200 days of data) [2025-09-23T19:11:28.563855] [DEBUG] [LOCAL ] HAE: Primary data saved (39544 records). [2025-09-23T19:11:28.564098] [INFO ] [MAIN ] HAE: Full history saved. [2025-09-23T19:11:28.564221] [INFO ] [MAIN ] Update Progress: 991/2372 symbols completed. HAE took 30.8s. Estimated remaining: 3h 3m 9s. Rate: 7.5 symbols/min [2025-09-23T19:11:28.737331] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:11:28.790185] [DEBUG] [LOCAL ] HASI: Loaded 47201 existing records from primary storage. [2025-09-23T19:11:28.803370] [INFO ] [MAIN ] HASI: Loaded 47201 existing records. [2025-09-23T19:11:28.890563] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-23T19:11:29.005849] [WARN ] [MAIN ] HASI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:11:29.005618] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-04. [2025-09-23T19:11:29.006886] [INFO ] [MAIN ] HASI: Wiping existing primary data before full refresh. [2025-09-23T19:11:29.006942] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-09-23T19:11:29.007955] [DEBUG] [LOCAL ] HASI: Deleted primary data file. [2025-09-23T19:11:29.008015] [INFO ] [MAIN ] HASI: Starting full primary refresh. [2025-09-23T19:11:29.365852] [INFO ] [REMOTE ] HASI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:11:29.802204] [INFO ] [REMOTE ] H: Fetching primary data for 2025-09. [2025-09-23T19:11:29.979283] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-23T19:11:30.356742] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-23T19:11:30.602199] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-05. [2025-09-23T19:11:30.937624] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-23T19:11:30.945815] [INFO ] [REMOTE ] H: Full fetch complete (61719 records). [2025-09-23T19:11:30.946083] [DEBUG] [VALIDATOR ] H: Validating primary data. [2025-09-23T19:11:31.373195] [DEBUG] [VALIDATOR ] H: All expected trading days are present. [2025-09-23T19:11:31.373282] [DEBUG] [VALIDATOR ] H: Primary data validation passed. [2025-09-23T19:11:31.374192] [INFO ] [MAIN ] H: Fetched primary data is valid. [2025-09-23T19:11:31.374262] [DEBUG] [LOCAL ] H: Saving primary data. [2025-09-23T19:11:31.375736] [DEBUG] [LOCAL ] H: Trimmed 61719 records to 44881 (keeping 200 days of data) [2025-09-23T19:11:31.442681] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-06. [2025-09-23T19:11:31.689046] [DEBUG] [LOCAL ] H: Primary data saved (44881 records). [2025-09-23T19:11:31.689202] [INFO ] [MAIN ] H: Full history saved. [2025-09-23T19:11:31.689314] [INFO ] [MAIN ] Update Progress: 992/2372 symbols completed. H took 35.8s. Estimated remaining: 3h 2m 54s. Rate: 7.5 symbols/min [2025-09-23T19:11:31.875869] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:11:31.929428] [DEBUG] [LOCAL ] HAYW: Loaded 48763 existing records from primary storage. [2025-09-23T19:11:31.929671] [INFO ] [MAIN ] HAYW: Loaded 48763 existing records. [2025-09-23T19:11:32.167316] [WARN ] [MAIN ] HAYW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:11:32.169481] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-23T19:11:32.179238] [INFO ] [MAIN ] HAYW: Wiping existing primary data before full refresh. [2025-09-23T19:11:32.179753] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-09-23T19:11:32.181073] [DEBUG] [LOCAL ] HAYW: Deleted primary data file. [2025-09-23T19:11:32.181150] [INFO ] [MAIN ] HAYW: Starting full primary refresh. [2025-09-23T19:11:32.214315] [INFO ] [REMOTE ] HASI: Fetching primary data for 2024-12. [2025-09-23T19:11:32.587502] [INFO ] [REMOTE ] HAYW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:11:33.002217] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-06. [2025-09-23T19:11:33.135168] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-23T19:11:33.455536] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-23T19:11:33.802206] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-07. [2025-09-23T19:11:34.253994] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-23T19:11:34.602201] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-01. [2025-09-23T19:11:35.402164] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-07. [2025-09-23T19:11:35.740360] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-23T19:11:35.851704] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-23T19:11:36.202243] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-08. [2025-09-23T19:11:36.527146] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-23T19:11:37.002205] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-02. [2025-09-23T19:11:37.742673] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-23T19:11:37.802155] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-08. [2025-09-23T19:11:38.352143] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-23T19:11:38.602203] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2024-12. [2025-09-23T19:11:38.937140] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-23T19:11:39.402196] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-09. [2025-09-23T19:11:39.850345] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-23T19:11:40.202188] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-09. [2025-09-23T19:11:41.002162] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-03. [2025-09-23T19:11:41.057174] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-23T19:11:41.066137] [INFO ] [REMOTE ] HAL: Full fetch complete (77766 records). [2025-09-23T19:11:41.066300] [DEBUG] [VALIDATOR ] HAL: Validating primary data. [2025-09-23T19:11:41.475497] [DEBUG] [VALIDATOR ] HAL: All expected trading days are present. [2025-09-23T19:11:41.475616] [DEBUG] [VALIDATOR ] HAL: Primary data validation passed. [2025-09-23T19:11:41.476545] [INFO ] [MAIN ] HAL: Fetched primary data is valid. [2025-09-23T19:11:41.476600] [DEBUG] [LOCAL ] HAL: Saving primary data. [2025-09-23T19:11:41.478102] [DEBUG] [LOCAL ] HAL: Trimmed 77766 records to 53718 (keeping 200 days of data) [2025-09-23T19:11:41.810863] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-01. [2025-09-23T19:11:41.813935] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-23T19:11:41.823552] [INFO ] [REMOTE ] HAFN: Full fetch complete (66032 records). [2025-09-23T19:11:41.826723] [DEBUG] [VALIDATOR ] HAFN: Validating primary data. [2025-09-23T19:11:42.296216] [DEBUG] [LOCAL ] HAL: Primary data saved (53718 records). [2025-09-23T19:11:42.296607] [INFO ] [MAIN ] HAL: Full history saved. [2025-09-23T19:11:42.296420] [DEBUG] [VALIDATOR ] HAFN: All expected trading days are present. [2025-09-23T19:11:42.296811] [INFO ] [MAIN ] Update Progress: 993/2372 symbols completed. HAL took 27.2s. Estimated remaining: 3h 2m 50s. Rate: 7.5 symbols/min [2025-09-23T19:11:42.296872] [DEBUG] [VALIDATOR ] HAFN: Primary data validation passed. [2025-09-23T19:11:42.303482] [INFO ] [MAIN ] HAFN: Fetched primary data is valid. [2025-09-23T19:11:42.303591] [DEBUG] [LOCAL ] HAFN: Saving primary data. [2025-09-23T19:11:42.392339] [DEBUG] [LOCAL ] HAFN: Trimmed 66032 records to 43614 (keeping 200 days of data) [2025-09-23T19:11:42.541489] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:11:42.598038] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-23T19:11:42.613108] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-04. [2025-09-23T19:11:42.616796] [DEBUG] [LOCAL ] HBB: Loaded 6937 existing records from primary storage. [2025-09-23T19:11:42.617700] [INFO ] [MAIN ] HBB: Loaded 6937 existing records. [2025-09-23T19:11:42.825529] [WARN ] [MAIN ] HBB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:11:42.827070] [INFO ] [MAIN ] HBB: Wiping existing primary data before full refresh. [2025-09-23T19:11:42.827723] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-09-23T19:11:42.829468] [DEBUG] [LOCAL ] HBB: Deleted primary data file. [2025-09-23T19:11:42.829821] [INFO ] [MAIN ] HBB: Starting full primary refresh. [2025-09-23T19:11:43.329711] [INFO ] [REMOTE ] HBB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:11:43.366846] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-23T19:11:43.404401] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-02. [2025-09-23T19:11:43.411725] [DEBUG] [LOCAL ] HAFN: Primary data saved (43614 records). [2025-09-23T19:11:43.411872] [INFO ] [MAIN ] HAFN: Full history saved. [2025-09-23T19:11:43.411961] [INFO ] [MAIN ] Update Progress: 994/2372 symbols completed. HAFN took 30.2s. Estimated remaining: 3h 2m 32s. Rate: 7.5 symbols/min [2025-09-23T19:11:43.590438] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:11:43.644781] [DEBUG] [LOCAL ] HBI: Loaded 53019 existing records from primary storage. [2025-09-23T19:11:43.645083] [INFO ] [MAIN ] HBI: Loaded 53019 existing records. [2025-09-23T19:11:43.833118] [WARN ] [MAIN ] HBI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:11:43.833427] [INFO ] [MAIN ] HBI: Wiping existing primary data before full refresh. [2025-09-23T19:11:43.833477] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-09-23T19:11:43.834493] [DEBUG] [LOCAL ] HBI: Deleted primary data file. [2025-09-23T19:11:43.834555] [INFO ] [MAIN ] HBI: Starting full primary refresh. [2025-09-23T19:11:44.207818] [INFO ] [REMOTE ] HBB: Fetching primary data for 2024-12. [2025-09-23T19:11:44.213793] [INFO ] [REMOTE ] HBI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:11:44.284393] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-23T19:11:44.626364] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-23T19:11:44.707802] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-23T19:11:45.002253] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-05. [2025-09-23T19:11:45.802286] [INFO ] [REMOTE ] HBI: Fetching primary data for 2024-12. [2025-09-23T19:11:46.315694] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-23T19:11:46.602207] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-06. [2025-09-23T19:11:47.050029] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-23T19:11:47.402221] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-01. [2025-09-23T19:11:47.870429] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-23T19:11:48.161265] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-23T19:11:48.202189] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-03. [2025-09-23T19:11:49.002224] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-02. [2025-09-23T19:11:49.380107] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-23T19:11:49.469667] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-23T19:11:49.802183] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-03. [2025-09-23T19:11:50.510667] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-23T19:11:50.602168] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-04. [2025-09-23T19:11:51.402234] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-07. [2025-09-23T19:11:51.862835] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-23T19:11:52.202239] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-04. [2025-09-23T19:11:52.678507] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-23T19:11:52.739142] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-23T19:11:53.002242] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-05. [2025-09-23T19:11:53.479615] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-23T19:11:53.802225] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-06. [2025-09-23T19:11:54.229461] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-23T19:11:54.602231] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-07. [2025-09-23T19:11:55.008508] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-23T19:11:55.402243] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-08. [2025-09-23T19:11:55.908269] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-23T19:11:56.202254] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-08. [2025-09-23T19:11:57.002208] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-05. [2025-09-23T19:11:57.473030] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-23T19:11:57.802232] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-09. [2025-09-23T19:11:58.198473] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-23T19:11:58.411771] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-23T19:11:58.413028] [INFO ] [REMOTE ] HBB: Full fetch complete (9992 records). [2025-09-23T19:11:58.413107] [DEBUG] [VALIDATOR ] HBB: Validating primary data. [2025-09-23T19:11:58.607277] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-01. [2025-09-23T19:11:58.819817] [DEBUG] [VALIDATOR ] HBB: All expected trading days are present. [2025-09-23T19:11:58.819903] [DEBUG] [VALIDATOR ] HBB: Primary data validation passed. [2025-09-23T19:11:58.820146] [INFO ] [MAIN ] HBB: Fetched primary data is valid. [2025-09-23T19:11:58.820182] [DEBUG] [LOCAL ] HBB: Saving primary data. [2025-09-23T19:11:58.820668] [DEBUG] [LOCAL ] HBB: Trimmed 9992 records to 6910 (keeping 200 days of data) [2025-09-23T19:11:58.863403] [DEBUG] [LOCAL ] HBB: Primary data saved (6910 records). [2025-09-23T19:11:58.863531] [INFO ] [MAIN ] HBB: Full history saved. [2025-09-23T19:11:58.863615] [INFO ] [MAIN ] Update Progress: 995/2372 symbols completed. HBB took 16.6s. Estimated remaining: 3h 2m 35s. Rate: 7.5 symbols/min [2025-09-23T19:11:59.033136] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:11:59.090448] [DEBUG] [LOCAL ] HBM: Loaded 52908 existing records from primary storage. [2025-09-23T19:11:59.090594] [INFO ] [MAIN ] HBM: Loaded 52908 existing records. [2025-09-23T19:11:59.282082] [WARN ] [MAIN ] HBM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:11:59.282566] [INFO ] [MAIN ] HBM: Wiping existing primary data before full refresh. [2025-09-23T19:11:59.282688] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-09-23T19:11:59.283869] [DEBUG] [LOCAL ] HBM: Deleted primary data file. [2025-09-23T19:11:59.283930] [INFO ] [MAIN ] HBM: Starting full primary refresh. [2025-09-23T19:11:59.407347] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-09. [2025-09-23T19:11:59.652991] [INFO ] [REMOTE ] HBM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:11:59.918509] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-23T19:12:00.202246] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-06. [2025-09-23T19:12:00.869602] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-23T19:12:00.880490] [INFO ] [REMOTE ] HASI: Full fetch complete (67967 records). [2025-09-23T19:12:00.880663] [DEBUG] [VALIDATOR ] HASI: Validating primary data. [2025-09-23T19:12:01.007282] [INFO ] [REMOTE ] HBM: Fetching primary data for 2024-12. [2025-09-23T19:12:01.399923] [DEBUG] [VALIDATOR ] HASI: All expected trading days are present. [2025-09-23T19:12:01.400202] [DEBUG] [VALIDATOR ] HASI: Primary data validation passed. [2025-09-23T19:12:01.401548] [INFO ] [MAIN ] HASI: Fetched primary data is valid. [2025-09-23T19:12:01.401678] [DEBUG] [LOCAL ] HASI: Saving primary data. [2025-09-23T19:12:01.445690] [DEBUG] [LOCAL ] HASI: Trimmed 67967 records to 47221 (keeping 200 days of data) [2025-09-23T19:12:01.447906] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-23T19:12:01.763554] [DEBUG] [LOCAL ] HASI: Primary data saved (47221 records). [2025-09-23T19:12:01.763745] [INFO ] [MAIN ] HASI: Full history saved. [2025-09-23T19:12:01.763897] [INFO ] [MAIN ] Update Progress: 996/2372 symbols completed. HASI took 33.2s. Estimated remaining: 3h 2m 20s. Rate: 7.5 symbols/min [2025-09-23T19:12:01.808558] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-07. [2025-09-23T19:12:01.945120] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:12:01.993534] [DEBUG] [LOCAL ] HCA: Loaded 47317 existing records from primary storage. [2025-09-23T19:12:01.993735] [INFO ] [MAIN ] HCA: Loaded 47317 existing records. [2025-09-23T19:12:02.206491] [WARN ] [MAIN ] HCA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:12:02.207097] [INFO ] [MAIN ] HCA: Wiping existing primary data before full refresh. [2025-09-23T19:12:02.207176] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-09-23T19:12:02.208519] [DEBUG] [LOCAL ] HCA: Deleted primary data file. [2025-09-23T19:12:02.208582] [INFO ] [MAIN ] HCA: Starting full primary refresh. [2025-09-23T19:12:02.569248] [INFO ] [REMOTE ] HCA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:12:02.602220] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-02. [2025-09-23T19:12:03.309851] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-09-23T19:12:03.402196] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-01. [2025-09-23T19:12:03.541421] [DEBUG] [REMOTE ] HAYW: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-09-23T19:12:03.541789] [WARN ] [REMOTE ] HAYW: No data returned for month 2025-07 [2025-09-23T19:12:04.202252] [INFO ] [REMOTE ] HCA: Fetching primary data for 2024-12. [2025-09-23T19:12:05.002247] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-08. [2025-09-23T19:12:05.358042] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-02 (2.76 seconds). [2025-09-23T19:12:05.689504] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-09-23T19:12:05.783738] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-23T19:12:05.802166] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-01. [2025-09-23T19:12:06.173456] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-23T19:12:06.602248] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-03. [2025-09-23T19:12:07.275550] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-23T19:12:07.402204] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-02. [2025-09-23T19:12:07.887250] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-23T19:12:08.202208] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-04. [2025-09-23T19:12:08.795905] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-23T19:12:09.002191] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-03. [2025-09-23T19:12:09.802227] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-02. [2025-09-23T19:12:09.893151] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-23T19:12:10.582553] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-23T19:12:10.602162] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-04. [2025-09-23T19:12:11.182344] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-23T19:12:11.402219] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-05. [2025-09-23T19:12:12.140038] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-23T19:12:12.202203] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-05. [2025-09-23T19:12:12.758599] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-23T19:12:13.002252] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-09. [2025-09-23T19:12:13.626119] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-23T19:12:13.802212] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-06. [2025-09-23T19:12:14.602193] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-06. [2025-09-23T19:12:14.694113] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-23T19:12:14.703917] [INFO ] [REMOTE ] HAYW: Full fetch complete (63344 records). [2025-09-23T19:12:14.704082] [DEBUG] [VALIDATOR ] HAYW: Validating primary data. [2025-09-23T19:12:14.914209] [WARN ] [VALIDATOR ] HAYW: Validation failed - insufficient historical data. Have 178 unique days, need 200 days [2025-09-23T19:12:14.914880] [FATAL] [MAIN ] HAYW: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:12:14.914988] [WARN ] [MAIN ] HAYW: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:12:14.915123] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-09-23T19:12:14.915219] [DEBUG] [LOCAL ] HAYW: No primary data file found to delete. [2025-09-23T19:12:14.915442] [INFO ] [LOCAL ] HAYW: Starting deletion of derivative data. [2025-09-23T19:12:14.915917] [DEBUG] [LOCAL ] HAYW: Deleted derivative data file. [2025-09-23T19:12:14.916058] [INFO ] [MAIN ] Update Progress: 997/2372 symbols completed. HAYW took 43.2s. Estimated remaining: 3h 2m 19s. Rate: 7.5 symbols/min [2025-09-23T19:12:15.402257] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-03. [2025-09-23T19:12:16.485155] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-23T19:12:16.497045] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-07. [2025-09-23T19:12:16.523256] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-06 (2.72 seconds). [2025-09-23T19:12:17.002253] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-07. [2025-09-23T19:12:17.406666] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-23T19:12:17.802241] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-04. [2025-09-23T19:12:17.929131] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-23T19:12:18.602165] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-08. [2025-09-23T19:12:18.815943] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-23T19:12:19.330840] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-23T19:12:19.402251] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-05. [2025-09-23T19:12:20.062623] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-23T19:12:20.202217] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-09. [2025-09-23T19:12:21.002177] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-08. [2025-09-23T19:12:21.352449] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-23T19:12:21.551618] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-23T19:12:21.560726] [INFO ] [REMOTE ] HBI: Full fetch complete (76912 records). [2025-09-23T19:12:21.560918] [DEBUG] [VALIDATOR ] HBI: Validating primary data. [2025-09-23T19:12:21.807592] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-06. [2025-09-23T19:12:21.977691] [DEBUG] [VALIDATOR ] HBI: All expected trading days are present. [2025-09-23T19:12:21.977778] [DEBUG] [VALIDATOR ] HBI: Primary data validation passed. [2025-09-23T19:12:21.978767] [INFO ] [MAIN ] HBI: Fetched primary data is valid. [2025-09-23T19:12:21.978848] [DEBUG] [LOCAL ] HBI: Saving primary data. [2025-09-23T19:12:21.985447] [DEBUG] [LOCAL ] HBI: Trimmed 76912 records to 53017 (keeping 200 days of data) [2025-09-23T19:12:22.290165] [DEBUG] [LOCAL ] HBI: Primary data saved (53017 records). [2025-09-23T19:12:22.290347] [INFO ] [MAIN ] HBI: Full history saved. [2025-09-23T19:12:22.290511] [INFO ] [MAIN ] Update Progress: 998/2372 symbols completed. HBI took 38.9s. Estimated remaining: 3h 2m 10s. Rate: 7.5 symbols/min [2025-09-23T19:12:22.354596] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-23T19:12:22.602206] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-09. [2025-09-23T19:12:23.154853] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-23T19:12:23.402257] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-07. [2025-09-23T19:12:24.020120] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-23T19:12:24.027967] [INFO ] [REMOTE ] HCA: Full fetch complete (69169 records). [2025-09-23T19:12:24.028126] [DEBUG] [VALIDATOR ] HCA: Validating primary data. [2025-09-23T19:12:24.414446] [DEBUG] [VALIDATOR ] HCA: All expected trading days are present. [2025-09-23T19:12:24.414529] [DEBUG] [VALIDATOR ] HCA: Primary data validation passed. [2025-09-23T19:12:24.415430] [INFO ] [MAIN ] HCA: Fetched primary data is valid. [2025-09-23T19:12:24.415495] [DEBUG] [LOCAL ] HCA: Saving primary data. [2025-09-23T19:12:24.416890] [DEBUG] [LOCAL ] HCA: Trimmed 69169 records to 47271 (keeping 200 days of data) [2025-09-23T19:12:24.744942] [DEBUG] [LOCAL ] HCA: Primary data saved (47271 records). [2025-09-23T19:12:24.745187] [INFO ] [MAIN ] HCA: Full history saved. [2025-09-23T19:12:24.745322] [INFO ] [MAIN ] Update Progress: 999/2372 symbols completed. HCA took 23.0s. Estimated remaining: 3h 1m 55s. Rate: 7.5 symbols/min [2025-09-23T19:12:24.810624] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-23T19:12:24.822272] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-08. [2025-09-23T19:12:26.259386] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-23T19:12:26.272032] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-09. [2025-09-23T19:12:27.950952] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-23T19:12:27.962255] [INFO ] [REMOTE ] HBM: Full fetch complete (76056 records). [2025-09-23T19:12:27.962377] [DEBUG] [VALIDATOR ] HBM: Validating primary data. [2025-09-23T19:12:28.357449] [DEBUG] [VALIDATOR ] HBM: All expected trading days are present. [2025-09-23T19:12:28.357526] [DEBUG] [VALIDATOR ] HBM: Primary data validation passed. [2025-09-23T19:12:28.358406] [INFO ] [MAIN ] HBM: Fetched primary data is valid. [2025-09-23T19:12:28.358571] [DEBUG] [LOCAL ] HBM: Saving primary data. [2025-09-23T19:12:28.360728] [DEBUG] [LOCAL ] HBM: Trimmed 76056 records to 52903 (keeping 200 days of data) [2025-09-23T19:12:28.686686] [DEBUG] [LOCAL ] HBM: Primary data saved (52903 records). [2025-09-23T19:12:28.687358] [INFO ] [MAIN ] HBM: Full history saved. [2025-09-23T19:12:28.687660] [INFO ] [MAIN ] Update Progress: 1000/2372 symbols completed. HBM took 29.8s. Estimated remaining: 3h 1m 41s. Rate: 7.6 symbols/min [2025-09-23T19:12:29.289083] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:12:29.336756] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:12:29.345775] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:12:29.404079] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:12:29.404323] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-09-23T19:12:29.404373] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-09-23T19:12:29.404685] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-09-23T19:12:29.404843] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-09-23T19:12:29.405037] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-09-23T19:12:29.405092] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-09-23T19:12:29.525286] [DEBUG] [LOCAL ] HCI: Loaded 13850 existing records from primary storage. [2025-09-23T19:12:29.541971] [INFO ] [MAIN ] HCI: Loaded 13850 existing records. [2025-09-23T19:12:29.906755] [DEBUG] [LOCAL ] HCC: Loaded 45340 existing records from primary storage. [2025-09-23T19:12:29.910937] [INFO ] [MAIN ] HCC: Loaded 45340 existing records. [2025-09-23T19:12:30.044749] [WARN ] [MAIN ] HCI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:12:30.068347] [DEBUG] [LOCAL ] HD: Loaded 53519 existing records from primary storage. [2025-09-23T19:12:30.136480] [INFO ] [MAIN ] HD: Loaded 53519 existing records. [2025-09-23T19:12:30.113840] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:12:30.140120] [INFO ] [MAIN ] HCI: Wiping existing primary data before full refresh. [2025-09-23T19:12:30.140529] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-09-23T19:12:30.140452] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2024-12. [2025-09-23T19:12:30.219534] [DEBUG] [LOCAL ] HCI: Deleted primary data file. [2025-09-23T19:12:30.219862] [INFO ] [MAIN ] HCI: Starting full primary refresh. [2025-09-23T19:12:30.380167] [WARN ] [MAIN ] HCC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:12:30.404198] [INFO ] [MAIN ] HCC: Wiping existing primary data before full refresh. [2025-09-23T19:12:30.414549] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-09-23T19:12:30.438063] [DEBUG] [LOCAL ] HCC: Deleted primary data file. [2025-09-23T19:12:30.448559] [INFO ] [MAIN ] HCC: Starting full primary refresh. [2025-09-23T19:12:30.647581] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-23T19:12:30.720442] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-01. [2025-09-23T19:12:30.714243] [WARN ] [MAIN ] HD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:12:30.765717] [INFO ] [MAIN ] HD: Wiping existing primary data before full refresh. [2025-09-23T19:12:30.777454] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-09-23T19:12:30.825978] [DEBUG] [LOCAL ] HD: Deleted primary data file. [2025-09-23T19:12:30.831761] [INFO ] [MAIN ] HD: Starting full primary refresh. [2025-09-23T19:12:31.064567] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-23T19:12:31.146136] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-09-23T19:12:31.235307] [INFO ] [REMOTE ] HCI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:12:31.324567] [INFO ] [REMOTE ] HCI: Fetching primary data for 2024-12. [2025-09-23T19:12:31.365145] [INFO ] [REMOTE ] HCC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:12:31.403917] [INFO ] [REMOTE ] HCC: Fetching primary data for 2024-12. [2025-09-23T19:12:31.553528] [INFO ] [REMOTE ] HD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:12:31.553920] [INFO ] [REMOTE ] HD: Fetching primary data for 2024-12. [2025-09-23T19:12:31.569664] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-23T19:12:31.570522] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-09-23T19:12:31.814263] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-09-23T19:12:31.815240] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-09-23T19:12:32.038159] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.22 seconds). [2025-09-23T19:12:32.094967] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-23T19:12:32.202164] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-09-23T19:12:32.508765] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-23T19:12:32.511048] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-23T19:12:33.002200] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-01. [2025-09-23T19:12:33.422037] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-23T19:12:33.802243] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-09-23T19:12:34.074513] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-09-23T19:12:34.232774] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-23T19:12:34.602204] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-09-23T19:12:34.859541] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-09-23T19:12:35.402198] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-02. [2025-09-23T19:12:36.202250] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-09-23T19:12:36.896020] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-23T19:12:36.934786] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-23T19:12:37.002162] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-03. [2025-09-23T19:12:37.802197] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-01. [2025-09-23T19:12:38.287632] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-23T19:12:38.602188] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-01. [2025-09-23T19:12:39.402217] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-09-23T19:12:39.587140] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-23T19:12:39.731878] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-23T19:12:39.732602] [INFO ] [REMOTE ] HCXY: Full fetch complete (606 records). [2025-09-23T19:12:39.732706] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-09-23T19:12:39.916281] [WARN ] [VALIDATOR ] HCXY: Validation failed - insufficient historical data. Have 167 unique days, need 200 days [2025-09-23T19:12:39.916559] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:12:39.916698] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:12:39.917000] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-09-23T19:12:39.917221] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-09-23T19:12:39.917449] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-09-23T19:12:39.917620] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-09-23T19:12:39.917823] [INFO ] [MAIN ] Update Progress: 1001/2372 symbols completed. HCXY took 11.2s. Estimated remaining: 3h 1m 38s. Rate: 7.5 symbols/min [2025-09-23T19:12:40.093225] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:12:40.135166] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-09-23T19:12:40.200265] [DEBUG] [LOCAL ] HDB: Loaded 51938 existing records from primary storage. [2025-09-23T19:12:40.200448] [INFO ] [MAIN ] HDB: Loaded 51938 existing records. [2025-09-23T19:12:40.211631] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-02. [2025-09-23T19:12:40.388145] [WARN ] [MAIN ] HDB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:12:40.388381] [INFO ] [MAIN ] HDB: Wiping existing primary data before full refresh. [2025-09-23T19:12:40.388435] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-09-23T19:12:40.389990] [DEBUG] [LOCAL ] HDB: Deleted primary data file. [2025-09-23T19:12:40.390060] [INFO ] [MAIN ] HDB: Starting full primary refresh. [2025-09-23T19:12:40.753805] [INFO ] [REMOTE ] HDB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:12:40.806354] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-23T19:12:41.002185] [INFO ] [REMOTE ] HDB: Fetching primary data for 2024-12. [2025-09-23T19:12:41.802233] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-02. [2025-09-23T19:12:42.428910] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-23T19:12:42.602257] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-04. [2025-09-23T19:12:43.355053] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-23T19:12:43.402141] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-03. [2025-09-23T19:12:43.993532] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-23T19:12:44.202188] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-05. [2025-09-23T19:12:45.002226] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-01. [2025-09-23T19:12:45.449104] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-23T19:12:45.570377] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-23T19:12:45.802245] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-03. [2025-09-23T19:12:46.275383] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-23T19:12:46.418902] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-23T19:12:46.602261] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-02. [2025-09-23T19:12:47.402219] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-06. [2025-09-23T19:12:47.856799] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-23T19:12:48.202206] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-03. [2025-09-23T19:12:48.687184] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-23T19:12:49.002217] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-07. [2025-09-23T19:12:49.802235] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-04. [2025-09-23T19:12:50.022272] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-23T19:12:50.332248] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-23T19:12:50.508217] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-23T19:12:50.602206] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-04. [2025-09-23T19:12:51.402274] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-05. [2025-09-23T19:12:52.117634] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-23T19:12:52.202155] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-04. [2025-09-23T19:12:52.356389] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-23T19:12:53.002210] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-05. [2025-09-23T19:12:53.802241] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-06. [2025-09-23T19:12:54.075904] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-23T19:12:54.372348] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-23T19:12:54.514082] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-23T19:12:54.602149] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-07. [2025-09-23T19:12:55.259197] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-23T19:12:55.402209] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-08. [2025-09-23T19:12:56.202223] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-06. [2025-09-23T19:12:56.414575] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-23T19:12:57.002294] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-09. [2025-09-23T19:12:57.695084] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-23T19:12:57.802287] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-07. [2025-09-23T19:12:57.925633] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-23T19:12:57.928783] [INFO ] [REMOTE ] HCI: Full fetch complete (19389 records). [2025-09-23T19:12:57.928883] [DEBUG] [VALIDATOR ] HCI: Validating primary data. [2025-09-23T19:12:58.296631] [DEBUG] [VALIDATOR ] HCI: All expected trading days are present. [2025-09-23T19:12:58.296780] [DEBUG] [VALIDATOR ] HCI: Primary data validation passed. [2025-09-23T19:12:58.297219] [INFO ] [MAIN ] HCI: Fetched primary data is valid. [2025-09-23T19:12:58.297258] [DEBUG] [LOCAL ] HCI: Saving primary data. [2025-09-23T19:12:58.297866] [DEBUG] [LOCAL ] HCI: Trimmed 19389 records to 13926 (keeping 200 days of data) [2025-09-23T19:12:58.387390] [DEBUG] [LOCAL ] HCI: Primary data saved (13926 records). [2025-09-23T19:12:58.387529] [INFO ] [MAIN ] HCI: Full history saved. [2025-09-23T19:12:58.387615] [INFO ] [MAIN ] Update Progress: 1002/2372 symbols completed. HCI took 29.7s. Estimated remaining: 3h 1m 44s. Rate: 7.5 symbols/min [2025-09-23T19:12:58.555324] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:12:58.602841] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-05. [2025-09-23T19:12:58.604721] [DEBUG] [LOCAL ] HE: Loaded 49245 existing records from primary storage. [2025-09-23T19:12:58.604968] [INFO ] [MAIN ] HE: Loaded 49245 existing records. [2025-09-23T19:12:58.786760] [WARN ] [MAIN ] HE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:12:58.787017] [INFO ] [MAIN ] HE: Wiping existing primary data before full refresh. [2025-09-23T19:12:58.787070] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-09-23T19:12:58.788075] [DEBUG] [LOCAL ] HE: Deleted primary data file. [2025-09-23T19:12:58.788160] [INFO ] [MAIN ] HE: Starting full primary refresh. [2025-09-23T19:12:59.138194] [INFO ] [REMOTE ] HE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:12:59.199900] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-23T19:12:59.402206] [INFO ] [REMOTE ] HE: Fetching primary data for 2024-12. [2025-09-23T19:13:00.202223] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-08. [2025-09-23T19:13:00.426370] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-23T19:13:00.938272] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-23T19:13:01.002165] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-01. [2025-09-23T19:13:01.506931] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-23T19:13:01.802200] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-08. [2025-09-23T19:13:02.490138] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-23T19:13:02.602207] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-02. [2025-09-23T19:13:03.029999] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-23T19:13:03.402202] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-06. [2025-09-23T19:13:03.995530] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-23T19:13:04.202204] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-09. [2025-09-23T19:13:05.002164] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-09. [2025-09-23T19:13:05.165703] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-23T19:13:05.432292] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-23T19:13:05.439507] [INFO ] [REMOTE ] HCC: Full fetch complete (64249 records). [2025-09-23T19:13:05.439612] [DEBUG] [VALIDATOR ] HCC: Validating primary data. [2025-09-23T19:13:05.804740] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-03. [2025-09-23T19:13:05.844787] [DEBUG] [VALIDATOR ] HCC: All expected trading days are present. [2025-09-23T19:13:05.844876] [DEBUG] [VALIDATOR ] HCC: Primary data validation passed. [2025-09-23T19:13:05.845717] [INFO ] [MAIN ] HCC: Fetched primary data is valid. [2025-09-23T19:13:05.845780] [DEBUG] [LOCAL ] HCC: Saving primary data. [2025-09-23T19:13:05.848041] [DEBUG] [LOCAL ] HCC: Trimmed 64249 records to 45383 (keeping 200 days of data) [2025-09-23T19:13:06.133669] [DEBUG] [LOCAL ] HCC: Primary data saved (45383 records). [2025-09-23T19:13:06.133830] [INFO ] [MAIN ] HCC: Full history saved. [2025-09-23T19:13:06.133936] [INFO ] [MAIN ] Update Progress: 1003/2372 symbols completed. HCC took 37.4s. Estimated remaining: 3h 1m 36s. Rate: 7.5 symbols/min [2025-09-23T19:13:06.304783] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:13:06.341633] [DEBUG] [LOCAL ] HEI: Loaded 32667 existing records from primary storage. [2025-09-23T19:13:06.341799] [INFO ] [MAIN ] HEI: Loaded 32667 existing records. [2025-09-23T19:13:06.526626] [WARN ] [MAIN ] HEI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:13:06.527136] [INFO ] [MAIN ] HEI: Wiping existing primary data before full refresh. [2025-09-23T19:13:06.527238] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-09-23T19:13:06.528454] [DEBUG] [LOCAL ] HEI: Deleted primary data file. [2025-09-23T19:13:06.528518] [INFO ] [MAIN ] HEI: Starting full primary refresh. [2025-09-23T19:13:06.607728] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-07. [2025-09-23T19:13:06.718603] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-23T19:13:06.816146] [INFO ] [REMOTE ] HDB: Full fetch complete (75232 records). [2025-09-23T19:13:06.838057] [DEBUG] [VALIDATOR ] HDB: Validating primary data. [2025-09-23T19:13:07.068602] [INFO ] [REMOTE ] HEI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:13:07.342926] [DEBUG] [VALIDATOR ] HDB: All expected trading days are present. [2025-09-23T19:13:07.343042] [DEBUG] [VALIDATOR ] HDB: Primary data validation passed. [2025-09-23T19:13:07.344038] [INFO ] [MAIN ] HDB: Fetched primary data is valid. [2025-09-23T19:13:07.344121] [DEBUG] [LOCAL ] HDB: Saving primary data. [2025-09-23T19:13:07.346038] [DEBUG] [LOCAL ] HDB: Trimmed 75232 records to 51936 (keeping 200 days of data) [2025-09-23T19:13:07.375546] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-23T19:13:07.436902] [INFO ] [REMOTE ] HEI: Fetching primary data for 2024-12. [2025-09-23T19:13:07.700634] [DEBUG] [LOCAL ] HDB: Primary data saved (51936 records). [2025-09-23T19:13:07.700797] [INFO ] [MAIN ] HDB: Full history saved. [2025-09-23T19:13:07.700883] [INFO ] [MAIN ] Update Progress: 1004/2372 symbols completed. HDB took 27.8s. Estimated remaining: 3h 1m 19s. Rate: 7.5 symbols/min [2025-09-23T19:13:07.868162] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:13:07.875499] [DEBUG] [LOCAL ] HEQ: Loaded 6186 existing records from primary storage. [2025-09-23T19:13:07.875590] [INFO ] [MAIN ] HEQ: Loaded 6186 existing records. [2025-09-23T19:13:08.056919] [WARN ] [MAIN ] HEQ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:13:08.057171] [INFO ] [MAIN ] HEQ: Wiping existing primary data before full refresh. [2025-09-23T19:13:08.057222] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-09-23T19:13:08.057532] [DEBUG] [LOCAL ] HEQ: Deleted primary data file. [2025-09-23T19:13:08.057594] [INFO ] [MAIN ] HEQ: Starting full primary refresh. [2025-09-23T19:13:08.207345] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-04. [2025-09-23T19:13:08.421634] [INFO ] [REMOTE ] HEQ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:13:08.535737] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-23T19:13:08.696588] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-23T19:13:09.002230] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-01. [2025-09-23T19:13:09.666209] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-23T19:13:09.802214] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-05. [2025-09-23T19:13:10.109134] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-23T19:13:10.602258] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-02. [2025-09-23T19:13:11.070042] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-23T19:13:11.402215] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-08. [2025-09-23T19:13:11.706556] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-23T19:13:12.202282] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-06. [2025-09-23T19:13:13.002293] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-03. [2025-09-23T19:13:13.174874] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-23T19:13:13.454133] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-23T19:13:13.802259] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-07. [2025-09-23T19:13:14.297931] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-23T19:13:14.602281] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-09. [2025-09-23T19:13:15.110715] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-23T19:13:15.402227] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2024-12. [2025-09-23T19:13:15.815938] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-09-23T19:13:16.202253] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-08. [2025-09-23T19:13:16.583193] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-23T19:13:16.592205] [INFO ] [REMOTE ] HD: Full fetch complete (77445 records). [2025-09-23T19:13:16.592361] [DEBUG] [VALIDATOR ] HD: Validating primary data. [2025-09-23T19:13:16.989676] [DEBUG] [VALIDATOR ] HD: All expected trading days are present. [2025-09-23T19:13:16.989795] [DEBUG] [VALIDATOR ] HD: Primary data validation passed. [2025-09-23T19:13:16.990740] [INFO ] [MAIN ] HD: Fetched primary data is valid. [2025-09-23T19:13:16.990806] [DEBUG] [LOCAL ] HD: Saving primary data. [2025-09-23T19:13:16.992341] [DEBUG] [LOCAL ] HD: Trimmed 77445 records to 53520 (keeping 200 days of data) [2025-09-23T19:13:17.052397] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-04. [2025-09-23T19:13:17.337061] [DEBUG] [LOCAL ] HD: Primary data saved (53520 records). [2025-09-23T19:13:17.337213] [INFO ] [MAIN ] HD: Full history saved. [2025-09-23T19:13:17.339124] [INFO ] [MAIN ] Update Progress: 1005/2372 symbols completed. HD took 48.6s. Estimated remaining: 3h 1m 14s. Rate: 7.5 symbols/min [2025-09-23T19:13:17.510158] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:13:17.582927] [DEBUG] [LOCAL ] HESM: Loaded 48154 existing records from primary storage. [2025-09-23T19:13:17.584713] [INFO ] [MAIN ] HESM: Loaded 48154 existing records. [2025-09-23T19:13:17.584478] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-23T19:13:17.787205] [WARN ] [MAIN ] HESM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:13:17.787578] [INFO ] [MAIN ] HESM: Wiping existing primary data before full refresh. [2025-09-23T19:13:17.787683] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-09-23T19:13:17.789145] [DEBUG] [LOCAL ] HESM: Deleted primary data file. [2025-09-23T19:13:17.789212] [INFO ] [MAIN ] HESM: Starting full primary refresh. [2025-09-23T19:13:17.810162] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-01. [2025-09-23T19:13:18.186059] [INFO ] [REMOTE ] HESM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:13:18.340329] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-23T19:13:18.602263] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-09. [2025-09-23T19:13:18.736975] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-23T19:13:19.402290] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-05. [2025-09-23T19:13:19.938946] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-23T19:13:19.947266] [INFO ] [REMOTE ] HE: Full fetch complete (72502 records). [2025-09-23T19:13:19.947421] [DEBUG] [VALIDATOR ] HE: Validating primary data. [2025-09-23T19:13:20.207340] [INFO ] [REMOTE ] HESM: Fetching primary data for 2024-12. [2025-09-23T19:13:20.342804] [DEBUG] [VALIDATOR ] HE: All expected trading days are present. [2025-09-23T19:13:20.343028] [DEBUG] [VALIDATOR ] HE: Primary data validation passed. [2025-09-23T19:13:20.343983] [INFO ] [MAIN ] HE: Fetched primary data is valid. [2025-09-23T19:13:20.344049] [DEBUG] [LOCAL ] HE: Saving primary data. [2025-09-23T19:13:20.345624] [DEBUG] [LOCAL ] HE: Trimmed 72502 records to 49238 (keeping 200 days of data) [2025-09-23T19:13:20.664280] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-23T19:13:20.683287] [DEBUG] [LOCAL ] HE: Primary data saved (49238 records). [2025-09-23T19:13:20.683414] [INFO ] [MAIN ] HE: Full history saved. [2025-09-23T19:13:20.683493] [INFO ] [MAIN ] Update Progress: 1006/2372 symbols completed. HE took 22.3s. Estimated remaining: 3h 0m 59s. Rate: 7.5 symbols/min [2025-09-23T19:13:20.855109] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:13:20.855310] [DEBUG] [LOCAL ] HF: No existing data file found in primary storage. [2025-09-23T19:13:20.855364] [WARN ] [MAIN ] HF: No existing data found, performing full refresh instead. [2025-09-23T19:13:20.855522] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-09-23T19:13:20.855564] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-09-23T19:13:20.855605] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-09-23T19:13:20.855637] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-09-23T19:13:21.007329] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-06. [2025-09-23T19:13:21.224876] [INFO ] [REMOTE ] HF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:13:21.450719] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-23T19:13:21.802183] [INFO ] [REMOTE ] HF: Fetching primary data for 2024-12. [2025-09-23T19:13:22.048198] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-23T19:13:22.058410] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2024-12 (0.26 seconds). [2025-09-23T19:13:22.602271] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-02. [2025-09-23T19:13:23.014904] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-23T19:13:23.402255] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-01. [2025-09-23T19:13:23.647191] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-01 (0.24 seconds). [2025-09-23T19:13:24.202263] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-09-23T19:13:24.503611] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-09-23T19:13:25.002247] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-07. [2025-09-23T19:13:25.802199] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-09-23T19:13:26.060139] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.26 seconds). [2025-09-23T19:13:26.292720] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-23T19:13:26.602230] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-03. [2025-09-23T19:13:26.978510] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-23T19:13:27.402191] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-04. [2025-09-23T19:13:27.850338] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-23T19:13:28.202203] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-08. [2025-09-23T19:13:29.002225] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-01. [2025-09-23T19:13:29.315299] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-23T19:13:29.802178] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-05. [2025-09-23T19:13:30.120246] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-23T19:13:30.214907] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-23T19:13:30.602255] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-06. [2025-09-23T19:13:31.185169] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-23T19:13:31.402188] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-07. [2025-09-23T19:13:31.805879] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-23T19:13:32.202212] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-09. [2025-09-23T19:13:33.002205] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-09-23T19:13:33.267781] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.27 seconds). [2025-09-23T19:13:33.766252] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-23T19:13:33.771308] [INFO ] [REMOTE ] HEI: Full fetch complete (49169 records). [2025-09-23T19:13:33.771467] [DEBUG] [VALIDATOR ] HEI: Validating primary data. [2025-09-23T19:13:33.807263] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-02. [2025-09-23T19:13:34.164925] [DEBUG] [VALIDATOR ] HEI: All expected trading days are present. [2025-09-23T19:13:34.165020] [DEBUG] [VALIDATOR ] HEI: Primary data validation passed. [2025-09-23T19:13:34.165917] [INFO ] [MAIN ] HEI: Fetched primary data is valid. [2025-09-23T19:13:34.165982] [DEBUG] [LOCAL ] HEI: Saving primary data. [2025-09-23T19:13:34.167088] [DEBUG] [LOCAL ] HEI: Trimmed 49169 records to 32626 (keeping 200 days of data) [2025-09-23T19:13:34.370764] [DEBUG] [LOCAL ] HEI: Primary data saved (32626 records). [2025-09-23T19:13:34.370911] [INFO ] [MAIN ] HEI: Full history saved. [2025-09-23T19:13:34.371001] [INFO ] [MAIN ] Update Progress: 1007/2372 symbols completed. HEI took 28.2s. Estimated remaining: 3h 0m 59s. Rate: 7.5 symbols/min [2025-09-23T19:13:34.553048] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:13:34.553224] [DEBUG] [LOCAL ] HFND: No existing data file found in primary storage. [2025-09-23T19:13:34.553261] [WARN ] [MAIN ] HFND: No existing data found, performing full refresh instead. [2025-09-23T19:13:34.553412] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-09-23T19:13:34.553454] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-09-23T19:13:34.553496] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-09-23T19:13:34.553530] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-09-23T19:13:34.609466] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-09-23T19:13:34.918280] [INFO ] [REMOTE ] HFND: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:13:34.986588] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-23T19:13:35.059770] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-23T19:13:35.402194] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-09-23T19:13:35.667172] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-09-23T19:13:36.202211] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-03. [2025-09-23T19:13:37.002214] [INFO ] [REMOTE ] HFND: Fetching primary data for 2024-12. [2025-09-23T19:13:37.414450] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-09-23T19:13:37.589512] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-23T19:13:37.802195] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-04. [2025-09-23T19:13:38.602224] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-09-23T19:13:38.841544] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-09-23T19:13:39.102189] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-23T19:13:39.402270] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-09-23T19:13:39.727577] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-23T19:13:40.202251] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-09-23T19:13:40.545038] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-23T19:13:40.545888] [INFO ] [REMOTE ] HF: Full fetch complete (507 records). [2025-09-23T19:13:40.545964] [DEBUG] [VALIDATOR ] HF: Validating primary data. [2025-09-23T19:13:40.546370] [FATAL] [VALIDATOR ] HF: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T19:13:40.546459] [FATAL] [MAIN ] HF: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:13:40.546502] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:13:40.546543] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-09-23T19:13:40.546614] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-09-23T19:13:40.546695] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-09-23T19:13:40.547112] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-09-23T19:13:40.547465] [INFO ] [MAIN ] Update Progress: 1008/2372 symbols completed. HF took 19.9s. Estimated remaining: 3h 0m 49s. Rate: 7.5 symbols/min [2025-09-23T19:13:40.729120] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:13:40.747999] [DEBUG] [LOCAL ] HFRO: Loaded 17449 existing records from primary storage. [2025-09-23T19:13:40.748154] [INFO ] [MAIN ] HFRO: Loaded 17449 existing records. [2025-09-23T19:13:40.938467] [WARN ] [MAIN ] HFRO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:13:40.938785] [INFO ] [MAIN ] HFRO: Wiping existing primary data before full refresh. [2025-09-23T19:13:40.938840] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-09-23T19:13:40.939431] [DEBUG] [LOCAL ] HFRO: Deleted primary data file. [2025-09-23T19:13:40.939491] [INFO ] [MAIN ] HFRO: Starting full primary refresh. [2025-09-23T19:13:41.007424] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-08. [2025-09-23T19:13:41.308306] [INFO ] [REMOTE ] HFRO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:13:41.550247] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-23T19:13:41.802191] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-09. [2025-09-23T19:13:42.337838] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-23T19:13:42.339931] [INFO ] [REMOTE ] HEQ: Full fetch complete (9054 records). [2025-09-23T19:13:42.340000] [DEBUG] [VALIDATOR ] HEQ: Validating primary data. [2025-09-23T19:13:42.607434] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2024-12. [2025-09-23T19:13:42.758448] [DEBUG] [VALIDATOR ] HEQ: All expected trading days are present. [2025-09-23T19:13:42.758548] [DEBUG] [VALIDATOR ] HEQ: Primary data validation passed. [2025-09-23T19:13:42.758924] [INFO ] [MAIN ] HEQ: Fetched primary data is valid. [2025-09-23T19:13:42.758995] [DEBUG] [LOCAL ] HEQ: Saving primary data. [2025-09-23T19:13:42.759574] [DEBUG] [LOCAL ] HEQ: Trimmed 9054 records to 6183 (keeping 200 days of data) [2025-09-23T19:13:42.796988] [DEBUG] [LOCAL ] HEQ: Primary data saved (6183 records). [2025-09-23T19:13:42.797096] [INFO ] [MAIN ] HEQ: Full history saved. [2025-09-23T19:13:42.797193] [INFO ] [MAIN ] Update Progress: 1009/2372 symbols completed. HEQ took 35.1s. Estimated remaining: 3h 0m 33s. Rate: 7.5 symbols/min [2025-09-23T19:13:42.978409] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:13:42.993236] [DEBUG] [LOCAL ] HGER: Loaded 12907 existing records from primary storage. [2025-09-23T19:13:42.993362] [INFO ] [MAIN ] HGER: Loaded 12907 existing records. [2025-09-23T19:13:43.186341] [WARN ] [MAIN ] HGER: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:13:43.186625] [INFO ] [MAIN ] HGER: Wiping existing primary data before full refresh. [2025-09-23T19:13:43.186707] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-09-23T19:13:43.187255] [DEBUG] [LOCAL ] HGER: Deleted primary data file. [2025-09-23T19:13:43.187314] [INFO ] [MAIN ] HGER: Starting full primary refresh. [2025-09-23T19:13:43.410293] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-01. [2025-09-23T19:13:43.557892] [INFO ] [REMOTE ] HGER: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:13:43.575525] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-23T19:13:43.770046] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-23T19:13:44.202248] [INFO ] [REMOTE ] HGER: Fetching primary data for 2024-12. [2025-09-23T19:13:44.688419] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-23T19:13:45.002240] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-01. [2025-09-23T19:13:45.422399] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-23T19:13:45.802190] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-09-23T19:13:46.220952] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-23T19:13:46.602201] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-01. [2025-09-23T19:13:47.337283] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-23T19:13:47.402203] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-02. [2025-09-23T19:13:47.783964] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-23T19:13:48.202204] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-02. [2025-09-23T19:13:49.002249] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-03. [2025-09-23T19:13:49.173034] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-23T19:13:49.462220] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-23T19:13:49.802275] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-09-23T19:13:50.088043] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-09-23T19:13:50.602213] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-04. [2025-09-23T19:13:51.140001] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-23T19:13:51.402231] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-05. [2025-09-23T19:13:51.910088] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-23T19:13:52.202203] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-09-23T19:13:52.627987] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-23T19:13:53.002200] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-09-23T19:13:53.276542] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-09-23T19:13:53.802214] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-09-23T19:13:54.081211] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-09-23T19:13:54.602257] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-06. [2025-09-23T19:13:55.380632] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-23T19:13:55.402136] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-07. [2025-09-23T19:13:56.202169] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-05. [2025-09-23T19:13:56.350664] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-23T19:13:57.002206] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-08. [2025-09-23T19:13:57.465238] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-23T19:13:57.546930] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-23T19:13:57.802209] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-09. [2025-09-23T19:13:58.594290] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-23T19:13:58.598075] [INFO ] [REMOTE ] HGER: Full fetch complete (16072 records). [2025-09-23T19:13:58.598161] [DEBUG] [VALIDATOR ] HGER: Validating primary data. [2025-09-23T19:13:58.609436] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-06. [2025-09-23T19:13:58.979507] [DEBUG] [VALIDATOR ] HGER: All expected trading days are present. [2025-09-23T19:13:58.979591] [DEBUG] [VALIDATOR ] HGER: Primary data validation passed. [2025-09-23T19:13:58.980009] [INFO ] [MAIN ] HGER: Fetched primary data is valid. [2025-09-23T19:13:58.980073] [DEBUG] [LOCAL ] HGER: Saving primary data. [2025-09-23T19:13:58.980707] [DEBUG] [LOCAL ] HGER: Trimmed 16072 records to 13005 (keeping 200 days of data) [2025-09-23T19:13:59.062145] [DEBUG] [LOCAL ] HGER: Primary data saved (13005 records). [2025-09-23T19:13:59.062293] [INFO ] [MAIN ] HGER: Full history saved. [2025-09-23T19:13:59.062379] [INFO ] [MAIN ] Update Progress: 1010/2372 symbols completed. HGER took 16.3s. Estimated remaining: 3h 0m 36s. Rate: 7.5 symbols/min [2025-09-23T19:13:59.234987] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:13:59.245869] [DEBUG] [LOCAL ] HGLB: Loaded 9732 existing records from primary storage. [2025-09-23T19:13:59.246010] [INFO ] [MAIN ] HGLB: Loaded 9732 existing records. [2025-09-23T19:13:59.407957] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-03. [2025-09-23T19:13:59.435917] [WARN ] [MAIN ] HGLB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:13:59.437218] [INFO ] [MAIN ] HGLB: Wiping existing primary data before full refresh. [2025-09-23T19:13:59.437309] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-09-23T19:13:59.437911] [DEBUG] [LOCAL ] HGLB: Deleted primary data file. [2025-09-23T19:13:59.437975] [INFO ] [MAIN ] HGLB: Starting full primary refresh. [2025-09-23T19:13:59.801007] [INFO ] [REMOTE ] HGLB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:14:00.008262] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-23T19:14:00.202323] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2024-12. [2025-09-23T19:14:00.306206] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-23T19:14:00.729079] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-23T19:14:01.002238] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-04. [2025-09-23T19:14:01.630856] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-23T19:14:01.802238] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-05. [2025-09-23T19:14:02.345480] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-23T19:14:02.602208] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-07. [2025-09-23T19:14:03.402189] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-06. [2025-09-23T19:14:03.876195] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-23T19:14:04.033210] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-23T19:14:04.202233] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-08. [2025-09-23T19:14:05.002193] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-09-23T19:14:05.280961] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-09-23T19:14:05.433509] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-23T19:14:05.802194] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-07. [2025-09-23T19:14:06.419901] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-23T19:14:06.602210] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-09. [2025-09-23T19:14:07.402198] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-08. [2025-09-23T19:14:08.076513] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-23T19:14:08.084983] [INFO ] [REMOTE ] HESM: Full fetch complete (68793 records). [2025-09-23T19:14:08.085205] [DEBUG] [VALIDATOR ] HESM: Validating primary data. [2025-09-23T19:14:08.204213] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-01. [2025-09-23T19:14:08.408829] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-23T19:14:08.506921] [DEBUG] [VALIDATOR ] HESM: All expected trading days are present. [2025-09-23T19:14:08.507034] [DEBUG] [VALIDATOR ] HESM: Primary data validation passed. [2025-09-23T19:14:08.508223] [INFO ] [MAIN ] HESM: Fetched primary data is valid. [2025-09-23T19:14:08.508292] [DEBUG] [LOCAL ] HESM: Saving primary data. [2025-09-23T19:14:08.509856] [DEBUG] [LOCAL ] HESM: Trimmed 68793 records to 48167 (keeping 200 days of data) [2025-09-23T19:14:08.819453] [DEBUG] [LOCAL ] HESM: Primary data saved (48167 records). [2025-09-23T19:14:08.819591] [INFO ] [MAIN ] HESM: Full history saved. [2025-09-23T19:14:08.819699] [INFO ] [MAIN ] Update Progress: 1011/2372 symbols completed. HESM took 51.5s. Estimated remaining: 3h 0m 31s. Rate: 7.5 symbols/min [2025-09-23T19:14:08.995299] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:14:09.003316] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-09. [2025-09-23T19:14:09.010771] [DEBUG] [LOCAL ] HGTY: Loaded 13004 existing records from primary storage. [2025-09-23T19:14:09.010907] [INFO ] [MAIN ] HGTY: Loaded 13004 existing records. [2025-09-23T19:14:09.123116] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-23T19:14:09.208970] [WARN ] [MAIN ] HGTY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:14:09.209239] [INFO ] [MAIN ] HGTY: Wiping existing primary data before full refresh. [2025-09-23T19:14:09.209292] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-09-23T19:14:09.209861] [DEBUG] [LOCAL ] HGTY: Deleted primary data file. [2025-09-23T19:14:09.209922] [INFO ] [MAIN ] HGTY: Starting full primary refresh. [2025-09-23T19:14:09.557171] [INFO ] [REMOTE ] HGTY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:14:09.701418] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-23T19:14:09.705117] [INFO ] [REMOTE ] HFRO: Full fetch complete (28725 records). [2025-09-23T19:14:09.705202] [DEBUG] [VALIDATOR ] HFRO: Validating primary data. [2025-09-23T19:14:09.804790] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-02. [2025-09-23T19:14:10.077255] [DEBUG] [VALIDATOR ] HFRO: All expected trading days are present. [2025-09-23T19:14:10.077420] [DEBUG] [VALIDATOR ] HFRO: Primary data validation passed. [2025-09-23T19:14:10.077991] [INFO ] [MAIN ] HFRO: Fetched primary data is valid. [2025-09-23T19:14:10.078053] [DEBUG] [LOCAL ] HFRO: Saving primary data. [2025-09-23T19:14:10.078827] [DEBUG] [LOCAL ] HFRO: Trimmed 28725 records to 17383 (keeping 200 days of data) [2025-09-23T19:14:10.186381] [DEBUG] [LOCAL ] HFRO: Primary data saved (17383 records). [2025-09-23T19:14:10.186551] [INFO ] [MAIN ] HFRO: Full history saved. [2025-09-23T19:14:10.186676] [INFO ] [MAIN ] Update Progress: 1012/2372 symbols completed. HFRO took 29.6s. Estimated remaining: 3h 0m 14s. Rate: 7.5 symbols/min [2025-09-23T19:14:10.356385] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:14:10.403210] [DEBUG] [LOCAL ] HGV: Loaded 47015 existing records from primary storage. [2025-09-23T19:14:10.403382] [INFO ] [MAIN ] HGV: Loaded 47015 existing records. [2025-09-23T19:14:10.582825] [WARN ] [MAIN ] HGV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:14:10.583163] [INFO ] [MAIN ] HGV: Wiping existing primary data before full refresh. [2025-09-23T19:14:10.583218] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-09-23T19:14:10.584681] [DEBUG] [LOCAL ] HGV: Deleted primary data file. [2025-09-23T19:14:10.584742] [INFO ] [MAIN ] HGV: Starting full primary refresh. [2025-09-23T19:14:10.607319] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-09-23T19:14:10.713761] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-23T19:14:10.968173] [INFO ] [REMOTE ] HGV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:14:10.970903] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-23T19:14:11.402207] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-09-23T19:14:11.794013] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-23T19:14:11.795190] [INFO ] [REMOTE ] HFND: Full fetch complete (1782 records). [2025-09-23T19:14:11.795268] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-09-23T19:14:11.996213] [WARN ] [VALIDATOR ] HFND: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-23T19:14:11.996479] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:14:11.996547] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:14:11.996623] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-09-23T19:14:11.996737] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-09-23T19:14:11.996791] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-09-23T19:14:11.997080] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-09-23T19:14:11.997445] [INFO ] [MAIN ] Update Progress: 1013/2372 symbols completed. HFND took 37.6s. Estimated remaining: 2h 59m 58s. Rate: 7.6 symbols/min [2025-09-23T19:14:12.178533] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:14:12.211159] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-03. [2025-09-23T19:14:12.213997] [DEBUG] [LOCAL ] HHH: Loaded 32676 existing records from primary storage. [2025-09-23T19:14:12.214179] [INFO ] [MAIN ] HHH: Loaded 32676 existing records. [2025-09-23T19:14:12.421397] [WARN ] [MAIN ] HHH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:14:12.421697] [INFO ] [MAIN ] HHH: Wiping existing primary data before full refresh. [2025-09-23T19:14:12.421790] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-09-23T19:14:12.422855] [DEBUG] [LOCAL ] HHH: Deleted primary data file. [2025-09-23T19:14:12.422919] [INFO ] [MAIN ] HHH: Starting full primary refresh. [2025-09-23T19:14:12.820533] [INFO ] [REMOTE ] HHH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:14:12.930791] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-23T19:14:13.002218] [INFO ] [REMOTE ] HHH: Fetching primary data for 2024-12. [2025-09-23T19:14:13.802205] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-04. [2025-09-23T19:14:14.107598] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-23T19:14:14.431779] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-23T19:14:14.602202] [INFO ] [REMOTE ] HGV: Fetching primary data for 2024-12. [2025-09-23T19:14:15.402233] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2024-12. [2025-09-23T19:14:15.655788] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-23T19:14:16.182252] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-23T19:14:16.202139] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-01. [2025-09-23T19:14:16.778012] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-23T19:14:17.002229] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-01. [2025-09-23T19:14:17.802206] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-02. [2025-09-23T19:14:18.283753] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-23T19:14:18.436339] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-23T19:14:18.602200] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-05. [2025-09-23T19:14:19.052566] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-23T19:14:19.402209] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-01. [2025-09-23T19:14:20.202279] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-02. [2025-09-23T19:14:20.531469] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-23T19:14:21.002230] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-02. [2025-09-23T19:14:21.124153] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-23T19:14:21.802203] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-03. [2025-09-23T19:14:22.095049] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-23T19:14:22.602225] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-03. [2025-09-23T19:14:22.745158] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-23T19:14:23.109141] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-23T19:14:23.402210] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-03. [2025-09-23T19:14:24.202195] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-04. [2025-09-23T19:14:24.637525] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-23T19:14:25.002209] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-06. [2025-09-23T19:14:25.461350] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-23T19:14:25.592426] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-23T19:14:25.802217] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-05. [2025-09-23T19:14:26.602195] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-04. [2025-09-23T19:14:27.004825] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-23T19:14:27.402235] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-07. [2025-09-23T19:14:27.828579] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-23T19:14:28.168259] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-23T19:14:28.202219] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-05. [2025-09-23T19:14:29.002207] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-06. [2025-09-23T19:14:29.424354] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-23T19:14:29.802189] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-06. [2025-09-23T19:14:30.020141] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-23T19:14:30.602190] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-04. [2025-09-23T19:14:30.986328] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-23T19:14:31.168304] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-23T19:14:31.402191] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-05. [2025-09-23T19:14:31.953021] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-23T19:14:32.202192] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-08. [2025-09-23T19:14:32.767461] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-23T19:14:33.002190] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-07. [2025-09-23T19:14:33.802195] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-07. [2025-09-23T19:14:34.289881] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-23T19:14:34.602203] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-09. [2025-09-23T19:14:35.198275] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-23T19:14:35.220103] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-23T19:14:35.224110] [INFO ] [REMOTE ] HGLB: Full fetch complete (14301 records). [2025-09-23T19:14:35.224217] [DEBUG] [VALIDATOR ] HGLB: Validating primary data. [2025-09-23T19:14:35.413828] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-08. [2025-09-23T19:14:35.600745] [DEBUG] [VALIDATOR ] HGLB: All expected trading days are present. [2025-09-23T19:14:35.600826] [DEBUG] [VALIDATOR ] HGLB: Primary data validation passed. [2025-09-23T19:14:35.601219] [INFO ] [MAIN ] HGLB: Fetched primary data is valid. [2025-09-23T19:14:35.601316] [DEBUG] [LOCAL ] HGLB: Saving primary data. [2025-09-23T19:14:35.601905] [DEBUG] [LOCAL ] HGLB: Trimmed 14301 records to 9713 (keeping 200 days of data) [2025-09-23T19:14:35.671419] [DEBUG] [LOCAL ] HGLB: Primary data saved (9713 records). [2025-09-23T19:14:35.671588] [INFO ] [MAIN ] HGLB: Full history saved. [2025-09-23T19:14:35.671806] [INFO ] [MAIN ] Update Progress: 1014/2372 symbols completed. HGLB took 36.6s. Estimated remaining: 3h 0m 11s. Rate: 7.5 symbols/min [2025-09-23T19:14:35.844145] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:14:35.886928] [DEBUG] [LOCAL ] HI: Loaded 35066 existing records from primary storage. [2025-09-23T19:14:35.887115] [INFO ] [MAIN ] HI: Loaded 35066 existing records. [2025-09-23T19:14:36.063354] [WARN ] [MAIN ] HI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:14:36.063661] [INFO ] [MAIN ] HI: Wiping existing primary data before full refresh. [2025-09-23T19:14:36.063735] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-09-23T19:14:36.064829] [DEBUG] [LOCAL ] HI: Deleted primary data file. [2025-09-23T19:14:36.064944] [INFO ] [MAIN ] HI: Starting full primary refresh. [2025-09-23T19:14:36.207272] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-08. [2025-09-23T19:14:36.441071] [INFO ] [REMOTE ] HI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:14:36.710552] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-23T19:14:37.002200] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-06. [2025-09-23T19:14:37.457612] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-23T19:14:37.685368] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-23T19:14:37.802232] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-09. [2025-09-23T19:14:38.602205] [INFO ] [REMOTE ] HI: Fetching primary data for 2024-12. [2025-09-23T19:14:38.962487] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-23T19:14:38.967991] [INFO ] [REMOTE ] HHH: Full fetch complete (45074 records). [2025-09-23T19:14:38.968078] [DEBUG] [VALIDATOR ] HHH: Validating primary data. [2025-09-23T19:14:39.381840] [DEBUG] [VALIDATOR ] HHH: All expected trading days are present. [2025-09-23T19:14:39.381925] [DEBUG] [VALIDATOR ] HHH: Primary data validation passed. [2025-09-23T19:14:39.382619] [INFO ] [MAIN ] HHH: Fetched primary data is valid. [2025-09-23T19:14:39.382696] [DEBUG] [LOCAL ] HHH: Saving primary data. [2025-09-23T19:14:39.383816] [DEBUG] [LOCAL ] HHH: Trimmed 45074 records to 32677 (keeping 200 days of data) [2025-09-23T19:14:39.441041] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-09. [2025-09-23T19:14:39.538676] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-23T19:14:39.628488] [DEBUG] [LOCAL ] HHH: Primary data saved (32677 records). [2025-09-23T19:14:39.628801] [INFO ] [MAIN ] HHH: Full history saved. [2025-09-23T19:14:39.629044] [INFO ] [MAIN ] Update Progress: 1015/2372 symbols completed. HHH took 27.6s. Estimated remaining: 2h 59m 58s. Rate: 7.5 symbols/min [2025-09-23T19:14:39.806801] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:14:39.872827] [DEBUG] [LOCAL ] HIG: Loaded 51259 existing records from primary storage. [2025-09-23T19:14:39.872990] [INFO ] [MAIN ] HIG: Loaded 51259 existing records. [2025-09-23T19:14:40.054036] [WARN ] [MAIN ] HIG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:14:40.054280] [INFO ] [MAIN ] HIG: Wiping existing primary data before full refresh. [2025-09-23T19:14:40.054330] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-09-23T19:14:40.055906] [DEBUG] [LOCAL ] HIG: Deleted primary data file. [2025-09-23T19:14:40.055987] [INFO ] [MAIN ] HIG: Starting full primary refresh. [2025-09-23T19:14:40.208768] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-07. [2025-09-23T19:14:40.435243] [INFO ] [REMOTE ] HIG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:14:40.662257] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-23T19:14:40.671621] [INFO ] [REMOTE ] HGV: Full fetch complete (65688 records). [2025-09-23T19:14:40.671830] [DEBUG] [VALIDATOR ] HGV: Validating primary data. [2025-09-23T19:14:40.922710] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-23T19:14:41.007291] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-08. [2025-09-23T19:14:41.093287] [DEBUG] [VALIDATOR ] HGV: All expected trading days are present. [2025-09-23T19:14:41.093448] [DEBUG] [VALIDATOR ] HGV: Primary data validation passed. [2025-09-23T19:14:41.094409] [INFO ] [MAIN ] HGV: Fetched primary data is valid. [2025-09-23T19:14:41.094492] [DEBUG] [LOCAL ] HGV: Saving primary data. [2025-09-23T19:14:41.096152] [DEBUG] [LOCAL ] HGV: Trimmed 65688 records to 46971 (keeping 200 days of data) [2025-09-23T19:14:41.382311] [DEBUG] [LOCAL ] HGV: Primary data saved (46971 records). [2025-09-23T19:14:41.382477] [INFO ] [MAIN ] HGV: Full history saved. [2025-09-23T19:14:41.382590] [INFO ] [MAIN ] Update Progress: 1016/2372 symbols completed. HGV took 31.2s. Estimated remaining: 2h 59m 41s. Rate: 7.5 symbols/min [2025-09-23T19:14:41.588216] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:14:41.633678] [DEBUG] [LOCAL ] HII: Loaded 35414 existing records from primary storage. [2025-09-23T19:14:41.633836] [INFO ] [MAIN ] HII: Loaded 35414 existing records. [2025-09-23T19:14:41.804634] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-01. [2025-09-23T19:14:41.955743] [WARN ] [MAIN ] HII: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:14:41.967684] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-23T19:14:41.967880] [INFO ] [MAIN ] HII: Wiping existing primary data before full refresh. [2025-09-23T19:14:41.975916] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-09-23T19:14:41.977487] [DEBUG] [LOCAL ] HII: Deleted primary data file. [2025-09-23T19:14:41.977587] [INFO ] [MAIN ] HII: Starting full primary refresh. [2025-09-23T19:14:42.498484] [INFO ] [REMOTE ] HII: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:14:42.602262] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-09. [2025-09-23T19:14:42.723172] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-23T19:14:43.402203] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-02. [2025-09-23T19:14:44.202242] [INFO ] [REMOTE ] HIG: Fetching primary data for 2024-12. [2025-09-23T19:14:44.361686] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-23T19:14:45.002194] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-03. [2025-09-23T19:14:45.421399] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-09 (2.82 seconds). [2025-09-23T19:14:45.425875] [INFO ] [REMOTE ] HGTY: Full fetch complete (17028 records). [2025-09-23T19:14:45.426071] [DEBUG] [VALIDATOR ] HGTY: Validating primary data. [2025-09-23T19:14:45.426690] [FATAL] [VALIDATOR ] HGTY: Data is stale - most recent date (2025-09-22) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T19:14:45.426827] [FATAL] [MAIN ] HGTY: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:14:45.426895] [WARN ] [MAIN ] HGTY: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:14:45.426978] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-09-23T19:14:45.427074] [DEBUG] [LOCAL ] HGTY: No primary data file found to delete. [2025-09-23T19:14:45.427208] [INFO ] [LOCAL ] HGTY: Starting deletion of derivative data. [2025-09-23T19:14:45.427740] [DEBUG] [LOCAL ] HGTY: Deleted derivative data file. [2025-09-23T19:14:45.427932] [INFO ] [MAIN ] Update Progress: 1017/2372 symbols completed. HGTY took 36.6s. Estimated remaining: 2h 59m 28s. Rate: 7.5 symbols/min [2025-09-23T19:14:45.558956] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-23T19:14:45.639600] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:14:45.706872] [DEBUG] [LOCAL ] HIMS: Loaded 53817 existing records from primary storage. [2025-09-23T19:14:45.707011] [INFO ] [MAIN ] HIMS: Loaded 53817 existing records. [2025-09-23T19:14:45.807945] [INFO ] [REMOTE ] HII: Fetching primary data for 2024-12. [2025-09-23T19:14:45.896411] [WARN ] [MAIN ] HIMS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:14:45.897074] [INFO ] [MAIN ] HIMS: Wiping existing primary data before full refresh. [2025-09-23T19:14:45.897176] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-09-23T19:14:45.898955] [DEBUG] [LOCAL ] HIMS: Deleted primary data file. [2025-09-23T19:14:45.899018] [INFO ] [MAIN ] HIMS: Starting full primary refresh. [2025-09-23T19:14:46.269103] [INFO ] [REMOTE ] HIMS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:14:46.290089] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-23T19:14:46.602249] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2024-12. [2025-09-23T19:14:47.067413] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-23T19:14:47.402228] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-01. [2025-09-23T19:14:48.202258] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-04. [2025-09-23T19:14:48.777859] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-09-23T19:14:48.856760] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-23T19:14:49.002185] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-02. [2025-09-23T19:14:49.352558] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-23T19:14:49.802173] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-05. [2025-09-23T19:14:50.243984] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-23T19:14:50.602200] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-03. [2025-09-23T19:14:50.895275] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-23T19:14:51.402212] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-01. [2025-09-23T19:14:52.031606] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-23T19:14:52.202173] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-06. [2025-09-23T19:14:53.002250] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-01. [2025-09-23T19:14:53.263548] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-23T19:14:53.410704] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-23T19:14:53.802256] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-02. [2025-09-23T19:14:54.172113] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-23T19:14:54.602261] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-07. [2025-09-23T19:14:55.402204] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-04. [2025-09-23T19:14:55.575795] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-23T19:14:55.980752] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-23T19:14:56.202184] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-03. [2025-09-23T19:14:57.002158] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-02. [2025-09-23T19:14:57.332521] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-23T19:14:57.802177] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-08. [2025-09-23T19:14:58.251546] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-23T19:14:58.465544] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-23T19:14:58.602213] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-04. [2025-09-23T19:14:58.934985] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-23T19:14:59.402199] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-05. [2025-09-23T19:15:00.202242] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-09. [2025-09-23T19:15:01.006003] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-03. [2025-09-23T19:15:01.008069] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-23T19:15:01.138854] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-23T19:15:01.144709] [INFO ] [REMOTE ] HI: Full fetch complete (49661 records). [2025-09-23T19:15:01.144816] [DEBUG] [VALIDATOR ] HI: Validating primary data. [2025-09-23T19:15:01.548470] [DEBUG] [VALIDATOR ] HI: All expected trading days are present. [2025-09-23T19:15:01.548833] [DEBUG] [VALIDATOR ] HI: Primary data validation passed. [2025-09-23T19:15:01.550130] [INFO ] [MAIN ] HI: Fetched primary data is valid. [2025-09-23T19:15:01.550266] [DEBUG] [LOCAL ] HI: Saving primary data. [2025-09-23T19:15:01.551914] [DEBUG] [LOCAL ] HI: Trimmed 49661 records to 35121 (keeping 200 days of data) [2025-09-23T19:15:01.684786] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-04 (3.08 seconds). [2025-09-23T19:15:01.807446] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-06. [2025-09-23T19:15:01.845126] [DEBUG] [LOCAL ] HI: Primary data saved (35121 records). [2025-09-23T19:15:01.845289] [INFO ] [MAIN ] HI: Full history saved. [2025-09-23T19:15:01.845394] [INFO ] [MAIN ] Update Progress: 1018/2372 symbols completed. HI took 26.2s. Estimated remaining: 2h 59m 32s. Rate: 7.5 symbols/min [2025-09-23T19:15:02.021864] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:15:02.045808] [DEBUG] [LOCAL ] HIO: Loaded 23761 existing records from primary storage. [2025-09-23T19:15:02.045956] [INFO ] [MAIN ] HIO: Loaded 23761 existing records. [2025-09-23T19:15:02.229483] [WARN ] [MAIN ] HIO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:15:02.229885] [INFO ] [MAIN ] HIO: Wiping existing primary data before full refresh. [2025-09-23T19:15:02.229944] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-09-23T19:15:02.231064] [DEBUG] [LOCAL ] HIO: Deleted primary data file. [2025-09-23T19:15:02.231128] [INFO ] [MAIN ] HIO: Starting full primary refresh. [2025-09-23T19:15:02.596660] [INFO ] [REMOTE ] HIO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:15:02.602227] [INFO ] [REMOTE ] HIO: Fetching primary data for 2024-12. [2025-09-23T19:15:03.207560] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-23T19:15:03.402330] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-04. [2025-09-23T19:15:04.202254] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-05. [2025-09-23T19:15:05.966870] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2024-12 (3.36 seconds). [2025-09-23T19:15:05.972636] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-01. [2025-09-23T19:15:06.302081] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-06 (4.49 seconds). [2025-09-23T19:15:06.312426] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-07. [2025-09-23T19:15:07.200262] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-23T19:15:07.206994] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-02. [2025-09-23T19:15:07.388550] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-04 (3.99 seconds). [2025-09-23T19:15:07.402163] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-05. [2025-09-23T19:15:07.809887] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-23T19:15:07.989321] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-23T19:15:08.202241] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-08. [2025-09-23T19:15:08.565208] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-23T19:15:09.002244] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-03. [2025-09-23T19:15:09.193352] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-05 (4.99 seconds). [2025-09-23T19:15:09.440637] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-23T19:15:09.802268] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-09. [2025-09-23T19:15:09.937835] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-23T19:15:10.602267] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-06. [2025-09-23T19:15:11.338110] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-23T19:15:11.348171] [INFO ] [REMOTE ] HIG: Full fetch complete (73260 records). [2025-09-23T19:15:11.348327] [DEBUG] [VALIDATOR ] HIG: Validating primary data. [2025-09-23T19:15:11.409522] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-04. [2025-09-23T19:15:11.791916] [DEBUG] [VALIDATOR ] HIG: All expected trading days are present. [2025-09-23T19:15:11.792022] [DEBUG] [VALIDATOR ] HIG: Primary data validation passed. [2025-09-23T19:15:11.792960] [INFO ] [MAIN ] HIG: Fetched primary data is valid. [2025-09-23T19:15:11.793027] [DEBUG] [LOCAL ] HIG: Saving primary data. [2025-09-23T19:15:11.794519] [DEBUG] [LOCAL ] HIG: Trimmed 73260 records to 51268 (keeping 200 days of data) [2025-09-23T19:15:12.119540] [DEBUG] [LOCAL ] HIG: Primary data saved (51268 records). [2025-09-23T19:15:12.119725] [INFO ] [MAIN ] HIG: Full history saved. [2025-09-23T19:15:12.119824] [INFO ] [MAIN ] Update Progress: 1019/2372 symbols completed. HIG took 32.5s. Estimated remaining: 2h 59m 27s. Rate: 7.5 symbols/min [2025-09-23T19:15:12.210987] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-06. [2025-09-23T19:15:12.293212] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:15:12.315928] [DEBUG] [LOCAL ] HIPO: Loaded 22871 existing records from primary storage. [2025-09-23T19:15:12.316059] [INFO ] [MAIN ] HIPO: Loaded 22871 existing records. [2025-09-23T19:15:12.502254] [WARN ] [MAIN ] HIPO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:15:12.502568] [INFO ] [MAIN ] HIPO: Wiping existing primary data before full refresh. [2025-09-23T19:15:12.502622] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-09-23T19:15:12.503333] [DEBUG] [LOCAL ] HIPO: Deleted primary data file. [2025-09-23T19:15:12.503395] [INFO ] [MAIN ] HIPO: Starting full primary refresh. [2025-09-23T19:15:12.642308] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-23T19:15:12.890880] [INFO ] [REMOTE ] HIPO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:15:12.979304] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-09-23T19:15:13.002151] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-07. [2025-09-23T19:15:13.407677] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-23T19:15:13.802184] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2024-12. [2025-09-23T19:15:14.602252] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-07. [2025-09-23T19:15:15.402179] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-05. [2025-09-23T19:15:15.745772] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-23T19:15:16.040281] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-07 (3.04 seconds). [2025-09-23T19:15:16.111913] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-23T19:15:16.202201] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-01. [2025-09-23T19:15:16.702547] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-23T19:15:16.943120] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-23T19:15:17.002193] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-08. [2025-09-23T19:15:17.802185] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-08. [2025-09-23T19:15:18.602223] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-02. [2025-09-23T19:15:18.790420] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-23T19:15:19.332399] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-23T19:15:19.397256] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-09-23T19:15:19.407552] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-09. [2025-09-23T19:15:20.202204] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-06. [2025-09-23T19:15:20.483109] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-23T19:15:20.489671] [INFO ] [REMOTE ] HII: Full fetch complete (53364 records). [2025-09-23T19:15:20.489871] [DEBUG] [VALIDATOR ] HII: Validating primary data. [2025-09-23T19:15:20.929100] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-23T19:15:20.936499] [DEBUG] [VALIDATOR ] HII: All expected trading days are present. [2025-09-23T19:15:20.937163] [DEBUG] [VALIDATOR ] HII: Primary data validation passed. [2025-09-23T19:15:20.937965] [INFO ] [MAIN ] HII: Fetched primary data is valid. [2025-09-23T19:15:20.938388] [DEBUG] [LOCAL ] HII: Saving primary data. [2025-09-23T19:15:20.939487] [DEBUG] [LOCAL ] HII: Trimmed 53364 records to 35268 (keeping 200 days of data) [2025-09-23T19:15:21.008155] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-03. [2025-09-23T19:15:21.168772] [DEBUG] [LOCAL ] HII: Primary data saved (35268 records). [2025-09-23T19:15:21.168925] [INFO ] [MAIN ] HII: Full history saved. [2025-09-23T19:15:21.169027] [INFO ] [MAIN ] Update Progress: 1020/2372 symbols completed. HII took 39.8s. Estimated remaining: 2h 59m 20s. Rate: 7.5 symbols/min [2025-09-23T19:15:21.341167] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:15:21.386897] [DEBUG] [LOCAL ] HIW: Loaded 44755 existing records from primary storage. [2025-09-23T19:15:21.387041] [INFO ] [MAIN ] HIW: Loaded 44755 existing records. [2025-09-23T19:15:21.562282] [WARN ] [MAIN ] HIW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:15:21.562516] [INFO ] [MAIN ] HIW: Wiping existing primary data before full refresh. [2025-09-23T19:15:21.562564] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-09-23T19:15:21.563735] [DEBUG] [LOCAL ] HIW: Deleted primary data file. [2025-09-23T19:15:21.563798] [INFO ] [MAIN ] HIW: Starting full primary refresh. [2025-09-23T19:15:21.807445] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-09. [2025-09-23T19:15:21.920537] [INFO ] [REMOTE ] HIW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:15:22.158027] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-23T19:15:22.602238] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-04. [2025-09-23T19:15:23.402242] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-07. [2025-09-23T19:15:23.817534] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-23T19:15:24.202164] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-05. [2025-09-23T19:15:24.230208] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-09-23T19:15:24.239765] [INFO ] [REMOTE ] HIMS: Full fetch complete (77935 records). [2025-09-23T19:15:24.239924] [DEBUG] [VALIDATOR ] HIMS: Validating primary data. [2025-09-23T19:15:24.591260] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-23T19:15:24.690735] [DEBUG] [VALIDATOR ] HIMS: All expected trading days are present. [2025-09-23T19:15:24.690832] [DEBUG] [VALIDATOR ] HIMS: Primary data validation passed. [2025-09-23T19:15:24.691848] [INFO ] [MAIN ] HIMS: Fetched primary data is valid. [2025-09-23T19:15:24.691917] [DEBUG] [LOCAL ] HIMS: Saving primary data. [2025-09-23T19:15:24.693508] [DEBUG] [LOCAL ] HIMS: Trimmed 77935 records to 53817 (keeping 200 days of data) [2025-09-23T19:15:24.957920] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-23T19:15:25.006304] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-06. [2025-09-23T19:15:25.057744] [DEBUG] [LOCAL ] HIMS: Primary data saved (53817 records). [2025-09-23T19:15:25.057901] [INFO ] [MAIN ] HIMS: Full history saved. [2025-09-23T19:15:25.057991] [INFO ] [MAIN ] Update Progress: 1021/2372 symbols completed. HIMS took 39.6s. Estimated remaining: 2h 59m 7s. Rate: 7.5 symbols/min [2025-09-23T19:15:25.225494] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:15:25.245340] [DEBUG] [LOCAL ] HIX: Loaded 20268 existing records from primary storage. [2025-09-23T19:15:25.245479] [INFO ] [MAIN ] HIX: Loaded 20268 existing records. [2025-09-23T19:15:25.425302] [WARN ] [MAIN ] HIX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:15:25.425563] [INFO ] [MAIN ] HIX: Wiping existing primary data before full refresh. [2025-09-23T19:15:25.425613] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-09-23T19:15:25.426327] [DEBUG] [LOCAL ] HIX: Deleted primary data file. [2025-09-23T19:15:25.426389] [INFO ] [MAIN ] HIX: Starting full primary refresh. [2025-09-23T19:15:25.805499] [INFO ] [REMOTE ] HIX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:15:25.805563] [INFO ] [REMOTE ] HIW: Fetching primary data for 2024-12. [2025-09-23T19:15:26.398134] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-23T19:15:26.602200] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-07. [2025-09-23T19:15:27.402207] [INFO ] [REMOTE ] HIX: Fetching primary data for 2024-12. [2025-09-23T19:15:27.924510] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-23T19:15:28.202252] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-08. [2025-09-23T19:15:28.225710] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-23T19:15:28.413177] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-23T19:15:28.950373] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-23T19:15:29.002201] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-01. [2025-09-23T19:15:29.802182] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-09. [2025-09-23T19:15:30.553325] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-23T19:15:30.608007] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-01. [2025-09-23T19:15:30.612736] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-23T19:15:30.618350] [INFO ] [REMOTE ] HIO: Full fetch complete (36760 records). [2025-09-23T19:15:30.618457] [DEBUG] [VALIDATOR ] HIO: Validating primary data. [2025-09-23T19:15:31.042484] [DEBUG] [VALIDATOR ] HIO: All expected trading days are present. [2025-09-23T19:15:31.042838] [DEBUG] [VALIDATOR ] HIO: Primary data validation passed. [2025-09-23T19:15:31.043503] [INFO ] [MAIN ] HIO: Fetched primary data is valid. [2025-09-23T19:15:31.043548] [DEBUG] [LOCAL ] HIO: Saving primary data. [2025-09-23T19:15:31.044697] [DEBUG] [LOCAL ] HIO: Trimmed 36760 records to 23711 (keeping 200 days of data) [2025-09-23T19:15:31.186835] [DEBUG] [LOCAL ] HIO: Primary data saved (23711 records). [2025-09-23T19:15:31.187023] [INFO ] [MAIN ] HIO: Full history saved. [2025-09-23T19:15:31.187129] [INFO ] [MAIN ] Update Progress: 1022/2372 symbols completed. HIO took 29.3s. Estimated remaining: 2h 58m 57s. Rate: 7.5 symbols/min [2025-09-23T19:15:31.361464] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:15:31.380701] [DEBUG] [LOCAL ] HKD: Loaded 18201 existing records from primary storage. [2025-09-23T19:15:31.380855] [INFO ] [MAIN ] HKD: Loaded 18201 existing records. [2025-09-23T19:15:31.412111] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-02. [2025-09-23T19:15:31.585505] [WARN ] [MAIN ] HKD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:15:31.585798] [INFO ] [MAIN ] HKD: Wiping existing primary data before full refresh. [2025-09-23T19:15:31.585851] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-09-23T19:15:31.586382] [DEBUG] [LOCAL ] HKD: Deleted primary data file. [2025-09-23T19:15:31.586443] [INFO ] [MAIN ] HKD: Starting full primary refresh. [2025-09-23T19:15:31.860362] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-23T19:15:31.970761] [INFO ] [REMOTE ] HKD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:15:32.202175] [INFO ] [REMOTE ] HKD: Fetching primary data for 2024-12. [2025-09-23T19:15:32.540573] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-23T19:15:33.002209] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-03. [2025-09-23T19:15:33.099768] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-23T19:15:33.802218] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-08. [2025-09-23T19:15:34.393168] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-23T19:15:34.602259] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-04. [2025-09-23T19:15:34.830442] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-23T19:15:35.402220] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-01. [2025-09-23T19:15:35.827802] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-23T19:15:36.202175] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-09. [2025-09-23T19:15:36.528698] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-23T19:15:37.008083] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-05. [2025-09-23T19:15:37.018351] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-23T19:15:37.023042] [INFO ] [REMOTE ] HIPO: Full fetch complete (31770 records). [2025-09-23T19:15:37.023138] [DEBUG] [VALIDATOR ] HIPO: Validating primary data. [2025-09-23T19:15:37.459108] [DEBUG] [VALIDATOR ] HIPO: All expected trading days are present. [2025-09-23T19:15:37.459231] [DEBUG] [VALIDATOR ] HIPO: Primary data validation passed. [2025-09-23T19:15:37.459952] [INFO ] [MAIN ] HIPO: Fetched primary data is valid. [2025-09-23T19:15:37.460039] [DEBUG] [LOCAL ] HIPO: Saving primary data. [2025-09-23T19:15:37.461666] [DEBUG] [LOCAL ] HIPO: Trimmed 31770 records to 22692 (keeping 200 days of data) [2025-09-23T19:15:37.614634] [DEBUG] [LOCAL ] HIPO: Primary data saved (22692 records). [2025-09-23T19:15:37.614810] [INFO ] [MAIN ] HIPO: Full history saved. [2025-09-23T19:15:37.614944] [INFO ] [MAIN ] Update Progress: 1023/2372 symbols completed. HIPO took 25.5s. Estimated remaining: 2h 58m 47s. Rate: 7.5 symbols/min [2025-09-23T19:15:37.819385] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:15:37.815126] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-02. [2025-09-23T19:15:37.872610] [DEBUG] [LOCAL ] HL: Loaded 53670 existing records from primary storage. [2025-09-23T19:15:37.872921] [INFO ] [MAIN ] HL: Loaded 53670 existing records. [2025-09-23T19:15:38.066189] [WARN ] [MAIN ] HL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:15:38.066478] [INFO ] [MAIN ] HL: Wiping existing primary data before full refresh. [2025-09-23T19:15:38.066529] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-09-23T19:15:38.067713] [DEBUG] [LOCAL ] HL: Deleted primary data file. [2025-09-23T19:15:38.067796] [INFO ] [MAIN ] HL: Starting full primary refresh. [2025-09-23T19:15:38.437828] [INFO ] [REMOTE ] HL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:15:38.489455] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-23T19:15:38.602160] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-06. [2025-09-23T19:15:38.866534] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-23T19:15:39.402229] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-03. [2025-09-23T19:15:39.728560] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-23T19:15:40.064285] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-23T19:15:40.202229] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-02. [2025-09-23T19:15:41.002203] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-04. [2025-09-23T19:15:41.106991] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-23T19:15:41.802233] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-07. [2025-09-23T19:15:41.900156] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-23T19:15:42.602221] [INFO ] [REMOTE ] HL: Fetching primary data for 2024-12. [2025-09-23T19:15:43.287035] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-23T19:15:43.402182] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-08. [2025-09-23T19:15:44.113444] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-23T19:15:44.202162] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-03. [2025-09-23T19:15:44.987109] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-23T19:15:45.002148] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-09. [2025-09-23T19:15:45.222249] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-23T19:15:45.802230] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-01. [2025-09-23T19:15:46.205702] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-23T19:15:46.213471] [INFO ] [REMOTE ] HIW: Full fetch complete (64705 records). [2025-09-23T19:15:46.213605] [DEBUG] [VALIDATOR ] HIW: Validating primary data. [2025-09-23T19:15:46.601139] [DEBUG] [VALIDATOR ] HIW: All expected trading days are present. [2025-09-23T19:15:46.601234] [DEBUG] [VALIDATOR ] HIW: Primary data validation passed. [2025-09-23T19:15:46.602125] [INFO ] [MAIN ] HIW: Fetched primary data is valid. [2025-09-23T19:15:46.602240] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-04. [2025-09-23T19:15:46.602407] [DEBUG] [LOCAL ] HIW: Saving primary data. [2025-09-23T19:15:46.604860] [DEBUG] [LOCAL ] HIW: Trimmed 64705 records to 44739 (keeping 200 days of data) [2025-09-23T19:15:46.876450] [DEBUG] [LOCAL ] HIW: Primary data saved (44739 records). [2025-09-23T19:15:46.876591] [INFO ] [MAIN ] HIW: Full history saved. [2025-09-23T19:15:46.876704] [INFO ] [MAIN ] Update Progress: 1024/2372 symbols completed. HIW took 25.7s. Estimated remaining: 2h 58m 40s. Rate: 7.5 symbols/min [2025-09-23T19:15:47.049232] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:15:47.095626] [DEBUG] [LOCAL ] HLF: Loaded 48773 existing records from primary storage. [2025-09-23T19:15:47.095854] [INFO ] [MAIN ] HLF: Loaded 48773 existing records. [2025-09-23T19:15:47.289472] [WARN ] [MAIN ] HLF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:15:47.289759] [INFO ] [MAIN ] HLF: Wiping existing primary data before full refresh. [2025-09-23T19:15:47.289816] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-09-23T19:15:47.290920] [DEBUG] [LOCAL ] HLF: Deleted primary data file. [2025-09-23T19:15:47.290989] [INFO ] [MAIN ] HLF: Starting full primary refresh. [2025-09-23T19:15:47.404366] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-05. [2025-09-23T19:15:47.598389] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-23T19:15:47.685851] [INFO ] [REMOTE ] HLF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:15:47.747872] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-23T19:15:48.202238] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-02. [2025-09-23T19:15:48.218249] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-23T19:15:49.002232] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-05. [2025-09-23T19:15:49.688623] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-23T19:15:49.802182] [INFO ] [REMOTE ] HLF: Fetching primary data for 2024-12. [2025-09-23T19:15:50.145040] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-23T19:15:50.602203] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-06. [2025-09-23T19:15:51.255209] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-23T19:15:51.313116] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-23T19:15:51.402201] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-06. [2025-09-23T19:15:52.202199] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-07. [2025-09-23T19:15:52.443369] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-23T19:15:53.002245] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-01. [2025-09-23T19:15:53.099235] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-23T19:15:53.802246] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-08. [2025-09-23T19:15:54.183967] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-23T19:15:54.558511] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-23T19:15:54.602148] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-09. [2025-09-23T19:15:55.402233] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-07. [2025-09-23T19:15:55.424832] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-23T19:15:55.428206] [INFO ] [REMOTE ] HIX: Full fetch complete (30611 records). [2025-09-23T19:15:55.428292] [DEBUG] [VALIDATOR ] HIX: Validating primary data. [2025-09-23T19:15:55.802760] [DEBUG] [VALIDATOR ] HIX: All expected trading days are present. [2025-09-23T19:15:55.802867] [DEBUG] [VALIDATOR ] HIX: Primary data validation passed. [2025-09-23T19:15:55.803473] [INFO ] [MAIN ] HIX: Fetched primary data is valid. [2025-09-23T19:15:55.803517] [DEBUG] [LOCAL ] HIX: Saving primary data. [2025-09-23T19:15:55.804309] [DEBUG] [LOCAL ] HIX: Trimmed 30611 records to 20270 (keeping 200 days of data) [2025-09-23T19:15:55.925428] [DEBUG] [LOCAL ] HIX: Primary data saved (20270 records). [2025-09-23T19:15:55.925559] [INFO ] [MAIN ] HIX: Full history saved. [2025-09-23T19:15:55.925670] [INFO ] [MAIN ] Update Progress: 1025/2372 symbols completed. HIX took 30.9s. Estimated remaining: 2h 58m 34s. Rate: 7.5 symbols/min [2025-09-23T19:15:56.105590] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:15:56.143042] [DEBUG] [LOCAL ] HLI: Loaded 31269 existing records from primary storage. [2025-09-23T19:15:56.143204] [INFO ] [MAIN ] HLI: Loaded 31269 existing records. [2025-09-23T19:15:56.208299] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-03. [2025-09-23T19:15:56.341019] [WARN ] [MAIN ] HLI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:15:56.341400] [INFO ] [MAIN ] HLI: Wiping existing primary data before full refresh. [2025-09-23T19:15:56.341452] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-09-23T19:15:56.343083] [DEBUG] [LOCAL ] HLI: Deleted primary data file. [2025-09-23T19:15:56.343146] [INFO ] [MAIN ] HLI: Starting full primary refresh. [2025-09-23T19:15:56.678374] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-23T19:15:56.750080] [INFO ] [REMOTE ] HLI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:15:57.002236] [INFO ] [REMOTE ] HLI: Fetching primary data for 2024-12. [2025-09-23T19:15:57.774045] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-23T19:15:57.802153] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-04. [2025-09-23T19:15:58.396734] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-23T19:15:58.602256] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-08. [2025-09-23T19:15:59.248286] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-23T19:15:59.402176] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-01. [2025-09-23T19:15:59.457367] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-23T19:16:00.202211] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-05. [2025-09-23T19:16:01.002252] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-09. [2025-09-23T19:16:01.044486] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-23T19:16:01.802246] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-02. [2025-09-23T19:16:01.911797] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-23T19:16:01.937629] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-23T19:16:01.942996] [INFO ] [REMOTE ] HKD: Full fetch complete (28723 records). [2025-09-23T19:16:01.943206] [DEBUG] [VALIDATOR ] HKD: Validating primary data. [2025-09-23T19:16:02.324365] [DEBUG] [VALIDATOR ] HKD: All expected trading days are present. [2025-09-23T19:16:02.324460] [DEBUG] [VALIDATOR ] HKD: Primary data validation passed. [2025-09-23T19:16:02.325121] [INFO ] [MAIN ] HKD: Fetched primary data is valid. [2025-09-23T19:16:02.325191] [DEBUG] [LOCAL ] HKD: Saving primary data. [2025-09-23T19:16:02.326272] [DEBUG] [LOCAL ] HKD: Trimmed 28723 records to 18303 (keeping 200 days of data) [2025-09-23T19:16:02.439333] [DEBUG] [LOCAL ] HKD: Primary data saved (18303 records). [2025-09-23T19:16:02.439510] [INFO ] [MAIN ] HKD: Full history saved. [2025-09-23T19:16:02.439608] [INFO ] [MAIN ] Update Progress: 1026/2372 symbols completed. HKD took 31.3s. Estimated remaining: 2h 58m 24s. Rate: 7.5 symbols/min [2025-09-23T19:16:02.607363] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-02. [2025-09-23T19:16:02.635356] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:16:02.663590] [DEBUG] [LOCAL ] HLIO: Loaded 28176 existing records from primary storage. [2025-09-23T19:16:02.663781] [INFO ] [MAIN ] HLIO: Loaded 28176 existing records. [2025-09-23T19:16:02.842615] [WARN ] [MAIN ] HLIO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:16:02.842879] [INFO ] [MAIN ] HLIO: Wiping existing primary data before full refresh. [2025-09-23T19:16:02.842927] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-09-23T19:16:02.843578] [DEBUG] [LOCAL ] HLIO: Deleted primary data file. [2025-09-23T19:16:02.843685] [INFO ] [MAIN ] HLIO: Starting full primary refresh. [2025-09-23T19:16:03.210311] [INFO ] [REMOTE ] HLIO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:16:03.267186] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-23T19:16:03.402191] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-03. [2025-09-23T19:16:03.651943] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-23T19:16:04.202215] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-03. [2025-09-23T19:16:04.673411] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-23T19:16:05.002218] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-04. [2025-09-23T19:16:05.276706] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-23T19:16:05.802218] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2024-12. [2025-09-23T19:16:06.282293] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-23T19:16:06.444725] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-23T19:16:06.602197] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-06. [2025-09-23T19:16:07.402194] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-01. [2025-09-23T19:16:08.119053] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-23T19:16:08.152717] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-23T19:16:08.202147] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-07. [2025-09-23T19:16:09.002234] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-05. [2025-09-23T19:16:09.802231] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-02. [2025-09-23T19:16:10.238571] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-23T19:16:10.463128] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-23T19:16:10.606638] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-04. [2025-09-23T19:16:10.613845] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-23T19:16:11.402226] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-06. [2025-09-23T19:16:11.589913] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-23T19:16:12.202204] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-05. [2025-09-23T19:16:12.928761] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-23T19:16:13.002208] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-03. [2025-09-23T19:16:13.232953] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-23T19:16:13.802226] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-06. [2025-09-23T19:16:14.093192] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-23T19:16:14.611227] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-07. [2025-09-23T19:16:14.619250] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-23T19:16:15.402210] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-04. [2025-09-23T19:16:16.202195] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-08. [2025-09-23T19:16:16.253149] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-23T19:16:16.322688] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-23T19:16:17.002278] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-08. [2025-09-23T19:16:17.802211] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-07. [2025-09-23T19:16:17.911771] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-23T19:16:18.580604] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-23T19:16:18.602151] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-09. [2025-09-23T19:16:18.830270] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-23T19:16:19.402215] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-05. [2025-09-23T19:16:20.202199] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-08. [2025-09-23T19:16:20.318837] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-23T19:16:20.353458] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-23T19:16:20.361703] [INFO ] [REMOTE ] HLF: Full fetch complete (71411 records). [2025-09-23T19:16:20.361869] [DEBUG] [VALIDATOR ] HLF: Validating primary data. [2025-09-23T19:16:20.751468] [DEBUG] [VALIDATOR ] HLF: All expected trading days are present. [2025-09-23T19:16:20.751553] [DEBUG] [VALIDATOR ] HLF: Primary data validation passed. [2025-09-23T19:16:20.752412] [INFO ] [MAIN ] HLF: Fetched primary data is valid. [2025-09-23T19:16:20.752481] [DEBUG] [LOCAL ] HLF: Saving primary data. [2025-09-23T19:16:20.753983] [DEBUG] [LOCAL ] HLF: Trimmed 71411 records to 48724 (keeping 200 days of data) [2025-09-23T19:16:21.010842] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-06. [2025-09-23T19:16:21.036930] [DEBUG] [LOCAL ] HLF: Primary data saved (48724 records). [2025-09-23T19:16:21.037038] [INFO ] [MAIN ] HLF: Full history saved. [2025-09-23T19:16:21.037140] [INFO ] [MAIN ] Update Progress: 1027/2372 symbols completed. HLF took 34.2s. Estimated remaining: 2h 58m 30s. Rate: 7.5 symbols/min [2025-09-23T19:16:21.212239] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:16:21.231926] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-23T19:16:21.266864] [DEBUG] [LOCAL ] HLLY: Loaded 33370 existing records from primary storage. [2025-09-23T19:16:21.267001] [INFO ] [MAIN ] HLLY: Loaded 33370 existing records. [2025-09-23T19:16:21.442066] [WARN ] [MAIN ] HLLY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:16:21.442357] [INFO ] [MAIN ] HLLY: Wiping existing primary data before full refresh. [2025-09-23T19:16:21.442406] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-09-23T19:16:21.443231] [DEBUG] [LOCAL ] HLLY: Deleted primary data file. [2025-09-23T19:16:21.443291] [INFO ] [MAIN ] HLLY: Starting full primary refresh. [2025-09-23T19:16:21.793785] [INFO ] [REMOTE ] HLLY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:16:21.802164] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2024-12. [2025-09-23T19:16:22.029524] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-23T19:16:22.602207] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-09. [2025-09-23T19:16:22.875340] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-23T19:16:23.402194] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-01. [2025-09-23T19:16:24.199934] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-23T19:16:24.205714] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-09. [2025-09-23T19:16:24.838438] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-09-23T19:16:24.847540] [INFO ] [REMOTE ] HL: Full fetch complete (77652 records). [2025-09-23T19:16:24.847727] [DEBUG] [VALIDATOR ] HL: Validating primary data. [2025-09-23T19:16:25.023080] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-07. [2025-09-23T19:16:25.244558] [DEBUG] [VALIDATOR ] HL: All expected trading days are present. [2025-09-23T19:16:25.244686] [DEBUG] [VALIDATOR ] HL: Primary data validation passed. [2025-09-23T19:16:25.245707] [INFO ] [MAIN ] HL: Fetched primary data is valid. [2025-09-23T19:16:25.245919] [DEBUG] [LOCAL ] HL: Saving primary data. [2025-09-23T19:16:25.247821] [DEBUG] [LOCAL ] HL: Trimmed 77652 records to 53670 (keeping 200 days of data) [2025-09-23T19:16:25.349480] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-23T19:16:25.357107] [INFO ] [REMOTE ] HLI: Full fetch complete (45214 records). [2025-09-23T19:16:25.358050] [DEBUG] [VALIDATOR ] HLI: Validating primary data. [2025-09-23T19:16:25.777931] [DEBUG] [VALIDATOR ] HLI: All expected trading days are present. [2025-09-23T19:16:25.778606] [DEBUG] [VALIDATOR ] HLI: Primary data validation passed. [2025-09-23T19:16:25.779560] [INFO ] [MAIN ] HLI: Fetched primary data is valid. [2025-09-23T19:16:25.779981] [DEBUG] [LOCAL ] HLI: Saving primary data. [2025-09-23T19:16:25.783003] [DEBUG] [LOCAL ] HLI: Trimmed 45214 records to 31220 (keeping 200 days of data) [2025-09-23T19:16:25.844064] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-02. [2025-09-23T19:16:26.148568] [DEBUG] [LOCAL ] HLI: Primary data saved (31220 records). [2025-09-23T19:16:26.149229] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-23T19:16:26.152139] [INFO ] [MAIN ] HLI: Full history saved. [2025-09-23T19:16:26.192432] [INFO ] [MAIN ] Update Progress: 1028/2372 symbols completed. HLI took 30.3s. Estimated remaining: 2h 58m 18s. Rate: 7.5 symbols/min [2025-09-23T19:16:26.383452] [DEBUG] [LOCAL ] HL: Primary data saved (53670 records). [2025-09-23T19:16:26.399848] [INFO ] [MAIN ] HL: Full history saved. [2025-09-23T19:16:26.412673] [INFO ] [MAIN ] Update Progress: 1029/2372 symbols completed. HL took 48.8s. Estimated remaining: 2h 58m 0s. Rate: 7.5 symbols/min [2025-09-23T19:16:26.432926] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:16:26.612158] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-08. [2025-09-23T19:16:26.650781] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:16:26.700397] [DEBUG] [LOCAL ] HLN: Loaded 53089 existing records from primary storage. [2025-09-23T19:16:26.713235] [INFO ] [MAIN ] HLN: Loaded 53089 existing records. [2025-09-23T19:16:26.730327] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-23T19:16:26.883468] [DEBUG] [LOCAL ] HLT: Loaded 50774 existing records from primary storage. [2025-09-23T19:16:26.884025] [INFO ] [MAIN ] HLT: Loaded 50774 existing records. [2025-09-23T19:16:27.083393] [WARN ] [MAIN ] HLN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:16:27.112126] [INFO ] [MAIN ] HLN: Wiping existing primary data before full refresh. [2025-09-23T19:16:27.133264] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-09-23T19:16:27.152949] [WARN ] [MAIN ] HLT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:16:27.153108] [INFO ] [MAIN ] HLT: Wiping existing primary data before full refresh. [2025-09-23T19:16:27.153151] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-09-23T19:16:27.154070] [DEBUG] [LOCAL ] HLN: Deleted primary data file. [2025-09-23T19:16:27.154158] [INFO ] [MAIN ] HLN: Starting full primary refresh. [2025-09-23T19:16:27.185292] [DEBUG] [LOCAL ] HLT: Deleted primary data file. [2025-09-23T19:16:27.217467] [INFO ] [MAIN ] HLT: Starting full primary refresh. [2025-09-23T19:16:27.406254] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-03. [2025-09-23T19:16:27.866139] [INFO ] [REMOTE ] HLN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:16:27.924563] [INFO ] [REMOTE ] HLT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:16:27.945670] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-23T19:16:28.202188] [INFO ] [REMOTE ] HLN: Fetching primary data for 2024-12. [2025-09-23T19:16:29.002189] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-09. [2025-09-23T19:16:29.105274] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-23T19:16:29.530221] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-23T19:16:29.765043] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-23T19:16:29.769680] [INFO ] [REMOTE ] HLIO: Full fetch complete (36143 records). [2025-09-23T19:16:29.769780] [DEBUG] [VALIDATOR ] HLIO: Validating primary data. [2025-09-23T19:16:29.807303] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-04. [2025-09-23T19:16:30.160411] [DEBUG] [VALIDATOR ] HLIO: All expected trading days are present. [2025-09-23T19:16:30.160515] [DEBUG] [VALIDATOR ] HLIO: Primary data validation passed. [2025-09-23T19:16:30.161177] [INFO ] [MAIN ] HLIO: Fetched primary data is valid. [2025-09-23T19:16:30.161240] [DEBUG] [LOCAL ] HLIO: Saving primary data. [2025-09-23T19:16:30.162287] [DEBUG] [LOCAL ] HLIO: Trimmed 36143 records to 28199 (keeping 200 days of data) [2025-09-23T19:16:30.340176] [DEBUG] [LOCAL ] HLIO: Primary data saved (28199 records). [2025-09-23T19:16:30.340327] [INFO ] [MAIN ] HLIO: Full history saved. [2025-09-23T19:16:30.340417] [INFO ] [MAIN ] Update Progress: 1030/2372 symbols completed. HLIO took 27.9s. Estimated remaining: 2h 57m 47s. Rate: 7.5 symbols/min [2025-09-23T19:16:30.510522] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:16:30.558712] [DEBUG] [LOCAL ] HLX: Loaded 48084 existing records from primary storage. [2025-09-23T19:16:30.558852] [INFO ] [MAIN ] HLX: Loaded 48084 existing records. [2025-09-23T19:16:30.612710] [INFO ] [REMOTE ] HLT: Fetching primary data for 2024-12. [2025-09-23T19:16:30.737826] [WARN ] [MAIN ] HLX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:16:30.738082] [INFO ] [MAIN ] HLX: Wiping existing primary data before full refresh. [2025-09-23T19:16:30.738130] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-09-23T19:16:30.739218] [DEBUG] [LOCAL ] HLX: Deleted primary data file. [2025-09-23T19:16:30.739282] [INFO ] [MAIN ] HLX: Starting full primary refresh. [2025-09-23T19:16:31.151133] [INFO ] [REMOTE ] HLX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:16:31.153367] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-23T19:16:31.402191] [INFO ] [REMOTE ] HLX: Fetching primary data for 2024-12. [2025-09-23T19:16:32.115054] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-23T19:16:32.202222] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-01. [2025-09-23T19:16:33.002205] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-01. [2025-09-23T19:16:33.046040] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-23T19:16:33.473845] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-23T19:16:33.802274] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-02. [2025-09-23T19:16:34.451889] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-23T19:16:34.602234] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-02. [2025-09-23T19:16:35.108517] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-23T19:16:35.402196] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-05. [2025-09-23T19:16:35.982715] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-23T19:16:36.202203] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-03. [2025-09-23T19:16:36.363828] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-23T19:16:37.002216] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-06. [2025-09-23T19:16:37.719411] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-23T19:16:37.750051] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-23T19:16:37.802227] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-03. [2025-09-23T19:16:38.602232] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-01. [2025-09-23T19:16:39.341366] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-23T19:16:39.402171] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-04. [2025-09-23T19:16:39.809939] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-23T19:16:40.202238] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-04. [2025-09-23T19:16:41.007546] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-02. [2025-09-23T19:16:41.038210] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-23T19:16:41.614616] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-23T19:16:41.802203] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-05. [2025-09-23T19:16:42.192388] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-23T19:16:42.602262] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-07. [2025-09-23T19:16:43.260807] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-23T19:16:43.402181] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-03. [2025-09-23T19:16:43.627760] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-23T19:16:44.202203] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-06. [2025-09-23T19:16:44.642821] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-23T19:16:45.002206] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-05. [2025-09-23T19:16:45.600005] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-23T19:16:45.802205] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-07. [2025-09-23T19:16:46.602510] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-04. [2025-09-23T19:16:46.923794] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-23T19:16:47.290436] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-23T19:16:47.402254] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-08. [2025-09-23T19:16:47.966333] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-23T19:16:48.202224] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-05. [2025-09-23T19:16:48.900986] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-23T19:16:49.002253] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-06. [2025-09-23T19:16:49.459277] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-23T19:16:49.802307] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-08. [2025-09-23T19:16:50.320116] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-23T19:16:50.602237] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-09. [2025-09-23T19:16:50.870866] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-23T19:16:51.402230] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-07. [2025-09-23T19:16:51.915434] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-23T19:16:51.925057] [INFO ] [REMOTE ] HLT: Full fetch complete (73433 records). [2025-09-23T19:16:51.925486] [DEBUG] [VALIDATOR ] HLT: Validating primary data. [2025-09-23T19:16:52.215865] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-06. [2025-09-23T19:16:52.381159] [DEBUG] [VALIDATOR ] HLT: All expected trading days are present. [2025-09-23T19:16:52.381277] [DEBUG] [VALIDATOR ] HLT: Primary data validation passed. [2025-09-23T19:16:52.382836] [INFO ] [MAIN ] HLT: Fetched primary data is valid. [2025-09-23T19:16:52.382965] [DEBUG] [LOCAL ] HLT: Saving primary data. [2025-09-23T19:16:52.388007] [DEBUG] [LOCAL ] HLT: Trimmed 73433 records to 50736 (keeping 200 days of data) [2025-09-23T19:16:52.724051] [DEBUG] [LOCAL ] HLT: Primary data saved (50736 records). [2025-09-23T19:16:52.724193] [INFO ] [MAIN ] HLT: Full history saved. [2025-09-23T19:16:52.724358] [INFO ] [MAIN ] Update Progress: 1031/2372 symbols completed. HLT took 26.3s. Estimated remaining: 2h 57m 58s. Rate: 7.5 symbols/min [2025-09-23T19:16:52.903927] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:16:52.951942] [DEBUG] [LOCAL ] HMC: Loaded 46929 existing records from primary storage. [2025-09-23T19:16:52.952090] [INFO ] [MAIN ] HMC: Loaded 46929 existing records. [2025-09-23T19:16:53.009010] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-09. [2025-09-23T19:16:53.148173] [WARN ] [MAIN ] HMC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:16:53.148447] [INFO ] [MAIN ] HMC: Wiping existing primary data before full refresh. [2025-09-23T19:16:53.148518] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-09-23T19:16:53.149555] [DEBUG] [LOCAL ] HMC: Deleted primary data file. [2025-09-23T19:16:53.149635] [INFO ] [MAIN ] HMC: Starting full primary refresh. [2025-09-23T19:16:53.562632] [INFO ] [REMOTE ] HMC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:16:53.571437] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-23T19:16:53.622326] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-23T19:16:53.802217] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-08. [2025-09-23T19:16:54.168386] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-23T19:16:54.179584] [INFO ] [REMOTE ] HLLY: Full fetch complete (46290 records). [2025-09-23T19:16:54.179814] [DEBUG] [VALIDATOR ] HLLY: Validating primary data. [2025-09-23T19:16:54.597442] [DEBUG] [VALIDATOR ] HLLY: All expected trading days are present. [2025-09-23T19:16:54.597584] [DEBUG] [VALIDATOR ] HLLY: Primary data validation passed. [2025-09-23T19:16:54.598278] [INFO ] [MAIN ] HLLY: Fetched primary data is valid. [2025-09-23T19:16:54.598352] [DEBUG] [LOCAL ] HLLY: Saving primary data. [2025-09-23T19:16:54.601665] [DEBUG] [LOCAL ] HLLY: Trimmed 46290 records to 33384 (keeping 200 days of data) [2025-09-23T19:16:54.602180] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-07. [2025-09-23T19:16:54.810106] [DEBUG] [LOCAL ] HLLY: Primary data saved (33384 records). [2025-09-23T19:16:54.810252] [INFO ] [MAIN ] HLLY: Full history saved. [2025-09-23T19:16:54.810395] [INFO ] [MAIN ] Update Progress: 1032/2372 symbols completed. HLLY took 33.8s. Estimated remaining: 2h 57m 42s. Rate: 7.5 symbols/min [2025-09-23T19:16:55.008165] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:16:55.039133] [DEBUG] [LOCAL ] HMN: Loaded 23306 existing records from primary storage. [2025-09-23T19:16:55.039293] [INFO ] [MAIN ] HMN: Loaded 23306 existing records. [2025-09-23T19:16:55.261742] [WARN ] [MAIN ] HMN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:16:55.262130] [INFO ] [MAIN ] HMN: Wiping existing primary data before full refresh. [2025-09-23T19:16:55.262193] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-09-23T19:16:55.263139] [DEBUG] [LOCAL ] HMN: Deleted primary data file. [2025-09-23T19:16:55.263224] [INFO ] [MAIN ] HMN: Starting full primary refresh. [2025-09-23T19:16:55.405687] [INFO ] [REMOTE ] HMC: Fetching primary data for 2024-12. [2025-09-23T19:16:55.683889] [INFO ] [REMOTE ] HMN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:16:55.713677] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-23T19:16:55.960573] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-23T19:16:56.202215] [INFO ] [REMOTE ] HMN: Fetching primary data for 2024-12. [2025-09-23T19:16:57.002175] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-09. [2025-09-23T19:16:57.205895] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-23T19:16:57.236308] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-23T19:16:57.802198] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-01. [2025-09-23T19:16:58.602209] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-01. [2025-09-23T19:16:58.749927] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-23T19:16:58.763251] [INFO ] [REMOTE ] HLN: Full fetch complete (76768 records). [2025-09-23T19:16:58.763400] [DEBUG] [VALIDATOR ] HLN: Validating primary data. [2025-09-23T19:16:59.192421] [DEBUG] [VALIDATOR ] HLN: All expected trading days are present. [2025-09-23T19:16:59.192668] [DEBUG] [VALIDATOR ] HLN: Primary data validation passed. [2025-09-23T19:16:59.193867] [INFO ] [MAIN ] HLN: Fetched primary data is valid. [2025-09-23T19:16:59.193973] [DEBUG] [LOCAL ] HLN: Saving primary data. [2025-09-23T19:16:59.196337] [DEBUG] [LOCAL ] HLN: Trimmed 76768 records to 53090 (keeping 200 days of data) [2025-09-23T19:16:59.340753] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-23T19:16:59.381573] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-23T19:16:59.450957] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-02. [2025-09-23T19:16:59.601186] [DEBUG] [LOCAL ] HLN: Primary data saved (53090 records). [2025-09-23T19:16:59.601332] [INFO ] [MAIN ] HLN: Full history saved. [2025-09-23T19:16:59.601418] [INFO ] [MAIN ] Update Progress: 1033/2372 symbols completed. HLN took 33.4s. Estimated remaining: 2h 57m 30s. Rate: 7.5 symbols/min [2025-09-23T19:16:59.768963] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:16:59.825635] [DEBUG] [LOCAL ] HMY: Loaded 53128 existing records from primary storage. [2025-09-23T19:16:59.825803] [INFO ] [MAIN ] HMY: Loaded 53128 existing records. [2025-09-23T19:17:00.009204] [WARN ] [MAIN ] HMY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:17:00.010736] [INFO ] [MAIN ] HMY: Wiping existing primary data before full refresh. [2025-09-23T19:17:00.010954] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-09-23T19:17:00.012610] [DEBUG] [LOCAL ] HMY: Deleted primary data file. [2025-09-23T19:17:00.012695] [INFO ] [MAIN ] HMY: Starting full primary refresh. [2025-09-23T19:17:00.211503] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-02. [2025-09-23T19:17:00.379979] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-23T19:17:00.385152] [INFO ] [REMOTE ] HMY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:17:01.002240] [INFO ] [REMOTE ] HMY: Fetching primary data for 2024-12. [2025-09-23T19:17:01.802259] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-03. [2025-09-23T19:17:02.007806] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-23T19:17:02.413860] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-23T19:17:02.597344] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-23T19:17:02.603285] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-01. [2025-09-23T19:17:03.402217] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-04. [2025-09-23T19:17:04.202158] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-08. [2025-09-23T19:17:04.272017] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-23T19:17:04.293958] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-23T19:17:05.002209] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-02. [2025-09-23T19:17:05.645509] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-23T19:17:05.802191] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-09. [2025-09-23T19:17:06.471525] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-23T19:17:06.602201] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-03. [2025-09-23T19:17:07.048190] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-23T19:17:07.058261] [INFO ] [REMOTE ] HLX: Full fetch complete (69176 records). [2025-09-23T19:17:07.058453] [DEBUG] [VALIDATOR ] HLX: Validating primary data. [2025-09-23T19:17:07.408236] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-05. [2025-09-23T19:17:07.459602] [DEBUG] [VALIDATOR ] HLX: All expected trading days are present. [2025-09-23T19:17:07.459733] [DEBUG] [VALIDATOR ] HLX: Primary data validation passed. [2025-09-23T19:17:07.460736] [INFO ] [MAIN ] HLX: Fetched primary data is valid. [2025-09-23T19:17:07.460823] [DEBUG] [LOCAL ] HLX: Saving primary data. [2025-09-23T19:17:07.465516] [DEBUG] [LOCAL ] HLX: Trimmed 69176 records to 48067 (keeping 200 days of data) [2025-09-23T19:17:07.743795] [DEBUG] [LOCAL ] HLX: Primary data saved (48067 records). [2025-09-23T19:17:07.743943] [INFO ] [MAIN ] HLX: Full history saved. [2025-09-23T19:17:07.744043] [INFO ] [MAIN ] Update Progress: 1034/2372 symbols completed. HLX took 37.4s. Estimated remaining: 2h 57m 23s. Rate: 7.5 symbols/min [2025-09-23T19:17:07.918280] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:17:07.918685] [DEBUG] [LOCAL ] HNGE: No existing data file found in primary storage. [2025-09-23T19:17:07.918833] [WARN ] [MAIN ] HNGE: No existing data found, performing full refresh instead. [2025-09-23T19:17:07.919041] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-09-23T19:17:07.919087] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-09-23T19:17:07.919130] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-09-23T19:17:07.919164] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-09-23T19:17:08.207296] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-03. [2025-09-23T19:17:08.318664] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:17:08.342334] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-23T19:17:08.424132] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-23T19:17:09.002201] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-04. [2025-09-23T19:17:09.802142] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-06. [2025-09-23T19:17:09.905959] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-23T19:17:10.535250] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-23T19:17:10.602148] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-04. [2025-09-23T19:17:11.039729] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-23T19:17:11.402204] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-07. [2025-09-23T19:17:12.202157] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-05. [2025-09-23T19:17:12.251443] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-23T19:17:12.774759] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-23T19:17:13.002189] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2024-12. [2025-09-23T19:17:13.198379] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:17:13.198824] [WARN ] [REMOTE ] HNGE: No data returned for month 2024-12 [2025-09-23T19:17:13.508978] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-23T19:17:13.802199] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-01. [2025-09-23T19:17:14.003519] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:17:14.003912] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-01 [2025-09-23T19:17:14.602215] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-05. [2025-09-23T19:17:15.402218] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-08. [2025-09-23T19:17:16.202157] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-06. [2025-09-23T19:17:16.264291] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-23T19:17:16.535578] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-23T19:17:17.002199] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-09. [2025-09-23T19:17:17.802242] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-02. [2025-09-23T19:17:17.938428] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-23T19:17:18.011043] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-23T19:17:18.015062] [INFO ] [REMOTE ] HMN: Full fetch complete (31657 records). [2025-09-23T19:17:18.015143] [DEBUG] [VALIDATOR ] HMN: Validating primary data. [2025-09-23T19:17:18.058816] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:17:18.107041] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-02 [2025-09-23T19:17:18.448161] [DEBUG] [VALIDATOR ] HMN: All expected trading days are present. [2025-09-23T19:17:18.448253] [DEBUG] [VALIDATOR ] HMN: Primary data validation passed. [2025-09-23T19:17:18.448800] [INFO ] [MAIN ] HMN: Fetched primary data is valid. [2025-09-23T19:17:18.448864] [DEBUG] [LOCAL ] HMN: Saving primary data. [2025-09-23T19:17:18.449600] [DEBUG] [LOCAL ] HMN: Trimmed 31657 records to 23395 (keeping 200 days of data) [2025-09-23T19:17:18.593696] [DEBUG] [LOCAL ] HMN: Primary data saved (23395 records). [2025-09-23T19:17:18.593827] [INFO ] [MAIN ] HMN: Full history saved. [2025-09-23T19:17:18.593910] [INFO ] [MAIN ] Update Progress: 1035/2372 symbols completed. HMN took 23.8s. Estimated remaining: 2h 57m 18s. Rate: 7.5 symbols/min [2025-09-23T19:17:18.607305] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-07. [2025-09-23T19:17:18.775189] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:17:18.804673] [DEBUG] [LOCAL ] HNI: Loaded 28782 existing records from primary storage. [2025-09-23T19:17:18.804815] [INFO ] [MAIN ] HNI: Loaded 28782 existing records. [2025-09-23T19:17:18.983069] [WARN ] [MAIN ] HNI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:17:18.983297] [INFO ] [MAIN ] HNI: Wiping existing primary data before full refresh. [2025-09-23T19:17:18.983343] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-09-23T19:17:18.984044] [DEBUG] [LOCAL ] HNI: Deleted primary data file. [2025-09-23T19:17:18.984105] [INFO ] [MAIN ] HNI: Starting full primary refresh. [2025-09-23T19:17:19.347115] [INFO ] [REMOTE ] HNI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:17:19.402181] [INFO ] [REMOTE ] HNI: Fetching primary data for 2024-12. [2025-09-23T19:17:20.072034] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-23T19:17:20.202204] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-03. [2025-09-23T19:17:20.418676] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:17:20.419011] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-03 [2025-09-23T19:17:20.752275] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-23T19:17:21.002196] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-06. [2025-09-23T19:17:21.802209] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-01. [2025-09-23T19:17:22.602199] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-04. [2025-09-23T19:17:22.840273] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:17:22.840583] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-04 [2025-09-23T19:17:22.977943] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-23T19:17:23.032414] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-23T19:17:23.402203] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-07. [2025-09-23T19:17:24.202212] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-08. [2025-09-23T19:17:25.002162] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-05. [2025-09-23T19:17:25.448253] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-23T19:17:25.552736] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-23T19:17:25.643447] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-23T19:17:25.802193] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-08. [2025-09-23T19:17:26.602199] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-06. [2025-09-23T19:17:27.404345] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-09. [2025-09-23T19:17:27.407357] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-23T19:17:27.849840] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-23T19:17:28.202186] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-07. [2025-09-23T19:17:28.737801] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-23T19:17:28.745994] [INFO ] [REMOTE ] HMC: Full fetch complete (69603 records). [2025-09-23T19:17:28.746116] [DEBUG] [VALIDATOR ] HMC: Validating primary data. [2025-09-23T19:17:29.007381] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-02. [2025-09-23T19:17:29.156780] [DEBUG] [VALIDATOR ] HMC: All expected trading days are present. [2025-09-23T19:17:29.156887] [DEBUG] [VALIDATOR ] HMC: Primary data validation passed. [2025-09-23T19:17:29.157833] [INFO ] [MAIN ] HMC: Fetched primary data is valid. [2025-09-23T19:17:29.157904] [DEBUG] [LOCAL ] HMC: Saving primary data. [2025-09-23T19:17:29.159733] [DEBUG] [LOCAL ] HMC: Trimmed 69603 records to 46861 (keeping 200 days of data) [2025-09-23T19:17:29.445366] [DEBUG] [LOCAL ] HMC: Primary data saved (46861 records). [2025-09-23T19:17:29.445514] [INFO ] [MAIN ] HMC: Full history saved. [2025-09-23T19:17:29.445606] [INFO ] [MAIN ] Update Progress: 1036/2372 symbols completed. HMC took 36.7s. Estimated remaining: 2h 57m 14s. Rate: 7.5 symbols/min [2025-09-23T19:17:29.624351] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:17:29.650174] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-23T19:17:29.707962] [DEBUG] [LOCAL ] HOG: Loaded 51269 existing records from primary storage. [2025-09-23T19:17:29.708129] [INFO ] [MAIN ] HOG: Loaded 51269 existing records. [2025-09-23T19:17:29.807315] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-09. [2025-09-23T19:17:29.892615] [WARN ] [MAIN ] HOG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:17:29.893068] [INFO ] [MAIN ] HOG: Wiping existing primary data before full refresh. [2025-09-23T19:17:29.893160] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-09-23T19:17:29.894500] [DEBUG] [LOCAL ] HOG: Deleted primary data file. [2025-09-23T19:17:29.894566] [INFO ] [MAIN ] HOG: Starting full primary refresh. [2025-09-23T19:17:30.212710] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-23T19:17:30.300950] [INFO ] [REMOTE ] HOG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:17:30.602246] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-03. [2025-09-23T19:17:31.402195] [INFO ] [REMOTE ] HOG: Fetching primary data for 2024-12. [2025-09-23T19:17:31.524300] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-23T19:17:31.865385] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-23T19:17:31.874230] [INFO ] [REMOTE ] HMY: Full fetch complete (76651 records). [2025-09-23T19:17:31.874373] [DEBUG] [VALIDATOR ] HMY: Validating primary data. [2025-09-23T19:17:32.210893] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-04. [2025-09-23T19:17:32.271199] [DEBUG] [VALIDATOR ] HMY: All expected trading days are present. [2025-09-23T19:17:32.271287] [DEBUG] [VALIDATOR ] HMY: Primary data validation passed. [2025-09-23T19:17:32.272214] [INFO ] [MAIN ] HMY: Fetched primary data is valid. [2025-09-23T19:17:32.272279] [DEBUG] [LOCAL ] HMY: Saving primary data. [2025-09-23T19:17:32.273950] [DEBUG] [LOCAL ] HMY: Trimmed 76651 records to 53136 (keeping 200 days of data) [2025-09-23T19:17:32.588278] [DEBUG] [LOCAL ] HMY: Primary data saved (53136 records). [2025-09-23T19:17:32.588439] [INFO ] [MAIN ] HMY: Full history saved. [2025-09-23T19:17:32.588538] [INFO ] [MAIN ] Update Progress: 1037/2372 symbols completed. HMY took 33.0s. Estimated remaining: 2h 56m 60s. Rate: 7.5 symbols/min [2025-09-23T19:17:32.734418] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-23T19:17:33.002205] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-08. [2025-09-23T19:17:33.161114] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-23T19:17:33.802217] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-05. [2025-09-23T19:17:34.232823] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-23T19:17:34.605913] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-01. [2025-09-23T19:17:34.607918] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-23T19:17:35.402277] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-09. [2025-09-23T19:17:35.953154] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-23T19:17:36.202191] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-02. [2025-09-23T19:17:36.693350] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-23T19:17:36.700753] [INFO ] [REMOTE ] HNGE: Full fetch complete (26095 records). [2025-09-23T19:17:36.700835] [DEBUG] [VALIDATOR ] HNGE: Validating primary data. [2025-09-23T19:17:36.888447] [WARN ] [VALIDATOR ] HNGE: Validation failed - insufficient historical data. Have 85 unique days, need 200 days [2025-09-23T19:17:36.888869] [FATAL] [MAIN ] HNGE: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:17:36.888947] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:17:36.888995] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-09-23T19:17:36.889052] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-09-23T19:17:36.889094] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-09-23T19:17:36.889150] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-09-23T19:17:36.889235] [INFO ] [MAIN ] Update Progress: 1038/2372 symbols completed. HNGE took 29.1s. Estimated remaining: 2h 56m 47s. Rate: 7.5 symbols/min [2025-09-23T19:17:37.002179] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-06. [2025-09-23T19:17:37.579265] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-23T19:17:37.802158] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-03. [2025-09-23T19:17:38.182201] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-23T19:17:38.602261] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-07. [2025-09-23T19:17:39.290541] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-23T19:17:39.402274] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-04. [2025-09-23T19:17:39.483880] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-23T19:17:40.202249] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-08. [2025-09-23T19:17:40.958620] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-23T19:17:41.002219] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-05. [2025-09-23T19:17:41.304776] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-23T19:17:41.802194] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-09. [2025-09-23T19:17:42.404265] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-23T19:17:42.602273] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-06. [2025-09-23T19:17:43.150688] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-23T19:17:43.157194] [INFO ] [REMOTE ] HNI: Full fetch complete (41011 records). [2025-09-23T19:17:43.157307] [DEBUG] [VALIDATOR ] HNI: Validating primary data. [2025-09-23T19:17:43.531317] [DEBUG] [VALIDATOR ] HNI: All expected trading days are present. [2025-09-23T19:17:43.531438] [DEBUG] [VALIDATOR ] HNI: Primary data validation passed. [2025-09-23T19:17:43.532158] [INFO ] [MAIN ] HNI: Fetched primary data is valid. [2025-09-23T19:17:43.532221] [DEBUG] [LOCAL ] HNI: Saving primary data. [2025-09-23T19:17:43.533210] [DEBUG] [LOCAL ] HNI: Trimmed 41011 records to 28779 (keeping 200 days of data) [2025-09-23T19:17:43.710274] [DEBUG] [LOCAL ] HNI: Primary data saved (28779 records). [2025-09-23T19:17:43.710413] [INFO ] [MAIN ] HNI: Full history saved. [2025-09-23T19:17:43.710505] [INFO ] [MAIN ] Update Progress: 1039/2372 symbols completed. HNI took 25.1s. Estimated remaining: 2h 56m 38s. Rate: 7.5 symbols/min [2025-09-23T19:17:43.792026] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-23T19:17:43.802405] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-07. [2025-09-23T19:17:45.177461] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-23T19:17:45.188899] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-08. [2025-09-23T19:17:46.486013] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-23T19:17:46.500436] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-09. [2025-09-23T19:17:48.227370] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-23T19:17:48.235886] [INFO ] [REMOTE ] HOG: Full fetch complete (74254 records). [2025-09-23T19:17:48.236015] [DEBUG] [VALIDATOR ] HOG: Validating primary data. [2025-09-23T19:17:48.632374] [DEBUG] [VALIDATOR ] HOG: All expected trading days are present. [2025-09-23T19:17:48.632524] [DEBUG] [VALIDATOR ] HOG: Primary data validation passed. [2025-09-23T19:17:48.633425] [INFO ] [MAIN ] HOG: Fetched primary data is valid. [2025-09-23T19:17:48.633492] [DEBUG] [LOCAL ] HOG: Saving primary data. [2025-09-23T19:17:48.635027] [DEBUG] [LOCAL ] HOG: Trimmed 74254 records to 51251 (keeping 200 days of data) [2025-09-23T19:17:48.945475] [DEBUG] [LOCAL ] HOG: Primary data saved (51251 records). [2025-09-23T19:17:48.945611] [INFO ] [MAIN ] HOG: Full history saved. [2025-09-23T19:17:48.945723] [INFO ] [MAIN ] Update Progress: 1040/2372 symbols completed. HOG took 19.5s. Estimated remaining: 2h 56m 26s. Rate: 7.5 symbols/min [2025-09-23T19:17:49.563240] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:17:49.587167] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:17:49.625970] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:17:49.663826] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:17:49.680910] [DEBUG] [LOCAL ] HOV: Loaded 13753 existing records from primary storage. [2025-09-23T19:17:49.681242] [INFO ] [MAIN ] HOV: Loaded 13753 existing records. [2025-09-23T19:17:49.967404] [WARN ] [MAIN ] HOV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:17:49.969013] [DEBUG] [LOCAL ] HP: Loaded 51601 existing records from primary storage. [2025-09-23T19:17:49.970441] [DEBUG] [LOCAL ] HOMB: Loaded 43641 existing records from primary storage. [2025-09-23T19:17:49.968317] [DEBUG] [LOCAL ] HOUS: Loaded 44037 existing records from primary storage. [2025-09-23T19:17:49.970927] [INFO ] [MAIN ] HOMB: Loaded 43641 existing records. [2025-09-23T19:17:49.970582] [INFO ] [MAIN ] HOUS: Loaded 44037 existing records. [2025-09-23T19:17:49.970832] [INFO ] [MAIN ] HP: Loaded 51601 existing records. [2025-09-23T19:17:49.970748] [INFO ] [MAIN ] HOV: Wiping existing primary data before full refresh. [2025-09-23T19:17:50.007375] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-09-23T19:17:50.123873] [DEBUG] [LOCAL ] HOV: Deleted primary data file. [2025-09-23T19:17:50.154617] [INFO ] [MAIN ] HOV: Starting full primary refresh. [2025-09-23T19:17:50.602581] [WARN ] [MAIN ] HP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:17:50.681622] [INFO ] [MAIN ] HP: Wiping existing primary data before full refresh. [2025-09-23T19:17:50.647915] [WARN ] [MAIN ] HOMB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:17:50.707918] [INFO ] [MAIN ] HOMB: Wiping existing primary data before full refresh. [2025-09-23T19:17:50.693460] [WARN ] [MAIN ] HOUS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:17:50.717108] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-09-23T19:17:50.710201] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-09-23T19:17:50.733719] [INFO ] [MAIN ] HOUS: Wiping existing primary data before full refresh. [2025-09-23T19:17:50.742716] [DEBUG] [LOCAL ] HP: Deleted primary data file. [2025-09-23T19:17:50.742896] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-09-23T19:17:50.742951] [INFO ] [MAIN ] HP: Starting full primary refresh. [2025-09-23T19:17:50.753900] [DEBUG] [LOCAL ] HOMB: Deleted primary data file. [2025-09-23T19:17:50.748265] [DEBUG] [LOCAL ] HOUS: Deleted primary data file. [2025-09-23T19:17:50.788845] [INFO ] [MAIN ] HOMB: Starting full primary refresh. [2025-09-23T19:17:50.774728] [INFO ] [MAIN ] HOUS: Starting full primary refresh. [2025-09-23T19:17:51.656400] [INFO ] [REMOTE ] HOV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:17:51.731816] [INFO ] [REMOTE ] HOV: Fetching primary data for 2024-12. [2025-09-23T19:17:52.028724] [INFO ] [REMOTE ] HOMB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:17:51.990617] [INFO ] [REMOTE ] HOUS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:17:52.033305] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2024-12. [2025-09-23T19:17:52.032874] [INFO ] [REMOTE ] HP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:17:52.033884] [INFO ] [REMOTE ] HP: Fetching primary data for 2024-12. [2025-09-23T19:17:52.034164] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2024-12. [2025-09-23T19:17:52.430384] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-23T19:17:52.433969] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-01. [2025-09-23T19:17:53.074813] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-23T19:17:53.082943] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-01. [2025-09-23T19:17:53.189235] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-23T19:17:53.197827] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-01. [2025-09-23T19:17:53.544886] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-23T19:17:53.547855] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-02. [2025-09-23T19:17:53.686227] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-23T19:17:53.696120] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-01. [2025-09-23T19:17:54.117004] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-23T19:17:54.125820] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-02. [2025-09-23T19:17:54.142823] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-23T19:17:54.145692] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-03. [2025-09-23T19:17:54.377955] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-23T19:17:54.602225] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-02. [2025-09-23T19:17:54.881479] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-23T19:17:54.962933] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-23T19:17:55.126930] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-23T19:17:55.402217] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-03. [2025-09-23T19:17:55.753499] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-23T19:17:56.202332] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-04. [2025-09-23T19:17:56.535177] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-23T19:17:56.814436] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-23T19:17:57.002183] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-03. [2025-09-23T19:17:57.802255] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-05. [2025-09-23T19:17:58.269459] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-23T19:17:58.307747] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-23T19:17:58.602255] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-06. [2025-09-23T19:17:59.402222] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-04. [2025-09-23T19:17:59.723157] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-23T19:18:00.202248] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-07. [2025-09-23T19:18:00.527892] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-23T19:18:00.930230] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-23T19:18:01.002250] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-05. [2025-09-23T19:18:01.802407] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-04. [2025-09-23T19:18:02.156759] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-23T19:18:02.602204] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-06. [2025-09-23T19:18:03.402158] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-08. [2025-09-23T19:18:03.830782] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-23T19:18:03.890030] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-23T19:18:04.052733] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-23T19:18:04.202270] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-09. [2025-09-23T19:18:05.002224] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-07. [2025-09-23T19:18:05.378368] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-23T19:18:05.382556] [INFO ] [REMOTE ] HOV: Full fetch complete (19491 records). [2025-09-23T19:18:05.382774] [DEBUG] [VALIDATOR ] HOV: Validating primary data. [2025-09-23T19:18:05.761843] [DEBUG] [VALIDATOR ] HOV: All expected trading days are present. [2025-09-23T19:18:05.761920] [DEBUG] [VALIDATOR ] HOV: Primary data validation passed. [2025-09-23T19:18:05.762322] [INFO ] [MAIN ] HOV: Fetched primary data is valid. [2025-09-23T19:18:05.762361] [DEBUG] [LOCAL ] HOV: Saving primary data. [2025-09-23T19:18:05.762969] [DEBUG] [LOCAL ] HOV: Trimmed 19491 records to 13783 (keeping 200 days of data) [2025-09-23T19:18:05.804332] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-02. [2025-09-23T19:18:05.848624] [DEBUG] [LOCAL ] HOV: Primary data saved (13783 records). [2025-09-23T19:18:05.848764] [INFO ] [MAIN ] HOV: Full history saved. [2025-09-23T19:18:05.848887] [INFO ] [MAIN ] Update Progress: 1041/2372 symbols completed. HOV took 16.9s. Estimated remaining: 2h 56m 30s. Rate: 7.5 symbols/min [2025-09-23T19:18:06.023532] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:18:06.078702] [DEBUG] [LOCAL ] HPE: Loaded 53697 existing records from primary storage. [2025-09-23T19:18:06.078936] [INFO ] [MAIN ] HPE: Loaded 53697 existing records. [2025-09-23T19:18:06.259355] [WARN ] [MAIN ] HPE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:18:06.259853] [INFO ] [MAIN ] HPE: Wiping existing primary data before full refresh. [2025-09-23T19:18:06.259942] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-09-23T19:18:06.261420] [DEBUG] [LOCAL ] HPE: Deleted primary data file. [2025-09-23T19:18:06.261483] [INFO ] [MAIN ] HPE: Starting full primary refresh. [2025-09-23T19:18:06.433533] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-23T19:18:06.607277] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-05. [2025-09-23T19:18:06.677863] [INFO ] [REMOTE ] HPE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:18:07.233047] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-23T19:18:07.402189] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-03. [2025-09-23T19:18:07.646171] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-23T19:18:08.202192] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-06. [2025-09-23T19:18:08.779465] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-23T19:18:09.002202] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-04. [2025-09-23T19:18:09.412113] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-23T19:18:09.802231] [INFO ] [REMOTE ] HPE: Fetching primary data for 2024-12. [2025-09-23T19:18:10.461292] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-23T19:18:10.602234] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-08. [2025-09-23T19:18:11.381708] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-23T19:18:11.402170] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-01. [2025-09-23T19:18:12.179688] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-23T19:18:12.202148] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-09. [2025-09-23T19:18:13.002229] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-07. [2025-09-23T19:18:13.058577] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-23T19:18:13.544426] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-23T19:18:13.552380] [INFO ] [REMOTE ] HOUS: Full fetch complete (62698 records). [2025-09-23T19:18:13.552507] [DEBUG] [VALIDATOR ] HOUS: Validating primary data. [2025-09-23T19:18:13.808210] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-02. [2025-09-23T19:18:13.953282] [DEBUG] [VALIDATOR ] HOUS: All expected trading days are present. [2025-09-23T19:18:13.953376] [DEBUG] [VALIDATOR ] HOUS: Primary data validation passed. [2025-09-23T19:18:13.954273] [INFO ] [MAIN ] HOUS: Fetched primary data is valid. [2025-09-23T19:18:13.954336] [DEBUG] [LOCAL ] HOUS: Saving primary data. [2025-09-23T19:18:13.955784] [DEBUG] [LOCAL ] HOUS: Trimmed 62698 records to 44099 (keeping 200 days of data) [2025-09-23T19:18:14.211387] [DEBUG] [LOCAL ] HOUS: Primary data saved (44099 records). [2025-09-23T19:18:14.211521] [INFO ] [MAIN ] HOUS: Full history saved. [2025-09-23T19:18:14.211607] [INFO ] [MAIN ] Update Progress: 1042/2372 symbols completed. HOUS took 25.3s. Estimated remaining: 2h 56m 23s. Rate: 7.5 symbols/min [2025-09-23T19:18:14.397797] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:18:14.407243] [DEBUG] [LOCAL ] HPF: Loaded 7280 existing records from primary storage. [2025-09-23T19:18:14.407365] [INFO ] [MAIN ] HPF: Loaded 7280 existing records. [2025-09-23T19:18:14.605380] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-05. [2025-09-23T19:18:14.599023] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-23T19:18:14.628491] [WARN ] [MAIN ] HPF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:18:14.639593] [INFO ] [MAIN ] HPF: Wiping existing primary data before full refresh. [2025-09-23T19:18:14.639743] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-09-23T19:18:14.640468] [DEBUG] [LOCAL ] HPF: Deleted primary data file. [2025-09-23T19:18:14.640533] [INFO ] [MAIN ] HPF: Starting full primary refresh. [2025-09-23T19:18:14.997841] [INFO ] [REMOTE ] HPF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:18:15.402140] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-08. [2025-09-23T19:18:15.517410] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-23T19:18:16.062357] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-23T19:18:16.202188] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-06. [2025-09-23T19:18:16.566487] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-23T19:18:17.002251] [INFO ] [REMOTE ] HPF: Fetching primary data for 2024-12. [2025-09-23T19:18:17.804931] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-09. [2025-09-23T19:18:17.816830] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-23T19:18:17.816545] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-23T19:18:18.602198] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-07. [2025-09-23T19:18:19.402202] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-03. [2025-09-23T19:18:19.519861] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-23T19:18:19.527510] [INFO ] [REMOTE ] HOMB: Full fetch complete (63692 records). [2025-09-23T19:18:19.527681] [DEBUG] [VALIDATOR ] HOMB: Validating primary data. [2025-09-23T19:18:19.929452] [DEBUG] [VALIDATOR ] HOMB: All expected trading days are present. [2025-09-23T19:18:19.929544] [DEBUG] [VALIDATOR ] HOMB: Primary data validation passed. [2025-09-23T19:18:19.930369] [INFO ] [MAIN ] HOMB: Fetched primary data is valid. [2025-09-23T19:18:19.930435] [DEBUG] [LOCAL ] HOMB: Saving primary data. [2025-09-23T19:18:19.931747] [DEBUG] [LOCAL ] HOMB: Trimmed 63692 records to 43632 (keeping 200 days of data) [2025-09-23T19:18:20.197179] [DEBUG] [LOCAL ] HOMB: Primary data saved (43632 records). [2025-09-23T19:18:20.197405] [INFO ] [MAIN ] HOMB: Full history saved. [2025-09-23T19:18:20.197578] [INFO ] [MAIN ] Update Progress: 1043/2372 symbols completed. HOMB took 31.3s. Estimated remaining: 2h 56m 12s. Rate: 7.5 symbols/min [2025-09-23T19:18:20.209595] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-01. [2025-09-23T19:18:20.412263] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-23T19:18:20.416113] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:18:20.439922] [DEBUG] [LOCAL ] HPI: Loaded 10105 existing records from primary storage. [2025-09-23T19:18:20.440046] [INFO ] [MAIN ] HPI: Loaded 10105 existing records. [2025-09-23T19:18:20.632172] [WARN ] [MAIN ] HPI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:18:20.632503] [INFO ] [MAIN ] HPI: Wiping existing primary data before full refresh. [2025-09-23T19:18:20.632556] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-09-23T19:18:20.633004] [DEBUG] [LOCAL ] HPI: Deleted primary data file. [2025-09-23T19:18:20.633066] [INFO ] [MAIN ] HPI: Starting full primary refresh. [2025-09-23T19:18:20.995702] [INFO ] [REMOTE ] HPI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:18:21.002143] [INFO ] [REMOTE ] HPI: Fetching primary data for 2024-12. [2025-09-23T19:18:21.475249] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-23T19:18:21.802192] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-02. [2025-09-23T19:18:21.964402] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-23T19:18:22.118725] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-03 (2.72 seconds). [2025-09-23T19:18:22.439629] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-23T19:18:22.602194] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-03. [2025-09-23T19:18:22.976215] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-23T19:18:23.402198] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-04. [2025-09-23T19:18:24.168553] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-23T19:18:24.202199] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-08. [2025-09-23T19:18:25.002203] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-05. [2025-09-23T19:18:25.689272] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-23T19:18:25.802177] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-04. [2025-09-23T19:18:26.206441] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-23T19:18:26.602196] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-06. [2025-09-23T19:18:27.216869] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-23T19:18:27.402151] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-09. [2025-09-23T19:18:27.537100] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-23T19:18:28.202256] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-07. [2025-09-23T19:18:28.632818] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-23T19:18:28.744676] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-23T19:18:28.754255] [INFO ] [REMOTE ] HP: Full fetch complete (73913 records). [2025-09-23T19:18:28.754519] [DEBUG] [VALIDATOR ] HP: Validating primary data. [2025-09-23T19:18:29.009725] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-05. [2025-09-23T19:18:29.199960] [DEBUG] [VALIDATOR ] HP: All expected trading days are present. [2025-09-23T19:18:29.200082] [DEBUG] [VALIDATOR ] HP: Primary data validation passed. [2025-09-23T19:18:29.201268] [INFO ] [MAIN ] HP: Fetched primary data is valid. [2025-09-23T19:18:29.201344] [DEBUG] [LOCAL ] HP: Saving primary data. [2025-09-23T19:18:29.203536] [DEBUG] [LOCAL ] HP: Trimmed 73913 records to 51614 (keeping 200 days of data) [2025-09-23T19:18:29.558147] [DEBUG] [LOCAL ] HP: Primary data saved (51614 records). [2025-09-23T19:18:29.558298] [INFO ] [MAIN ] HP: Full history saved. [2025-09-23T19:18:29.558386] [INFO ] [MAIN ] Update Progress: 1044/2372 symbols completed. HP took 40.6s. Estimated remaining: 2h 56m 6s. Rate: 7.5 symbols/min [2025-09-23T19:18:29.732397] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:18:29.781816] [DEBUG] [LOCAL ] HPP: Loaded 50793 existing records from primary storage. [2025-09-23T19:18:29.782002] [INFO ] [MAIN ] HPP: Loaded 50793 existing records. [2025-09-23T19:18:29.812713] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-01. [2025-09-23T19:18:29.965173] [WARN ] [MAIN ] HPP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:18:29.965501] [INFO ] [MAIN ] HPP: Wiping existing primary data before full refresh. [2025-09-23T19:18:29.965560] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-09-23T19:18:29.966917] [DEBUG] [LOCAL ] HPP: Deleted primary data file. [2025-09-23T19:18:29.966981] [INFO ] [MAIN ] HPP: Starting full primary refresh. [2025-09-23T19:18:30.343494] [INFO ] [REMOTE ] HPP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:18:30.579724] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-23T19:18:30.602165] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-02. [2025-09-23T19:18:31.114329] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-23T19:18:31.136374] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-23T19:18:31.402269] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-06. [2025-09-23T19:18:32.202200] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-08. [2025-09-23T19:18:32.739693] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-23T19:18:33.002208] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-09. [2025-09-23T19:18:33.802206] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-03. [2025-09-23T19:18:34.589188] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-06 (3.19 seconds). [2025-09-23T19:18:34.602073] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-07. [2025-09-23T19:18:34.760276] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-23T19:18:34.762554] [INFO ] [REMOTE ] HPF: Full fetch complete (10818 records). [2025-09-23T19:18:34.762634] [DEBUG] [VALIDATOR ] HPF: Validating primary data. [2025-09-23T19:18:34.985505] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-23T19:18:35.177140] [DEBUG] [VALIDATOR ] HPF: All expected trading days are present. [2025-09-23T19:18:35.177223] [DEBUG] [VALIDATOR ] HPF: Primary data validation passed. [2025-09-23T19:18:35.177539] [INFO ] [MAIN ] HPF: Fetched primary data is valid. [2025-09-23T19:18:35.177580] [DEBUG] [LOCAL ] HPF: Saving primary data. [2025-09-23T19:18:35.178075] [DEBUG] [LOCAL ] HPF: Trimmed 10818 records to 7292 (keeping 200 days of data) [2025-09-23T19:18:35.222544] [DEBUG] [LOCAL ] HPF: Primary data saved (7292 records). [2025-09-23T19:18:35.222756] [INFO ] [MAIN ] HPF: Full history saved. [2025-09-23T19:18:35.222876] [INFO ] [MAIN ] Update Progress: 1045/2372 symbols completed. HPF took 21.0s. Estimated remaining: 2h 55m 55s. Rate: 7.5 symbols/min [2025-09-23T19:18:35.413255] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-04. [2025-09-23T19:18:35.417220] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:18:35.476697] [DEBUG] [LOCAL ] HPQ: Loaded 53668 existing records from primary storage. [2025-09-23T19:18:35.476883] [INFO ] [MAIN ] HPQ: Loaded 53668 existing records. [2025-09-23T19:18:35.658128] [WARN ] [MAIN ] HPQ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:18:35.658410] [INFO ] [MAIN ] HPQ: Wiping existing primary data before full refresh. [2025-09-23T19:18:35.658458] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-09-23T19:18:35.659913] [DEBUG] [LOCAL ] HPQ: Deleted primary data file. [2025-09-23T19:18:35.659976] [INFO ] [MAIN ] HPQ: Starting full primary refresh. [2025-09-23T19:18:36.016490] [INFO ] [REMOTE ] HPQ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:18:36.024205] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-23T19:18:36.202209] [INFO ] [REMOTE ] HPP: Fetching primary data for 2024-12. [2025-09-23T19:18:36.645800] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-23T19:18:37.002253] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-05. [2025-09-23T19:18:37.802198] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-08. [2025-09-23T19:18:37.963044] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-23T19:18:37.969088] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-23T19:18:38.602224] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-01. [2025-09-23T19:18:39.377422] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-23T19:18:39.402151] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-09. [2025-09-23T19:18:40.202168] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-06. [2025-09-23T19:18:40.250026] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-23T19:18:40.658023] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-23T19:18:41.002227] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-07. [2025-09-23T19:18:41.136886] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-23T19:18:41.145989] [INFO ] [REMOTE ] HPE: Full fetch complete (77732 records). [2025-09-23T19:18:41.146151] [DEBUG] [VALIDATOR ] HPE: Validating primary data. [2025-09-23T19:18:41.554548] [DEBUG] [VALIDATOR ] HPE: All expected trading days are present. [2025-09-23T19:18:41.554670] [DEBUG] [VALIDATOR ] HPE: Primary data validation passed. [2025-09-23T19:18:41.555614] [INFO ] [MAIN ] HPE: Fetched primary data is valid. [2025-09-23T19:18:41.555704] [DEBUG] [LOCAL ] HPE: Saving primary data. [2025-09-23T19:18:41.557257] [DEBUG] [LOCAL ] HPE: Trimmed 77732 records to 53697 (keeping 200 days of data) [2025-09-23T19:18:41.679509] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-23T19:18:41.802315] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-08. [2025-09-23T19:18:41.912206] [DEBUG] [LOCAL ] HPE: Primary data saved (53697 records). [2025-09-23T19:18:41.912346] [INFO ] [MAIN ] HPE: Full history saved. [2025-09-23T19:18:41.912429] [INFO ] [MAIN ] Update Progress: 1046/2372 symbols completed. HPE took 36.1s. Estimated remaining: 2h 55m 45s. Rate: 7.5 symbols/min [2025-09-23T19:18:42.093573] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:18:42.109003] [DEBUG] [LOCAL ] HPS: Loaded 10262 existing records from primary storage. [2025-09-23T19:18:42.109128] [INFO ] [MAIN ] HPS: Loaded 10262 existing records. [2025-09-23T19:18:42.285900] [WARN ] [MAIN ] HPS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:18:42.286213] [INFO ] [MAIN ] HPS: Wiping existing primary data before full refresh. [2025-09-23T19:18:42.286286] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-09-23T19:18:42.286747] [DEBUG] [LOCAL ] HPS: Deleted primary data file. [2025-09-23T19:18:42.286816] [INFO ] [MAIN ] HPS: Starting full primary refresh. [2025-09-23T19:18:42.607304] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2024-12. [2025-09-23T19:18:42.647108] [INFO ] [REMOTE ] HPS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:18:42.697682] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-23T19:18:43.402206] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-09. [2025-09-23T19:18:44.112509] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-23T19:18:44.151834] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-23T19:18:44.155248] [INFO ] [REMOTE ] HPI: Full fetch complete (13448 records). [2025-09-23T19:18:44.155332] [DEBUG] [VALIDATOR ] HPI: Validating primary data. [2025-09-23T19:18:44.210068] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-02. [2025-09-23T19:18:44.526074] [DEBUG] [VALIDATOR ] HPI: All expected trading days are present. [2025-09-23T19:18:44.526155] [DEBUG] [VALIDATOR ] HPI: Primary data validation passed. [2025-09-23T19:18:44.526517] [INFO ] [MAIN ] HPI: Fetched primary data is valid. [2025-09-23T19:18:44.526588] [DEBUG] [LOCAL ] HPI: Saving primary data. [2025-09-23T19:18:44.527205] [DEBUG] [LOCAL ] HPI: Trimmed 13448 records to 10123 (keeping 200 days of data) [2025-09-23T19:18:44.595360] [DEBUG] [LOCAL ] HPI: Primary data saved (10123 records). [2025-09-23T19:18:44.595496] [INFO ] [MAIN ] HPI: Full history saved. [2025-09-23T19:18:44.595593] [INFO ] [MAIN ] Update Progress: 1047/2372 symbols completed. HPI took 24.4s. Estimated remaining: 2h 55m 31s. Rate: 7.5 symbols/min [2025-09-23T19:18:44.764477] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:18:44.792621] [DEBUG] [LOCAL ] HQH: Loaded 24877 existing records from primary storage. [2025-09-23T19:18:44.792787] [INFO ] [MAIN ] HQH: Loaded 24877 existing records. [2025-09-23T19:18:44.967599] [WARN ] [MAIN ] HQH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:18:44.967873] [INFO ] [MAIN ] HQH: Wiping existing primary data before full refresh. [2025-09-23T19:18:44.967921] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-09-23T19:18:44.968745] [DEBUG] [LOCAL ] HQH: Deleted primary data file. [2025-09-23T19:18:44.968812] [INFO ] [MAIN ] HQH: Starting full primary refresh. [2025-09-23T19:18:45.010540] [INFO ] [REMOTE ] HPS: Fetching primary data for 2024-12. [2025-09-23T19:18:45.338036] [INFO ] [REMOTE ] HQH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:18:45.590380] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-23T19:18:45.751275] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-23T19:18:45.802163] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-03. [2025-09-23T19:18:46.602230] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-01. [2025-09-23T19:18:47.082791] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-23T19:18:47.402203] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-01. [2025-09-23T19:18:48.067336] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-23T19:18:48.202193] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-04. [2025-09-23T19:18:48.220495] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-23T19:18:49.002190] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-02. [2025-09-23T19:18:49.802179] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-02. [2025-09-23T19:18:49.876207] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-23T19:18:49.913703] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-23T19:18:50.602248] [INFO ] [REMOTE ] HQH: Fetching primary data for 2024-12. [2025-09-23T19:18:51.192589] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-23T19:18:51.402174] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-03. [2025-09-23T19:18:51.464466] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-23T19:18:52.202212] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-05. [2025-09-23T19:18:52.925085] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-23T19:18:53.002210] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-01. [2025-09-23T19:18:53.423490] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-23T19:18:53.802204] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-03. [2025-09-23T19:18:54.241716] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-23T19:18:54.401477] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-23T19:18:54.602199] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-04. [2025-09-23T19:18:55.137064] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-23T19:18:55.402216] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-05. [2025-09-23T19:18:56.138010] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-23T19:18:56.202219] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-04. [2025-09-23T19:18:57.002204] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-06. [2025-09-23T19:18:57.729870] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-23T19:18:57.802248] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-06. [2025-09-23T19:18:58.541869] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-23T19:18:58.610810] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-02. [2025-09-23T19:18:58.630589] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-23T19:18:59.402163] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-07. [2025-09-23T19:18:59.708284] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-23T19:19:00.202228] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-07. [2025-09-23T19:19:00.350268] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-23T19:19:01.002206] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-03. [2025-09-23T19:19:01.802254] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-05. [2025-09-23T19:19:01.953616] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-23T19:19:02.147544] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-23T19:19:02.602285] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-04. [2025-09-23T19:19:03.402201] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-08. [2025-09-23T19:19:03.769558] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-23T19:19:03.892517] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-23T19:19:04.028933] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-23T19:19:04.202232] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-05. [2025-09-23T19:19:05.002236] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-06. [2025-09-23T19:19:05.083839] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-23T19:19:05.802214] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-06. [2025-09-23T19:19:06.437786] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-23T19:19:06.587270] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-23T19:19:06.602160] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-07. [2025-09-23T19:19:07.402193] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-08. [2025-09-23T19:19:07.555627] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-23T19:19:08.202232] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-09. [2025-09-23T19:19:09.002165] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-07. [2025-09-23T19:19:09.128999] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-23T19:19:09.154253] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-23T19:19:09.156719] [INFO ] [REMOTE ] HPS: Full fetch complete (15168 records). [2025-09-23T19:19:09.156904] [DEBUG] [VALIDATOR ] HPS: Validating primary data. [2025-09-23T19:19:09.552771] [DEBUG] [VALIDATOR ] HPS: All expected trading days are present. [2025-09-23T19:19:09.552906] [DEBUG] [VALIDATOR ] HPS: Primary data validation passed. [2025-09-23T19:19:09.553424] [INFO ] [MAIN ] HPS: Fetched primary data is valid. [2025-09-23T19:19:09.553560] [DEBUG] [LOCAL ] HPS: Saving primary data. [2025-09-23T19:19:09.554671] [DEBUG] [LOCAL ] HPS: Trimmed 15168 records to 10223 (keeping 200 days of data) [2025-09-23T19:19:09.626246] [DEBUG] [LOCAL ] HPS: Primary data saved (10223 records). [2025-09-23T19:19:09.626448] [INFO ] [MAIN ] HPS: Full history saved. [2025-09-23T19:19:09.626658] [INFO ] [MAIN ] Update Progress: 1048/2372 symbols completed. HPS took 27.7s. Estimated remaining: 2h 55m 45s. Rate: 7.5 symbols/min [2025-09-23T19:19:09.807385] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-08. [2025-09-23T19:19:09.810237] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:19:09.841508] [DEBUG] [LOCAL ] HQL: Loaded 15995 existing records from primary storage. [2025-09-23T19:19:09.841749] [INFO ] [MAIN ] HQL: Loaded 15995 existing records. [2025-09-23T19:19:10.055134] [WARN ] [MAIN ] HQL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:19:10.055555] [INFO ] [MAIN ] HQL: Wiping existing primary data before full refresh. [2025-09-23T19:19:10.055678] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-09-23T19:19:10.056483] [DEBUG] [LOCAL ] HQL: Deleted primary data file. [2025-09-23T19:19:10.056568] [INFO ] [MAIN ] HQL: Starting full primary refresh. [2025-09-23T19:19:10.467291] [INFO ] [REMOTE ] HQL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:19:10.602247] [INFO ] [REMOTE ] HQL: Fetching primary data for 2024-12. [2025-09-23T19:19:11.028111] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-23T19:19:11.115708] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-23T19:19:11.198094] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-23T19:19:11.402269] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-09. [2025-09-23T19:19:12.202264] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-08. [2025-09-23T19:19:12.240043] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-23T19:19:12.245325] [INFO ] [REMOTE ] HQH: Full fetch complete (37199 records). [2025-09-23T19:19:12.245486] [DEBUG] [VALIDATOR ] HQH: Validating primary data. [2025-09-23T19:19:12.670920] [DEBUG] [VALIDATOR ] HQH: All expected trading days are present. [2025-09-23T19:19:12.671128] [DEBUG] [VALIDATOR ] HQH: Primary data validation passed. [2025-09-23T19:19:12.672134] [INFO ] [MAIN ] HQH: Fetched primary data is valid. [2025-09-23T19:19:12.672203] [DEBUG] [LOCAL ] HQH: Saving primary data. [2025-09-23T19:19:12.673473] [DEBUG] [LOCAL ] HQH: Trimmed 37199 records to 24832 (keeping 200 days of data) [2025-09-23T19:19:12.850180] [DEBUG] [LOCAL ] HQH: Primary data saved (24832 records). [2025-09-23T19:19:12.850392] [INFO ] [MAIN ] HQH: Full history saved. [2025-09-23T19:19:12.850585] [INFO ] [MAIN ] Update Progress: 1049/2372 symbols completed. HQH took 28.3s. Estimated remaining: 2h 55m 31s. Rate: 7.5 symbols/min [2025-09-23T19:19:13.009375] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-01. [2025-09-23T19:19:13.037123] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:19:13.103065] [DEBUG] [LOCAL ] HR: Loaded 51967 existing records from primary storage. [2025-09-23T19:19:13.103275] [INFO ] [MAIN ] HR: Loaded 51967 existing records. [2025-09-23T19:19:13.390039] [WARN ] [MAIN ] HR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:19:13.390434] [INFO ] [MAIN ] HR: Wiping existing primary data before full refresh. [2025-09-23T19:19:13.390487] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-09-23T19:19:13.392478] [DEBUG] [LOCAL ] HR: Deleted primary data file. [2025-09-23T19:19:13.392543] [INFO ] [MAIN ] HR: Starting full primary refresh. [2025-09-23T19:19:13.778895] [INFO ] [REMOTE ] HR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:19:13.802253] [INFO ] [REMOTE ] HR: Fetching primary data for 2024-12. [2025-09-23T19:19:13.874027] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-23T19:19:14.030349] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-23T19:19:14.602199] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-09. [2025-09-23T19:19:15.120677] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-23T19:19:15.402235] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-02. [2025-09-23T19:19:16.175734] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-23T19:19:16.202225] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-09. [2025-09-23T19:19:16.573899] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-23T19:19:16.592098] [INFO ] [REMOTE ] HPQ: Full fetch complete (77668 records). [2025-09-23T19:19:16.592950] [DEBUG] [VALIDATOR ] HPQ: Validating primary data. [2025-09-23T19:19:17.009915] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-03. [2025-09-23T19:19:17.011790] [DEBUG] [VALIDATOR ] HPQ: All expected trading days are present. [2025-09-23T19:19:17.011885] [DEBUG] [VALIDATOR ] HPQ: Primary data validation passed. [2025-09-23T19:19:17.013020] [INFO ] [MAIN ] HPQ: Fetched primary data is valid. [2025-09-23T19:19:17.013099] [DEBUG] [LOCAL ] HPQ: Saving primary data. [2025-09-23T19:19:17.015163] [DEBUG] [LOCAL ] HPQ: Trimmed 77668 records to 53668 (keeping 200 days of data) [2025-09-23T19:19:17.363683] [DEBUG] [LOCAL ] HPQ: Primary data saved (53668 records). [2025-09-23T19:19:17.363826] [INFO ] [MAIN ] HPQ: Full history saved. [2025-09-23T19:19:17.363925] [INFO ] [MAIN ] Update Progress: 1050/2372 symbols completed. HPQ took 42.1s. Estimated remaining: 2h 55m 18s. Rate: 7.5 symbols/min [2025-09-23T19:19:17.537603] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:19:17.562815] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-23T19:19:17.572038] [INFO ] [REMOTE ] HPP: Full fetch complete (73367 records). [2025-09-23T19:19:17.572228] [DEBUG] [VALIDATOR ] HPP: Validating primary data. [2025-09-23T19:19:17.803680] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-01. [2025-09-23T19:19:17.818474] [DEBUG] [LOCAL ] HRB: Loaded 48621 existing records from primary storage. [2025-09-23T19:19:17.837883] [INFO ] [MAIN ] HRB: Loaded 48621 existing records. [2025-09-23T19:19:18.209572] [WARN ] [MAIN ] HRB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:19:18.216055] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-23T19:19:18.238034] [INFO ] [MAIN ] HRB: Wiping existing primary data before full refresh. [2025-09-23T19:19:18.238154] [DEBUG] [VALIDATOR ] HPP: All expected trading days are present. [2025-09-23T19:19:18.238509] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-09-23T19:19:18.238629] [DEBUG] [VALIDATOR ] HPP: Primary data validation passed. [2025-09-23T19:19:18.239618] [INFO ] [MAIN ] HPP: Fetched primary data is valid. [2025-09-23T19:19:18.239708] [DEBUG] [LOCAL ] HPP: Saving primary data. [2025-09-23T19:19:18.239989] [DEBUG] [LOCAL ] HRB: Deleted primary data file. [2025-09-23T19:19:18.240055] [INFO ] [MAIN ] HRB: Starting full primary refresh. [2025-09-23T19:19:18.335447] [DEBUG] [LOCAL ] HPP: Trimmed 73367 records to 50822 (keeping 200 days of data) [2025-09-23T19:19:18.602259] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-04. [2025-09-23T19:19:18.720142] [INFO ] [REMOTE ] HRB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:19:18.912601] [DEBUG] [LOCAL ] HPP: Primary data saved (50822 records). [2025-09-23T19:19:18.912768] [INFO ] [MAIN ] HPP: Full history saved. [2025-09-23T19:19:18.912858] [INFO ] [MAIN ] Update Progress: 1051/2372 symbols completed. HPP took 49.4s. Estimated remaining: 2h 55m 2s. Rate: 7.5 symbols/min [2025-09-23T19:19:19.082735] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:19:19.124320] [DEBUG] [LOCAL ] HRI: Loaded 33152 existing records from primary storage. [2025-09-23T19:19:19.124464] [INFO ] [MAIN ] HRI: Loaded 33152 existing records. [2025-09-23T19:19:19.313871] [WARN ] [MAIN ] HRI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:19:19.314101] [INFO ] [MAIN ] HRI: Wiping existing primary data before full refresh. [2025-09-23T19:19:19.314148] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-09-23T19:19:19.315042] [DEBUG] [LOCAL ] HRI: Deleted primary data file. [2025-09-23T19:19:19.315102] [INFO ] [MAIN ] HRI: Starting full primary refresh. [2025-09-23T19:19:19.415178] [INFO ] [REMOTE ] HRB: Fetching primary data for 2024-12. [2025-09-23T19:19:19.614129] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-23T19:19:19.701740] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-23T19:19:19.738425] [INFO ] [REMOTE ] HRI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:19:20.202201] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-02. [2025-09-23T19:19:20.666962] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-23T19:19:21.002198] [INFO ] [REMOTE ] HRI: Fetching primary data for 2024-12. [2025-09-23T19:19:21.331970] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-23T19:19:21.802159] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-01. [2025-09-23T19:19:22.015740] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-23T19:19:22.602196] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-05. [2025-09-23T19:19:23.402169] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-03. [2025-09-23T19:19:23.439263] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-23T19:19:23.481291] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-23T19:19:24.202244] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-06. [2025-09-23T19:19:24.826726] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-23T19:19:24.955092] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-23T19:19:25.002200] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-01. [2025-09-23T19:19:25.802200] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-04. [2025-09-23T19:19:26.223942] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-23T19:19:26.602179] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-07. [2025-09-23T19:19:27.216821] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-23T19:19:27.402168] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-02. [2025-09-23T19:19:27.452788] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-23T19:19:28.202224] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-08. [2025-09-23T19:19:29.003484] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-05. [2025-09-23T19:19:29.019068] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-23T19:19:29.022032] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-23T19:19:29.802216] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-09. [2025-09-23T19:19:30.307023] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-23T19:19:30.602280] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-02. [2025-09-23T19:19:30.701538] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-23T19:19:30.704490] [INFO ] [REMOTE ] HQL: Full fetch complete (24032 records). [2025-09-23T19:19:30.704585] [DEBUG] [VALIDATOR ] HQL: Validating primary data. [2025-09-23T19:19:31.111753] [DEBUG] [VALIDATOR ] HQL: All expected trading days are present. [2025-09-23T19:19:31.111858] [DEBUG] [VALIDATOR ] HQL: Primary data validation passed. [2025-09-23T19:19:31.112447] [INFO ] [MAIN ] HQL: Fetched primary data is valid. [2025-09-23T19:19:31.112517] [DEBUG] [LOCAL ] HQL: Saving primary data. [2025-09-23T19:19:31.113800] [DEBUG] [LOCAL ] HQL: Trimmed 24032 records to 15826 (keeping 200 days of data) [2025-09-23T19:19:31.221874] [DEBUG] [LOCAL ] HQL: Primary data saved (15826 records). [2025-09-23T19:19:31.222046] [INFO ] [MAIN ] HQL: Full history saved. [2025-09-23T19:19:31.222161] [INFO ] [MAIN ] Update Progress: 1052/2372 symbols completed. HQL took 21.6s. Estimated remaining: 2h 54m 60s. Rate: 7.5 symbols/min [2025-09-23T19:19:31.413117] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-03. [2025-09-23T19:19:31.417990] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:19:31.480411] [DEBUG] [LOCAL ] HRL: Loaded 53077 existing records from primary storage. [2025-09-23T19:19:31.480577] [INFO ] [MAIN ] HRL: Loaded 53077 existing records. [2025-09-23T19:19:31.668981] [WARN ] [MAIN ] HRL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:19:31.669323] [INFO ] [MAIN ] HRL: Wiping existing primary data before full refresh. [2025-09-23T19:19:31.669457] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-09-23T19:19:31.670966] [DEBUG] [LOCAL ] HRL: Deleted primary data file. [2025-09-23T19:19:31.671035] [INFO ] [MAIN ] HRL: Starting full primary refresh. [2025-09-23T19:19:31.795536] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-23T19:19:32.052688] [INFO ] [REMOTE ] HRL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:19:32.202194] [INFO ] [REMOTE ] HRL: Fetching primary data for 2024-12. [2025-09-23T19:19:32.821552] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-23T19:19:33.002255] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-06. [2025-09-23T19:19:33.628613] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-23T19:19:33.802208] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-03. [2025-09-23T19:19:34.329908] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-23T19:19:34.602237] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-01. [2025-09-23T19:19:34.989580] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-23T19:19:35.402259] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-04. [2025-09-23T19:19:36.202192] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-04. [2025-09-23T19:19:36.444228] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-23T19:19:36.515624] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-23T19:19:37.002244] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-05. [2025-09-23T19:19:37.802222] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-07. [2025-09-23T19:19:37.945228] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-23T19:19:38.015941] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-23T19:19:38.602258] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-05. [2025-09-23T19:19:39.171468] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-23T19:19:39.402207] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-06. [2025-09-23T19:19:40.202167] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-02. [2025-09-23T19:19:40.393945] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-23T19:19:40.826525] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-23T19:19:41.002200] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-07. [2025-09-23T19:19:41.802231] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-08. [2025-09-23T19:19:41.862556] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-23T19:19:42.377904] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-23T19:19:42.602212] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-06. [2025-09-23T19:19:43.402166] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-03. [2025-09-23T19:19:43.560568] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-23T19:19:44.128165] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-23T19:19:44.202159] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-07. [2025-09-23T19:19:45.002204] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-09. [2025-09-23T19:19:45.070732] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-23T19:19:45.806867] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-04. [2025-09-23T19:19:45.819136] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-23T19:19:46.524599] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-23T19:19:46.537374] [INFO ] [REMOTE ] HR: Full fetch complete (74789 records). [2025-09-23T19:19:46.537521] [DEBUG] [VALIDATOR ] HR: Validating primary data. [2025-09-23T19:19:46.607272] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-08. [2025-09-23T19:19:46.946065] [DEBUG] [VALIDATOR ] HR: All expected trading days are present. [2025-09-23T19:19:46.946160] [DEBUG] [VALIDATOR ] HR: Primary data validation passed. [2025-09-23T19:19:46.947073] [INFO ] [MAIN ] HR: Fetched primary data is valid. [2025-09-23T19:19:46.947138] [DEBUG] [LOCAL ] HR: Saving primary data. [2025-09-23T19:19:46.948602] [DEBUG] [LOCAL ] HR: Trimmed 74789 records to 51956 (keeping 200 days of data) [2025-09-23T19:19:47.303539] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-23T19:19:47.327709] [DEBUG] [LOCAL ] HR: Primary data saved (51956 records). [2025-09-23T19:19:47.327869] [INFO ] [MAIN ] HR: Full history saved. [2025-09-23T19:19:47.328014] [INFO ] [MAIN ] Update Progress: 1053/2372 symbols completed. HR took 34.5s. Estimated remaining: 2h 55m 2s. Rate: 7.5 symbols/min [2025-09-23T19:19:47.407399] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-05. [2025-09-23T19:19:47.498934] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:19:47.531404] [DEBUG] [LOCAL ] HRTG: Loaded 32764 existing records from primary storage. [2025-09-23T19:19:47.531540] [INFO ] [MAIN ] HRTG: Loaded 32764 existing records. [2025-09-23T19:19:47.715381] [WARN ] [MAIN ] HRTG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:19:47.715799] [INFO ] [MAIN ] HRTG: Wiping existing primary data before full refresh. [2025-09-23T19:19:47.715874] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-09-23T19:19:47.722299] [DEBUG] [LOCAL ] HRTG: Deleted primary data file. [2025-09-23T19:19:47.732384] [INFO ] [MAIN ] HRTG: Starting full primary refresh. [2025-09-23T19:19:47.805397] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-23T19:19:48.096622] [INFO ] [REMOTE ] HRTG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:19:48.202144] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2024-12. [2025-09-23T19:19:49.007618] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-09. [2025-09-23T19:19:49.027989] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-23T19:19:49.359857] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-23T19:19:49.802203] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-08. [2025-09-23T19:19:50.195774] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-23T19:19:50.202228] [INFO ] [REMOTE ] HRI: Full fetch complete (45966 records). [2025-09-23T19:19:50.202455] [DEBUG] [VALIDATOR ] HRI: Validating primary data. [2025-09-23T19:19:50.610833] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-06. [2025-09-23T19:19:50.615202] [DEBUG] [VALIDATOR ] HRI: All expected trading days are present. [2025-09-23T19:19:50.616360] [DEBUG] [VALIDATOR ] HRI: Primary data validation passed. [2025-09-23T19:19:50.617270] [INFO ] [MAIN ] HRI: Fetched primary data is valid. [2025-09-23T19:19:50.617487] [DEBUG] [LOCAL ] HRI: Saving primary data. [2025-09-23T19:19:50.619064] [DEBUG] [LOCAL ] HRI: Trimmed 45966 records to 33171 (keeping 200 days of data) [2025-09-23T19:19:50.837571] [DEBUG] [LOCAL ] HRI: Primary data saved (33171 records). [2025-09-23T19:19:50.837754] [INFO ] [MAIN ] HRI: Full history saved. [2025-09-23T19:19:50.837873] [INFO ] [MAIN ] Update Progress: 1054/2372 symbols completed. HRI took 31.9s. Estimated remaining: 2h 54m 48s. Rate: 7.5 symbols/min [2025-09-23T19:19:51.016300] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:19:51.016726] [DEBUG] [LOCAL ] HSBC: No existing data file found in primary storage. [2025-09-23T19:19:51.016804] [WARN ] [MAIN ] HSBC: No existing data found, performing full refresh instead. [2025-09-23T19:19:51.017141] [INFO ] [MAIN ] HSBC: Wiping existing primary data before full refresh. [2025-09-23T19:19:51.017230] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-09-23T19:19:51.017329] [DEBUG] [LOCAL ] HSBC: No primary data file found to delete. [2025-09-23T19:19:51.017399] [INFO ] [MAIN ] HSBC: Starting full primary refresh. [2025-09-23T19:19:51.416071] [INFO ] [REMOTE ] HSBC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:19:51.407554] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-01. [2025-09-23T19:19:51.420286] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-23T19:19:52.106991] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-23T19:19:52.202162] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-09. [2025-09-23T19:19:52.471737] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-23T19:19:53.002198] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2024-12. [2025-09-23T19:19:53.802161] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-07. [2025-09-23T19:19:53.889178] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-23T19:19:53.897627] [INFO ] [REMOTE ] HRB: Full fetch complete (69794 records). [2025-09-23T19:19:53.897784] [DEBUG] [VALIDATOR ] HRB: Validating primary data. [2025-09-23T19:19:54.314780] [DEBUG] [VALIDATOR ] HRB: All expected trading days are present. [2025-09-23T19:19:54.314911] [DEBUG] [VALIDATOR ] HRB: Primary data validation passed. [2025-09-23T19:19:54.315922] [INFO ] [MAIN ] HRB: Fetched primary data is valid. [2025-09-23T19:19:54.315993] [DEBUG] [LOCAL ] HRB: Saving primary data. [2025-09-23T19:19:54.317451] [DEBUG] [LOCAL ] HRB: Trimmed 69794 records to 48618 (keeping 200 days of data) [2025-09-23T19:19:54.604039] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-02. [2025-09-23T19:19:54.614615] [DEBUG] [LOCAL ] HRB: Primary data saved (48618 records). [2025-09-23T19:19:54.614725] [INFO ] [MAIN ] HRB: Full history saved. [2025-09-23T19:19:54.614834] [INFO ] [MAIN ] Update Progress: 1055/2372 symbols completed. HRB took 37.3s. Estimated remaining: 2h 54m 35s. Rate: 7.5 symbols/min [2025-09-23T19:19:54.792608] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:19:54.821146] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-23T19:19:54.841783] [DEBUG] [LOCAL ] HSHP: Loaded 15572 existing records from primary storage. [2025-09-23T19:19:54.841892] [INFO ] [MAIN ] HSHP: Loaded 15572 existing records. [2025-09-23T19:19:55.031540] [WARN ] [MAIN ] HSHP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:19:55.031848] [INFO ] [MAIN ] HSHP: Wiping existing primary data before full refresh. [2025-09-23T19:19:55.031900] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-09-23T19:19:55.032385] [DEBUG] [LOCAL ] HSHP: Deleted primary data file. [2025-09-23T19:19:55.032445] [INFO ] [MAIN ] HSHP: Starting full primary refresh. [2025-09-23T19:19:55.398145] [INFO ] [REMOTE ] HSHP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:19:55.409955] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-01. [2025-09-23T19:19:55.411781] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-23T19:19:55.701768] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-23T19:19:56.202205] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-08. [2025-09-23T19:19:56.891142] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-23T19:19:57.002190] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-02. [2025-09-23T19:19:57.802177] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-03. [2025-09-23T19:19:58.076203] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-23T19:19:58.602157] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-09. [2025-09-23T19:19:58.620744] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-23T19:19:58.837820] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-23T19:19:59.402194] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2024-12. [2025-09-23T19:20:00.202234] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-04. [2025-09-23T19:20:00.257820] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-23T19:20:00.267060] [INFO ] [REMOTE ] HRL: Full fetch complete (76687 records). [2025-09-23T19:20:00.267251] [DEBUG] [VALIDATOR ] HRL: Validating primary data. [2025-09-23T19:20:00.590081] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-23T19:20:00.727740] [DEBUG] [VALIDATOR ] HRL: All expected trading days are present. [2025-09-23T19:20:00.727834] [DEBUG] [VALIDATOR ] HRL: Primary data validation passed. [2025-09-23T19:20:00.728916] [INFO ] [MAIN ] HRL: Fetched primary data is valid. [2025-09-23T19:20:00.728980] [DEBUG] [LOCAL ] HRL: Saving primary data. [2025-09-23T19:20:00.730497] [DEBUG] [LOCAL ] HRL: Trimmed 76687 records to 53088 (keeping 200 days of data) [2025-09-23T19:20:01.008521] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-01. [2025-09-23T19:20:01.055665] [DEBUG] [LOCAL ] HRL: Primary data saved (53088 records). [2025-09-23T19:20:01.055819] [INFO ] [MAIN ] HRL: Full history saved. [2025-09-23T19:20:01.055910] [INFO ] [MAIN ] Update Progress: 1056/2372 symbols completed. HRL took 29.8s. Estimated remaining: 2h 54m 25s. Rate: 7.5 symbols/min [2025-09-23T19:20:01.232194] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:20:01.292071] [DEBUG] [LOCAL ] HSY: Loaded 50458 existing records from primary storage. [2025-09-23T19:20:01.292243] [INFO ] [MAIN ] HSY: Loaded 50458 existing records. [2025-09-23T19:20:01.473560] [WARN ] [MAIN ] HSY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:20:01.474007] [INFO ] [MAIN ] HSY: Wiping existing primary data before full refresh. [2025-09-23T19:20:01.492401] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-09-23T19:20:01.493855] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-23T19:20:01.493988] [DEBUG] [LOCAL ] HSY: Deleted primary data file. [2025-09-23T19:20:01.500923] [INFO ] [MAIN ] HSY: Starting full primary refresh. [2025-09-23T19:20:01.805159] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-05. [2025-09-23T19:20:01.875229] [INFO ] [REMOTE ] HSY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:20:01.878765] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-23T19:20:02.602226] [INFO ] [REMOTE ] HSY: Fetching primary data for 2024-12. [2025-09-23T19:20:03.402228] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-03. [2025-09-23T19:20:03.481682] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-23T19:20:04.202227] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-06. [2025-09-23T19:20:04.635926] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-23T19:20:05.002247] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-01. [2025-09-23T19:20:05.062154] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-23T19:20:05.199788] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-23T19:20:05.802204] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-07. [2025-09-23T19:20:06.602159] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-04. [2025-09-23T19:20:06.873875] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-23T19:20:07.021508] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-23T19:20:07.402200] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-08. [2025-09-23T19:20:08.202224] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-02. [2025-09-23T19:20:08.782912] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-23T19:20:08.818901] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-23T19:20:09.002228] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-09. [2025-09-23T19:20:09.802198] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-05. [2025-09-23T19:20:10.064940] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-23T19:20:10.070582] [INFO ] [REMOTE ] HRTG: Full fetch complete (42093 records). [2025-09-23T19:20:10.070689] [DEBUG] [VALIDATOR ] HRTG: Validating primary data. [2025-09-23T19:20:10.457884] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-09-23T19:20:10.520048] [DEBUG] [VALIDATOR ] HRTG: All expected trading days are present. [2025-09-23T19:20:10.520147] [DEBUG] [VALIDATOR ] HRTG: Primary data validation passed. [2025-09-23T19:20:10.520862] [INFO ] [MAIN ] HRTG: Fetched primary data is valid. [2025-09-23T19:20:10.520958] [DEBUG] [LOCAL ] HRTG: Saving primary data. [2025-09-23T19:20:10.522204] [DEBUG] [LOCAL ] HRTG: Trimmed 42093 records to 32918 (keeping 200 days of data) [2025-09-23T19:20:10.606239] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-03. [2025-09-23T19:20:10.716872] [DEBUG] [LOCAL ] HRTG: Primary data saved (32918 records). [2025-09-23T19:20:10.717031] [INFO ] [MAIN ] HRTG: Full history saved. [2025-09-23T19:20:10.717120] [INFO ] [MAIN ] Update Progress: 1057/2372 symbols completed. HRTG took 23.4s. Estimated remaining: 2h 54m 20s. Rate: 7.5 symbols/min [2025-09-23T19:20:10.898176] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:20:10.898361] [DEBUG] [LOCAL ] HTB: No existing data file found in primary storage. [2025-09-23T19:20:10.898398] [WARN ] [MAIN ] HTB: No existing data found, performing full refresh instead. [2025-09-23T19:20:10.898541] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-09-23T19:20:10.898582] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-09-23T19:20:10.898624] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-09-23T19:20:10.898690] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-09-23T19:20:11.285882] [INFO ] [REMOTE ] HTB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:20:11.351303] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-23T19:20:11.402174] [INFO ] [REMOTE ] HTB: Fetching primary data for 2024-12. [2025-09-23T19:20:11.623347] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:20:11.623630] [WARN ] [REMOTE ] HTB: No data returned for month 2024-12 [2025-09-23T19:20:12.202166] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-06. [2025-09-23T19:20:12.486901] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-23T19:20:13.002200] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-01. [2025-09-23T19:20:13.197250] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:20:13.197483] [WARN ] [REMOTE ] HTB: No data returned for month 2025-01 [2025-09-23T19:20:13.809819] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-02. [2025-09-23T19:20:13.828162] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-23T19:20:14.059521] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-02 (0.25 seconds). [2025-09-23T19:20:14.602185] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-03. [2025-09-23T19:20:15.066494] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-23T19:20:15.402196] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-07. [2025-09-23T19:20:16.202189] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-04. [2025-09-23T19:20:17.002174] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-04. [2025-09-23T19:20:17.500919] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-23T19:20:17.701083] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-23T19:20:17.802170] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-02. [2025-09-23T19:20:17.887097] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-23T19:20:18.602192] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-08. [2025-09-23T19:20:18.813992] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-23T19:20:19.402203] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-05. [2025-09-23T19:20:20.145202] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-23T19:20:20.202150] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-03. [2025-09-23T19:20:20.440372] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-23T19:20:21.002211] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-05. [2025-09-23T19:20:21.268936] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-23T19:20:21.802203] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-09. [2025-09-23T19:20:22.512773] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-23T19:20:22.602184] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-06. [2025-09-23T19:20:23.402193] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-04. [2025-09-23T19:20:23.556942] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-23T19:20:23.565227] [INFO ] [REMOTE ] HSBC: Full fetch complete (73599 records). [2025-09-23T19:20:23.565356] [DEBUG] [VALIDATOR ] HSBC: Validating primary data. [2025-09-23T19:20:23.967815] [DEBUG] [VALIDATOR ] HSBC: All expected trading days are present. [2025-09-23T19:20:23.967902] [DEBUG] [VALIDATOR ] HSBC: Primary data validation passed. [2025-09-23T19:20:23.968850] [INFO ] [MAIN ] HSBC: Fetched primary data is valid. [2025-09-23T19:20:23.968919] [DEBUG] [LOCAL ] HSBC: Saving primary data. [2025-09-23T19:20:23.970389] [DEBUG] [LOCAL ] HSBC: Trimmed 73599 records to 51156 (keeping 200 days of data) [2025-09-23T19:20:24.204922] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-06. [2025-09-23T19:20:24.342723] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-23T19:20:24.372177] [DEBUG] [LOCAL ] HSBC: Primary data saved (51156 records). [2025-09-23T19:20:24.372343] [INFO ] [MAIN ] HSBC: Full history saved. [2025-09-23T19:20:24.372435] [INFO ] [MAIN ] Update Progress: 1058/2372 symbols completed. HSBC took 33.5s. Estimated remaining: 2h 54m 19s. Rate: 7.5 symbols/min [2025-09-23T19:20:24.559412] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-23T19:20:24.598462] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:20:24.617359] [DEBUG] [LOCAL ] HTD: Loaded 13500 existing records from primary storage. [2025-09-23T19:20:24.617501] [INFO ] [MAIN ] HTD: Loaded 13500 existing records. [2025-09-23T19:20:24.779843] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-23T19:20:24.820904] [WARN ] [MAIN ] HTD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:20:24.821166] [INFO ] [MAIN ] HTD: Wiping existing primary data before full refresh. [2025-09-23T19:20:24.821218] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-09-23T19:20:24.821852] [DEBUG] [LOCAL ] HTD: Deleted primary data file. [2025-09-23T19:20:24.821916] [INFO ] [MAIN ] HTD: Starting full primary refresh. [2025-09-23T19:20:25.007694] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-05. [2025-09-23T19:20:25.198784] [INFO ] [REMOTE ] HTD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:20:25.698196] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-23T19:20:25.802183] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-06. [2025-09-23T19:20:26.602202] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-07. [2025-09-23T19:20:26.765201] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-23T19:20:27.056377] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-23T19:20:27.402204] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-07. [2025-09-23T19:20:28.202189] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-07. [2025-09-23T19:20:28.964096] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-23T19:20:29.002190] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-08. [2025-09-23T19:20:29.178788] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-23T19:20:29.802224] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-08. [2025-09-23T19:20:30.504671] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-23T19:20:30.602191] [INFO ] [REMOTE ] HTD: Fetching primary data for 2024-12. [2025-09-23T19:20:30.757947] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-23T19:20:31.216930] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-23T19:20:31.402227] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-09. [2025-09-23T19:20:32.202205] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-08. [2025-09-23T19:20:32.711475] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-23T19:20:33.002202] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-09. [2025-09-23T19:20:33.252089] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-23T19:20:33.264714] [INFO ] [REMOTE ] HSY: Full fetch complete (73835 records). [2025-09-23T19:20:33.264973] [DEBUG] [VALIDATOR ] HSY: Validating primary data. [2025-09-23T19:20:33.718868] [DEBUG] [VALIDATOR ] HSY: All expected trading days are present. [2025-09-23T19:20:33.718994] [DEBUG] [VALIDATOR ] HSY: Primary data validation passed. [2025-09-23T19:20:33.720353] [INFO ] [MAIN ] HSY: Fetched primary data is valid. [2025-09-23T19:20:33.720545] [DEBUG] [LOCAL ] HSY: Saving primary data. [2025-09-23T19:20:33.729385] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-23T19:20:33.732553] [INFO ] [REMOTE ] HTB: Full fetch complete (7547 records). [2025-09-23T19:20:33.732891] [DEBUG] [VALIDATOR ] HTB: Validating primary data. [2025-09-23T19:20:33.738927] [DEBUG] [LOCAL ] HSY: Trimmed 73835 records to 50459 (keeping 200 days of data) [2025-09-23T19:20:33.803593] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-09. [2025-09-23T19:20:34.148410] [WARN ] [VALIDATOR ] HTB: Validation failed - insufficient historical data. Have 143 unique days, need 200 days [2025-09-23T19:20:34.150097] [FATAL] [MAIN ] HTB: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:20:34.150943] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:20:34.151040] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-09-23T19:20:34.151196] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-09-23T19:20:34.151259] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-09-23T19:20:34.151335] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-09-23T19:20:34.151437] [INFO ] [MAIN ] Update Progress: 1059/2372 symbols completed. HTB took 23.4s. Estimated remaining: 2h 54m 13s. Rate: 7.5 symbols/min [2025-09-23T19:20:34.482861] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:20:34.493428] [DEBUG] [LOCAL ] HTFC: No existing data file found in primary storage. [2025-09-23T19:20:34.493879] [WARN ] [MAIN ] HTFC: No existing data found, performing full refresh instead. [2025-09-23T19:20:34.494134] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-09-23T19:20:34.494212] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-09-23T19:20:34.494415] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-09-23T19:20:34.494467] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-09-23T19:20:34.603455] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-01. [2025-09-23T19:20:35.007352] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-23T19:20:35.034629] [INFO ] [REMOTE ] HSHP: Full fetch complete (23615 records). [2025-09-23T19:20:35.057479] [DEBUG] [VALIDATOR ] HSHP: Validating primary data. [2025-09-23T19:20:35.225986] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:20:35.409498] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2024-12. [2025-09-23T19:20:35.554248] [DEBUG] [VALIDATOR ] HSHP: All expected trading days are present. [2025-09-23T19:20:35.554927] [DEBUG] [VALIDATOR ] HSHP: Primary data validation passed. [2025-09-23T19:20:35.556095] [INFO ] [MAIN ] HSHP: Fetched primary data is valid. [2025-09-23T19:20:35.556446] [DEBUG] [LOCAL ] HSHP: Saving primary data. [2025-09-23T19:20:35.561911] [DEBUG] [LOCAL ] HSHP: Trimmed 23615 records to 15671 (keeping 200 days of data) [2025-09-23T19:20:35.700221] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-23T19:20:35.726385] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-09-23T19:20:35.743080] [DEBUG] [LOCAL ] HSY: Primary data saved (50459 records). [2025-09-23T19:20:35.743192] [INFO ] [MAIN ] HSY: Full history saved. [2025-09-23T19:20:35.743922] [INFO ] [MAIN ] Update Progress: 1060/2372 symbols completed. HSY took 34.7s. Estimated remaining: 2h 53m 57s. Rate: 7.5 symbols/min [2025-09-23T19:20:35.902605] [DEBUG] [LOCAL ] HSHP: Primary data saved (15671 records). [2025-09-23T19:20:35.910527] [INFO ] [MAIN ] HSHP: Full history saved. [2025-09-23T19:20:35.911488] [INFO ] [MAIN ] Update Progress: 1061/2372 symbols completed. HSHP took 41.3s. Estimated remaining: 2h 53m 40s. Rate: 7.5 symbols/min [2025-09-23T19:20:35.928417] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:20:36.102586] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:20:36.146248] [DEBUG] [LOCAL ] HTGC: Loaded 47623 existing records from primary storage. [2025-09-23T19:20:36.146442] [INFO ] [MAIN ] HTGC: Loaded 47623 existing records. [2025-09-23T19:20:36.211752] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-02. [2025-09-23T19:20:36.265316] [DEBUG] [LOCAL ] HTH: Loaded 32579 existing records from primary storage. [2025-09-23T19:20:36.265506] [INFO ] [MAIN ] HTH: Loaded 32579 existing records. [2025-09-23T19:20:36.502731] [WARN ] [MAIN ] HTGC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:20:36.529939] [INFO ] [MAIN ] HTGC: Wiping existing primary data before full refresh. [2025-09-23T19:20:36.530170] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-09-23T19:20:36.530038] [WARN ] [MAIN ] HTH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:20:36.530405] [INFO ] [MAIN ] HTH: Wiping existing primary data before full refresh. [2025-09-23T19:20:36.530459] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-09-23T19:20:36.531622] [DEBUG] [LOCAL ] HTH: Deleted primary data file. [2025-09-23T19:20:36.531709] [INFO ] [MAIN ] HTH: Starting full primary refresh. [2025-09-23T19:20:36.531760] [DEBUG] [LOCAL ] HTGC: Deleted primary data file. [2025-09-23T19:20:36.575359] [INFO ] [MAIN ] HTGC: Starting full primary refresh. [2025-09-23T19:20:37.021069] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-01. [2025-09-23T19:20:37.142772] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-23T19:20:37.241217] [INFO ] [REMOTE ] HTH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:20:37.308106] [INFO ] [REMOTE ] HTGC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:20:37.543684] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-23T19:20:37.802251] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-09-23T19:20:38.288749] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-23T19:20:38.602240] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-03. [2025-09-23T19:20:39.173878] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-23T19:20:39.402207] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-04. [2025-09-23T19:20:40.202198] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-09-23T19:20:40.367934] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-23T19:20:40.587333] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-23T19:20:41.002195] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-05. [2025-09-23T19:20:41.592223] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-23T19:20:41.802206] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-09-23T19:20:42.223163] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-23T19:20:42.602239] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2024-12. [2025-09-23T19:20:43.402200] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-09-23T19:20:43.730588] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-23T19:20:44.202243] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-06. [2025-09-23T19:20:44.240882] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-23T19:20:44.795009] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-23T19:20:45.002192] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-09-23T19:20:45.317793] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-23T19:20:45.802247] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-07. [2025-09-23T19:20:46.602160] [INFO ] [REMOTE ] HTH: Fetching primary data for 2024-12. [2025-09-23T19:20:46.756386] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-23T19:20:47.402164] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-08. [2025-09-23T19:20:47.498567] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-23T19:20:48.202203] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-01. [2025-09-23T19:20:48.511558] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-23T19:20:49.002225] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-09-23T19:20:49.247616] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-09-23T19:20:49.363445] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-23T19:20:49.802202] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-01. [2025-09-23T19:20:50.602208] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-09-23T19:20:50.880850] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-09-23T19:20:51.109585] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-23T19:20:51.402175] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-09. [2025-09-23T19:20:52.202310] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-02. [2025-09-23T19:20:52.393037] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-23T19:20:52.396865] [INFO ] [REMOTE ] HTD: Full fetch complete (18833 records). [2025-09-23T19:20:52.396945] [DEBUG] [VALIDATOR ] HTD: Validating primary data. [2025-09-23T19:20:52.789040] [DEBUG] [VALIDATOR ] HTD: All expected trading days are present. [2025-09-23T19:20:52.789171] [DEBUG] [VALIDATOR ] HTD: Primary data validation passed. [2025-09-23T19:20:52.789680] [INFO ] [MAIN ] HTD: Fetched primary data is valid. [2025-09-23T19:20:52.789761] [DEBUG] [LOCAL ] HTD: Saving primary data. [2025-09-23T19:20:52.790406] [DEBUG] [LOCAL ] HTD: Trimmed 18833 records to 13506 (keeping 200 days of data) [2025-09-23T19:20:52.882015] [DEBUG] [LOCAL ] HTD: Primary data saved (13506 records). [2025-09-23T19:20:52.882146] [INFO ] [MAIN ] HTD: Full history saved. [2025-09-23T19:20:52.882343] [INFO ] [MAIN ] Update Progress: 1062/2372 symbols completed. HTD took 28.5s. Estimated remaining: 2h 53m 43s. Rate: 7.5 symbols/min [2025-09-23T19:20:53.007419] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-09-23T19:20:53.066143] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:20:53.109153] [DEBUG] [LOCAL ] HUBB: Loaded 37308 existing records from primary storage. [2025-09-23T19:20:53.109295] [INFO ] [MAIN ] HUBB: Loaded 37308 existing records. [2025-09-23T19:20:53.297613] [WARN ] [MAIN ] HUBB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:20:53.298084] [INFO ] [MAIN ] HUBB: Wiping existing primary data before full refresh. [2025-09-23T19:20:53.298286] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-09-23T19:20:53.306406] [DEBUG] [LOCAL ] HUBB: Deleted primary data file. [2025-09-23T19:20:53.320487] [INFO ] [MAIN ] HUBB: Starting full primary refresh. [2025-09-23T19:20:53.356113] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-23T19:20:53.425436] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-23T19:20:53.451765] [INFO ] [REMOTE ] HTFC: Full fetch complete (853 records). [2025-09-23T19:20:53.451940] [DEBUG] [VALIDATOR ] HTFC: Validating primary data. [2025-09-23T19:20:53.458255] [FATAL] [VALIDATOR ] HTFC: Data is stale - most recent date (2025-09-19) is before last completed trading day (2025-09-23). Symbol may be delisted or halted. [2025-09-23T19:20:53.463515] [FATAL] [MAIN ] HTFC: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:20:53.478963] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:20:53.479052] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-09-23T19:20:53.479397] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-09-23T19:20:53.505080] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-09-23T19:20:53.515949] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-09-23T19:20:53.530809] [INFO ] [MAIN ] Update Progress: 1063/2372 symbols completed. HTFC took 19.4s. Estimated remaining: 2h 53m 26s. Rate: 7.5 symbols/min [2025-09-23T19:20:53.803359] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-02. [2025-09-23T19:20:53.869797] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:20:53.937253] [INFO ] [REMOTE ] HUBB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:20:53.977948] [DEBUG] [LOCAL ] HUBS: Loaded 39661 existing records from primary storage. [2025-09-23T19:20:53.978099] [INFO ] [MAIN ] HUBS: Loaded 39661 existing records. [2025-09-23T19:20:54.158689] [WARN ] [MAIN ] HUBS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:20:54.158955] [INFO ] [MAIN ] HUBS: Wiping existing primary data before full refresh. [2025-09-23T19:20:54.159004] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-09-23T19:20:54.160026] [DEBUG] [LOCAL ] HUBS: Deleted primary data file. [2025-09-23T19:20:54.160103] [INFO ] [MAIN ] HUBS: Starting full primary refresh. [2025-09-23T19:20:54.521883] [INFO ] [REMOTE ] HUBS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:20:54.602185] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2024-12. [2025-09-23T19:20:55.402173] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2024-12. [2025-09-23T19:20:55.522921] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-23T19:20:55.842233] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-23T19:20:56.202249] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-01. [2025-09-23T19:20:56.478948] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-23T19:20:57.002206] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-01. [2025-09-23T19:20:57.726803] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-23T19:20:57.802175] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-02. [2025-09-23T19:20:58.478227] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-23T19:20:58.602181] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-02. [2025-09-23T19:20:59.067502] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-23T19:20:59.402257] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-03. [2025-09-23T19:21:00.092521] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-23T19:21:00.202247] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-03. [2025-09-23T19:21:01.002240] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-03. [2025-09-23T19:21:01.481079] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-23T19:21:01.753949] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-23T19:21:01.802195] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-04. [2025-09-23T19:21:02.602254] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-04. [2025-09-23T19:21:03.015944] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-23T19:21:03.402205] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-04. [2025-09-23T19:21:04.202171] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-03. [2025-09-23T19:21:04.372305] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-09-23T19:21:05.002164] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-05. [2025-09-23T19:21:05.173847] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-23T19:21:05.201196] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-23T19:21:05.392006] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-04 (2.79 seconds). [2025-09-23T19:21:05.802195] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-05. [2025-09-23T19:21:06.181281] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-23T19:21:06.602193] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-04. [2025-09-23T19:21:07.288911] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-23T19:21:07.402174] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-06. [2025-09-23T19:21:07.929102] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-23T19:21:08.202211] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-05. [2025-09-23T19:21:08.508971] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-23T19:21:09.002196] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-07. [2025-09-23T19:21:09.178854] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-23T19:21:09.802204] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-05. [2025-09-23T19:21:10.419240] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-23T19:21:10.602251] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-08. [2025-09-23T19:21:11.402175] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-06. [2025-09-23T19:21:11.517908] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-23T19:21:11.976767] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-23T19:21:12.202188] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-09. [2025-09-23T19:21:12.374001] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-23T19:21:13.002191] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-06. [2025-09-23T19:21:13.603849] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-23T19:21:13.613998] [INFO ] [REMOTE ] HUBB: Full fetch complete (53581 records). [2025-09-23T19:21:13.614202] [DEBUG] [VALIDATOR ] HUBB: Validating primary data. [2025-09-23T19:21:13.809093] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-06. [2025-09-23T19:21:14.008586] [DEBUG] [VALIDATOR ] HUBB: All expected trading days are present. [2025-09-23T19:21:14.008702] [DEBUG] [VALIDATOR ] HUBB: Primary data validation passed. [2025-09-23T19:21:14.009511] [INFO ] [MAIN ] HUBB: Fetched primary data is valid. [2025-09-23T19:21:14.009557] [DEBUG] [LOCAL ] HUBB: Saving primary data. [2025-09-23T19:21:14.012748] [DEBUG] [LOCAL ] HUBB: Trimmed 53581 records to 37249 (keeping 200 days of data) [2025-09-23T19:21:14.256088] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-23T19:21:14.294717] [DEBUG] [LOCAL ] HUBB: Primary data saved (37249 records). [2025-09-23T19:21:14.294916] [INFO ] [MAIN ] HUBB: Full history saved. [2025-09-23T19:21:14.295044] [INFO ] [MAIN ] Update Progress: 1064/2372 symbols completed. HUBB took 21.4s. Estimated remaining: 2h 53m 34s. Rate: 7.5 symbols/min [2025-09-23T19:21:14.469931] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:21:14.521907] [DEBUG] [LOCAL ] HUM: Loaded 48899 existing records from primary storage. [2025-09-23T19:21:14.522106] [INFO ] [MAIN ] HUM: Loaded 48899 existing records. [2025-09-23T19:21:14.607422] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-07. [2025-09-23T19:21:14.708347] [WARN ] [MAIN ] HUM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:21:14.708701] [INFO ] [MAIN ] HUM: Wiping existing primary data before full refresh. [2025-09-23T19:21:14.708854] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-09-23T19:21:14.710181] [DEBUG] [LOCAL ] HUM: Deleted primary data file. [2025-09-23T19:21:14.710245] [INFO ] [MAIN ] HUM: Starting full primary refresh. [2025-09-23T19:21:15.102811] [INFO ] [REMOTE ] HUM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:21:15.136639] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-23T19:21:15.402212] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-07. [2025-09-23T19:21:16.202206] [INFO ] [REMOTE ] HUM: Fetching primary data for 2024-12. [2025-09-23T19:21:16.258251] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-23T19:21:16.608463] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-23T19:21:17.002190] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-08. [2025-09-23T19:21:17.636630] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-23T19:21:17.802195] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-01. [2025-09-23T19:21:18.602168] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-08. [2025-09-23T19:21:18.717173] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-23T19:21:19.402236] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-07. [2025-09-23T19:21:19.536495] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-23T19:21:19.923561] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-23T19:21:20.202247] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-02. [2025-09-23T19:21:20.821976] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-23T19:21:21.002204] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-09. [2025-09-23T19:21:21.802231] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-08. [2025-09-23T19:21:21.969894] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-23T19:21:22.602196] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-09. [2025-09-23T19:21:23.141746] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-23T19:21:23.149755] [INFO ] [REMOTE ] HTGC: Full fetch complete (68100 records). [2025-09-23T19:21:23.149911] [DEBUG] [VALIDATOR ] HTGC: Validating primary data. [2025-09-23T19:21:23.414593] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-03. [2025-09-23T19:21:23.546573] [DEBUG] [VALIDATOR ] HTGC: All expected trading days are present. [2025-09-23T19:21:23.546687] [DEBUG] [VALIDATOR ] HTGC: Primary data validation passed. [2025-09-23T19:21:23.547551] [INFO ] [MAIN ] HTGC: Fetched primary data is valid. [2025-09-23T19:21:23.547596] [DEBUG] [LOCAL ] HTGC: Saving primary data. [2025-09-23T19:21:23.548953] [DEBUG] [LOCAL ] HTGC: Trimmed 68100 records to 47566 (keeping 200 days of data) [2025-09-23T19:21:23.813467] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-23T19:21:23.891683] [DEBUG] [LOCAL ] HTGC: Primary data saved (47566 records). [2025-09-23T19:21:23.891835] [INFO ] [MAIN ] HTGC: Full history saved. [2025-09-23T19:21:23.891946] [INFO ] [MAIN ] Update Progress: 1065/2372 symbols completed. HTGC took 48.1s. Estimated remaining: 2h 53m 28s. Rate: 7.5 symbols/min [2025-09-23T19:21:24.060329] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:21:24.119761] [DEBUG] [LOCAL ] HUN: Loaded 53203 existing records from primary storage. [2025-09-23T19:21:24.119910] [INFO ] [MAIN ] HUN: Loaded 53203 existing records. [2025-09-23T19:21:24.211712] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-09. [2025-09-23T19:21:24.306893] [WARN ] [MAIN ] HUN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:21:24.307253] [INFO ] [MAIN ] HUN: Wiping existing primary data before full refresh. [2025-09-23T19:21:24.307309] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-09-23T19:21:24.308575] [DEBUG] [LOCAL ] HUN: Deleted primary data file. [2025-09-23T19:21:24.308639] [INFO ] [MAIN ] HUN: Starting full primary refresh. [2025-09-23T19:21:24.668134] [INFO ] [REMOTE ] HUN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:21:24.781141] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-23T19:21:24.791060] [INFO ] [REMOTE ] HTH: Full fetch complete (46556 records). [2025-09-23T19:21:24.791286] [DEBUG] [VALIDATOR ] HTH: Validating primary data. [2025-09-23T19:21:25.043296] [INFO ] [REMOTE ] HUN: Fetching primary data for 2024-12. [2025-09-23T19:21:25.203287] [DEBUG] [VALIDATOR ] HTH: All expected trading days are present. [2025-09-23T19:21:25.203417] [DEBUG] [VALIDATOR ] HTH: Primary data validation passed. [2025-09-23T19:21:25.204372] [INFO ] [MAIN ] HTH: Fetched primary data is valid. [2025-09-23T19:21:25.204462] [DEBUG] [LOCAL ] HTH: Saving primary data. [2025-09-23T19:21:25.206018] [DEBUG] [LOCAL ] HTH: Trimmed 46556 records to 32495 (keeping 200 days of data) [2025-09-23T19:21:25.300504] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-23T19:21:25.445914] [DEBUG] [LOCAL ] HTH: Primary data saved (32495 records). [2025-09-23T19:21:25.446063] [INFO ] [MAIN ] HTH: Full history saved. [2025-09-23T19:21:25.446168] [INFO ] [MAIN ] Update Progress: 1066/2372 symbols completed. HTH took 49.5s. Estimated remaining: 2h 53m 12s. Rate: 7.5 symbols/min [2025-09-23T19:21:25.615719] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:21:25.662332] [DEBUG] [LOCAL ] HUYA: Loaded 44445 existing records from primary storage. [2025-09-23T19:21:25.662468] [INFO ] [MAIN ] HUYA: Loaded 44445 existing records. [2025-09-23T19:21:25.812549] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-04. [2025-09-23T19:21:25.843814] [WARN ] [MAIN ] HUYA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:21:25.844105] [INFO ] [MAIN ] HUYA: Wiping existing primary data before full refresh. [2025-09-23T19:21:25.844174] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-09-23T19:21:25.845519] [DEBUG] [LOCAL ] HUYA: Deleted primary data file. [2025-09-23T19:21:25.845740] [INFO ] [MAIN ] HUYA: Starting full primary refresh. [2025-09-23T19:21:26.040212] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-23T19:21:26.135972] [INFO ] [REMOTE ] HUBS: Full fetch complete (55456 records). [2025-09-23T19:21:26.158304] [DEBUG] [VALIDATOR ] HUBS: Validating primary data. [2025-09-23T19:21:26.323481] [INFO ] [REMOTE ] HUYA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:21:26.605457] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2024-12. [2025-09-23T19:21:26.726293] [DEBUG] [VALIDATOR ] HUBS: All expected trading days are present. [2025-09-23T19:21:26.726549] [DEBUG] [VALIDATOR ] HUBS: Primary data validation passed. [2025-09-23T19:21:26.728121] [INFO ] [MAIN ] HUBS: Fetched primary data is valid. [2025-09-23T19:21:26.728255] [DEBUG] [LOCAL ] HUBS: Saving primary data. [2025-09-23T19:21:26.730200] [DEBUG] [LOCAL ] HUBS: Trimmed 55456 records to 39541 (keeping 200 days of data) [2025-09-23T19:21:26.875887] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-23T19:21:27.188095] [DEBUG] [LOCAL ] HUBS: Primary data saved (39541 records). [2025-09-23T19:21:27.188342] [INFO ] [MAIN ] HUBS: Full history saved. [2025-09-23T19:21:27.188518] [INFO ] [MAIN ] Update Progress: 1067/2372 symbols completed. HUBS took 33.6s. Estimated remaining: 2h 52m 56s. Rate: 7.5 symbols/min [2025-09-23T19:21:27.417803] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-01. [2025-09-23T19:21:27.460921] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:21:27.490112] [DEBUG] [LOCAL ] HVT: Loaded 16157 existing records from primary storage. [2025-09-23T19:21:27.490460] [INFO ] [MAIN ] HVT: Loaded 16157 existing records. [2025-09-23T19:21:27.781067] [WARN ] [MAIN ] HVT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:21:27.781768] [INFO ] [MAIN ] HVT: Wiping existing primary data before full refresh. [2025-09-23T19:21:27.781881] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-09-23T19:21:27.782627] [DEBUG] [LOCAL ] HVT: Deleted primary data file. [2025-09-23T19:21:27.782845] [INFO ] [MAIN ] HVT: Starting full primary refresh. [2025-09-23T19:21:28.028069] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-23T19:21:28.209787] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-05. [2025-09-23T19:21:28.240268] [INFO ] [REMOTE ] HVT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:21:28.267393] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-23T19:21:28.770995] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-23T19:21:29.002209] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-01. [2025-09-23T19:21:29.802217] [INFO ] [REMOTE ] HVT: Fetching primary data for 2024-12. [2025-09-23T19:21:30.260973] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-23T19:21:30.463713] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-23T19:21:30.542926] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-23T19:21:30.602192] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-02. [2025-09-23T19:21:31.402255] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-02. [2025-09-23T19:21:32.122102] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-23T19:21:32.202164] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-03. [2025-09-23T19:21:33.011791] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-06. [2025-09-23T19:21:33.018332] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-23T19:21:33.802185] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-03. [2025-09-23T19:21:33.880317] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-23T19:21:34.602179] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-01. [2025-09-23T19:21:34.701212] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-23T19:21:35.158022] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-23T19:21:35.402160] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-07. [2025-09-23T19:21:35.558058] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-23T19:21:36.202207] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-02. [2025-09-23T19:21:37.002222] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-04. [2025-09-23T19:21:37.088282] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-23T19:21:37.270760] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-23T19:21:37.802214] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-08. [2025-09-23T19:21:38.518417] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-23T19:21:38.602234] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-05. [2025-09-23T19:21:39.402242] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-03. [2025-09-23T19:21:39.470481] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-23T19:21:39.934043] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-23T19:21:40.202223] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-04. [2025-09-23T19:21:40.452144] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-23T19:21:41.002239] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-04. [2025-09-23T19:21:41.589481] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-23T19:21:41.802158] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-05. [2025-09-23T19:21:42.081854] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-23T19:21:42.602468] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-06. [2025-09-23T19:21:43.379229] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-23T19:21:43.402158] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-06. [2025-09-23T19:21:44.207357] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-05. [2025-09-23T19:21:44.225431] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-23T19:21:44.470402] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-23T19:21:44.980534] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-23T19:21:45.002179] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-07. [2025-09-23T19:21:45.802212] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-06. [2025-09-23T19:21:46.602201] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-09. [2025-09-23T19:21:46.829992] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-23T19:21:46.852696] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-23T19:21:47.402257] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-07. [2025-09-23T19:21:48.202222] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-08. [2025-09-23T19:21:48.877690] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-09-23T19:21:48.887922] [INFO ] [REMOTE ] HUM: Full fetch complete (70991 records). [2025-09-23T19:21:48.888121] [DEBUG] [VALIDATOR ] HUM: Validating primary data. [2025-09-23T19:21:49.007368] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-07. [2025-09-23T19:21:49.283810] [DEBUG] [VALIDATOR ] HUM: All expected trading days are present. [2025-09-23T19:21:49.283895] [DEBUG] [VALIDATOR ] HUM: Primary data validation passed. [2025-09-23T19:21:49.284814] [INFO ] [MAIN ] HUM: Fetched primary data is valid. [2025-09-23T19:21:49.284880] [DEBUG] [LOCAL ] HUM: Saving primary data. [2025-09-23T19:21:49.286295] [DEBUG] [LOCAL ] HUM: Trimmed 70991 records to 48892 (keeping 200 days of data) [2025-09-23T19:21:49.638622] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-23T19:21:49.650512] [DEBUG] [LOCAL ] HUM: Primary data saved (48892 records). [2025-09-23T19:21:49.651175] [INFO ] [MAIN ] HUM: Full history saved. [2025-09-23T19:21:49.651452] [INFO ] [MAIN ] Update Progress: 1068/2372 symbols completed. HUM took 35.4s. Estimated remaining: 2h 53m 6s. Rate: 7.5 symbols/min [2025-09-23T19:21:49.801572] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-23T19:21:49.806828] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-09. [2025-09-23T19:21:49.863740] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:21:49.923800] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-09-23T19:21:49.950629] [DEBUG] [LOCAL ] HWM: Loaded 53021 existing records from primary storage. [2025-09-23T19:21:49.950814] [INFO ] [MAIN ] HWM: Loaded 53021 existing records. [2025-09-23T19:21:50.126711] [WARN ] [MAIN ] HWM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:21:50.126972] [INFO ] [MAIN ] HWM: Wiping existing primary data before full refresh. [2025-09-23T19:21:50.127020] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-09-23T19:21:50.128459] [DEBUG] [LOCAL ] HWM: Deleted primary data file. [2025-09-23T19:21:50.128521] [INFO ] [MAIN ] HWM: Starting full primary refresh. [2025-09-23T19:21:50.509722] [INFO ] [REMOTE ] HWM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:21:50.602161] [INFO ] [REMOTE ] HWM: Fetching primary data for 2024-12. [2025-09-23T19:21:51.402216] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-08. [2025-09-23T19:21:51.687753] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-23T19:21:51.696572] [INFO ] [REMOTE ] HUN: Full fetch complete (76605 records). [2025-09-23T19:21:51.696750] [DEBUG] [VALIDATOR ] HUN: Validating primary data. [2025-09-23T19:21:52.098268] [DEBUG] [VALIDATOR ] HUN: All expected trading days are present. [2025-09-23T19:21:52.098553] [DEBUG] [VALIDATOR ] HUN: Primary data validation passed. [2025-09-23T19:21:52.099557] [INFO ] [MAIN ] HUN: Fetched primary data is valid. [2025-09-23T19:21:52.099622] [DEBUG] [LOCAL ] HUN: Saving primary data. [2025-09-23T19:21:52.101239] [DEBUG] [LOCAL ] HUN: Trimmed 76605 records to 53203 (keeping 200 days of data) [2025-09-23T19:21:52.202238] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-08. [2025-09-23T19:21:52.371448] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-23T19:21:52.402182] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-23T19:21:52.494673] [DEBUG] [LOCAL ] HUN: Primary data saved (53203 records). [2025-09-23T19:21:52.494828] [INFO ] [MAIN ] HUN: Full history saved. [2025-09-23T19:21:52.494959] [INFO ] [MAIN ] Update Progress: 1069/2372 symbols completed. HUN took 28.6s. Estimated remaining: 2h 52m 52s. Rate: 7.5 symbols/min [2025-09-23T19:21:52.664461] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:21:52.709187] [DEBUG] [LOCAL ] HXL: Loaded 46127 existing records from primary storage. [2025-09-23T19:21:52.709348] [INFO ] [MAIN ] HXL: Loaded 46127 existing records. [2025-09-23T19:21:52.892812] [WARN ] [MAIN ] HXL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:21:52.893088] [INFO ] [MAIN ] HXL: Wiping existing primary data before full refresh. [2025-09-23T19:21:52.893134] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-09-23T19:21:52.894541] [DEBUG] [LOCAL ] HXL: Deleted primary data file. [2025-09-23T19:21:52.894603] [INFO ] [MAIN ] HXL: Starting full primary refresh. [2025-09-23T19:21:53.007391] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-01. [2025-09-23T19:21:53.310231] [INFO ] [REMOTE ] HXL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:21:53.470294] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-23T19:21:53.802195] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-09. [2025-09-23T19:21:54.602210] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-09. [2025-09-23T19:21:54.750350] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-23T19:21:55.141471] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-23T19:21:55.149356] [INFO ] [REMOTE ] HUYA: Full fetch complete (63855 records). [2025-09-23T19:21:55.149469] [DEBUG] [VALIDATOR ] HUYA: Validating primary data. [2025-09-23T19:21:55.407292] [INFO ] [REMOTE ] HXL: Fetching primary data for 2024-12. [2025-09-23T19:21:55.469533] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-23T19:21:55.505914] [INFO ] [REMOTE ] HVT: Full fetch complete (23750 records). [2025-09-23T19:21:55.520402] [DEBUG] [VALIDATOR ] HVT: Validating primary data. [2025-09-23T19:21:55.602069] [DEBUG] [VALIDATOR ] HUYA: All expected trading days are present. [2025-09-23T19:21:55.628323] [DEBUG] [VALIDATOR ] HUYA: Primary data validation passed. [2025-09-23T19:21:55.635481] [INFO ] [MAIN ] HUYA: Fetched primary data is valid. [2025-09-23T19:21:55.640723] [DEBUG] [LOCAL ] HUYA: Saving primary data. [2025-09-23T19:21:55.690009] [DEBUG] [LOCAL ] HUYA: Trimmed 63855 records to 44441 (keeping 200 days of data) [2025-09-23T19:21:56.027232] [DEBUG] [VALIDATOR ] HVT: All expected trading days are present. [2025-09-23T19:21:56.027878] [DEBUG] [VALIDATOR ] HVT: Primary data validation passed. [2025-09-23T19:21:56.028726] [INFO ] [MAIN ] HVT: Fetched primary data is valid. [2025-09-23T19:21:56.028804] [DEBUG] [LOCAL ] HVT: Saving primary data. [2025-09-23T19:21:56.030826] [DEBUG] [LOCAL ] HVT: Trimmed 23750 records to 16034 (keeping 200 days of data) [2025-09-23T19:21:56.203854] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-02. [2025-09-23T19:21:56.239457] [DEBUG] [LOCAL ] HVT: Primary data saved (16034 records). [2025-09-23T19:21:56.240158] [INFO ] [MAIN ] HVT: Full history saved. [2025-09-23T19:21:56.240513] [INFO ] [MAIN ] Update Progress: 1070/2372 symbols completed. HVT took 29.1s. Estimated remaining: 2h 52m 39s. Rate: 7.5 symbols/min [2025-09-23T19:21:56.426936] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:21:56.444096] [DEBUG] [LOCAL ] HY: Loaded 10144 existing records from primary storage. [2025-09-23T19:21:56.446927] [INFO ] [MAIN ] HY: Loaded 10144 existing records. [2025-09-23T19:21:56.647253] [WARN ] [MAIN ] HY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:21:56.649902] [INFO ] [MAIN ] HY: Wiping existing primary data before full refresh. [2025-09-23T19:21:56.651474] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-09-23T19:21:56.673462] [DEBUG] [LOCAL ] HY: Deleted primary data file. [2025-09-23T19:21:56.678262] [INFO ] [MAIN ] HY: Starting full primary refresh. [2025-09-23T19:21:56.846980] [DEBUG] [LOCAL ] HUYA: Primary data saved (44441 records). [2025-09-23T19:21:56.863492] [INFO ] [MAIN ] HUYA: Full history saved. [2025-09-23T19:21:56.874704] [INFO ] [MAIN ] Update Progress: 1071/2372 symbols completed. HUYA took 31.4s. Estimated remaining: 2h 52m 22s. Rate: 7.5 symbols/min [2025-09-23T19:21:56.891968] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-23T19:21:57.049026] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-01. [2025-09-23T19:21:57.274268] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:21:57.299147] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-09-23T19:21:57.304976] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-09-23T19:21:57.323242] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-09-23T19:21:57.331142] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-09-23T19:21:57.333574] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-09-23T19:21:57.333715] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-09-23T19:21:57.342720] [INFO ] [REMOTE ] HY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:21:57.691220] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:21:57.802169] [INFO ] [REMOTE ] HY: Fetching primary data for 2024-12. [2025-09-23T19:21:57.867056] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-23T19:21:58.306296] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-23T19:21:58.352902] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-23T19:21:58.602200] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-01. [2025-09-23T19:21:59.367483] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-23T19:21:59.402230] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-02. [2025-09-23T19:21:59.986501] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-23T19:22:00.202235] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-02. [2025-09-23T19:22:01.002242] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-03. [2025-09-23T19:22:01.689248] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-23T19:22:01.802207] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-03. [2025-09-23T19:22:02.607479] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-03. [2025-09-23T19:22:02.613817] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-23T19:22:03.149204] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-23T19:22:03.402210] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-04. [2025-09-23T19:22:03.510228] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-23T19:22:04.202211] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-04. [2025-09-23T19:22:05.002249] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2024-12. [2025-09-23T19:22:05.061914] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-23T19:22:05.494124] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-23T19:22:05.802212] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-05. [2025-09-23T19:22:06.113838] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-23T19:22:06.602217] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-04. [2025-09-23T19:22:07.207083] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-23T19:22:07.402200] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-05. [2025-09-23T19:22:07.495068] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-23T19:22:08.202202] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-01. [2025-09-23T19:22:08.543340] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-23T19:22:09.002183] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-09-23T19:22:09.186432] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-23T19:22:09.340260] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-23T19:22:09.802210] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-06. [2025-09-23T19:22:10.602196] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-06. [2025-09-23T19:22:11.318407] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-23T19:22:11.402237] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-07. [2025-09-23T19:22:12.202202] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-05. [2025-09-23T19:22:12.235078] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-23T19:22:12.960258] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-23T19:22:13.002201] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-06. [2025-09-23T19:22:13.077770] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-23T19:22:13.742693] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-23T19:22:13.802170] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-08. [2025-09-23T19:22:14.602205] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-07. [2025-09-23T19:22:15.346165] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-23T19:22:15.402192] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-09-23T19:22:15.603321] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-23T19:22:15.624253] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.22 seconds). [2025-09-23T19:22:16.202199] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-07. [2025-09-23T19:22:17.002227] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-09-23T19:22:17.254222] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.25 seconds). [2025-09-23T19:22:17.802165] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-09-23T19:22:17.971324] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-23T19:22:18.043100] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.24 seconds). [2025-09-23T19:22:18.602202] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-09-23T19:22:18.914378] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-23T19:22:19.402249] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-09. [2025-09-23T19:22:20.202207] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-08. [2025-09-23T19:22:21.002199] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-09-23T19:22:21.430454] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-23T19:22:21.439588] [INFO ] [REMOTE ] HWM: Full fetch complete (76642 records). [2025-09-23T19:22:21.439778] [DEBUG] [VALIDATOR ] HWM: Validating primary data. [2025-09-23T19:22:21.746746] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-23T19:22:21.804801] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-09-23T19:22:21.900264] [DEBUG] [VALIDATOR ] HWM: All expected trading days are present. [2025-09-23T19:22:21.909258] [DEBUG] [VALIDATOR ] HWM: Primary data validation passed. [2025-09-23T19:22:21.915920] [INFO ] [MAIN ] HWM: Fetched primary data is valid. [2025-09-23T19:22:21.925414] [DEBUG] [LOCAL ] HWM: Saving primary data. [2025-09-23T19:22:21.927977] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-23T19:22:21.938497] [DEBUG] [LOCAL ] HWM: Trimmed 76642 records to 53013 (keeping 200 days of data) [2025-09-23T19:22:22.043798] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-09-23T19:22:22.305595] [DEBUG] [LOCAL ] HWM: Primary data saved (53013 records). [2025-09-23T19:22:22.305784] [INFO ] [MAIN ] HWM: Full history saved. [2025-09-23T19:22:22.305885] [INFO ] [MAIN ] Update Progress: 1072/2372 symbols completed. HWM took 32.7s. Estimated remaining: 2h 52m 35s. Rate: 7.5 symbols/min [2025-09-23T19:22:22.495703] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:22:22.495898] [DEBUG] [LOCAL ] HYBX: No existing data file found in primary storage. [2025-09-23T19:22:22.495951] [WARN ] [MAIN ] HYBX: No existing data found, performing full refresh instead. [2025-09-23T19:22:22.496100] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-09-23T19:22:22.496142] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-09-23T19:22:22.496206] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-09-23T19:22:22.496239] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-09-23T19:22:22.607459] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-09-23T19:22:22.880458] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:22:22.956091] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-23T19:22:22.957110] [INFO ] [REMOTE ] HYAC: Full fetch complete (869 records). [2025-09-23T19:22:22.957207] [DEBUG] [VALIDATOR ] HYAC: Validating primary data. [2025-09-23T19:22:23.159534] [WARN ] [VALIDATOR ] HYAC: Validation failed - insufficient historical data. Have 173 unique days, need 200 days [2025-09-23T19:22:23.159769] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:22:23.159840] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:22:23.159918] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-09-23T19:22:23.159984] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-09-23T19:22:23.160025] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-09-23T19:22:23.160081] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-09-23T19:22:23.160162] [INFO ] [MAIN ] Update Progress: 1073/2372 symbols completed. HYAC took 26.3s. Estimated remaining: 2h 52m 19s. Rate: 7.5 symbols/min [2025-09-23T19:22:23.334628] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:22:23.345255] [DEBUG] [LOCAL ] HYI: Loaded 8846 existing records from primary storage. [2025-09-23T19:22:23.345385] [INFO ] [MAIN ] HYI: Loaded 8846 existing records. [2025-09-23T19:22:23.411139] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-08. [2025-09-23T19:22:23.540037] [WARN ] [MAIN ] HYI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:22:23.540316] [INFO ] [MAIN ] HYI: Wiping existing primary data before full refresh. [2025-09-23T19:22:23.540373] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-09-23T19:22:23.540756] [DEBUG] [LOCAL ] HYI: Deleted primary data file. [2025-09-23T19:22:23.540815] [INFO ] [MAIN ] HYI: Starting full primary refresh. [2025-09-23T19:22:23.928275] [INFO ] [REMOTE ] HYI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:22:24.202192] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2024-12. [2025-09-23T19:22:24.343684] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-23T19:22:24.625991] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-23T19:22:25.002237] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-01. [2025-09-23T19:22:25.342617] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-23T19:22:25.802199] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-09. [2025-09-23T19:22:26.602205] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-09-23T19:22:26.793613] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-23T19:22:26.797457] [INFO ] [REMOTE ] HY: Full fetch complete (15264 records). [2025-09-23T19:22:26.797581] [DEBUG] [VALIDATOR ] HY: Validating primary data. [2025-09-23T19:22:26.888568] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-09-23T19:22:27.172880] [DEBUG] [VALIDATOR ] HY: All expected trading days are present. [2025-09-23T19:22:27.172969] [DEBUG] [VALIDATOR ] HY: Primary data validation passed. [2025-09-23T19:22:27.173382] [INFO ] [MAIN ] HY: Fetched primary data is valid. [2025-09-23T19:22:27.173440] [DEBUG] [LOCAL ] HY: Saving primary data. [2025-09-23T19:22:27.174182] [DEBUG] [LOCAL ] HY: Trimmed 15264 records to 10134 (keeping 200 days of data) [2025-09-23T19:22:27.241085] [DEBUG] [LOCAL ] HY: Primary data saved (10134 records). [2025-09-23T19:22:27.241241] [INFO ] [MAIN ] HY: Full history saved. [2025-09-23T19:22:27.241351] [INFO ] [MAIN ] Update Progress: 1074/2372 symbols completed. HY took 31.0s. Estimated remaining: 2h 52m 6s. Rate: 7.5 symbols/min [2025-09-23T19:22:27.406232] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-09. [2025-09-23T19:22:27.427502] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:22:27.465303] [DEBUG] [LOCAL ] HYT: Loaded 33218 existing records from primary storage. [2025-09-23T19:22:27.465457] [INFO ] [MAIN ] HYT: Loaded 33218 existing records. [2025-09-23T19:22:27.653992] [WARN ] [MAIN ] HYT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:22:27.654278] [INFO ] [MAIN ] HYT: Wiping existing primary data before full refresh. [2025-09-23T19:22:27.654328] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-09-23T19:22:27.655218] [DEBUG] [LOCAL ] HYT: Deleted primary data file. [2025-09-23T19:22:27.655279] [INFO ] [MAIN ] HYT: Starting full primary refresh. [2025-09-23T19:22:28.043469] [INFO ] [REMOTE ] HYT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:22:28.202256] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-09-23T19:22:28.444432] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-09-23T19:22:29.002206] [INFO ] [REMOTE ] HYT: Fetching primary data for 2024-12. [2025-09-23T19:22:29.032499] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-23T19:22:29.040291] [INFO ] [REMOTE ] HXL: Full fetch complete (66161 records). [2025-09-23T19:22:29.040422] [DEBUG] [VALIDATOR ] HXL: Validating primary data. [2025-09-23T19:22:29.442187] [DEBUG] [VALIDATOR ] HXL: All expected trading days are present. [2025-09-23T19:22:29.442275] [DEBUG] [VALIDATOR ] HXL: Primary data validation passed. [2025-09-23T19:22:29.443192] [INFO ] [MAIN ] HXL: Fetched primary data is valid. [2025-09-23T19:22:29.443257] [DEBUG] [LOCAL ] HXL: Saving primary data. [2025-09-23T19:22:29.444902] [DEBUG] [LOCAL ] HXL: Trimmed 66161 records to 46079 (keeping 200 days of data) [2025-09-23T19:22:29.751935] [DEBUG] [LOCAL ] HXL: Primary data saved (46079 records). [2025-09-23T19:22:29.752106] [INFO ] [MAIN ] HXL: Full history saved. [2025-09-23T19:22:29.752210] [INFO ] [MAIN ] Update Progress: 1075/2372 symbols completed. HXL took 37.3s. Estimated remaining: 2h 51m 51s. Rate: 7.5 symbols/min [2025-09-23T19:22:29.811677] [INFO ] [REMOTE ] HYI: Fetching primary data for 2024-12. [2025-09-23T19:22:29.954796] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:22:29.960733] [DEBUG] [LOCAL ] HYTR: Loaded 3174 existing records from primary storage. [2025-09-23T19:22:29.960845] [INFO ] [MAIN ] HYTR: Loaded 3174 existing records. [2025-09-23T19:22:30.150475] [WARN ] [MAIN ] HYTR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:22:30.150839] [INFO ] [MAIN ] HYTR: Wiping existing primary data before full refresh. [2025-09-23T19:22:30.150896] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-09-23T19:22:30.157286] [DEBUG] [LOCAL ] HYTR: Deleted primary data file. [2025-09-23T19:22:30.167313] [INFO ] [MAIN ] HYTR: Starting full primary refresh. [2025-09-23T19:22:30.167844] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-23T19:22:30.470262] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-23T19:22:30.593246] [INFO ] [REMOTE ] HYTR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:22:30.602228] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2024-12. [2025-09-23T19:22:31.023020] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-23T19:22:31.402264] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-01. [2025-09-23T19:22:32.095786] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-23T19:22:32.202246] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-01. [2025-09-23T19:22:32.519753] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-09-23T19:22:33.002206] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-01. [2025-09-23T19:22:33.802218] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-02. [2025-09-23T19:22:34.567374] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-23T19:22:34.568398] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-23T19:22:34.602138] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-02. [2025-09-23T19:22:35.402206] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-09-23T19:22:35.754076] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-23T19:22:35.844418] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-23T19:22:36.202229] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-03. [2025-09-23T19:22:36.766898] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-23T19:22:37.002205] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-02. [2025-09-23T19:22:37.332331] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-23T19:22:37.802231] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-03. [2025-09-23T19:22:38.357384] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-23T19:22:38.602208] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-04. [2025-09-23T19:22:39.406282] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-09-23T19:22:39.408910] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-23T19:22:39.733467] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-23T19:22:40.202212] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-05. [2025-09-23T19:22:40.939327] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-23T19:22:41.002235] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-04. [2025-09-23T19:22:41.611488] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-23T19:22:41.802195] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-03. [2025-09-23T19:22:42.602196] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-09-23T19:22:42.786244] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-23T19:22:42.961793] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-23T19:22:43.402213] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-06. [2025-09-23T19:22:44.143004] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-23T19:22:44.202224] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-07. [2025-09-23T19:22:45.002213] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-05. [2025-09-23T19:22:45.156193] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-23T19:22:45.564247] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-23T19:22:45.802189] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-08. [2025-09-23T19:22:46.602258] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-04. [2025-09-23T19:22:46.631460] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-23T19:22:47.402188] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-09. [2025-09-23T19:22:48.114032] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-23T19:22:48.112502] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-23T19:22:48.123980] [INFO ] [REMOTE ] HYI: Full fetch complete (12786 records). [2025-09-23T19:22:48.124327] [DEBUG] [VALIDATOR ] HYI: Validating primary data. [2025-09-23T19:22:48.207318] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-09-23T19:22:48.508215] [DEBUG] [VALIDATOR ] HYI: All expected trading days are present. [2025-09-23T19:22:48.508318] [DEBUG] [VALIDATOR ] HYI: Primary data validation passed. [2025-09-23T19:22:48.508763] [INFO ] [MAIN ] HYI: Fetched primary data is valid. [2025-09-23T19:22:48.508845] [DEBUG] [LOCAL ] HYI: Saving primary data. [2025-09-23T19:22:48.509559] [DEBUG] [LOCAL ] HYI: Trimmed 12786 records to 8893 (keeping 200 days of data) [2025-09-23T19:22:48.569074] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-23T19:22:48.577182] [DEBUG] [LOCAL ] HYI: Primary data saved (8893 records). [2025-09-23T19:22:48.577359] [INFO ] [MAIN ] HYI: Full history saved. [2025-09-23T19:22:48.577474] [INFO ] [MAIN ] Update Progress: 1076/2372 symbols completed. HYI took 25.4s. Estimated remaining: 2h 51m 57s. Rate: 7.5 symbols/min [2025-09-23T19:22:48.768051] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:22:48.802922] [DEBUG] [LOCAL ] HZO: Loaded 29378 existing records from primary storage. [2025-09-23T19:22:48.803071] [INFO ] [MAIN ] HZO: Loaded 29378 existing records. [2025-09-23T19:22:48.983639] [WARN ] [MAIN ] HZO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:22:48.983996] [INFO ] [MAIN ] HZO: Wiping existing primary data before full refresh. [2025-09-23T19:22:48.984078] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-09-23T19:22:48.984843] [DEBUG] [LOCAL ] HZO: Deleted primary data file. [2025-09-23T19:22:48.984931] [INFO ] [MAIN ] HZO: Starting full primary refresh. [2025-09-23T19:22:49.007434] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-05. [2025-09-23T19:22:49.342825] [INFO ] [REMOTE ] HZO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:22:49.802208] [INFO ] [REMOTE ] HZO: Fetching primary data for 2024-12. [2025-09-23T19:22:50.509301] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-23T19:22:50.531196] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-23T19:22:50.602153] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-01. [2025-09-23T19:22:51.402153] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-09-23T19:22:51.731172] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-23T19:22:52.202197] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-06. [2025-09-23T19:22:53.002268] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-02. [2025-09-23T19:22:53.802239] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-06. [2025-09-23T19:23:04.639711] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (13.24 seconds). [2025-09-23T19:23:04.640744] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-09-23T19:23:05.475281] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-06 (13.27 seconds). [2025-09-23T19:23:05.477070] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-07. [2025-09-23T19:23:06.000331] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-02 (13.00 seconds). [2025-09-23T19:23:06.005845] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-03. [2025-09-23T19:23:06.055690] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-06 (12.25 seconds). [2025-09-23T19:23:06.063368] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-07. [2025-09-23T19:23:06.411377] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-23T19:23:06.412903] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-08. [2025-09-23T19:23:06.935994] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-23T19:23:06.937282] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-09. [2025-09-23T19:23:07.148830] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (2.51 seconds). [2025-09-23T19:23:07.149564] [INFO ] [REMOTE ] HYBX: Full fetch complete (817 records). [2025-09-23T19:23:07.149636] [DEBUG] [VALIDATOR ] HYBX: Validating primary data. [2025-09-23T19:23:07.360363] [WARN ] [VALIDATOR ] HYBX: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-23T19:23:07.399837] [FATAL] [MAIN ] HYBX: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:23:07.400831] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:23:07.405621] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-09-23T19:23:07.405519] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-23T19:23:07.410208] [INFO ] [REMOTE ] HYTR: Full fetch complete (4432 records). [2025-09-23T19:23:07.408253] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-23T19:23:07.417418] [DEBUG] [VALIDATOR ] HYTR: Validating primary data. [2025-09-23T19:23:07.419788] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-09-23T19:23:07.419531] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-23T19:23:07.449454] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-04. [2025-09-23T19:23:07.449546] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-09-23T19:23:07.474975] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-09-23T19:23:07.475295] [INFO ] [MAIN ] Update Progress: 1077/2372 symbols completed. HYBX took 45.2s. Estimated remaining: 2h 52m 2s. Rate: 7.5 symbols/min [2025-09-23T19:23:07.500152] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-08. [2025-09-23T19:23:07.828034] [DEBUG] [VALIDATOR ] HYTR: All expected trading days are present. [2025-09-23T19:23:07.828215] [DEBUG] [VALIDATOR ] HYTR: Primary data validation passed. [2025-09-23T19:23:07.828415] [INFO ] [MAIN ] HYTR: Fetched primary data is valid. [2025-09-23T19:23:07.828495] [DEBUG] [LOCAL ] HYTR: Saving primary data. [2025-09-23T19:23:07.829117] [DEBUG] [LOCAL ] HYTR: Trimmed 4432 records to 3182 (keeping 200 days of data) [2025-09-23T19:23:07.852599] [DEBUG] [LOCAL ] HYTR: Primary data saved (3182 records). [2025-09-23T19:23:07.852713] [INFO ] [MAIN ] HYTR: Full history saved. [2025-09-23T19:23:07.852882] [INFO ] [MAIN ] Update Progress: 1078/2372 symbols completed. HYTR took 38.1s. Estimated remaining: 2h 51m 45s. Rate: 7.5 symbols/min [2025-09-23T19:23:08.979756] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-23T19:23:08.993399] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-05. [2025-09-23T19:23:09.029886] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-23T19:23:09.038783] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-09. [2025-09-23T19:23:10.246474] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-23T19:23:10.253016] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-06. [2025-09-23T19:23:10.457582] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-23T19:23:10.463054] [INFO ] [REMOTE ] HYT: Full fetch complete (46846 records). [2025-09-23T19:23:10.463205] [DEBUG] [VALIDATOR ] HYT: Validating primary data. [2025-09-23T19:23:10.886988] [DEBUG] [VALIDATOR ] HYT: All expected trading days are present. [2025-09-23T19:23:10.887162] [DEBUG] [VALIDATOR ] HYT: Primary data validation passed. [2025-09-23T19:23:10.887956] [INFO ] [MAIN ] HYT: Fetched primary data is valid. [2025-09-23T19:23:10.888044] [DEBUG] [LOCAL ] HYT: Saving primary data. [2025-09-23T19:23:10.892340] [DEBUG] [LOCAL ] HYT: Trimmed 46846 records to 33213 (keeping 200 days of data) [2025-09-23T19:23:11.102691] [DEBUG] [LOCAL ] HYT: Primary data saved (33213 records). [2025-09-23T19:23:11.102846] [INFO ] [MAIN ] HYT: Full history saved. [2025-09-23T19:23:11.103062] [INFO ] [MAIN ] Update Progress: 1079/2372 symbols completed. HYT took 43.9s. Estimated remaining: 2h 51m 31s. Rate: 7.5 symbols/min [2025-09-23T19:23:11.455722] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-23T19:23:11.463897] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-07. [2025-09-23T19:23:12.725185] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-23T19:23:12.735202] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-08. [2025-09-23T19:23:13.864176] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-23T19:23:13.871909] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-09. [2025-09-23T19:23:15.106126] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-23T19:23:15.112201] [INFO ] [REMOTE ] HZO: Full fetch complete (40652 records). [2025-09-23T19:23:15.112401] [DEBUG] [VALIDATOR ] HZO: Validating primary data. [2025-09-23T19:23:15.505793] [DEBUG] [VALIDATOR ] HZO: All expected trading days are present. [2025-09-23T19:23:15.505869] [DEBUG] [VALIDATOR ] HZO: Primary data validation passed. [2025-09-23T19:23:15.506505] [INFO ] [MAIN ] HZO: Fetched primary data is valid. [2025-09-23T19:23:15.506604] [DEBUG] [LOCAL ] HZO: Saving primary data. [2025-09-23T19:23:15.507547] [DEBUG] [LOCAL ] HZO: Trimmed 40652 records to 29357 (keeping 200 days of data) [2025-09-23T19:23:15.688603] [DEBUG] [LOCAL ] HZO: Primary data saved (29357 records). [2025-09-23T19:23:15.688750] [INFO ] [MAIN ] HZO: Full history saved. [2025-09-23T19:23:15.688902] [INFO ] [MAIN ] Update Progress: 1080/2372 symbols completed. HZO took 27.1s. Estimated remaining: 2h 51m 19s. Rate: 7.5 symbols/min [2025-09-23T19:23:16.285534] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:23:16.460726] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:23:16.433606] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:23:16.483149] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:23:16.507929] [DEBUG] [LOCAL ] IAE: Loaded 5843 existing records from primary storage. [2025-09-23T19:23:16.508045] [INFO ] [MAIN ] IAE: Loaded 5843 existing records. [2025-09-23T19:23:16.752292] [WARN ] [MAIN ] IAE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:23:16.768552] [INFO ] [MAIN ] IAE: Wiping existing primary data before full refresh. [2025-09-23T19:23:16.768835] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-09-23T19:23:16.785451] [DEBUG] [LOCAL ] IBN: Loaded 52896 existing records from primary storage. [2025-09-23T19:23:16.785757] [INFO ] [MAIN ] IBN: Loaded 52896 existing records. [2025-09-23T19:23:16.786428] [DEBUG] [LOCAL ] IAE: Deleted primary data file. [2025-09-23T19:23:16.786600] [INFO ] [MAIN ] IAE: Starting full primary refresh. [2025-09-23T19:23:16.792583] [DEBUG] [LOCAL ] IBM: Loaded 53638 existing records from primary storage. [2025-09-23T19:23:16.823910] [INFO ] [MAIN ] IBM: Loaded 53638 existing records. [2025-09-23T19:23:17.034703] [DEBUG] [LOCAL ] IAG: Loaded 53442 existing records from primary storage. [2025-09-23T19:23:17.104966] [INFO ] [MAIN ] IAG: Loaded 53442 existing records. [2025-09-23T19:23:17.435217] [WARN ] [MAIN ] IBN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:23:17.474941] [INFO ] [MAIN ] IBN: Wiping existing primary data before full refresh. [2025-09-23T19:23:17.553026] [WARN ] [MAIN ] IBM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:23:17.567433] [INFO ] [MAIN ] IBM: Wiping existing primary data before full refresh. [2025-09-23T19:23:17.567553] [INFO ] [LOCAL ] IBN: Starting deletion of primary data. [2025-09-23T19:23:17.583805] [DEBUG] [LOCAL ] IBN: Deleted primary data file. [2025-09-23T19:23:17.572868] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-09-23T19:23:17.589779] [INFO ] [MAIN ] IBN: Starting full primary refresh. [2025-09-23T19:23:17.677533] [DEBUG] [LOCAL ] IBM: Deleted primary data file. [2025-09-23T19:23:17.762185] [INFO ] [MAIN ] IBM: Starting full primary refresh. [2025-09-23T19:23:17.796089] [WARN ] [MAIN ] IAG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:23:17.838891] [INFO ] [REMOTE ] IAE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:23:17.869164] [INFO ] [REMOTE ] IAE: Fetching primary data for 2024-12. [2025-09-23T19:23:17.876047] [INFO ] [MAIN ] IAG: Wiping existing primary data before full refresh. [2025-09-23T19:23:17.907382] [INFO ] [LOCAL ] IAG: Starting deletion of primary data. [2025-09-23T19:23:17.949832] [DEBUG] [LOCAL ] IAG: Deleted primary data file. [2025-09-23T19:23:17.950001] [INFO ] [MAIN ] IAG: Starting full primary refresh. [2025-09-23T19:23:18.821918] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-23T19:23:18.851399] [INFO ] [REMOTE ] IBN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:23:18.898411] [INFO ] [REMOTE ] IBM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:23:18.892513] [INFO ] [REMOTE ] IBN: Fetching primary data for 2024-12. [2025-09-23T19:23:18.894631] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-01. [2025-09-23T19:23:18.898977] [INFO ] [REMOTE ] IBM: Fetching primary data for 2024-12. [2025-09-23T19:23:18.982742] [INFO ] [REMOTE ] IAG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:23:18.983034] [INFO ] [REMOTE ] IAG: Fetching primary data for 2024-12. [2025-09-23T19:23:19.397569] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-23T19:23:19.399333] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-02. [2025-09-23T19:23:20.049951] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-23T19:23:20.051978] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-03. [2025-09-23T19:23:20.753488] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-23T19:23:20.755696] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-04. [2025-09-23T19:23:20.859701] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-23T19:23:20.870346] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-01. [2025-09-23T19:23:20.914557] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-23T19:23:20.926131] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-01. [2025-09-23T19:23:21.093544] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-23T19:23:21.105611] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-01. [2025-09-23T19:23:21.111064] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-23T19:23:21.113183] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-05. [2025-09-23T19:23:21.794516] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-23T19:23:21.796706] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-06. [2025-09-23T19:23:22.242400] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-23T19:23:22.252763] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-02. [2025-09-23T19:23:22.270830] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-23T19:23:22.272838] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-07. [2025-09-23T19:23:22.751730] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-23T19:23:22.763234] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-02. [2025-09-23T19:23:22.946810] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-23T19:23:22.949002] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-08. [2025-09-23T19:23:23.243199] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-09-23T19:23:23.253927] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-02. [2025-09-23T19:23:23.456086] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-23T19:23:23.466479] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-03. [2025-09-23T19:23:23.612003] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-23T19:23:23.613953] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-09. [2025-09-23T19:23:24.466338] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-23T19:23:24.468416] [INFO ] [REMOTE ] IAE: Full fetch complete (8573 records). [2025-09-23T19:23:24.468492] [DEBUG] [VALIDATOR ] IAE: Validating primary data. [2025-09-23T19:23:24.846963] [DEBUG] [VALIDATOR ] IAE: All expected trading days are present. [2025-09-23T19:23:24.847130] [DEBUG] [VALIDATOR ] IAE: Primary data validation passed. [2025-09-23T19:23:24.847512] [INFO ] [MAIN ] IAE: Fetched primary data is valid. [2025-09-23T19:23:24.847758] [DEBUG] [LOCAL ] IAE: Saving primary data. [2025-09-23T19:23:24.876245] [DEBUG] [LOCAL ] IAE: Trimmed 8573 records to 5892 (keeping 200 days of data) [2025-09-23T19:23:24.878745] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-09-23T19:23:24.906335] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-03. [2025-09-23T19:23:24.926133] [DEBUG] [LOCAL ] IAE: Primary data saved (5892 records). [2025-09-23T19:23:24.926250] [INFO ] [MAIN ] IAE: Full history saved. [2025-09-23T19:23:24.926334] [INFO ] [MAIN ] Update Progress: 1081/2372 symbols completed. IAE took 9.2s. Estimated remaining: 2h 51m 13s. Rate: 7.5 symbols/min [2025-09-23T19:23:25.110004] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:23:25.175000] [DEBUG] [LOCAL ] IBP: Loaded 29382 existing records from primary storage. [2025-09-23T19:23:25.178182] [INFO ] [MAIN ] IBP: Loaded 29382 existing records. [2025-09-23T19:23:25.178013] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-23T19:23:25.250170] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-04. [2025-09-23T19:23:25.392989] [WARN ] [MAIN ] IBP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:23:25.393356] [INFO ] [MAIN ] IBP: Wiping existing primary data before full refresh. [2025-09-23T19:23:25.393431] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-09-23T19:23:25.394557] [DEBUG] [LOCAL ] IBP: Deleted primary data file. [2025-09-23T19:23:25.394623] [INFO ] [MAIN ] IBP: Starting full primary refresh. [2025-09-23T19:23:25.724150] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-09-23T19:23:25.777219] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-03. [2025-09-23T19:23:25.824933] [INFO ] [REMOTE ] IBP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:23:25.825309] [INFO ] [REMOTE ] IBP: Fetching primary data for 2024-12. [2025-09-23T19:23:26.621350] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-23T19:23:26.634208] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-04. [2025-09-23T19:23:26.705737] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-23T19:23:26.711233] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-01. [2025-09-23T19:23:27.123009] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-23T19:23:27.134161] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-05. [2025-09-23T19:23:27.619691] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-23T19:23:27.625304] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-02. [2025-09-23T19:23:27.658553] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-23T19:23:28.211616] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-04. [2025-09-23T19:23:28.232327] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-23T19:23:28.497489] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-23T19:23:28.905938] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-23T19:23:29.002198] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-06. [2025-09-23T19:23:29.802254] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-03. [2025-09-23T19:23:30.117271] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-23T19:23:30.316035] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-23T19:23:30.602230] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-07. [2025-09-23T19:23:30.712737] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-23T19:23:31.402195] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-04. [2025-09-23T19:23:32.202215] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-05. [2025-09-23T19:23:32.284848] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-23T19:23:32.695945] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-23T19:23:33.002183] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-08. [2025-09-23T19:23:33.802165] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-05. [2025-09-23T19:23:34.020778] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-23T19:23:34.602219] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-05. [2025-09-23T19:23:34.758773] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-23T19:23:35.402210] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-06. [2025-09-23T19:23:35.490044] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-23T19:23:35.939916] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-23T19:23:36.202227] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-06. [2025-09-23T19:23:36.854214] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-23T19:23:37.002231] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-07. [2025-09-23T19:23:37.802216] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-09. [2025-09-23T19:23:38.038129] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-23T19:23:38.602197] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-07. [2025-09-23T19:23:39.038512] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-23T19:23:39.170247] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-23T19:23:39.178985] [INFO ] [REMOTE ] IBN: Full fetch complete (76259 records). [2025-09-23T19:23:39.179122] [DEBUG] [VALIDATOR ] IBN: Validating primary data. [2025-09-23T19:23:39.412114] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-08. [2025-09-23T19:23:39.580176] [DEBUG] [VALIDATOR ] IBN: All expected trading days are present. [2025-09-23T19:23:39.580280] [DEBUG] [VALIDATOR ] IBN: Primary data validation passed. [2025-09-23T19:23:39.581270] [INFO ] [MAIN ] IBN: Fetched primary data is valid. [2025-09-23T19:23:39.581338] [DEBUG] [LOCAL ] IBN: Saving primary data. [2025-09-23T19:23:39.583058] [DEBUG] [LOCAL ] IBN: Trimmed 76259 records to 52892 (keeping 200 days of data) [2025-09-23T19:23:39.923960] [DEBUG] [LOCAL ] IBN: Primary data saved (52892 records). [2025-09-23T19:23:39.924097] [INFO ] [MAIN ] IBN: Full history saved. [2025-09-23T19:23:39.924192] [INFO ] [MAIN ] Update Progress: 1082/2372 symbols completed. IBN took 24.2s. Estimated remaining: 2h 51m 13s. Rate: 7.5 symbols/min [2025-09-23T19:23:40.114574] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:23:40.152945] [DEBUG] [LOCAL ] IBTA: Loaded 38115 existing records from primary storage. [2025-09-23T19:23:40.153102] [INFO ] [MAIN ] IBTA: Loaded 38115 existing records. [2025-09-23T19:23:40.217963] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-06. [2025-09-23T19:23:40.339952] [WARN ] [MAIN ] IBTA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:23:40.340229] [INFO ] [MAIN ] IBTA: Wiping existing primary data before full refresh. [2025-09-23T19:23:40.340280] [INFO ] [LOCAL ] IBTA: Starting deletion of primary data. [2025-09-23T19:23:40.341456] [DEBUG] [LOCAL ] IBTA: Deleted primary data file. [2025-09-23T19:23:40.341519] [INFO ] [MAIN ] IBTA: Starting full primary refresh. [2025-09-23T19:23:40.718007] [INFO ] [REMOTE ] IBTA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:23:40.752991] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-23T19:23:40.927537] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-23T19:23:41.002239] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-09. [2025-09-23T19:23:41.158857] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-23T19:23:41.802239] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-08. [2025-09-23T19:23:42.602192] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-07. [2025-09-23T19:23:42.943268] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-23T19:23:42.952348] [INFO ] [REMOTE ] IAG: Full fetch complete (77207 records). [2025-09-23T19:23:42.952503] [DEBUG] [VALIDATOR ] IAG: Validating primary data. [2025-09-23T19:23:43.343452] [DEBUG] [VALIDATOR ] IAG: All expected trading days are present. [2025-09-23T19:23:43.343533] [DEBUG] [VALIDATOR ] IAG: Primary data validation passed. [2025-09-23T19:23:43.344509] [INFO ] [MAIN ] IAG: Fetched primary data is valid. [2025-09-23T19:23:43.344574] [DEBUG] [LOCAL ] IAG: Saving primary data. [2025-09-23T19:23:43.348554] [DEBUG] [LOCAL ] IAG: Trimmed 77207 records to 53442 (keeping 200 days of data) [2025-09-23T19:23:43.407763] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2024-12. [2025-09-23T19:23:43.685455] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-23T19:23:43.716998] [DEBUG] [LOCAL ] IAG: Primary data saved (53442 records). [2025-09-23T19:23:43.717162] [INFO ] [MAIN ] IAG: Full history saved. [2025-09-23T19:23:43.717256] [INFO ] [MAIN ] Update Progress: 1083/2372 symbols completed. IAG took 28.0s. Estimated remaining: 2h 51m 0s. Rate: 7.5 symbols/min [2025-09-23T19:23:43.888865] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:23:43.943724] [DEBUG] [LOCAL ] ICE: Loaded 53023 existing records from primary storage. [2025-09-23T19:23:43.943904] [INFO ] [MAIN ] ICE: Loaded 53023 existing records. [2025-09-23T19:23:44.149301] [WARN ] [MAIN ] ICE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:23:44.149720] [INFO ] [MAIN ] ICE: Wiping existing primary data before full refresh. [2025-09-23T19:23:44.149853] [INFO ] [LOCAL ] ICE: Starting deletion of primary data. [2025-09-23T19:23:44.151364] [DEBUG] [LOCAL ] ICE: Deleted primary data file. [2025-09-23T19:23:44.151428] [INFO ] [MAIN ] ICE: Starting full primary refresh. [2025-09-23T19:23:44.214336] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-08. [2025-09-23T19:23:44.316382] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-08 (2.51 seconds). [2025-09-23T19:23:44.595214] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-23T19:23:44.600965] [INFO ] [REMOTE ] ICE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:23:45.002246] [INFO ] [REMOTE ] ICE: Fetching primary data for 2024-12. [2025-09-23T19:23:45.624267] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-23T19:23:45.802271] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-01. [2025-09-23T19:23:46.602168] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-09. [2025-09-23T19:23:46.775767] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-23T19:23:46.963975] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-23T19:23:47.402187] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-02. [2025-09-23T19:23:48.140069] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-23T19:23:48.145192] [INFO ] [REMOTE ] IBP: Full fetch complete (41108 records). [2025-09-23T19:23:48.145309] [DEBUG] [VALIDATOR ] IBP: Validating primary data. [2025-09-23T19:23:48.210448] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-01. [2025-09-23T19:23:48.575242] [DEBUG] [VALIDATOR ] IBP: All expected trading days are present. [2025-09-23T19:23:48.575570] [DEBUG] [VALIDATOR ] IBP: Primary data validation passed. [2025-09-23T19:23:48.576328] [INFO ] [MAIN ] IBP: Fetched primary data is valid. [2025-09-23T19:23:48.576416] [DEBUG] [LOCAL ] IBP: Saving primary data. [2025-09-23T19:23:48.577413] [DEBUG] [LOCAL ] IBP: Trimmed 41108 records to 29338 (keeping 200 days of data) [2025-09-23T19:23:48.701209] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-23T19:23:48.809368] [DEBUG] [LOCAL ] IBP: Primary data saved (29338 records). [2025-09-23T19:23:48.809507] [INFO ] [MAIN ] IBP: Full history saved. [2025-09-23T19:23:48.809594] [INFO ] [MAIN ] Update Progress: 1084/2372 symbols completed. IBP took 23.9s. Estimated remaining: 2h 50m 49s. Rate: 7.5 symbols/min [2025-09-23T19:23:48.980961] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:23:49.006846] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-03. [2025-09-23T19:23:49.023870] [DEBUG] [LOCAL ] ICL: Loaded 38776 existing records from primary storage. [2025-09-23T19:23:49.024026] [INFO ] [MAIN ] ICL: Loaded 38776 existing records. [2025-09-23T19:23:49.197719] [WARN ] [MAIN ] ICL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:23:49.197939] [INFO ] [MAIN ] ICL: Wiping existing primary data before full refresh. [2025-09-23T19:23:49.197987] [INFO ] [LOCAL ] ICL: Starting deletion of primary data. [2025-09-23T19:23:49.199014] [DEBUG] [LOCAL ] ICL: Deleted primary data file. [2025-09-23T19:23:49.199075] [INFO ] [MAIN ] ICL: Starting full primary refresh. [2025-09-23T19:23:49.548912] [INFO ] [REMOTE ] ICL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:23:49.796549] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-23T19:23:49.807168] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-09-23T19:23:50.602194] [INFO ] [REMOTE ] ICL: Fetching primary data for 2024-12. [2025-09-23T19:23:50.683757] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-23T19:23:51.402256] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-04. [2025-09-23T19:23:52.063681] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-23T19:23:52.097133] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-09-23T19:23:52.106298] [INFO ] [REMOTE ] IBM: Full fetch complete (77620 records). [2025-09-23T19:23:52.106448] [DEBUG] [VALIDATOR ] IBM: Validating primary data. [2025-09-23T19:23:52.207394] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-01. [2025-09-23T19:23:52.514737] [DEBUG] [VALIDATOR ] IBM: All expected trading days are present. [2025-09-23T19:23:52.515037] [DEBUG] [VALIDATOR ] IBM: Primary data validation passed. [2025-09-23T19:23:52.516048] [INFO ] [MAIN ] IBM: Fetched primary data is valid. [2025-09-23T19:23:52.516134] [DEBUG] [LOCAL ] IBM: Saving primary data. [2025-09-23T19:23:52.518156] [DEBUG] [LOCAL ] IBM: Trimmed 77620 records to 53639 (keeping 200 days of data) [2025-09-23T19:23:52.670693] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-23T19:23:52.930312] [DEBUG] [LOCAL ] IBM: Primary data saved (53639 records). [2025-09-23T19:23:52.930464] [INFO ] [MAIN ] IBM: Full history saved. [2025-09-23T19:23:52.930551] [INFO ] [MAIN ] Update Progress: 1085/2372 symbols completed. IBM took 37.2s. Estimated remaining: 2h 50m 36s. Rate: 7.5 symbols/min [2025-09-23T19:23:53.008746] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-02. [2025-09-23T19:23:53.111236] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:23:53.150185] [DEBUG] [LOCAL ] IDA: Loaded 31959 existing records from primary storage. [2025-09-23T19:23:53.150329] [INFO ] [MAIN ] IDA: Loaded 31959 existing records. [2025-09-23T19:23:53.334620] [WARN ] [MAIN ] IDA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:23:53.334967] [INFO ] [MAIN ] IDA: Wiping existing primary data before full refresh. [2025-09-23T19:23:53.335121] [INFO ] [LOCAL ] IDA: Starting deletion of primary data. [2025-09-23T19:23:53.348703] [DEBUG] [LOCAL ] IDA: Deleted primary data file. [2025-09-23T19:23:53.348783] [INFO ] [MAIN ] IDA: Starting full primary refresh. [2025-09-23T19:23:53.456349] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-23T19:23:53.757772] [INFO ] [REMOTE ] IDA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:23:53.802155] [INFO ] [REMOTE ] IDA: Fetching primary data for 2024-12. [2025-09-23T19:23:54.440738] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-23T19:23:54.602244] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-03. [2025-09-23T19:23:55.117039] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-23T19:23:55.402225] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-02. [2025-09-23T19:23:56.202233] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-05. [2025-09-23T19:23:56.434452] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-23T19:23:56.481417] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-23T19:23:57.002247] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-03. [2025-09-23T19:23:57.626583] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-23T19:23:57.802226] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-04. [2025-09-23T19:23:58.079016] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-23T19:23:58.602246] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-01. [2025-09-23T19:23:59.402193] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-06. [2025-09-23T19:23:59.536131] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-23T19:23:59.934630] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-23T19:24:00.202201] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-05. [2025-09-23T19:24:00.393543] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-23T19:24:01.002252] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-04. [2025-09-23T19:24:01.802225] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-07. [2025-09-23T19:24:02.602187] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-02. [2025-09-23T19:24:02.746877] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-05 (2.54 seconds). [2025-09-23T19:24:03.188733] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-23T19:24:03.402278] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-06. [2025-09-23T19:24:04.202220] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-05. [2025-09-23T19:24:04.445586] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-07 (2.64 seconds). [2025-09-23T19:24:04.923297] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-09-23T19:24:05.002189] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-08. [2025-09-23T19:24:05.052830] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-23T19:24:05.762734] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-23T19:24:05.802164] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-06. [2025-09-23T19:24:06.578611] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-23T19:24:06.602181] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-09. [2025-09-23T19:24:07.281119] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-23T19:24:07.402240] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-07. [2025-09-23T19:24:07.753030] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-23T19:24:07.760325] [INFO ] [REMOTE ] IBTA: Full fetch complete (50581 records). [2025-09-23T19:24:07.760431] [DEBUG] [VALIDATOR ] IBTA: Validating primary data. [2025-09-23T19:24:08.151299] [DEBUG] [VALIDATOR ] IBTA: All expected trading days are present. [2025-09-23T19:24:08.151420] [DEBUG] [VALIDATOR ] IBTA: Primary data validation passed. [2025-09-23T19:24:08.152351] [INFO ] [MAIN ] IBTA: Fetched primary data is valid. [2025-09-23T19:24:08.152415] [DEBUG] [LOCAL ] IBTA: Saving primary data. [2025-09-23T19:24:08.153534] [DEBUG] [LOCAL ] IBTA: Trimmed 50581 records to 38052 (keeping 200 days of data) [2025-09-23T19:24:08.209896] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-07. [2025-09-23T19:24:08.375998] [DEBUG] [LOCAL ] IBTA: Primary data saved (38052 records). [2025-09-23T19:24:08.376580] [INFO ] [MAIN ] IBTA: Full history saved. [2025-09-23T19:24:08.376710] [INFO ] [MAIN ] Update Progress: 1086/2372 symbols completed. IBTA took 28.5s. Estimated remaining: 2h 50m 37s. Rate: 7.5 symbols/min [2025-09-23T19:24:08.549782] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:24:08.559767] [DEBUG] [LOCAL ] IDE: Loaded 8405 existing records from primary storage. [2025-09-23T19:24:08.559914] [INFO ] [MAIN ] IDE: Loaded 8405 existing records. [2025-09-23T19:24:08.744865] [WARN ] [MAIN ] IDE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:24:08.745220] [INFO ] [MAIN ] IDE: Wiping existing primary data before full refresh. [2025-09-23T19:24:08.745273] [INFO ] [LOCAL ] IDE: Starting deletion of primary data. [2025-09-23T19:24:08.745845] [DEBUG] [LOCAL ] IDE: Deleted primary data file. [2025-09-23T19:24:08.745967] [INFO ] [MAIN ] IDE: Starting full primary refresh. [2025-09-23T19:24:09.021678] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-03. [2025-09-23T19:24:09.042441] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-23T19:24:09.152153] [INFO ] [REMOTE ] IDE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:24:09.802277] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-08. [2025-09-23T19:24:10.039792] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-23T19:24:10.088356] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-23T19:24:10.602206] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-04. [2025-09-23T19:24:11.277476] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-23T19:24:11.402186] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-09. [2025-09-23T19:24:11.954178] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-23T19:24:12.202211] [INFO ] [REMOTE ] IDE: Fetching primary data for 2024-12. [2025-09-23T19:24:12.956188] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-23T19:24:12.962538] [INFO ] [REMOTE ] ICL: Full fetch complete (56375 records). [2025-09-23T19:24:12.962736] [DEBUG] [VALIDATOR ] ICL: Validating primary data. [2025-09-23T19:24:13.007298] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-08. [2025-09-23T19:24:13.091281] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-23T19:24:13.370315] [DEBUG] [VALIDATOR ] ICL: All expected trading days are present. [2025-09-23T19:24:13.370394] [DEBUG] [VALIDATOR ] ICL: Primary data validation passed. [2025-09-23T19:24:13.371197] [INFO ] [MAIN ] ICL: Fetched primary data is valid. [2025-09-23T19:24:13.371261] [DEBUG] [LOCAL ] ICL: Saving primary data. [2025-09-23T19:24:13.372428] [DEBUG] [LOCAL ] ICL: Trimmed 56375 records to 38666 (keeping 200 days of data) [2025-09-23T19:24:13.593562] [DEBUG] [LOCAL ] ICL: Primary data saved (38666 records). [2025-09-23T19:24:13.593729] [INFO ] [MAIN ] ICL: Full history saved. [2025-09-23T19:24:13.593825] [INFO ] [MAIN ] Update Progress: 1087/2372 symbols completed. ICL took 24.8s. Estimated remaining: 2h 50m 26s. Rate: 7.5 symbols/min [2025-09-23T19:24:13.769803] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:24:13.788430] [DEBUG] [LOCAL ] IDT: Loaded 17600 existing records from primary storage. [2025-09-23T19:24:13.788578] [INFO ] [MAIN ] IDT: Loaded 17600 existing records. [2025-09-23T19:24:13.810063] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-01. [2025-09-23T19:24:13.975281] [WARN ] [MAIN ] IDT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:24:13.975542] [INFO ] [MAIN ] IDT: Wiping existing primary data before full refresh. [2025-09-23T19:24:13.975590] [INFO ] [LOCAL ] IDT: Starting deletion of primary data. [2025-09-23T19:24:13.976156] [DEBUG] [LOCAL ] IDT: Deleted primary data file. [2025-09-23T19:24:13.976218] [INFO ] [MAIN ] IDT: Starting full primary refresh. [2025-09-23T19:24:14.336452] [INFO ] [REMOTE ] IDT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:24:14.602156] [INFO ] [REMOTE ] IDT: Fetching primary data for 2024-12. [2025-09-23T19:24:14.796606] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-23T19:24:15.402169] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-05. [2025-09-23T19:24:15.599894] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-08 (2.59 seconds). [2025-09-23T19:24:16.091429] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-23T19:24:16.202179] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-01. [2025-09-23T19:24:17.002239] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-02. [2025-09-23T19:24:17.292804] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-23T19:24:17.474921] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-23T19:24:17.706858] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-23T19:24:17.802150] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-06. [2025-09-23T19:24:18.602238] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-03. [2025-09-23T19:24:19.200614] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-23T19:24:19.221915] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-23T19:24:19.402211] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-04. [2025-09-23T19:24:20.107942] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-23T19:24:20.202172] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-05. [2025-09-23T19:24:20.947417] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-23T19:24:21.002213] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-07. [2025-09-23T19:24:21.802217] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-09. [2025-09-23T19:24:22.439339] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-23T19:24:22.602205] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-02. [2025-09-23T19:24:23.051339] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-23T19:24:23.312629] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-23T19:24:23.322737] [INFO ] [REMOTE ] ICE: Full fetch complete (76765 records). [2025-09-23T19:24:23.322932] [DEBUG] [VALIDATOR ] ICE: Validating primary data. [2025-09-23T19:24:23.409507] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-06. [2025-09-23T19:24:23.981469] [DEBUG] [VALIDATOR ] ICE: All expected trading days are present. [2025-09-23T19:24:23.981607] [DEBUG] [VALIDATOR ] ICE: Primary data validation passed. [2025-09-23T19:24:23.983451] [INFO ] [MAIN ] ICE: Fetched primary data is valid. [2025-09-23T19:24:23.983539] [DEBUG] [LOCAL ] ICE: Saving primary data. [2025-09-23T19:24:23.985719] [DEBUG] [LOCAL ] ICE: Trimmed 76765 records to 53019 (keeping 200 days of data) [2025-09-23T19:24:24.247368] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-03. [2025-09-23T19:24:24.313318] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-23T19:24:24.477089] [DEBUG] [LOCAL ] ICE: Primary data saved (53019 records). [2025-09-23T19:24:24.477259] [INFO ] [MAIN ] ICE: Full history saved. [2025-09-23T19:24:24.477371] [INFO ] [MAIN ] Update Progress: 1088/2372 symbols completed. ICE took 40.8s. Estimated remaining: 2h 50m 22s. Rate: 7.5 symbols/min [2025-09-23T19:24:24.686274] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:24:24.728509] [DEBUG] [LOCAL ] IEX: Loaded 38423 existing records from primary storage. [2025-09-23T19:24:24.728711] [INFO ] [MAIN ] IEX: Loaded 38423 existing records. [2025-09-23T19:24:24.921230] [WARN ] [MAIN ] IEX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:24:24.921517] [INFO ] [MAIN ] IEX: Wiping existing primary data before full refresh. [2025-09-23T19:24:24.921572] [INFO ] [LOCAL ] IEX: Starting deletion of primary data. [2025-09-23T19:24:24.922544] [DEBUG] [LOCAL ] IEX: Deleted primary data file. [2025-09-23T19:24:24.922606] [INFO ] [MAIN ] IEX: Starting full primary refresh. [2025-09-23T19:24:25.007298] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-08. [2025-09-23T19:24:25.318738] [INFO ] [REMOTE ] IEX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:24:25.351399] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-23T19:24:25.802194] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-04. [2025-09-23T19:24:26.097479] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-23T19:24:26.488519] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-23T19:24:26.602195] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-05. [2025-09-23T19:24:27.402180] [INFO ] [REMOTE ] IEX: Fetching primary data for 2024-12. [2025-09-23T19:24:27.626868] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-23T19:24:28.202204] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-06. [2025-09-23T19:24:28.919587] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-23T19:24:29.002150] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-01. [2025-09-23T19:24:29.435116] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-23T19:24:29.802170] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-07. [2025-09-23T19:24:30.602197] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-07. [2025-09-23T19:24:31.257380] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-23T19:24:31.310757] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-09-23T19:24:31.352757] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-23T19:24:31.402141] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-02. [2025-09-23T19:24:32.202194] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-08. [2025-09-23T19:24:32.835625] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-23T19:24:32.839636] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-23T19:24:33.002210] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-09. [2025-09-23T19:24:33.802243] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-08. [2025-09-23T19:24:33.852579] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-23T19:24:33.854767] [INFO ] [REMOTE ] IDE: Full fetch complete (12805 records). [2025-09-23T19:24:33.854860] [DEBUG] [VALIDATOR ] IDE: Validating primary data. [2025-09-23T19:24:34.265911] [DEBUG] [VALIDATOR ] IDE: All expected trading days are present. [2025-09-23T19:24:34.266007] [DEBUG] [VALIDATOR ] IDE: Primary data validation passed. [2025-09-23T19:24:34.266357] [INFO ] [MAIN ] IDE: Fetched primary data is valid. [2025-09-23T19:24:34.266398] [DEBUG] [LOCAL ] IDE: Saving primary data. [2025-09-23T19:24:34.266919] [DEBUG] [LOCAL ] IDE: Trimmed 12805 records to 8535 (keeping 200 days of data) [2025-09-23T19:24:34.322069] [DEBUG] [LOCAL ] IDE: Primary data saved (8535 records). [2025-09-23T19:24:34.322242] [INFO ] [MAIN ] IDE: Full history saved. [2025-09-23T19:24:34.322353] [INFO ] [MAIN ] Update Progress: 1089/2372 symbols completed. IDE took 25.9s. Estimated remaining: 2h 50m 16s. Rate: 7.5 symbols/min [2025-09-23T19:24:34.500086] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:24:34.552388] [DEBUG] [LOCAL ] IFF: Loaded 50956 existing records from primary storage. [2025-09-23T19:24:34.552538] [INFO ] [MAIN ] IFF: Loaded 50956 existing records. [2025-09-23T19:24:34.614636] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-09. [2025-09-23T19:24:34.671670] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-23T19:24:34.747627] [WARN ] [MAIN ] IFF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:24:34.747887] [INFO ] [MAIN ] IFF: Wiping existing primary data before full refresh. [2025-09-23T19:24:34.747935] [INFO ] [LOCAL ] IFF: Starting deletion of primary data. [2025-09-23T19:24:34.749035] [DEBUG] [LOCAL ] IFF: Deleted primary data file. [2025-09-23T19:24:34.749095] [INFO ] [MAIN ] IFF: Starting full primary refresh. [2025-09-23T19:24:35.103945] [INFO ] [REMOTE ] IFF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:24:35.402205] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-03. [2025-09-23T19:24:35.843349] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-23T19:24:35.848050] [INFO ] [REMOTE ] IDA: Full fetch complete (44564 records). [2025-09-23T19:24:35.848152] [DEBUG] [VALIDATOR ] IDA: Validating primary data. [2025-09-23T19:24:36.216779] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-09. [2025-09-23T19:24:36.234005] [DEBUG] [VALIDATOR ] IDA: All expected trading days are present. [2025-09-23T19:24:36.234090] [DEBUG] [VALIDATOR ] IDA: Primary data validation passed. [2025-09-23T19:24:36.234827] [INFO ] [MAIN ] IDA: Fetched primary data is valid. [2025-09-23T19:24:36.234923] [DEBUG] [LOCAL ] IDA: Saving primary data. [2025-09-23T19:24:36.236163] [DEBUG] [LOCAL ] IDA: Trimmed 44564 records to 32000 (keeping 200 days of data) [2025-09-23T19:24:36.445530] [DEBUG] [LOCAL ] IDA: Primary data saved (32000 records). [2025-09-23T19:24:36.445697] [INFO ] [MAIN ] IDA: Full history saved. [2025-09-23T19:24:36.445796] [INFO ] [MAIN ] Update Progress: 1090/2372 symbols completed. IDA took 43.5s. Estimated remaining: 2h 50m 1s. Rate: 7.5 symbols/min [2025-09-23T19:24:36.619943] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:24:36.638934] [DEBUG] [LOCAL ] IFN: Loaded 18150 existing records from primary storage. [2025-09-23T19:24:36.639070] [INFO ] [MAIN ] IFN: Loaded 18150 existing records. [2025-09-23T19:24:36.831401] [WARN ] [MAIN ] IFN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:24:36.832045] [INFO ] [MAIN ] IFN: Wiping existing primary data before full refresh. [2025-09-23T19:24:36.832119] [INFO ] [LOCAL ] IFN: Starting deletion of primary data. [2025-09-23T19:24:36.832918] [DEBUG] [LOCAL ] IFN: Deleted primary data file. [2025-09-23T19:24:36.832982] [INFO ] [MAIN ] IFN: Starting full primary refresh. [2025-09-23T19:24:37.003998] [INFO ] [REMOTE ] IFF: Fetching primary data for 2024-12. [2025-09-23T19:24:37.007006] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-23T19:24:37.261199] [INFO ] [REMOTE ] IFN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:24:37.392042] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-23T19:24:37.395988] [INFO ] [REMOTE ] IDT: Full fetch complete (22509 records). [2025-09-23T19:24:37.396124] [DEBUG] [VALIDATOR ] IDT: Validating primary data. [2025-09-23T19:24:37.760332] [DEBUG] [VALIDATOR ] IDT: All expected trading days are present. [2025-09-23T19:24:37.760440] [DEBUG] [VALIDATOR ] IDT: Primary data validation passed. [2025-09-23T19:24:37.761191] [INFO ] [MAIN ] IDT: Fetched primary data is valid. [2025-09-23T19:24:37.761259] [DEBUG] [LOCAL ] IDT: Saving primary data. [2025-09-23T19:24:37.762344] [DEBUG] [LOCAL ] IDT: Trimmed 22509 records to 17675 (keeping 200 days of data) [2025-09-23T19:24:37.807724] [INFO ] [REMOTE ] IFN: Fetching primary data for 2024-12. [2025-09-23T19:24:37.871009] [DEBUG] [LOCAL ] IDT: Primary data saved (17675 records). [2025-09-23T19:24:37.871135] [INFO ] [MAIN ] IDT: Full history saved. [2025-09-23T19:24:37.871218] [INFO ] [MAIN ] Update Progress: 1091/2372 symbols completed. IDT took 24.3s. Estimated remaining: 2h 49m 45s. Rate: 7.5 symbols/min [2025-09-23T19:24:38.044281] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:24:38.066998] [DEBUG] [LOCAL ] IFS: Loaded 23060 existing records from primary storage. [2025-09-23T19:24:38.067137] [INFO ] [MAIN ] IFS: Loaded 23060 existing records. [2025-09-23T19:24:38.242628] [WARN ] [MAIN ] IFS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:24:38.242902] [INFO ] [MAIN ] IFS: Wiping existing primary data before full refresh. [2025-09-23T19:24:38.242950] [INFO ] [LOCAL ] IFS: Starting deletion of primary data. [2025-09-23T19:24:38.243610] [DEBUG] [LOCAL ] IFS: Deleted primary data file. [2025-09-23T19:24:38.243705] [INFO ] [MAIN ] IFS: Starting full primary refresh. [2025-09-23T19:24:38.601512] [INFO ] [REMOTE ] IFS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:24:38.602135] [INFO ] [REMOTE ] IFS: Fetching primary data for 2024-12. [2025-09-23T19:24:38.671522] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-23T19:24:38.850355] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-23T19:24:39.145722] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-23T19:24:39.402232] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-01. [2025-09-23T19:24:40.202156] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-01. [2025-09-23T19:24:40.671460] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-23T19:24:41.002189] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-04. [2025-09-23T19:24:41.807288] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-01. [2025-09-23T19:24:41.820504] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-23T19:24:42.311223] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-23T19:24:42.402812] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-23T19:24:42.602201] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-02. [2025-09-23T19:24:43.402198] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-02. [2025-09-23T19:24:44.161720] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-23T19:24:44.202150] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-03. [2025-09-23T19:24:44.218359] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-23T19:24:45.002185] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-03. [2025-09-23T19:24:45.802208] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-02. [2025-09-23T19:24:46.056977] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-23T19:24:46.099152] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-23T19:24:46.602164] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-05. [2025-09-23T19:24:47.003091] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-23T19:24:47.402258] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-04. [2025-09-23T19:24:47.726420] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-23T19:24:48.202248] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-06. [2025-09-23T19:24:49.002191] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-03. [2025-09-23T19:24:49.080168] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-23T19:24:49.802183] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-04. [2025-09-23T19:24:49.889381] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-23T19:24:50.104054] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-23T19:24:50.602169] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-04. [2025-09-23T19:24:50.866183] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-23T19:24:51.402159] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-05. [2025-09-23T19:24:51.426068] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-23T19:24:52.202250] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-05. [2025-09-23T19:24:53.002174] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-07. [2025-09-23T19:24:53.145582] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-23T19:24:53.213903] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-23T19:24:53.802258] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-06. [2025-09-23T19:24:54.269534] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-23T19:24:54.602208] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-06. [2025-09-23T19:24:54.646435] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-23T19:24:55.402203] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-08. [2025-09-23T19:24:56.135766] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-23T19:24:56.202148] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-07. [2025-09-23T19:24:56.510219] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-23T19:24:57.002184] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-05. [2025-09-23T19:24:57.637943] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-23T19:24:57.802162] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-08. [2025-09-23T19:24:58.127728] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-23T19:24:58.602425] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-09. [2025-09-23T19:24:59.342006] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-23T19:24:59.402200] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-09. [2025-09-23T19:24:59.754720] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-23T19:24:59.761500] [INFO ] [REMOTE ] IEX: Full fetch complete (53312 records). [2025-09-23T19:24:59.761607] [DEBUG] [VALIDATOR ] IEX: Validating primary data. [2025-09-23T19:25:00.149229] [DEBUG] [VALIDATOR ] IEX: All expected trading days are present. [2025-09-23T19:25:00.149320] [DEBUG] [VALIDATOR ] IEX: Primary data validation passed. [2025-09-23T19:25:00.150084] [INFO ] [MAIN ] IEX: Fetched primary data is valid. [2025-09-23T19:25:00.150147] [DEBUG] [LOCAL ] IEX: Saving primary data. [2025-09-23T19:25:00.153476] [DEBUG] [LOCAL ] IEX: Trimmed 53312 records to 38405 (keeping 200 days of data) [2025-09-23T19:25:00.213790] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-07. [2025-09-23T19:25:00.403120] [DEBUG] [LOCAL ] IEX: Primary data saved (38405 records). [2025-09-23T19:25:00.403272] [INFO ] [MAIN ] IEX: Full history saved. [2025-09-23T19:25:00.403359] [INFO ] [MAIN ] Update Progress: 1092/2372 symbols completed. IEX took 35.9s. Estimated remaining: 2h 49m 54s. Rate: 7.5 symbols/min [2025-09-23T19:25:00.573205] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:25:00.585597] [DEBUG] [LOCAL ] IGA: Loaded 9666 existing records from primary storage. [2025-09-23T19:25:00.585774] [INFO ] [MAIN ] IGA: Loaded 9666 existing records. [2025-09-23T19:25:00.781061] [WARN ] [MAIN ] IGA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:25:00.781535] [INFO ] [MAIN ] IGA: Wiping existing primary data before full refresh. [2025-09-23T19:25:00.781691] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-09-23T19:25:00.782169] [DEBUG] [LOCAL ] IGA: Deleted primary data file. [2025-09-23T19:25:00.782233] [INFO ] [MAIN ] IGA: Starting full primary refresh. [2025-09-23T19:25:01.013351] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-06. [2025-09-23T19:25:01.139610] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-23T19:25:01.192773] [INFO ] [REMOTE ] IFF: Full fetch complete (72794 records). [2025-09-23T19:25:01.212393] [INFO ] [REMOTE ] IGA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:25:01.212827] [DEBUG] [VALIDATOR ] IFF: Validating primary data. [2025-09-23T19:25:01.506968] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-23T19:25:01.661072] [DEBUG] [VALIDATOR ] IFF: All expected trading days are present. [2025-09-23T19:25:01.661177] [DEBUG] [VALIDATOR ] IFF: Primary data validation passed. [2025-09-23T19:25:01.662152] [INFO ] [MAIN ] IFF: Fetched primary data is valid. [2025-09-23T19:25:01.662230] [DEBUG] [LOCAL ] IFF: Saving primary data. [2025-09-23T19:25:01.663964] [DEBUG] [LOCAL ] IFF: Trimmed 72794 records to 50969 (keeping 200 days of data) [2025-09-23T19:25:01.802966] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-08. [2025-09-23T19:25:02.007765] [DEBUG] [LOCAL ] IFF: Primary data saved (50969 records). [2025-09-23T19:25:02.007922] [INFO ] [MAIN ] IFF: Full history saved. [2025-09-23T19:25:02.008011] [INFO ] [MAIN ] Update Progress: 1093/2372 symbols completed. IFF took 27.7s. Estimated remaining: 2h 49m 39s. Rate: 7.5 symbols/min [2025-09-23T19:25:02.205887] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:25:02.225597] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-23T19:25:02.258752] [DEBUG] [LOCAL ] IGD: Loaded 18971 existing records from primary storage. [2025-09-23T19:25:02.259084] [INFO ] [MAIN ] IGD: Loaded 18971 existing records. [2025-09-23T19:25:02.460096] [WARN ] [MAIN ] IGD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:25:02.460489] [INFO ] [MAIN ] IGD: Wiping existing primary data before full refresh. [2025-09-23T19:25:02.460566] [INFO ] [LOCAL ] IGD: Starting deletion of primary data. [2025-09-23T19:25:02.461357] [DEBUG] [LOCAL ] IGD: Deleted primary data file. [2025-09-23T19:25:02.461420] [INFO ] [MAIN ] IGD: Starting full primary refresh. [2025-09-23T19:25:02.606678] [INFO ] [REMOTE ] IGA: Fetching primary data for 2024-12. [2025-09-23T19:25:02.812286] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-23T19:25:02.859538] [INFO ] [REMOTE ] IGD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:25:03.338384] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-23T19:25:03.402288] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-09. [2025-09-23T19:25:04.202218] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-01. [2025-09-23T19:25:04.519158] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-23T19:25:04.522622] [INFO ] [REMOTE ] IFN: Full fetch complete (29060 records). [2025-09-23T19:25:04.522760] [DEBUG] [VALIDATOR ] IFN: Validating primary data. [2025-09-23T19:25:04.920874] [DEBUG] [VALIDATOR ] IFN: All expected trading days are present. [2025-09-23T19:25:04.921087] [DEBUG] [VALIDATOR ] IFN: Primary data validation passed. [2025-09-23T19:25:04.921704] [INFO ] [MAIN ] IFN: Fetched primary data is valid. [2025-09-23T19:25:04.921775] [DEBUG] [LOCAL ] IFN: Saving primary data. [2025-09-23T19:25:04.923150] [DEBUG] [LOCAL ] IFN: Trimmed 29060 records to 18212 (keeping 200 days of data) [2025-09-23T19:25:05.011896] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-07. [2025-09-23T19:25:05.025113] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-23T19:25:05.059288] [DEBUG] [LOCAL ] IFN: Primary data saved (18212 records). [2025-09-23T19:25:05.059443] [INFO ] [MAIN ] IFN: Full history saved. [2025-09-23T19:25:05.059600] [INFO ] [MAIN ] Update Progress: 1094/2372 symbols completed. IFN took 28.6s. Estimated remaining: 2h 49m 25s. Rate: 7.5 symbols/min [2025-09-23T19:25:05.229311] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:25:05.237947] [DEBUG] [LOCAL ] IGI: Loaded 3702 existing records from primary storage. [2025-09-23T19:25:05.238055] [INFO ] [MAIN ] IGI: Loaded 3702 existing records. [2025-09-23T19:25:05.418572] [WARN ] [MAIN ] IGI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:25:05.418871] [INFO ] [MAIN ] IGI: Wiping existing primary data before full refresh. [2025-09-23T19:25:05.418918] [INFO ] [LOCAL ] IGI: Starting deletion of primary data. [2025-09-23T19:25:05.419190] [DEBUG] [LOCAL ] IGI: Deleted primary data file. [2025-09-23T19:25:05.419253] [INFO ] [MAIN ] IGI: Starting full primary refresh. [2025-09-23T19:25:05.806721] [INFO ] [REMOTE ] IGD: Fetching primary data for 2024-12. [2025-09-23T19:25:05.806556] [INFO ] [REMOTE ] IGI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:25:06.087542] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-23T19:25:06.602194] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-08. [2025-09-23T19:25:06.804823] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-23T19:25:07.412176] [INFO ] [REMOTE ] IGI: Fetching primary data for 2024-12. [2025-09-23T19:25:07.414365] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-23T19:25:07.987946] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-23T19:25:08.202247] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-01. [2025-09-23T19:25:09.002214] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-09. [2025-09-23T19:25:09.430820] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-23T19:25:09.802220] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-02. [2025-09-23T19:25:10.212668] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-23T19:25:10.217299] [INFO ] [REMOTE ] IFS: Full fetch complete (31460 records). [2025-09-23T19:25:10.217388] [DEBUG] [VALIDATOR ] IFS: Validating primary data. [2025-09-23T19:25:10.557254] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-23T19:25:10.602540] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-01. [2025-09-23T19:25:10.632974] [DEBUG] [VALIDATOR ] IFS: All expected trading days are present. [2025-09-23T19:25:10.633081] [DEBUG] [VALIDATOR ] IFS: Primary data validation passed. [2025-09-23T19:25:10.633744] [INFO ] [MAIN ] IFS: Fetched primary data is valid. [2025-09-23T19:25:10.633869] [DEBUG] [LOCAL ] IFS: Saving primary data. [2025-09-23T19:25:10.637907] [DEBUG] [LOCAL ] IFS: Trimmed 31460 records to 23131 (keeping 200 days of data) [2025-09-23T19:25:10.790792] [DEBUG] [LOCAL ] IFS: Primary data saved (23131 records). [2025-09-23T19:25:10.790940] [INFO ] [MAIN ] IFS: Full history saved. [2025-09-23T19:25:10.791119] [INFO ] [MAIN ] Update Progress: 1095/2372 symbols completed. IFS took 32.9s. Estimated remaining: 2h 49m 15s. Rate: 7.5 symbols/min [2025-09-23T19:25:10.966128] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:25:11.005532] [DEBUG] [LOCAL ] IGR: Loaded 30584 existing records from primary storage. [2025-09-23T19:25:11.005739] [INFO ] [MAIN ] IGR: Loaded 30584 existing records. [2025-09-23T19:25:11.193591] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-23T19:25:11.199004] [WARN ] [MAIN ] IGR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:25:11.200490] [INFO ] [MAIN ] IGR: Wiping existing primary data before full refresh. [2025-09-23T19:25:11.200540] [INFO ] [LOCAL ] IGR: Starting deletion of primary data. [2025-09-23T19:25:11.201458] [DEBUG] [LOCAL ] IGR: Deleted primary data file. [2025-09-23T19:25:11.201537] [INFO ] [MAIN ] IGR: Starting full primary refresh. [2025-09-23T19:25:11.409505] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-02. [2025-09-23T19:25:11.576040] [INFO ] [REMOTE ] IGR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:25:12.202198] [INFO ] [REMOTE ] IGR: Fetching primary data for 2024-12. [2025-09-23T19:25:12.484080] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-23T19:25:13.002204] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-03. [2025-09-23T19:25:13.359385] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-23T19:25:13.802209] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-01. [2025-09-23T19:25:13.966318] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-23T19:25:14.602206] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-03. [2025-09-23T19:25:15.204502] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-23T19:25:15.220697] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-23T19:25:15.402200] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-02. [2025-09-23T19:25:15.859154] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-23T19:25:16.202210] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-02. [2025-09-23T19:25:17.002252] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-04. [2025-09-23T19:25:17.517886] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-23T19:25:17.628522] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-23T19:25:17.802192] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-05. [2025-09-23T19:25:18.495468] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-23T19:25:18.602142] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-06. [2025-09-23T19:25:19.245632] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-23T19:25:19.402222] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-03. [2025-09-23T19:25:19.977382] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-23T19:25:20.202201] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-04. [2025-09-23T19:25:21.002170] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-04. [2025-09-23T19:25:21.360534] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-23T19:25:21.616319] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-23T19:25:21.802203] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-05. [2025-09-23T19:25:22.259820] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-23T19:25:22.602261] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-06. [2025-09-23T19:25:23.166399] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-23T19:25:23.402213] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-03. [2025-09-23T19:25:24.202191] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-07. [2025-09-23T19:25:24.566118] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-23T19:25:24.786681] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-23T19:25:25.002220] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-08. [2025-09-23T19:25:25.619274] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-23T19:25:25.802232] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-09. [2025-09-23T19:25:26.561212] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-23T19:25:26.562864] [INFO ] [REMOTE ] IGI: Full fetch complete (5220 records). [2025-09-23T19:25:26.562962] [DEBUG] [VALIDATOR ] IGI: Validating primary data. [2025-09-23T19:25:26.607305] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-05. [2025-09-23T19:25:26.949760] [DEBUG] [VALIDATOR ] IGI: All expected trading days are present. [2025-09-23T19:25:26.949867] [DEBUG] [VALIDATOR ] IGI: Primary data validation passed. [2025-09-23T19:25:26.950027] [INFO ] [MAIN ] IGI: Fetched primary data is valid. [2025-09-23T19:25:26.950066] [DEBUG] [LOCAL ] IGI: Saving primary data. [2025-09-23T19:25:26.950425] [DEBUG] [LOCAL ] IGI: Trimmed 5220 records to 3685 (keeping 200 days of data) [2025-09-23T19:25:26.976126] [DEBUG] [LOCAL ] IGI: Primary data saved (3685 records). [2025-09-23T19:25:26.976195] [INFO ] [MAIN ] IGI: Full history saved. [2025-09-23T19:25:26.976336] [INFO ] [MAIN ] Update Progress: 1096/2372 symbols completed. IGI took 21.9s. Estimated remaining: 2h 49m 16s. Rate: 7.5 symbols/min [2025-09-23T19:25:27.145429] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:25:27.153903] [DEBUG] [LOCAL ] IH: Loaded 3545 existing records from primary storage. [2025-09-23T19:25:27.153994] [INFO ] [MAIN ] IH: Loaded 3545 existing records. [2025-09-23T19:25:27.329988] [WARN ] [MAIN ] IH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:25:27.330258] [INFO ] [MAIN ] IH: Wiping existing primary data before full refresh. [2025-09-23T19:25:27.330355] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-09-23T19:25:27.330631] [DEBUG] [LOCAL ] IH: Deleted primary data file. [2025-09-23T19:25:27.330722] [INFO ] [MAIN ] IH: Starting full primary refresh. [2025-09-23T19:25:27.407303] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-04. [2025-09-23T19:25:27.703740] [INFO ] [REMOTE ] IH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:25:27.743249] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-23T19:25:28.202281] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-07. [2025-09-23T19:25:28.384283] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-23T19:25:29.000759] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-23T19:25:29.003585] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-05. [2025-09-23T19:25:29.802168] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-08. [2025-09-23T19:25:30.258330] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-23T19:25:30.602219] [INFO ] [REMOTE ] IH: Fetching primary data for 2024-12. [2025-09-23T19:25:30.618496] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-23T19:25:31.047148] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-23T19:25:31.402215] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-06. [2025-09-23T19:25:32.202168] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-01. [2025-09-23T19:25:32.493756] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-23T19:25:32.630192] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-23T19:25:33.002234] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-09. [2025-09-23T19:25:33.620381] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-23T19:25:33.622701] [INFO ] [REMOTE ] IGA: Full fetch complete (13576 records). [2025-09-23T19:25:33.622772] [DEBUG] [VALIDATOR ] IGA: Validating primary data. [2025-09-23T19:25:33.807397] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-07. [2025-09-23T19:25:33.999059] [DEBUG] [VALIDATOR ] IGA: All expected trading days are present. [2025-09-23T19:25:33.999202] [DEBUG] [VALIDATOR ] IGA: Primary data validation passed. [2025-09-23T19:25:33.999519] [INFO ] [MAIN ] IGA: Fetched primary data is valid. [2025-09-23T19:25:33.999559] [DEBUG] [LOCAL ] IGA: Saving primary data. [2025-09-23T19:25:34.000088] [DEBUG] [LOCAL ] IGA: Trimmed 13576 records to 9692 (keeping 200 days of data) [2025-09-23T19:25:34.067560] [DEBUG] [LOCAL ] IGA: Primary data saved (9692 records). [2025-09-23T19:25:34.067741] [INFO ] [MAIN ] IGA: Full history saved. [2025-09-23T19:25:34.067912] [INFO ] [MAIN ] Update Progress: 1097/2372 symbols completed. IGA took 33.7s. Estimated remaining: 2h 49m 8s. Rate: 7.5 symbols/min [2025-09-23T19:25:34.238031] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:25:34.251784] [DEBUG] [LOCAL ] IHD: Loaded 7246 existing records from primary storage. [2025-09-23T19:25:34.251917] [INFO ] [MAIN ] IHD: Loaded 7246 existing records. [2025-09-23T19:25:34.430512] [WARN ] [MAIN ] IHD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:25:34.430838] [INFO ] [MAIN ] IHD: Wiping existing primary data before full refresh. [2025-09-23T19:25:34.430888] [INFO ] [LOCAL ] IHD: Starting deletion of primary data. [2025-09-23T19:25:34.431276] [DEBUG] [LOCAL ] IHD: Deleted primary data file. [2025-09-23T19:25:34.431338] [INFO ] [MAIN ] IHD: Starting full primary refresh. [2025-09-23T19:25:34.607304] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-06. [2025-09-23T19:25:34.795914] [INFO ] [REMOTE ] IHD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:25:34.994592] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-23T19:25:35.402233] [INFO ] [REMOTE ] IHD: Fetching primary data for 2024-12. [2025-09-23T19:25:35.769507] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-23T19:25:36.202157] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-08. [2025-09-23T19:25:36.265812] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-23T19:25:37.002218] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-07. [2025-09-23T19:25:37.245801] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-23T19:25:37.802212] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-02. [2025-09-23T19:25:38.385801] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-23T19:25:38.533082] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-23T19:25:38.602164] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-01. [2025-09-23T19:25:39.292353] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-23T19:25:39.402216] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-09. [2025-09-23T19:25:40.197128] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-23T19:25:40.201208] [INFO ] [REMOTE ] IGD: Full fetch complete (29283 records). [2025-09-23T19:25:40.201312] [DEBUG] [VALIDATOR ] IGD: Validating primary data. [2025-09-23T19:25:40.207394] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-08. [2025-09-23T19:25:40.575888] [DEBUG] [VALIDATOR ] IGD: All expected trading days are present. [2025-09-23T19:25:40.575991] [DEBUG] [VALIDATOR ] IGD: Primary data validation passed. [2025-09-23T19:25:40.576722] [INFO ] [MAIN ] IGD: Fetched primary data is valid. [2025-09-23T19:25:40.576789] [DEBUG] [LOCAL ] IGD: Saving primary data. [2025-09-23T19:25:40.577566] [DEBUG] [LOCAL ] IGD: Trimmed 29283 records to 18878 (keeping 200 days of data) [2025-09-23T19:25:40.695738] [DEBUG] [LOCAL ] IGD: Primary data saved (18878 records). [2025-09-23T19:25:40.695889] [INFO ] [MAIN ] IGD: Full history saved. [2025-09-23T19:25:40.696009] [INFO ] [MAIN ] Update Progress: 1098/2372 symbols completed. IGD took 38.7s. Estimated remaining: 2h 48m 58s. Rate: 7.5 symbols/min [2025-09-23T19:25:40.875065] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:25:40.904521] [DEBUG] [LOCAL ] IHG: Loaded 24753 existing records from primary storage. [2025-09-23T19:25:40.904700] [INFO ] [MAIN ] IHG: Loaded 24753 existing records. [2025-09-23T19:25:41.007441] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-03. [2025-09-23T19:25:41.134132] [WARN ] [MAIN ] IHG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:25:41.134391] [INFO ] [MAIN ] IHG: Wiping existing primary data before full refresh. [2025-09-23T19:25:41.134441] [INFO ] [LOCAL ] IHG: Starting deletion of primary data. [2025-09-23T19:25:41.135443] [DEBUG] [LOCAL ] IHG: Deleted primary data file. [2025-09-23T19:25:41.135509] [INFO ] [MAIN ] IHG: Starting full primary refresh. [2025-09-23T19:25:41.517959] [INFO ] [REMOTE ] IHG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:25:41.611544] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-23T19:25:41.625131] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-23T19:25:41.802200] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-09. [2025-09-23T19:25:42.602199] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-04. [2025-09-23T19:25:43.075092] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-23T19:25:43.080246] [INFO ] [REMOTE ] IGR: Full fetch complete (45777 records). [2025-09-23T19:25:43.080340] [DEBUG] [VALIDATOR ] IGR: Validating primary data. [2025-09-23T19:25:43.195695] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-23T19:25:43.405834] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-02. [2025-09-23T19:25:43.507004] [DEBUG] [VALIDATOR ] IGR: All expected trading days are present. [2025-09-23T19:25:43.507116] [DEBUG] [VALIDATOR ] IGR: Primary data validation passed. [2025-09-23T19:25:43.507883] [INFO ] [MAIN ] IGR: Fetched primary data is valid. [2025-09-23T19:25:43.507956] [DEBUG] [LOCAL ] IGR: Saving primary data. [2025-09-23T19:25:43.509310] [DEBUG] [LOCAL ] IGR: Trimmed 45777 records to 30548 (keeping 200 days of data) [2025-09-23T19:25:43.698561] [DEBUG] [LOCAL ] IGR: Primary data saved (30548 records). [2025-09-23T19:25:43.698750] [INFO ] [MAIN ] IGR: Full history saved. [2025-09-23T19:25:43.698881] [INFO ] [MAIN ] Update Progress: 1099/2372 symbols completed. IGR took 32.9s. Estimated remaining: 2h 48m 44s. Rate: 7.5 symbols/min [2025-09-23T19:25:43.873711] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:25:43.912830] [DEBUG] [LOCAL ] IHS: Loaded 38999 existing records from primary storage. [2025-09-23T19:25:43.913000] [INFO ] [MAIN ] IHS: Loaded 38999 existing records. [2025-09-23T19:25:44.099306] [WARN ] [MAIN ] IHS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:25:44.099617] [INFO ] [MAIN ] IHS: Wiping existing primary data before full refresh. [2025-09-23T19:25:44.099695] [INFO ] [LOCAL ] IHS: Starting deletion of primary data. [2025-09-23T19:25:44.101025] [DEBUG] [LOCAL ] IHS: Deleted primary data file. [2025-09-23T19:25:44.101087] [INFO ] [MAIN ] IHS: Starting full primary refresh. [2025-09-23T19:25:44.204465] [INFO ] [REMOTE ] IHG: Fetching primary data for 2024-12. [2025-09-23T19:25:44.260094] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-23T19:25:44.474100] [INFO ] [REMOTE ] IHS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:25:45.002213] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-05. [2025-09-23T19:25:45.110554] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-23T19:25:45.422821] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-23T19:25:45.802204] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-06. [2025-09-23T19:25:46.237092] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-23T19:25:46.602235] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-07. [2025-09-23T19:25:47.281748] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-23T19:25:47.402209] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-08. [2025-09-23T19:25:47.949610] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-23T19:25:48.202243] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-01. [2025-09-23T19:25:49.002254] [INFO ] [REMOTE ] IHS: Fetching primary data for 2024-12. [2025-09-23T19:25:49.165220] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-23T19:25:49.802209] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-03. [2025-09-23T19:25:50.346166] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-23T19:25:50.560034] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-23T19:25:50.602231] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-04. [2025-09-23T19:25:51.266313] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-23T19:25:51.402278] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-09. [2025-09-23T19:25:51.979078] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-23T19:25:51.980266] [INFO ] [REMOTE ] IH: Full fetch complete (4938 records). [2025-09-23T19:25:51.980345] [DEBUG] [VALIDATOR ] IH: Validating primary data. [2025-09-23T19:25:52.207415] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-05. [2025-09-23T19:25:52.348893] [DEBUG] [VALIDATOR ] IH: All expected trading days are present. [2025-09-23T19:25:52.348976] [DEBUG] [VALIDATOR ] IH: Primary data validation passed. [2025-09-23T19:25:52.349119] [INFO ] [MAIN ] IH: Fetched primary data is valid. [2025-09-23T19:25:52.349156] [DEBUG] [LOCAL ] IH: Saving primary data. [2025-09-23T19:25:52.349518] [DEBUG] [LOCAL ] IH: Trimmed 4938 records to 3505 (keeping 200 days of data) [2025-09-23T19:25:52.369629] [DEBUG] [LOCAL ] IH: Primary data saved (3505 records). [2025-09-23T19:25:52.369718] [INFO ] [MAIN ] IH: Full history saved. [2025-09-23T19:25:52.369804] [INFO ] [MAIN ] Update Progress: 1100/2372 symbols completed. IH took 25.4s. Estimated remaining: 2h 48m 37s. Rate: 7.5 symbols/min [2025-09-23T19:25:52.535211] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:25:52.545402] [DEBUG] [LOCAL ] IIF: Loaded 5789 existing records from primary storage. [2025-09-23T19:25:52.545519] [INFO ] [MAIN ] IIF: Loaded 5789 existing records. [2025-09-23T19:25:52.720101] [WARN ] [MAIN ] IIF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:25:52.720312] [INFO ] [MAIN ] IIF: Wiping existing primary data before full refresh. [2025-09-23T19:25:52.720357] [INFO ] [LOCAL ] IIF: Starting deletion of primary data. [2025-09-23T19:25:52.722033] [DEBUG] [LOCAL ] IIF: Deleted primary data file. [2025-09-23T19:25:52.722094] [INFO ] [MAIN ] IIF: Starting full primary refresh. [2025-09-23T19:25:53.009425] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-01. [2025-09-23T19:25:53.085605] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-23T19:25:53.085210] [INFO ] [REMOTE ] IIF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:25:53.802206] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-02. [2025-09-23T19:25:54.246356] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-23T19:25:54.602213] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-02. [2025-09-23T19:25:54.667677] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-23T19:25:55.402261] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-03. [2025-09-23T19:25:55.595440] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-23T19:25:56.202297] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-06. [2025-09-23T19:25:56.614335] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-23T19:25:56.671837] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-23T19:25:57.002257] [INFO ] [REMOTE ] IIF: Fetching primary data for 2024-12. [2025-09-23T19:25:57.720403] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-23T19:25:57.802198] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-03. [2025-09-23T19:25:58.602207] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-01. [2025-09-23T19:25:59.284554] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-23T19:25:59.352610] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-23T19:25:59.402169] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-04. [2025-09-23T19:26:00.202197] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-04. [2025-09-23T19:26:00.836439] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-23T19:26:01.002219] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-07. [2025-09-23T19:26:01.430851] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-23T19:26:01.601711] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-23T19:26:01.802201] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-02. [2025-09-23T19:26:02.495035] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-23T19:26:02.602231] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-03. [2025-09-23T19:26:02.988296] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-23T19:26:03.402209] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-04. [2025-09-23T19:26:04.192190] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-23T19:26:04.202142] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-05. [2025-09-23T19:26:04.926511] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-23T19:26:05.002190] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-06. [2025-09-23T19:26:05.623865] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-23T19:26:05.802204] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-07. [2025-09-23T19:26:06.504983] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-23T19:26:06.602223] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-05. [2025-09-23T19:26:07.402214] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-05. [2025-09-23T19:26:07.782663] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-23T19:26:08.202251] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-08. [2025-09-23T19:26:08.794554] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-23T19:26:09.002236] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-08. [2025-09-23T19:26:09.182279] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-23T19:26:09.714410] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-23T19:26:09.802261] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-09. [2025-09-23T19:26:10.262090] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-23T19:26:10.264033] [INFO ] [REMOTE ] IIF: Full fetch complete (9645 records). [2025-09-23T19:26:10.264190] [DEBUG] [VALIDATOR ] IIF: Validating primary data. [2025-09-23T19:26:10.611776] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-06. [2025-09-23T19:26:10.726982] [DEBUG] [VALIDATOR ] IIF: All expected trading days are present. [2025-09-23T19:26:10.727208] [DEBUG] [VALIDATOR ] IIF: Primary data validation passed. [2025-09-23T19:26:10.727560] [INFO ] [MAIN ] IIF: Fetched primary data is valid. [2025-09-23T19:26:10.727606] [DEBUG] [LOCAL ] IIF: Saving primary data. [2025-09-23T19:26:10.728206] [DEBUG] [LOCAL ] IIF: Trimmed 9645 records to 5769 (keeping 200 days of data) [2025-09-23T19:26:10.765300] [DEBUG] [LOCAL ] IIF: Primary data saved (5769 records). [2025-09-23T19:26:10.765464] [INFO ] [MAIN ] IIF: Full history saved. [2025-09-23T19:26:10.765563] [INFO ] [MAIN ] Update Progress: 1101/2372 symbols completed. IIF took 18.4s. Estimated remaining: 2h 48m 41s. Rate: 7.5 symbols/min [2025-09-23T19:26:10.933749] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:26:10.952915] [DEBUG] [LOCAL ] IIIN: Loaded 16813 existing records from primary storage. [2025-09-23T19:26:10.953124] [INFO ] [MAIN ] IIIN: Loaded 16813 existing records. [2025-09-23T19:26:11.130081] [WARN ] [MAIN ] IIIN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:26:11.130370] [INFO ] [MAIN ] IIIN: Wiping existing primary data before full refresh. [2025-09-23T19:26:11.130419] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-09-23T19:26:11.131059] [DEBUG] [LOCAL ] IIIN: Deleted primary data file. [2025-09-23T19:26:11.131121] [INFO ] [MAIN ] IIIN: Starting full primary refresh. [2025-09-23T19:26:11.409504] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-06. [2025-09-23T19:26:11.496121] [INFO ] [REMOTE ] IIIN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:26:11.911697] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-23T19:26:12.202193] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2024-12. [2025-09-23T19:26:12.927168] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-23T19:26:13.002207] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-07. [2025-09-23T19:26:13.196524] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-23T19:26:13.802198] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-01. [2025-09-23T19:26:14.006769] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-23T19:26:14.602174] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-07. [2025-09-23T19:26:14.877833] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-23T19:26:15.402155] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-09. [2025-09-23T19:26:15.795551] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-23T19:26:16.193255] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-23T19:26:16.195938] [INFO ] [REMOTE ] IHD: Full fetch complete (11909 records). [2025-09-23T19:26:16.196073] [DEBUG] [VALIDATOR ] IHD: Validating primary data. [2025-09-23T19:26:16.208841] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-08. [2025-09-23T19:26:16.581499] [DEBUG] [VALIDATOR ] IHD: All expected trading days are present. [2025-09-23T19:26:16.581603] [DEBUG] [VALIDATOR ] IHD: Primary data validation passed. [2025-09-23T19:26:16.581951] [INFO ] [MAIN ] IHD: Fetched primary data is valid. [2025-09-23T19:26:16.582014] [DEBUG] [LOCAL ] IHD: Saving primary data. [2025-09-23T19:26:16.582793] [DEBUG] [LOCAL ] IHD: Trimmed 11909 records to 7247 (keeping 200 days of data) [2025-09-23T19:26:16.629035] [DEBUG] [LOCAL ] IHD: Primary data saved (7247 records). [2025-09-23T19:26:16.629191] [INFO ] [MAIN ] IHD: Full history saved. [2025-09-23T19:26:16.629280] [INFO ] [MAIN ] Update Progress: 1102/2372 symbols completed. IHD took 42.6s. Estimated remaining: 2h 48m 31s. Rate: 7.5 symbols/min [2025-09-23T19:26:16.820500] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:26:16.840148] [DEBUG] [LOCAL ] IIM: Loaded 15903 existing records from primary storage. [2025-09-23T19:26:16.840302] [INFO ] [MAIN ] IIM: Loaded 15903 existing records. [2025-09-23T19:26:17.002287] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-02. [2025-09-23T19:26:17.026954] [WARN ] [MAIN ] IIM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:26:17.028328] [INFO ] [MAIN ] IIM: Wiping existing primary data before full refresh. [2025-09-23T19:26:17.028382] [INFO ] [LOCAL ] IIM: Starting deletion of primary data. [2025-09-23T19:26:17.029178] [DEBUG] [LOCAL ] IIM: Deleted primary data file. [2025-09-23T19:26:17.029337] [INFO ] [MAIN ] IIM: Starting full primary refresh. [2025-09-23T19:26:17.399098] [INFO ] [REMOTE ] IIM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:26:17.421781] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-23T19:26:17.802183] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-09. [2025-09-23T19:26:17.945389] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-23T19:26:18.602190] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-03. [2025-09-23T19:26:19.210552] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-23T19:26:19.216212] [INFO ] [REMOTE ] IHS: Full fetch complete (52488 records). [2025-09-23T19:26:19.216316] [DEBUG] [VALIDATOR ] IHS: Validating primary data. [2025-09-23T19:26:19.407472] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-08. [2025-09-23T19:26:19.613277] [DEBUG] [VALIDATOR ] IHS: All expected trading days are present. [2025-09-23T19:26:19.613427] [DEBUG] [VALIDATOR ] IHS: Primary data validation passed. [2025-09-23T19:26:19.614283] [INFO ] [MAIN ] IHS: Fetched primary data is valid. [2025-09-23T19:26:19.614351] [DEBUG] [LOCAL ] IHS: Saving primary data. [2025-09-23T19:26:19.615794] [DEBUG] [LOCAL ] IHS: Trimmed 52488 records to 39033 (keeping 200 days of data) [2025-09-23T19:26:19.715444] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-23T19:26:19.858035] [DEBUG] [LOCAL ] IHS: Primary data saved (39033 records). [2025-09-23T19:26:19.858187] [INFO ] [MAIN ] IHS: Full history saved. [2025-09-23T19:26:19.858272] [INFO ] [MAIN ] Update Progress: 1103/2372 symbols completed. IHS took 36.2s. Estimated remaining: 2h 48m 18s. Rate: 7.5 symbols/min [2025-09-23T19:26:20.027499] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:26:20.058110] [DEBUG] [LOCAL ] IIPR: Loaded 29620 existing records from primary storage. [2025-09-23T19:26:20.058292] [INFO ] [MAIN ] IIPR: Loaded 29620 existing records. [2025-09-23T19:26:20.202711] [INFO ] [REMOTE ] IIM: Fetching primary data for 2024-12. [2025-09-23T19:26:20.247318] [WARN ] [MAIN ] IIPR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:26:20.247741] [INFO ] [MAIN ] IIPR: Wiping existing primary data before full refresh. [2025-09-23T19:26:20.247888] [INFO ] [LOCAL ] IIPR: Starting deletion of primary data. [2025-09-23T19:26:20.254080] [DEBUG] [LOCAL ] IIPR: Deleted primary data file. [2025-09-23T19:26:20.262404] [INFO ] [MAIN ] IIPR: Starting full primary refresh. [2025-09-23T19:26:20.286576] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-23T19:26:20.641411] [INFO ] [REMOTE ] IIPR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:26:21.005841] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-04. [2025-09-23T19:26:21.008204] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-23T19:26:21.802192] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2024-12. [2025-09-23T19:26:22.097419] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-23T19:26:22.602206] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-09. [2025-09-23T19:26:23.243757] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-23T19:26:23.407992] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-05. [2025-09-23T19:26:23.412526] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-23T19:26:23.417460] [INFO ] [REMOTE ] IHG: Full fetch complete (33478 records). [2025-09-23T19:26:23.417583] [DEBUG] [VALIDATOR ] IHG: Validating primary data. [2025-09-23T19:26:23.794425] [DEBUG] [VALIDATOR ] IHG: All expected trading days are present. [2025-09-23T19:26:23.794511] [DEBUG] [VALIDATOR ] IHG: Primary data validation passed. [2025-09-23T19:26:23.795228] [INFO ] [MAIN ] IHG: Fetched primary data is valid. [2025-09-23T19:26:23.795292] [DEBUG] [LOCAL ] IHG: Saving primary data. [2025-09-23T19:26:23.796112] [DEBUG] [LOCAL ] IHG: Trimmed 33478 records to 24663 (keeping 200 days of data) [2025-09-23T19:26:23.954415] [DEBUG] [LOCAL ] IHG: Primary data saved (24663 records). [2025-09-23T19:26:23.954579] [INFO ] [MAIN ] IHG: Full history saved. [2025-09-23T19:26:23.954693] [INFO ] [MAIN ] Update Progress: 1104/2372 symbols completed. IHG took 43.3s. Estimated remaining: 2h 48m 5s. Rate: 7.5 symbols/min [2025-09-23T19:26:24.139416] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:26:24.185608] [DEBUG] [LOCAL ] IMAX: Loaded 42779 existing records from primary storage. [2025-09-23T19:26:24.185931] [INFO ] [MAIN ] IMAX: Loaded 42779 existing records. [2025-09-23T19:26:24.207299] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-01. [2025-09-23T19:26:24.382588] [WARN ] [MAIN ] IMAX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:26:24.382873] [INFO ] [MAIN ] IMAX: Wiping existing primary data before full refresh. [2025-09-23T19:26:24.382924] [INFO ] [LOCAL ] IMAX: Starting deletion of primary data. [2025-09-23T19:26:24.384601] [DEBUG] [LOCAL ] IMAX: Deleted primary data file. [2025-09-23T19:26:24.384724] [INFO ] [MAIN ] IMAX: Starting full primary refresh. [2025-09-23T19:26:24.505324] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-23T19:26:24.769700] [INFO ] [REMOTE ] IMAX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:26:25.002197] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2024-12. [2025-09-23T19:26:25.565865] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-23T19:26:25.802185] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-02. [2025-09-23T19:26:26.029572] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-23T19:26:26.602197] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-01. [2025-09-23T19:26:27.110256] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-23T19:26:27.402200] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-01. [2025-09-23T19:26:27.922439] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-23T19:26:28.202260] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-03. [2025-09-23T19:26:28.611900] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-23T19:26:29.002234] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-06. [2025-09-23T19:26:29.603486] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-23T19:26:29.802175] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-02. [2025-09-23T19:26:29.909390] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-23T19:26:30.602195] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-07. [2025-09-23T19:26:31.227398] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-23T19:26:31.402212] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-04. [2025-09-23T19:26:31.675935] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-23T19:26:32.202199] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-08. [2025-09-23T19:26:32.807979] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-23T19:26:32.987603] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-23T19:26:33.002155] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-09. [2025-09-23T19:26:33.802237] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-02. [2025-09-23T19:26:33.971269] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-23T19:26:33.975201] [INFO ] [REMOTE ] IIIN: Full fetch complete (25182 records). [2025-09-23T19:26:33.975293] [DEBUG] [VALIDATOR ] IIIN: Validating primary data. [2025-09-23T19:26:34.343500] [DEBUG] [VALIDATOR ] IIIN: All expected trading days are present. [2025-09-23T19:26:34.343590] [DEBUG] [VALIDATOR ] IIIN: Primary data validation passed. [2025-09-23T19:26:34.344210] [INFO ] [MAIN ] IIIN: Fetched primary data is valid. [2025-09-23T19:26:34.344276] [DEBUG] [LOCAL ] IIIN: Saving primary data. [2025-09-23T19:26:34.345051] [DEBUG] [LOCAL ] IIIN: Trimmed 25182 records to 16764 (keeping 200 days of data) [2025-09-23T19:26:34.457771] [DEBUG] [LOCAL ] IIIN: Primary data saved (16764 records). [2025-09-23T19:26:34.457929] [INFO ] [MAIN ] IIIN: Full history saved. [2025-09-23T19:26:34.458033] [INFO ] [MAIN ] Update Progress: 1105/2372 symbols completed. IIIN took 23.7s. Estimated remaining: 2h 48m 0s. Rate: 7.5 symbols/min [2025-09-23T19:26:34.603741] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-05. [2025-09-23T19:26:34.637740] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:26:34.655879] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-23T19:26:34.720220] [DEBUG] [LOCAL ] INFA: Loaded 50099 existing records from primary storage. [2025-09-23T19:26:34.720409] [INFO ] [MAIN ] INFA: Loaded 50099 existing records. [2025-09-23T19:26:34.904541] [WARN ] [MAIN ] INFA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:26:34.904860] [INFO ] [MAIN ] INFA: Wiping existing primary data before full refresh. [2025-09-23T19:26:34.904943] [INFO ] [LOCAL ] INFA: Starting deletion of primary data. [2025-09-23T19:26:34.906257] [DEBUG] [LOCAL ] INFA: Deleted primary data file. [2025-09-23T19:26:34.906318] [INFO ] [MAIN ] INFA: Starting full primary refresh. [2025-09-23T19:26:35.278424] [INFO ] [REMOTE ] INFA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:26:35.402211] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-03. [2025-09-23T19:26:35.925186] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-23T19:26:36.202177] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-06. [2025-09-23T19:26:36.626555] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-23T19:26:37.002188] [INFO ] [REMOTE ] INFA: Fetching primary data for 2024-12. [2025-09-23T19:26:37.063343] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-23T19:26:37.802273] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-07. [2025-09-23T19:26:38.602175] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-04. [2025-09-23T19:26:38.687457] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-23T19:26:38.761207] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-23T19:26:39.220525] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-23T19:26:39.402242] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-05. [2025-09-23T19:26:39.941313] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-23T19:26:40.202207] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-03. [2025-09-23T19:26:41.002215] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-01. [2025-09-23T19:26:41.719213] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-23T19:26:41.802258] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-04. [2025-09-23T19:26:42.171339] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-23T19:26:42.602271] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-02. [2025-09-23T19:26:43.402208] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-06. [2025-09-23T19:26:43.484320] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-23T19:26:44.202221] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-05. [2025-09-23T19:26:44.368114] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-23T19:26:44.437840] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-23T19:26:45.002185] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-07. [2025-09-23T19:26:45.579917] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-23T19:26:45.609186] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-23T19:26:45.802196] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-06. [2025-09-23T19:26:46.602221] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-08. [2025-09-23T19:26:47.177342] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-23T19:26:47.234740] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-23T19:26:47.402219] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-09. [2025-09-23T19:26:48.202217] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-08. [2025-09-23T19:26:48.405731] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-23T19:26:48.409109] [INFO ] [REMOTE ] IIM: Full fetch complete (25360 records). [2025-09-23T19:26:48.409183] [DEBUG] [VALIDATOR ] IIM: Validating primary data. [2025-09-23T19:26:48.772385] [DEBUG] [VALIDATOR ] IIM: All expected trading days are present. [2025-09-23T19:26:48.772481] [DEBUG] [VALIDATOR ] IIM: Primary data validation passed. [2025-09-23T19:26:48.773121] [INFO ] [MAIN ] IIM: Fetched primary data is valid. [2025-09-23T19:26:48.773188] [DEBUG] [LOCAL ] IIM: Saving primary data. [2025-09-23T19:26:48.775049] [DEBUG] [LOCAL ] IIM: Trimmed 25360 records to 15910 (keeping 200 days of data) [2025-09-23T19:26:48.875120] [DEBUG] [LOCAL ] IIM: Primary data saved (15910 records). [2025-09-23T19:26:48.875270] [INFO ] [MAIN ] IIM: Full history saved. [2025-09-23T19:26:48.875936] [INFO ] [MAIN ] Update Progress: 1106/2372 symbols completed. IIM took 32.2s. Estimated remaining: 2h 47m 60s. Rate: 7.5 symbols/min [2025-09-23T19:26:49.007524] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-03. [2025-09-23T19:26:49.065679] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:26:49.127546] [DEBUG] [LOCAL ] INFY: Loaded 53601 existing records from primary storage. [2025-09-23T19:26:49.127749] [INFO ] [MAIN ] INFY: Loaded 53601 existing records. [2025-09-23T19:26:49.323030] [WARN ] [MAIN ] INFY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:26:49.323288] [INFO ] [MAIN ] INFY: Wiping existing primary data before full refresh. [2025-09-23T19:26:49.323338] [INFO ] [LOCAL ] INFY: Starting deletion of primary data. [2025-09-23T19:26:49.325069] [DEBUG] [LOCAL ] INFY: Deleted primary data file. [2025-09-23T19:26:49.325131] [INFO ] [MAIN ] INFY: Starting full primary refresh. [2025-09-23T19:26:49.707456] [INFO ] [REMOTE ] INFY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:26:49.733993] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-23T19:26:49.802201] [INFO ] [REMOTE ] INFY: Fetching primary data for 2024-12. [2025-09-23T19:26:50.408084] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-23T19:26:50.602230] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-09. [2025-09-23T19:26:51.402173] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-04. [2025-09-23T19:26:51.819398] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-23T19:26:51.990925] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-23T19:26:51.996558] [INFO ] [REMOTE ] IIPR: Full fetch complete (44093 records). [2025-09-23T19:26:51.996699] [DEBUG] [VALIDATOR ] IIPR: Validating primary data. [2025-09-23T19:26:52.210288] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-07. [2025-09-23T19:26:52.422451] [DEBUG] [VALIDATOR ] IIPR: All expected trading days are present. [2025-09-23T19:26:52.422633] [DEBUG] [VALIDATOR ] IIPR: Primary data validation passed. [2025-09-23T19:26:52.423973] [INFO ] [MAIN ] IIPR: Fetched primary data is valid. [2025-09-23T19:26:52.424043] [DEBUG] [LOCAL ] IIPR: Saving primary data. [2025-09-23T19:26:52.425796] [DEBUG] [LOCAL ] IIPR: Trimmed 44093 records to 29629 (keeping 200 days of data) [2025-09-23T19:26:52.607084] [DEBUG] [LOCAL ] IIPR: Primary data saved (29629 records). [2025-09-23T19:26:52.607236] [INFO ] [MAIN ] IIPR: Full history saved. [2025-09-23T19:26:52.607324] [INFO ] [MAIN ] Update Progress: 1107/2372 symbols completed. IIPR took 32.7s. Estimated remaining: 2h 47m 47s. Rate: 7.5 symbols/min [2025-09-23T19:26:52.787328] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:26:52.838441] [DEBUG] [LOCAL ] ING: Loaded 50823 existing records from primary storage. [2025-09-23T19:26:52.838603] [INFO ] [MAIN ] ING: Loaded 50823 existing records. [2025-09-23T19:26:53.002475] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-01. [2025-09-23T19:26:53.035980] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-23T19:26:53.086978] [WARN ] [MAIN ] ING: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:26:53.087288] [INFO ] [MAIN ] ING: Wiping existing primary data before full refresh. [2025-09-23T19:26:53.087343] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-09-23T19:26:53.089030] [DEBUG] [LOCAL ] ING: Deleted primary data file. [2025-09-23T19:26:53.089101] [INFO ] [MAIN ] ING: Starting full primary refresh. [2025-09-23T19:26:53.460878] [INFO ] [REMOTE ] ING: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:26:53.802226] [INFO ] [REMOTE ] ING: Fetching primary data for 2024-12. [2025-09-23T19:26:53.932954] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-23T19:26:54.472304] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-23T19:26:54.602165] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-02. [2025-09-23T19:26:55.141503] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-23T19:26:55.402200] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-05. [2025-09-23T19:26:56.202197] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-08. [2025-09-23T19:26:56.267506] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-23T19:26:57.002169] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-03. [2025-09-23T19:26:57.106358] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-23T19:26:57.315795] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-23T19:26:57.802260] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-09. [2025-09-23T19:26:58.602172] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-01. [2025-09-23T19:26:58.895787] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-23T19:26:58.932894] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-23T19:26:58.941096] [INFO ] [REMOTE ] IMAX: Full fetch complete (59448 records). [2025-09-23T19:26:58.941364] [DEBUG] [VALIDATOR ] IMAX: Validating primary data. [2025-09-23T19:26:59.361103] [DEBUG] [VALIDATOR ] IMAX: All expected trading days are present. [2025-09-23T19:26:59.361253] [DEBUG] [VALIDATOR ] IMAX: Primary data validation passed. [2025-09-23T19:26:59.362125] [INFO ] [MAIN ] IMAX: Fetched primary data is valid. [2025-09-23T19:26:59.362190] [DEBUG] [LOCAL ] IMAX: Saving primary data. [2025-09-23T19:26:59.363609] [DEBUG] [LOCAL ] IMAX: Trimmed 59448 records to 42766 (keeping 200 days of data) [2025-09-23T19:26:59.416290] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-04. [2025-09-23T19:26:59.617914] [DEBUG] [LOCAL ] IMAX: Primary data saved (42766 records). [2025-09-23T19:26:59.618061] [INFO ] [MAIN ] IMAX: Full history saved. [2025-09-23T19:26:59.618145] [INFO ] [MAIN ] Update Progress: 1108/2372 symbols completed. IMAX took 35.7s. Estimated remaining: 2h 47m 38s. Rate: 7.5 symbols/min [2025-09-23T19:26:59.788503] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:26:59.821154] [DEBUG] [LOCAL ] INGM: Loaded 28926 existing records from primary storage. [2025-09-23T19:26:59.821315] [INFO ] [MAIN ] INGM: Loaded 28926 existing records. [2025-09-23T19:27:00.037262] [WARN ] [MAIN ] INGM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:27:00.037761] [INFO ] [MAIN ] INGM: Wiping existing primary data before full refresh. [2025-09-23T19:27:00.037818] [INFO ] [LOCAL ] INGM: Starting deletion of primary data. [2025-09-23T19:27:00.038886] [DEBUG] [LOCAL ] INGM: Deleted primary data file. [2025-09-23T19:27:00.038948] [INFO ] [MAIN ] INGM: Starting full primary refresh. [2025-09-23T19:27:00.203995] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-06. [2025-09-23T19:27:00.395829] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-23T19:27:00.490725] [INFO ] [REMOTE ] INGM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:27:01.002289] [INFO ] [REMOTE ] INGM: Fetching primary data for 2024-12. [2025-09-23T19:27:01.265526] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-23T19:27:01.802294] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-05. [2025-09-23T19:27:02.079945] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-23T19:27:02.602277] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-02. [2025-09-23T19:27:02.891874] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-23T19:27:03.402197] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-01. [2025-09-23T19:27:04.202227] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-07. [2025-09-23T19:27:05.169289] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-23T19:27:05.175688] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-02. [2025-09-23T19:27:05.774323] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-05 (3.97 seconds). [2025-09-23T19:27:05.807237] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-06. [2025-09-23T19:27:05.821171] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-02 (3.22 seconds). [2025-09-23T19:27:05.864999] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-23T19:27:05.942970] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-23T19:27:06.602204] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-03. [2025-09-23T19:27:07.127199] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-23T19:27:07.402210] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-07. [2025-09-23T19:27:07.997968] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-23T19:27:08.202207] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-04. [2025-09-23T19:27:08.792399] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-23T19:27:09.002204] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-03. [2025-09-23T19:27:09.585985] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-23T19:27:09.802215] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-08. [2025-09-23T19:27:10.602177] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-05. [2025-09-23T19:27:10.755493] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-23T19:27:11.174274] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-23T19:27:11.402164] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-04. [2025-09-23T19:27:11.446858] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-23T19:27:12.202202] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-09. [2025-09-23T19:27:13.002198] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-06. [2025-09-23T19:27:13.298438] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-23T19:27:13.543872] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-23T19:27:13.553765] [INFO ] [REMOTE ] INFA: Full fetch complete (71864 records). [2025-09-23T19:27:13.553916] [DEBUG] [VALIDATOR ] INFA: Validating primary data. [2025-09-23T19:27:13.808914] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-05. [2025-09-23T19:27:13.962422] [DEBUG] [VALIDATOR ] INFA: All expected trading days are present. [2025-09-23T19:27:13.962531] [DEBUG] [VALIDATOR ] INFA: Primary data validation passed. [2025-09-23T19:27:13.963553] [INFO ] [MAIN ] INFA: Fetched primary data is valid. [2025-09-23T19:27:13.963617] [DEBUG] [LOCAL ] INFA: Saving primary data. [2025-09-23T19:27:13.967234] [DEBUG] [LOCAL ] INFA: Trimmed 71864 records to 50032 (keeping 200 days of data) [2025-09-23T19:27:14.261803] [DEBUG] [LOCAL ] INFA: Primary data saved (50032 records). [2025-09-23T19:27:14.261952] [INFO ] [MAIN ] INFA: Full history saved. [2025-09-23T19:27:14.262038] [INFO ] [MAIN ] Update Progress: 1109/2372 symbols completed. INFA took 39.8s. Estimated remaining: 2h 47m 37s. Rate: 7.5 symbols/min [2025-09-23T19:27:14.433474] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:27:14.473520] [DEBUG] [LOCAL ] INGR: Loaded 33393 existing records from primary storage. [2025-09-23T19:27:14.473720] [INFO ] [MAIN ] INGR: Loaded 33393 existing records. [2025-09-23T19:27:14.615711] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-08. [2025-09-23T19:27:14.658143] [WARN ] [MAIN ] INGR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:27:14.658408] [INFO ] [MAIN ] INGR: Wiping existing primary data before full refresh. [2025-09-23T19:27:14.658455] [INFO ] [LOCAL ] INGR: Starting deletion of primary data. [2025-09-23T19:27:14.659346] [DEBUG] [LOCAL ] INGR: Deleted primary data file. [2025-09-23T19:27:14.659407] [INFO ] [MAIN ] INGR: Starting full primary refresh. [2025-09-23T19:27:14.940063] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-23T19:27:15.087904] [INFO ] [REMOTE ] INGR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:27:15.402203] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-07. [2025-09-23T19:27:16.202211] [INFO ] [REMOTE ] INGR: Fetching primary data for 2024-12. [2025-09-23T19:27:16.619326] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-23T19:27:16.762831] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-05 (2.95 seconds). [2025-09-23T19:27:17.002183] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-06. [2025-09-23T19:27:17.126567] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-08 (2.51 seconds). [2025-09-23T19:27:17.188446] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-23T19:27:17.802206] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-01. [2025-09-23T19:27:18.602267] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-08. [2025-09-23T19:27:18.668494] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-23T19:27:19.199166] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-23T19:27:19.402182] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-02. [2025-09-23T19:27:19.715793] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-23T19:27:20.202226] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-07. [2025-09-23T19:27:20.667516] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-23T19:27:21.002230] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-09. [2025-09-23T19:27:21.806895] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-03. [2025-09-23T19:27:21.820438] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-23T19:27:22.602184] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-09. [2025-09-23T19:27:22.859789] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-23T19:27:22.870207] [INFO ] [REMOTE ] INFY: Full fetch complete (77535 records). [2025-09-23T19:27:22.870429] [DEBUG] [VALIDATOR ] INFY: Validating primary data. [2025-09-23T19:27:23.301379] [DEBUG] [VALIDATOR ] INFY: All expected trading days are present. [2025-09-23T19:27:23.301767] [DEBUG] [VALIDATOR ] INFY: Primary data validation passed. [2025-09-23T19:27:23.302933] [INFO ] [MAIN ] INFY: Fetched primary data is valid. [2025-09-23T19:27:23.303035] [DEBUG] [LOCAL ] INFY: Saving primary data. [2025-09-23T19:27:23.305216] [DEBUG] [LOCAL ] INFY: Trimmed 77535 records to 53600 (keeping 200 days of data) [2025-09-23T19:27:23.407094] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-08. [2025-09-23T19:27:23.467198] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-23T19:27:23.596964] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-23T19:27:23.606252] [INFO ] [REMOTE ] INGM: Full fetch complete (42150 records). [2025-09-23T19:27:23.606944] [DEBUG] [VALIDATOR ] INGM: Validating primary data. [2025-09-23T19:27:24.086211] [DEBUG] [VALIDATOR ] INGM: All expected trading days are present. [2025-09-23T19:27:24.086993] [DEBUG] [VALIDATOR ] INGM: Primary data validation passed. [2025-09-23T19:27:24.087846] [INFO ] [MAIN ] INGM: Fetched primary data is valid. [2025-09-23T19:27:24.088194] [DEBUG] [LOCAL ] INGM: Saving primary data. [2025-09-23T19:27:24.091771] [DEBUG] [LOCAL ] INGM: Trimmed 42150 records to 28874 (keeping 200 days of data) [2025-09-23T19:27:24.203119] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-04. [2025-09-23T19:27:24.215563] [DEBUG] [LOCAL ] INFY: Primary data saved (53600 records). [2025-09-23T19:27:24.216728] [INFO ] [MAIN ] INFY: Full history saved. [2025-09-23T19:27:24.217162] [INFO ] [MAIN ] Update Progress: 1110/2372 symbols completed. INFY took 35.3s. Estimated remaining: 2h 47m 32s. Rate: 7.5 symbols/min [2025-09-23T19:27:24.413058] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:27:24.501147] [DEBUG] [LOCAL ] INN: Loaded 41951 existing records from primary storage. [2025-09-23T19:27:24.502240] [INFO ] [MAIN ] INN: Loaded 41951 existing records. [2025-09-23T19:27:24.635403] [DEBUG] [LOCAL ] INGM: Primary data saved (28874 records). [2025-09-23T19:27:24.641718] [INFO ] [MAIN ] INGM: Full history saved. [2025-09-23T19:27:24.647087] [INFO ] [MAIN ] Update Progress: 1111/2372 symbols completed. INGM took 25.0s. Estimated remaining: 2h 47m 15s. Rate: 7.5 symbols/min [2025-09-23T19:27:24.836615] [WARN ] [MAIN ] INN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:27:24.852769] [INFO ] [MAIN ] INN: Wiping existing primary data before full refresh. [2025-09-23T19:27:24.868349] [INFO ] [LOCAL ] INN: Starting deletion of primary data. [2025-09-23T19:27:24.919176] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:27:24.917387] [DEBUG] [LOCAL ] INN: Deleted primary data file. [2025-09-23T19:27:24.919425] [INFO ] [MAIN ] INN: Starting full primary refresh. [2025-09-23T19:27:24.919518] [DEBUG] [LOCAL ] INR: No existing data file found in primary storage. [2025-09-23T19:27:24.924799] [WARN ] [MAIN ] INR: No existing data found, performing full refresh instead. [2025-09-23T19:27:25.008111] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-09-23T19:27:25.043239] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-09-23T19:27:25.053505] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-09-23T19:27:25.069382] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-09-23T19:27:25.636660] [INFO ] [REMOTE ] INN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:27:25.681940] [INFO ] [REMOTE ] INN: Fetching primary data for 2024-12. [2025-09-23T19:27:25.786485] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-09-23T19:27:25.784417] [INFO ] [REMOTE ] INR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:27:25.806783] [INFO ] [REMOTE ] INR: Fetching primary data for 2024-12. [2025-09-23T19:27:25.820605] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-23T19:27:26.013218] [DEBUG] [REMOTE ] INR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:27:26.013594] [WARN ] [REMOTE ] INR: No data returned for month 2024-12 [2025-09-23T19:27:26.602187] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-05. [2025-09-23T19:27:27.329196] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-23T19:27:27.402143] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-01. [2025-09-23T19:27:28.048404] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-23T19:27:28.202183] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-09. [2025-09-23T19:27:28.671894] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-23T19:27:29.002256] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-02. [2025-09-23T19:27:29.802221] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-06. [2025-09-23T19:27:30.148393] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-23T19:27:30.158299] [INFO ] [REMOTE ] ING: Full fetch complete (73628 records). [2025-09-23T19:27:30.158452] [DEBUG] [VALIDATOR ] ING: Validating primary data. [2025-09-23T19:27:30.493834] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-23T19:27:30.594351] [DEBUG] [VALIDATOR ] ING: All expected trading days are present. [2025-09-23T19:27:30.594464] [DEBUG] [VALIDATOR ] ING: Primary data validation passed. [2025-09-23T19:27:30.596806] [INFO ] [MAIN ] ING: Fetched primary data is valid. [2025-09-23T19:27:30.596871] [DEBUG] [LOCAL ] ING: Saving primary data. [2025-09-23T19:27:30.601095] [DEBUG] [LOCAL ] ING: Trimmed 73628 records to 50806 (keeping 200 days of data) [2025-09-23T19:27:30.602170] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-03. [2025-09-23T19:27:30.926230] [DEBUG] [LOCAL ] ING: Primary data saved (50806 records). [2025-09-23T19:27:30.926381] [INFO ] [MAIN ] ING: Full history saved. [2025-09-23T19:27:30.926503] [INFO ] [MAIN ] Update Progress: 1112/2372 symbols completed. ING took 38.3s. Estimated remaining: 2h 47m 5s. Rate: 7.5 symbols/min [2025-09-23T19:27:31.101495] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:27:31.143146] [DEBUG] [LOCAL ] INSP: Loaded 36812 existing records from primary storage. [2025-09-23T19:27:31.143516] [INFO ] [MAIN ] INSP: Loaded 36812 existing records. [2025-09-23T19:27:31.265350] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-23T19:27:31.354975] [WARN ] [MAIN ] INSP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:27:31.355273] [INFO ] [MAIN ] INSP: Wiping existing primary data before full refresh. [2025-09-23T19:27:31.355344] [INFO ] [LOCAL ] INSP: Starting deletion of primary data. [2025-09-23T19:27:31.356204] [DEBUG] [LOCAL ] INSP: Deleted primary data file. [2025-09-23T19:27:31.356264] [INFO ] [MAIN ] INSP: Starting full primary refresh. [2025-09-23T19:27:31.410544] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-01. [2025-09-23T19:27:31.720994] [INFO ] [REMOTE ] INSP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:27:32.202249] [INFO ] [REMOTE ] INSP: Fetching primary data for 2024-12. [2025-09-23T19:27:32.895324] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-23T19:27:32.935676] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-09-23T19:27:33.002167] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-02. [2025-09-23T19:27:33.802223] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-07. [2025-09-23T19:27:33.922382] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-23T19:27:33.993148] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-23T19:27:34.602221] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-04. [2025-09-23T19:27:35.057808] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-23T19:27:35.402217] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-03. [2025-09-23T19:27:35.829993] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-23T19:27:36.202192] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-05. [2025-09-23T19:27:36.726385] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-23T19:27:37.002194] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-04. [2025-09-23T19:27:37.453109] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-23T19:27:37.802228] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-01. [2025-09-23T19:27:38.145548] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-23T19:27:38.602233] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-05. [2025-09-23T19:27:39.176929] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-23T19:27:39.402242] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-02. [2025-09-23T19:27:39.700491] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-23T19:27:40.202292] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-08. [2025-09-23T19:27:40.523335] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-23T19:27:41.002258] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-03. [2025-09-23T19:27:41.622893] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-23T19:27:41.802199] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-09. [2025-09-23T19:27:42.285176] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-23T19:27:42.602235] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-06. [2025-09-23T19:27:43.296255] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-23T19:27:43.305904] [INFO ] [REMOTE ] INGR: Full fetch complete (49760 records). [2025-09-23T19:27:43.306117] [DEBUG] [VALIDATOR ] INGR: Validating primary data. [2025-09-23T19:27:43.402394] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-06. [2025-09-23T19:27:43.701384] [DEBUG] [VALIDATOR ] INGR: All expected trading days are present. [2025-09-23T19:27:43.701539] [DEBUG] [VALIDATOR ] INGR: Primary data validation passed. [2025-09-23T19:27:43.702509] [INFO ] [MAIN ] INGR: Fetched primary data is valid. [2025-09-23T19:27:43.702579] [DEBUG] [LOCAL ] INGR: Saving primary data. [2025-09-23T19:27:43.703770] [DEBUG] [LOCAL ] INGR: Trimmed 49760 records to 33372 (keeping 200 days of data) [2025-09-23T19:27:43.858384] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-23T19:27:43.972152] [DEBUG] [LOCAL ] INGR: Primary data saved (33372 records). [2025-09-23T19:27:43.972302] [INFO ] [MAIN ] INGR: Full history saved. [2025-09-23T19:27:43.972410] [INFO ] [MAIN ] Update Progress: 1113/2372 symbols completed. INGR took 29.7s. Estimated remaining: 2h 47m 3s. Rate: 7.5 symbols/min [2025-09-23T19:27:44.205828] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:27:44.204694] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-07. [2025-09-23T19:27:44.227030] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-23T19:27:44.271886] [DEBUG] [LOCAL ] INSW: Loaded 40407 existing records from primary storage. [2025-09-23T19:27:44.272056] [INFO ] [MAIN ] INSW: Loaded 40407 existing records. [2025-09-23T19:27:44.447185] [WARN ] [MAIN ] INSW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:27:44.447511] [INFO ] [MAIN ] INSW: Wiping existing primary data before full refresh. [2025-09-23T19:27:44.447560] [INFO ] [LOCAL ] INSW: Starting deletion of primary data. [2025-09-23T19:27:44.448721] [DEBUG] [LOCAL ] INSW: Deleted primary data file. [2025-09-23T19:27:44.448790] [INFO ] [MAIN ] INSW: Starting full primary refresh. [2025-09-23T19:27:44.807023] [INFO ] [REMOTE ] INSW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:27:45.002232] [INFO ] [REMOTE ] INSW: Fetching primary data for 2024-12. [2025-09-23T19:27:45.656238] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-23T19:27:45.802178] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-04. [2025-09-23T19:27:46.562337] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-23T19:27:46.602188] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-01. [2025-09-23T19:27:46.863513] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-23T19:27:47.402221] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-05. [2025-09-23T19:27:48.203841] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-07. [2025-09-23T19:27:48.209251] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-23T19:27:48.860863] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-23T19:27:49.002181] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-06. [2025-09-23T19:27:49.027780] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-23T19:27:49.802207] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-08. [2025-09-23T19:27:50.598091] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-23T19:27:50.604127] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-02. [2025-09-23T19:27:50.624479] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-23T19:27:51.402196] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-09. [2025-09-23T19:27:52.202212] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-07. [2025-09-23T19:27:52.261676] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-23T19:27:52.367619] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-23T19:27:52.372590] [INFO ] [REMOTE ] INR: Full fetch complete (32917 records). [2025-09-23T19:27:52.372708] [DEBUG] [VALIDATOR ] INR: Validating primary data. [2025-09-23T19:27:52.577184] [WARN ] [VALIDATOR ] INR: Validation failed - insufficient historical data. Have 162 unique days, need 200 days [2025-09-23T19:27:52.577691] [FATAL] [MAIN ] INR: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:27:52.577779] [WARN ] [MAIN ] INR: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:27:52.577868] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-09-23T19:27:52.577957] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-09-23T19:27:52.578056] [INFO ] [LOCAL ] INR: Starting deletion of derivative data. [2025-09-23T19:27:52.578164] [DEBUG] [LOCAL ] INR: No derivative data file found to delete. [2025-09-23T19:27:52.578276] [INFO ] [MAIN ] Update Progress: 1114/2372 symbols completed. INR took 27.9s. Estimated remaining: 2h 46m 56s. Rate: 7.5 symbols/min [2025-09-23T19:27:52.757823] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:27:52.814546] [DEBUG] [LOCAL ] INVH: Loaded 53139 existing records from primary storage. [2025-09-23T19:27:52.814869] [INFO ] [MAIN ] INVH: Loaded 53139 existing records. [2025-09-23T19:27:53.003400] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-03. [2025-09-23T19:27:53.003561] [WARN ] [MAIN ] INVH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:27:53.004044] [INFO ] [MAIN ] INVH: Wiping existing primary data before full refresh. [2025-09-23T19:27:53.004744] [INFO ] [LOCAL ] INVH: Starting deletion of primary data. [2025-09-23T19:27:53.006087] [DEBUG] [LOCAL ] INVH: Deleted primary data file. [2025-09-23T19:27:53.006148] [INFO ] [MAIN ] INVH: Starting full primary refresh. [2025-09-23T19:27:53.400945] [INFO ] [REMOTE ] INVH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:27:53.423490] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-23T19:27:53.802192] [INFO ] [REMOTE ] INVH: Fetching primary data for 2024-12. [2025-09-23T19:27:54.452422] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-23T19:27:54.602194] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-04. [2025-09-23T19:27:55.069421] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-23T19:27:55.402191] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-01. [2025-09-23T19:27:56.141083] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-23T19:27:56.202167] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-05. [2025-09-23T19:27:57.002179] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-08. [2025-09-23T19:27:57.234660] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-23T19:27:57.650073] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-23T19:27:57.802196] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-08. [2025-09-23T19:27:58.232585] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-23T19:27:58.602221] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-09. [2025-09-23T19:27:59.402251] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-06. [2025-09-23T19:27:59.608770] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-23T19:27:59.964775] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-23T19:27:59.973199] [INFO ] [REMOTE ] INN: Full fetch complete (57765 records). [2025-09-23T19:27:59.973345] [DEBUG] [VALIDATOR ] INN: Validating primary data. [2025-09-23T19:28:00.207502] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-09. [2025-09-23T19:28:00.366543] [DEBUG] [VALIDATOR ] INN: All expected trading days are present. [2025-09-23T19:28:00.366666] [DEBUG] [VALIDATOR ] INN: Primary data validation passed. [2025-09-23T19:28:00.367526] [INFO ] [MAIN ] INN: Fetched primary data is valid. [2025-09-23T19:28:00.367570] [DEBUG] [LOCAL ] INN: Saving primary data. [2025-09-23T19:28:00.368815] [DEBUG] [LOCAL ] INN: Trimmed 57765 records to 41945 (keeping 200 days of data) [2025-09-23T19:28:00.635300] [DEBUG] [LOCAL ] INN: Primary data saved (41945 records). [2025-09-23T19:28:00.635445] [INFO ] [MAIN ] INN: Full history saved. [2025-09-23T19:28:00.635555] [INFO ] [MAIN ] Update Progress: 1115/2372 symbols completed. INN took 36.4s. Estimated remaining: 2h 46m 48s. Rate: 7.5 symbols/min [2025-09-23T19:28:00.835327] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:28:00.836963] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-23T19:28:00.876036] [DEBUG] [LOCAL ] INVX: Loaded 28990 existing records from primary storage. [2025-09-23T19:28:00.876205] [INFO ] [MAIN ] INVX: Loaded 28990 existing records. [2025-09-23T19:28:01.015483] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-07. [2025-09-23T19:28:01.057810] [WARN ] [MAIN ] INVX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:28:01.058077] [INFO ] [MAIN ] INVX: Wiping existing primary data before full refresh. [2025-09-23T19:28:01.058127] [INFO ] [LOCAL ] INVX: Starting deletion of primary data. [2025-09-23T19:28:01.058884] [DEBUG] [LOCAL ] INVX: Deleted primary data file. [2025-09-23T19:28:01.058946] [INFO ] [MAIN ] INVX: Starting full primary refresh. [2025-09-23T19:28:01.418750] [INFO ] [REMOTE ] INVX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:28:01.802193] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-02. [2025-09-23T19:28:02.063966] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-23T19:28:02.071445] [INFO ] [REMOTE ] INSP: Full fetch complete (52304 records). [2025-09-23T19:28:02.071556] [DEBUG] [VALIDATOR ] INSP: Validating primary data. [2025-09-23T19:28:02.458756] [DEBUG] [VALIDATOR ] INSP: All expected trading days are present. [2025-09-23T19:28:02.458907] [DEBUG] [VALIDATOR ] INSP: Primary data validation passed. [2025-09-23T19:28:02.459779] [INFO ] [MAIN ] INSP: Fetched primary data is valid. [2025-09-23T19:28:02.459941] [DEBUG] [LOCAL ] INSP: Saving primary data. [2025-09-23T19:28:02.461125] [DEBUG] [LOCAL ] INSP: Trimmed 52304 records to 36869 (keeping 200 days of data) [2025-09-23T19:28:02.623527] [INFO ] [REMOTE ] INVX: Fetching primary data for 2024-12. [2025-09-23T19:28:02.685959] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-23T19:28:02.714390] [DEBUG] [LOCAL ] INSP: Primary data saved (36869 records). [2025-09-23T19:28:02.714513] [INFO ] [MAIN ] INSP: Full history saved. [2025-09-23T19:28:02.714590] [INFO ] [MAIN ] Update Progress: 1116/2372 symbols completed. INSP took 31.8s. Estimated remaining: 2h 46m 33s. Rate: 7.5 symbols/min [2025-09-23T19:28:02.883702] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:28:02.940171] [DEBUG] [LOCAL ] IONQ: Loaded 53788 existing records from primary storage. [2025-09-23T19:28:02.940341] [INFO ] [MAIN ] IONQ: Loaded 53788 existing records. [2025-09-23T19:28:03.125583] [WARN ] [MAIN ] IONQ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:28:03.126303] [INFO ] [MAIN ] IONQ: Wiping existing primary data before full refresh. [2025-09-23T19:28:03.126479] [INFO ] [LOCAL ] IONQ: Starting deletion of primary data. [2025-09-23T19:28:03.127970] [DEBUG] [LOCAL ] IONQ: Deleted primary data file. [2025-09-23T19:28:03.128033] [INFO ] [MAIN ] IONQ: Starting full primary refresh. [2025-09-23T19:28:03.375586] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-23T19:28:03.407981] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-08. [2025-09-23T19:28:03.538968] [INFO ] [REMOTE ] IONQ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:28:03.796298] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-23T19:28:04.202196] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-01. [2025-09-23T19:28:04.562772] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-23T19:28:05.002195] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2024-12. [2025-09-23T19:28:05.178779] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-23T19:28:05.802208] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-03. [2025-09-23T19:28:06.602197] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-02. [2025-09-23T19:28:07.402168] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-09. [2025-09-23T19:28:07.643217] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-23T19:28:07.837854] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2024-12 (2.84 seconds). [2025-09-23T19:28:07.865893] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-23T19:28:08.202194] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-04. [2025-09-23T19:28:08.495726] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-23T19:28:08.502438] [INFO ] [REMOTE ] INSW: Full fetch complete (60900 records). [2025-09-23T19:28:08.502575] [DEBUG] [VALIDATOR ] INSW: Validating primary data. [2025-09-23T19:28:08.882594] [DEBUG] [VALIDATOR ] INSW: All expected trading days are present. [2025-09-23T19:28:08.882713] [DEBUG] [VALIDATOR ] INSW: Primary data validation passed. [2025-09-23T19:28:08.883525] [INFO ] [MAIN ] INSW: Fetched primary data is valid. [2025-09-23T19:28:08.883568] [DEBUG] [LOCAL ] INSW: Saving primary data. [2025-09-23T19:28:08.884835] [DEBUG] [LOCAL ] INSW: Trimmed 60900 records to 40407 (keeping 200 days of data) [2025-09-23T19:28:09.003742] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-01. [2025-09-23T19:28:09.134808] [DEBUG] [LOCAL ] INSW: Primary data saved (40407 records). [2025-09-23T19:28:09.134983] [INFO ] [MAIN ] INSW: Full history saved. [2025-09-23T19:28:09.135071] [INFO ] [MAIN ] Update Progress: 1117/2372 symbols completed. INSW took 25.2s. Estimated remaining: 2h 46m 24s. Rate: 7.5 symbols/min [2025-09-23T19:28:09.802269] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-03. [2025-09-23T19:28:10.009197] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-23T19:28:10.602216] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-05. [2025-09-23T19:28:10.666864] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-23T19:28:11.402188] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-04. [2025-09-23T19:28:11.698969] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-01 (2.70 seconds). [2025-09-23T19:28:12.202235] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-02. [2025-09-23T19:28:12.456574] [DEBUG] [REMOTE ] IONQ: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-09-23T19:28:12.457356] [WARN ] [REMOTE ] IONQ: No data returned for month 2025-02 [2025-09-23T19:28:12.501328] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-23T19:28:12.585164] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-23T19:28:13.002228] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-03. [2025-09-23T19:28:13.802187] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-06. [2025-09-23T19:28:14.602254] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-05. [2025-09-23T19:28:15.236748] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-23T19:28:15.402307] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-07. [2025-09-23T19:28:15.841639] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-23T19:28:15.942793] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-03 (2.94 seconds). [2025-09-23T19:28:16.202239] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-06. [2025-09-23T19:28:17.002163] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-04. [2025-09-23T19:28:17.041361] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-23T19:28:17.160843] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-23T19:28:17.802274] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-08. [2025-09-23T19:28:18.602263] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-07. [2025-09-23T19:28:19.375543] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-23T19:28:19.402144] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-09. [2025-09-23T19:28:19.500325] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-09-23T19:28:19.899393] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-23T19:28:20.202202] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-08. [2025-09-23T19:28:21.007258] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-05. [2025-09-23T19:28:21.023917] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-23T19:28:21.033961] [INFO ] [REMOTE ] INVH: Full fetch complete (76681 records). [2025-09-23T19:28:21.034159] [DEBUG] [VALIDATOR ] INVH: Validating primary data. [2025-09-23T19:28:21.458595] [DEBUG] [VALIDATOR ] INVH: All expected trading days are present. [2025-09-23T19:28:21.458766] [DEBUG] [VALIDATOR ] INVH: Primary data validation passed. [2025-09-23T19:28:21.459794] [INFO ] [MAIN ] INVH: Fetched primary data is valid. [2025-09-23T19:28:21.459982] [DEBUG] [LOCAL ] INVH: Saving primary data. [2025-09-23T19:28:21.461719] [DEBUG] [LOCAL ] INVH: Trimmed 76681 records to 53139 (keeping 200 days of data) [2025-09-23T19:28:21.571976] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-23T19:28:21.806574] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-09. [2025-09-23T19:28:21.833406] [DEBUG] [LOCAL ] INVH: Primary data saved (53139 records). [2025-09-23T19:28:21.833566] [INFO ] [MAIN ] INVH: Full history saved. [2025-09-23T19:28:21.833673] [INFO ] [MAIN ] Update Progress: 1118/2372 symbols completed. INVH took 29.3s. Estimated remaining: 2h 46m 21s. Rate: 7.5 symbols/min [2025-09-23T19:28:22.721826] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-23T19:28:22.726330] [INFO ] [REMOTE ] INVX: Full fetch complete (44425 records). [2025-09-23T19:28:22.726428] [DEBUG] [VALIDATOR ] INVX: Validating primary data. [2025-09-23T19:28:23.109630] [DEBUG] [VALIDATOR ] INVX: All expected trading days are present. [2025-09-23T19:28:23.109819] [DEBUG] [VALIDATOR ] INVX: Primary data validation passed. [2025-09-23T19:28:23.110701] [INFO ] [MAIN ] INVX: Fetched primary data is valid. [2025-09-23T19:28:23.110764] [DEBUG] [LOCAL ] INVX: Saving primary data. [2025-09-23T19:28:23.111834] [DEBUG] [LOCAL ] INVX: Trimmed 44425 records to 28970 (keeping 200 days of data) [2025-09-23T19:28:23.286505] [DEBUG] [LOCAL ] INVX: Primary data saved (28970 records). [2025-09-23T19:28:23.286681] [INFO ] [MAIN ] INVX: Full history saved. [2025-09-23T19:28:23.286826] [INFO ] [MAIN ] Update Progress: 1119/2372 symbols completed. INVX took 22.7s. Estimated remaining: 2h 46m 6s. Rate: 7.5 symbols/min [2025-09-23T19:28:23.719460] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-05 (2.71 seconds). [2025-09-23T19:28:23.732924] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-06. [2025-09-23T19:28:26.376323] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-06 (2.64 seconds). [2025-09-23T19:28:26.387499] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-07. [2025-09-23T19:28:28.856822] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-09-23T19:28:28.869309] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-08. [2025-09-23T19:28:31.265108] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-09-23T19:28:31.277595] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-09. [2025-09-23T19:28:33.869742] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-09 (2.59 seconds). [2025-09-23T19:28:33.878733] [INFO ] [REMOTE ] IONQ: Full fetch complete (70558 records). [2025-09-23T19:28:33.878866] [DEBUG] [VALIDATOR ] IONQ: Validating primary data. [2025-09-23T19:28:34.072099] [WARN ] [VALIDATOR ] IONQ: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-23T19:28:34.072880] [FATAL] [MAIN ] IONQ: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:28:34.072954] [WARN ] [MAIN ] IONQ: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:28:34.073026] [INFO ] [LOCAL ] IONQ: Starting deletion of primary data. [2025-09-23T19:28:34.073098] [DEBUG] [LOCAL ] IONQ: No primary data file found to delete. [2025-09-23T19:28:34.073135] [INFO ] [LOCAL ] IONQ: Starting deletion of derivative data. [2025-09-23T19:28:34.073557] [DEBUG] [LOCAL ] IONQ: Deleted derivative data file. [2025-09-23T19:28:34.073690] [INFO ] [MAIN ] Update Progress: 1120/2372 symbols completed. IONQ took 31.4s. Estimated remaining: 2h 46m 1s. Rate: 7.5 symbols/min [2025-09-23T19:28:34.715719] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:28:34.716611] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:28:34.671976] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:28:34.794497] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:28:34.823204] [DEBUG] [LOCAL ] IPI: Loaded 21232 existing records from primary storage. [2025-09-23T19:28:34.836699] [INFO ] [MAIN ] IPI: Loaded 21232 existing records. [2025-09-23T19:28:35.015212] [DEBUG] [LOCAL ] IOT: Loaded 53472 existing records from primary storage. [2025-09-23T19:28:35.059624] [INFO ] [MAIN ] IOT: Loaded 53472 existing records. [2025-09-23T19:28:35.176701] [DEBUG] [LOCAL ] IP: Loaded 53326 existing records from primary storage. [2025-09-23T19:28:35.176832] [WARN ] [MAIN ] IPI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:28:35.211942] [INFO ] [MAIN ] IP: Loaded 53326 existing records. [2025-09-23T19:28:35.217799] [DEBUG] [LOCAL ] IPG: Loaded 53332 existing records from primary storage. [2025-09-23T19:28:35.239623] [INFO ] [MAIN ] IPI: Wiping existing primary data before full refresh. [2025-09-23T19:28:35.228774] [INFO ] [MAIN ] IPG: Loaded 53332 existing records. [2025-09-23T19:28:35.270253] [INFO ] [LOCAL ] IPI: Starting deletion of primary data. [2025-09-23T19:28:35.441807] [DEBUG] [LOCAL ] IPI: Deleted primary data file. [2025-09-23T19:28:35.449738] [WARN ] [MAIN ] IOT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:28:35.455189] [INFO ] [MAIN ] IPI: Starting full primary refresh. [2025-09-23T19:28:35.529024] [INFO ] [MAIN ] IOT: Wiping existing primary data before full refresh. [2025-09-23T19:28:35.532704] [INFO ] [LOCAL ] IOT: Starting deletion of primary data. [2025-09-23T19:28:35.644506] [DEBUG] [LOCAL ] IOT: Deleted primary data file. [2025-09-23T19:28:35.688044] [INFO ] [MAIN ] IOT: Starting full primary refresh. [2025-09-23T19:28:35.784480] [WARN ] [MAIN ] IP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:28:35.855804] [INFO ] [MAIN ] IP: Wiping existing primary data before full refresh. [2025-09-23T19:28:35.898968] [INFO ] [LOCAL ] IP: Starting deletion of primary data. [2025-09-23T19:28:35.898894] [WARN ] [MAIN ] IPG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:28:35.943516] [DEBUG] [LOCAL ] IP: Deleted primary data file. [2025-09-23T19:28:35.964064] [INFO ] [MAIN ] IP: Starting full primary refresh. [2025-09-23T19:28:35.958766] [INFO ] [MAIN ] IPG: Wiping existing primary data before full refresh. [2025-09-23T19:28:36.001574] [INFO ] [LOCAL ] IPG: Starting deletion of primary data. [2025-09-23T19:28:36.065958] [DEBUG] [LOCAL ] IPG: Deleted primary data file. [2025-09-23T19:28:36.154979] [INFO ] [MAIN ] IPG: Starting full primary refresh. [2025-09-23T19:28:36.671449] [INFO ] [REMOTE ] IPI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:28:36.775378] [INFO ] [REMOTE ] IPI: Fetching primary data for 2024-12. [2025-09-23T19:28:36.881623] [INFO ] [REMOTE ] IOT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:28:36.955088] [INFO ] [REMOTE ] IOT: Fetching primary data for 2024-12. [2025-09-23T19:28:37.205733] [INFO ] [REMOTE ] IP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:28:37.208276] [INFO ] [REMOTE ] IP: Fetching primary data for 2024-12. [2025-09-23T19:28:37.230117] [INFO ] [REMOTE ] IPG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:28:37.230392] [INFO ] [REMOTE ] IPG: Fetching primary data for 2024-12. [2025-09-23T19:28:37.886368] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-23T19:28:37.890676] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-01. [2025-09-23T19:28:38.505723] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-23T19:28:38.509914] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-02. [2025-09-23T19:28:38.618667] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-23T19:28:38.630724] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-01. [2025-09-23T19:28:38.662682] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-23T19:28:38.673955] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-01. [2025-09-23T19:28:38.727313] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-23T19:28:38.737924] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-01. [2025-09-23T19:28:39.109319] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-23T19:28:39.113554] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-03. [2025-09-23T19:28:40.200337] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-23T19:28:40.206415] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-04. [2025-09-23T19:28:40.324862] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-23T19:28:40.336421] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-02. [2025-09-23T19:28:40.370366] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-23T19:28:40.381034] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-02. [2025-09-23T19:28:40.438203] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-23T19:28:40.449474] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-02. [2025-09-23T19:28:40.946454] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-23T19:28:40.953945] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-05. [2025-09-23T19:28:41.599662] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-23T19:28:41.610018] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-03. [2025-09-23T19:28:41.764294] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-23T19:28:41.804974] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-06. [2025-09-23T19:28:41.809492] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-23T19:28:41.821971] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-03. [2025-09-23T19:28:41.924266] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-23T19:28:41.934727] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-03. [2025-09-23T19:28:42.856518] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-23T19:28:42.861865] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-07. [2025-09-23T19:28:43.047745] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-23T19:28:43.059534] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-04. [2025-09-23T19:28:43.562610] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-23T19:28:43.567364] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-08. [2025-09-23T19:28:43.759983] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-23T19:28:43.772043] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-04. [2025-09-23T19:28:43.849898] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-23T19:28:44.202241] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-04. [2025-09-23T19:28:44.563442] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-23T19:28:44.635799] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-23T19:28:45.002235] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-05. [2025-09-23T19:28:45.173436] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-23T19:28:45.802210] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-09. [2025-09-23T19:28:46.191353] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-23T19:28:46.359836] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-23T19:28:46.602185] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-05. [2025-09-23T19:28:46.922666] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-23T19:28:46.926759] [INFO ] [REMOTE ] IPI: Full fetch complete (28929 records). [2025-09-23T19:28:46.926849] [DEBUG] [VALIDATOR ] IPI: Validating primary data. [2025-09-23T19:28:47.301143] [DEBUG] [VALIDATOR ] IPI: All expected trading days are present. [2025-09-23T19:28:47.301230] [DEBUG] [VALIDATOR ] IPI: Primary data validation passed. [2025-09-23T19:28:47.301887] [INFO ] [MAIN ] IPI: Fetched primary data is valid. [2025-09-23T19:28:47.301950] [DEBUG] [LOCAL ] IPI: Saving primary data. [2025-09-23T19:28:47.302740] [DEBUG] [LOCAL ] IPI: Trimmed 28929 records to 21223 (keeping 200 days of data) [2025-09-23T19:28:47.402334] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-05. [2025-09-23T19:28:47.427126] [DEBUG] [LOCAL ] IPI: Primary data saved (21223 records). [2025-09-23T19:28:47.427262] [INFO ] [MAIN ] IPI: Full history saved. [2025-09-23T19:28:47.427376] [INFO ] [MAIN ] Update Progress: 1121/2372 symbols completed. IPI took 13.3s. Estimated remaining: 2h 45m 59s. Rate: 7.5 symbols/min [2025-09-23T19:28:47.601486] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:28:47.601706] [DEBUG] [LOCAL ] IQI: No existing data file found in primary storage. [2025-09-23T19:28:47.601756] [WARN ] [MAIN ] IQI: No existing data found, performing full refresh instead. [2025-09-23T19:28:47.601898] [INFO ] [MAIN ] IQI: Wiping existing primary data before full refresh. [2025-09-23T19:28:47.601940] [INFO ] [LOCAL ] IQI: Starting deletion of primary data. [2025-09-23T19:28:47.601980] [DEBUG] [LOCAL ] IQI: No primary data file found to delete. [2025-09-23T19:28:47.602011] [INFO ] [MAIN ] IQI: Starting full primary refresh. [2025-09-23T19:28:47.957674] [INFO ] [REMOTE ] IQI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:28:48.212681] [INFO ] [REMOTE ] IQI: Fetching primary data for 2024-12. [2025-09-23T19:28:48.219182] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-23T19:28:49.002255] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-06. [2025-09-23T19:28:49.219570] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-23T19:28:49.280305] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-23T19:28:49.802193] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-06. [2025-09-23T19:28:50.463436] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-23T19:28:50.602201] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-07. [2025-09-23T19:28:51.247138] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-23T19:28:51.402236] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-06. [2025-09-23T19:28:52.202211] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-07. [2025-09-23T19:28:52.707012] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-23T19:28:53.002195] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-08. [2025-09-23T19:28:53.147171] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-23T19:28:53.802177] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-07. [2025-09-23T19:28:54.136725] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-23T19:28:54.602240] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-08. [2025-09-23T19:28:55.034711] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-23T19:28:55.402208] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-01. [2025-09-23T19:28:55.659092] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-23T19:28:55.884624] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-23T19:28:56.202231] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-09. [2025-09-23T19:28:56.411144] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-23T19:28:57.002227] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-08. [2025-09-23T19:28:57.802163] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-02. [2025-09-23T19:28:57.978277] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-23T19:28:57.989344] [INFO ] [REMOTE ] IP: Full fetch complete (77058 records). [2025-09-23T19:28:57.989680] [DEBUG] [VALIDATOR ] IP: Validating primary data. [2025-09-23T19:28:58.409049] [DEBUG] [VALIDATOR ] IP: All expected trading days are present. [2025-09-23T19:28:58.409276] [DEBUG] [VALIDATOR ] IP: Primary data validation passed. [2025-09-23T19:28:58.410782] [INFO ] [MAIN ] IP: Fetched primary data is valid. [2025-09-23T19:28:58.410874] [DEBUG] [LOCAL ] IP: Saving primary data. [2025-09-23T19:28:58.413502] [DEBUG] [LOCAL ] IP: Trimmed 77058 records to 53323 (keeping 200 days of data) [2025-09-23T19:28:58.608450] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-09. [2025-09-23T19:28:58.802327] [DEBUG] [LOCAL ] IP: Primary data saved (53323 records). [2025-09-23T19:28:58.802518] [INFO ] [MAIN ] IP: Full history saved. [2025-09-23T19:28:58.802892] [INFO ] [MAIN ] Update Progress: 1122/2372 symbols completed. IP took 24.7s. Estimated remaining: 2h 45m 55s. Rate: 7.5 symbols/min [2025-09-23T19:28:58.804672] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-23T19:28:58.991219] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:28:59.041208] [DEBUG] [LOCAL ] IQV: Loaded 50377 existing records from primary storage. [2025-09-23T19:28:59.041386] [INFO ] [MAIN ] IQV: Loaded 50377 existing records. [2025-09-23T19:28:59.156884] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-23T19:28:59.242984] [WARN ] [MAIN ] IQV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:28:59.243292] [INFO ] [MAIN ] IQV: Wiping existing primary data before full refresh. [2025-09-23T19:28:59.243341] [INFO ] [LOCAL ] IQV: Starting deletion of primary data. [2025-09-23T19:28:59.244790] [DEBUG] [LOCAL ] IQV: Deleted primary data file. [2025-09-23T19:28:59.244853] [INFO ] [MAIN ] IQV: Starting full primary refresh. [2025-09-23T19:28:59.402442] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-09. [2025-09-23T19:28:59.604454] [INFO ] [REMOTE ] IQV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:29:00.202226] [INFO ] [REMOTE ] IQV: Fetching primary data for 2024-12. [2025-09-23T19:29:00.636322] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-23T19:29:00.645283] [INFO ] [REMOTE ] IOT: Full fetch complete (77381 records). [2025-09-23T19:29:00.645439] [DEBUG] [VALIDATOR ] IOT: Validating primary data. [2025-09-23T19:29:01.018542] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-03. [2025-09-23T19:29:01.061034] [DEBUG] [VALIDATOR ] IOT: All expected trading days are present. [2025-09-23T19:29:01.061230] [DEBUG] [VALIDATOR ] IOT: Primary data validation passed. [2025-09-23T19:29:01.062327] [INFO ] [MAIN ] IOT: Fetched primary data is valid. [2025-09-23T19:29:01.062398] [DEBUG] [LOCAL ] IOT: Saving primary data. [2025-09-23T19:29:01.064104] [DEBUG] [LOCAL ] IOT: Trimmed 77381 records to 53471 (keeping 200 days of data) [2025-09-23T19:29:01.420393] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-23T19:29:01.433546] [INFO ] [REMOTE ] IPG: Full fetch complete (77249 records). [2025-09-23T19:29:01.434720] [DEBUG] [VALIDATOR ] IPG: Validating primary data. [2025-09-23T19:29:01.523548] [DEBUG] [LOCAL ] IOT: Primary data saved (53471 records). [2025-09-23T19:29:01.529173] [INFO ] [MAIN ] IOT: Full history saved. [2025-09-23T19:29:01.529515] [INFO ] [MAIN ] Update Progress: 1123/2372 symbols completed. IOT took 27.5s. Estimated remaining: 2h 45m 41s. Rate: 7.5 symbols/min [2025-09-23T19:29:01.944806] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:29:02.175154] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-23T19:29:02.179081] [DEBUG] [VALIDATOR ] IPG: All expected trading days are present. [2025-09-23T19:29:02.191958] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-01. [2025-09-23T19:29:02.192679] [DEBUG] [VALIDATOR ] IPG: Primary data validation passed. [2025-09-23T19:29:02.195599] [INFO ] [MAIN ] IPG: Fetched primary data is valid. [2025-09-23T19:29:02.197258] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-23T19:29:02.197448] [DEBUG] [LOCAL ] IPG: Saving primary data. [2025-09-23T19:29:02.219728] [DEBUG] [LOCAL ] IPG: Trimmed 77249 records to 53332 (keeping 200 days of data) [2025-09-23T19:29:02.330849] [DEBUG] [LOCAL ] IR: Loaded 52696 existing records from primary storage. [2025-09-23T19:29:02.331762] [INFO ] [MAIN ] IR: Loaded 52696 existing records. [2025-09-23T19:29:02.552804] [WARN ] [MAIN ] IR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:29:02.554737] [INFO ] [MAIN ] IR: Wiping existing primary data before full refresh. [2025-09-23T19:29:02.555100] [INFO ] [LOCAL ] IR: Starting deletion of primary data. [2025-09-23T19:29:02.558020] [DEBUG] [LOCAL ] IR: Deleted primary data file. [2025-09-23T19:29:02.558380] [INFO ] [MAIN ] IR: Starting full primary refresh. [2025-09-23T19:29:02.604428] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-04. [2025-09-23T19:29:02.982036] [INFO ] [REMOTE ] IR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:29:03.209072] [DEBUG] [LOCAL ] IPG: Primary data saved (53332 records). [2025-09-23T19:29:03.209298] [INFO ] [MAIN ] IPG: Full history saved. [2025-09-23T19:29:03.209424] [INFO ] [MAIN ] Update Progress: 1124/2372 symbols completed. IPG took 29.1s. Estimated remaining: 2h 45m 26s. Rate: 7.5 symbols/min [2025-09-23T19:29:03.387042] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:29:03.402195] [INFO ] [REMOTE ] IR: Fetching primary data for 2024-12. [2025-09-23T19:29:03.439736] [DEBUG] [LOCAL ] IRM: Loaded 49510 existing records from primary storage. [2025-09-23T19:29:03.439941] [INFO ] [MAIN ] IRM: Loaded 49510 existing records. [2025-09-23T19:29:03.649762] [WARN ] [MAIN ] IRM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:29:03.650250] [INFO ] [MAIN ] IRM: Wiping existing primary data before full refresh. [2025-09-23T19:29:03.650314] [INFO ] [LOCAL ] IRM: Starting deletion of primary data. [2025-09-23T19:29:03.651892] [DEBUG] [LOCAL ] IRM: Deleted primary data file. [2025-09-23T19:29:03.651962] [INFO ] [MAIN ] IRM: Starting full primary refresh. [2025-09-23T19:29:04.059029] [INFO ] [REMOTE ] IRM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:29:04.089637] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-23T19:29:04.101169] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-23T19:29:04.202189] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-02. [2025-09-23T19:29:05.002200] [INFO ] [REMOTE ] IRM: Fetching primary data for 2024-12. [2025-09-23T19:29:05.188817] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-23T19:29:05.346020] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-23T19:29:05.802318] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-01. [2025-09-23T19:29:06.470416] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-23T19:29:06.602252] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-05. [2025-09-23T19:29:07.402221] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-03. [2025-09-23T19:29:07.511888] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-23T19:29:07.573315] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-23T19:29:08.202197] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-02. [2025-09-23T19:29:08.991914] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-23T19:29:09.002156] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-01. [2025-09-23T19:29:09.594363] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-23T19:29:09.802197] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-03. [2025-09-23T19:29:10.602192] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-04. [2025-09-23T19:29:10.755198] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-23T19:29:11.058602] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-23T19:29:11.402190] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-02. [2025-09-23T19:29:12.202205] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-06. [2025-09-23T19:29:12.437701] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-23T19:29:12.819848] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-23T19:29:13.002198] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-05. [2025-09-23T19:29:13.133384] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-23T19:29:13.802208] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-03. [2025-09-23T19:29:14.602205] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-07. [2025-09-23T19:29:14.713680] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-23T19:29:15.402229] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-04. [2025-09-23T19:29:15.571086] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-23T19:29:15.606888] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-23T19:29:16.202195] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-04. [2025-09-23T19:29:17.002798] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-06. [2025-09-23T19:29:17.009300] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-23T19:29:17.802225] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-08. [2025-09-23T19:29:17.982491] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-23T19:29:18.407023] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-23T19:29:18.602193] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-05. [2025-09-23T19:29:18.898940] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-23T19:29:19.402222] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-09. [2025-09-23T19:29:20.202172] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-07. [2025-09-23T19:29:20.365495] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-23T19:29:20.405452] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-23T19:29:20.408815] [INFO ] [REMOTE ] IQI: Full fetch complete (27268 records). [2025-09-23T19:29:20.408898] [DEBUG] [VALIDATOR ] IQI: Validating primary data. [2025-09-23T19:29:20.778840] [DEBUG] [VALIDATOR ] IQI: All expected trading days are present. [2025-09-23T19:29:20.778931] [DEBUG] [VALIDATOR ] IQI: Primary data validation passed. [2025-09-23T19:29:20.779486] [INFO ] [MAIN ] IQI: Fetched primary data is valid. [2025-09-23T19:29:20.779539] [DEBUG] [LOCAL ] IQI: Saving primary data. [2025-09-23T19:29:20.780322] [DEBUG] [LOCAL ] IQI: Trimmed 27268 records to 18001 (keeping 200 days of data) [2025-09-23T19:29:20.891345] [DEBUG] [LOCAL ] IQI: Primary data saved (18001 records). [2025-09-23T19:29:20.891508] [INFO ] [MAIN ] IQI: Full history saved. [2025-09-23T19:29:20.891585] [INFO ] [MAIN ] Update Progress: 1125/2372 symbols completed. IQI took 33.5s. Estimated remaining: 2h 45m 29s. Rate: 7.5 symbols/min [2025-09-23T19:29:21.007258] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-05. [2025-09-23T19:29:21.067759] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:29:21.090840] [DEBUG] [LOCAL ] IRS: Loaded 21606 existing records from primary storage. [2025-09-23T19:29:21.091000] [INFO ] [MAIN ] IRS: Loaded 21606 existing records. [2025-09-23T19:29:21.272923] [WARN ] [MAIN ] IRS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:29:21.273303] [INFO ] [MAIN ] IRS: Wiping existing primary data before full refresh. [2025-09-23T19:29:21.273371] [INFO ] [LOCAL ] IRS: Starting deletion of primary data. [2025-09-23T19:29:21.274169] [DEBUG] [LOCAL ] IRS: Deleted primary data file. [2025-09-23T19:29:21.274235] [INFO ] [MAIN ] IRS: Starting full primary refresh. [2025-09-23T19:29:21.634943] [INFO ] [REMOTE ] IRS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:29:21.802174] [INFO ] [REMOTE ] IRS: Fetching primary data for 2024-12. [2025-09-23T19:29:22.061531] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-23T19:29:22.602179] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-06. [2025-09-23T19:29:22.820216] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-23T19:29:22.911877] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-23T19:29:23.402192] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-08. [2025-09-23T19:29:23.996609] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-23T19:29:24.202202] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-07. [2025-09-23T19:29:24.622604] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-23T19:29:25.002198] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-01. [2025-09-23T19:29:25.597002] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-23T19:29:25.758828] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-23T19:29:25.802196] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-08. [2025-09-23T19:29:26.602202] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-02. [2025-09-23T19:29:27.402162] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-06. [2025-09-23T19:29:27.463634] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-23T19:29:27.594206] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-23T19:29:28.202229] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-03. [2025-09-23T19:29:29.002194] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-09. [2025-09-23T19:29:29.064144] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-23T19:29:29.108086] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-23T19:29:29.802250] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-04. [2025-09-23T19:29:30.476131] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-23T19:29:30.484397] [INFO ] [REMOTE ] IRM: Full fetch complete (72270 records). [2025-09-23T19:29:30.484529] [DEBUG] [VALIDATOR ] IRM: Validating primary data. [2025-09-23T19:29:30.604381] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-09. [2025-09-23T19:29:30.900018] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-23T19:29:30.925550] [DEBUG] [VALIDATOR ] IRM: All expected trading days are present. [2025-09-23T19:29:30.926092] [DEBUG] [VALIDATOR ] IRM: Primary data validation passed. [2025-09-23T19:29:30.929318] [INFO ] [MAIN ] IRM: Fetched primary data is valid. [2025-09-23T19:29:30.929387] [DEBUG] [LOCAL ] IRM: Saving primary data. [2025-09-23T19:29:30.931224] [DEBUG] [LOCAL ] IRM: Trimmed 72270 records to 49478 (keeping 200 days of data) [2025-09-23T19:29:31.242839] [DEBUG] [LOCAL ] IRM: Primary data saved (49478 records). [2025-09-23T19:29:31.242989] [INFO ] [MAIN ] IRM: Full history saved. [2025-09-23T19:29:31.243071] [INFO ] [MAIN ] Update Progress: 1126/2372 symbols completed. IRM took 28.0s. Estimated remaining: 2h 45m 24s. Rate: 7.5 symbols/min [2025-09-23T19:29:31.416597] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:29:31.413056] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-05. [2025-09-23T19:29:31.468935] [DEBUG] [LOCAL ] IRT: Loaded 50393 existing records from primary storage. [2025-09-23T19:29:31.469104] [INFO ] [MAIN ] IRT: Loaded 50393 existing records. [2025-09-23T19:29:31.646054] [WARN ] [MAIN ] IRT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:29:31.646343] [INFO ] [MAIN ] IRT: Wiping existing primary data before full refresh. [2025-09-23T19:29:31.646408] [INFO ] [LOCAL ] IRT: Starting deletion of primary data. [2025-09-23T19:29:31.647932] [DEBUG] [LOCAL ] IRT: Deleted primary data file. [2025-09-23T19:29:31.647994] [INFO ] [MAIN ] IRT: Starting full primary refresh. [2025-09-23T19:29:32.010503] [INFO ] [REMOTE ] IRT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:29:32.202181] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-07. [2025-09-23T19:29:32.342288] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-23T19:29:32.351794] [INFO ] [REMOTE ] IQV: Full fetch complete (72386 records). [2025-09-23T19:29:32.351933] [DEBUG] [VALIDATOR ] IQV: Validating primary data. [2025-09-23T19:29:32.526499] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-23T19:29:32.823959] [DEBUG] [VALIDATOR ] IQV: All expected trading days are present. [2025-09-23T19:29:32.824047] [DEBUG] [VALIDATOR ] IQV: Primary data validation passed. [2025-09-23T19:29:32.825086] [INFO ] [MAIN ] IQV: Fetched primary data is valid. [2025-09-23T19:29:32.825173] [DEBUG] [LOCAL ] IQV: Saving primary data. [2025-09-23T19:29:32.830760] [DEBUG] [LOCAL ] IQV: Trimmed 72386 records to 50310 (keeping 200 days of data) [2025-09-23T19:29:33.011174] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-06. [2025-09-23T19:29:33.149481] [DEBUG] [LOCAL ] IQV: Primary data saved (50310 records). [2025-09-23T19:29:33.149629] [INFO ] [MAIN ] IQV: Full history saved. [2025-09-23T19:29:33.149792] [INFO ] [MAIN ] Update Progress: 1127/2372 symbols completed. IQV took 34.3s. Estimated remaining: 2h 45m 9s. Rate: 7.5 symbols/min [2025-09-23T19:29:33.329065] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:29:33.348407] [DEBUG] [LOCAL ] ISD: Loaded 15668 existing records from primary storage. [2025-09-23T19:29:33.348546] [INFO ] [MAIN ] ISD: Loaded 15668 existing records. [2025-09-23T19:29:33.530912] [WARN ] [MAIN ] ISD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:29:33.531475] [INFO ] [MAIN ] ISD: Wiping existing primary data before full refresh. [2025-09-23T19:29:33.531698] [INFO ] [LOCAL ] ISD: Starting deletion of primary data. [2025-09-23T19:29:33.532290] [DEBUG] [LOCAL ] ISD: Deleted primary data file. [2025-09-23T19:29:33.532382] [INFO ] [MAIN ] ISD: Starting full primary refresh. [2025-09-23T19:29:33.805032] [INFO ] [REMOTE ] IRT: Fetching primary data for 2024-12. [2025-09-23T19:29:33.913291] [INFO ] [REMOTE ] ISD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:29:33.950682] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-23T19:29:34.085170] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-23T19:29:34.602227] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-08. [2025-09-23T19:29:35.402242] [INFO ] [REMOTE ] ISD: Fetching primary data for 2024-12. [2025-09-23T19:29:35.606163] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-23T19:29:36.203404] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-07. [2025-09-23T19:29:36.226094] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-23T19:29:36.362453] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-23T19:29:37.002194] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-09. [2025-09-23T19:29:37.334767] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-23T19:29:37.802222] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-01. [2025-09-23T19:29:38.377152] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-23T19:29:38.390381] [INFO ] [REMOTE ] IR: Full fetch complete (76116 records). [2025-09-23T19:29:38.390559] [DEBUG] [VALIDATOR ] IR: Validating primary data. [2025-09-23T19:29:38.607460] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-01. [2025-09-23T19:29:38.837599] [DEBUG] [VALIDATOR ] IR: All expected trading days are present. [2025-09-23T19:29:38.837745] [DEBUG] [VALIDATOR ] IR: Primary data validation passed. [2025-09-23T19:29:38.840223] [INFO ] [MAIN ] IR: Fetched primary data is valid. [2025-09-23T19:29:38.840298] [DEBUG] [LOCAL ] IR: Saving primary data. [2025-09-23T19:29:38.844689] [DEBUG] [LOCAL ] IR: Trimmed 76116 records to 52696 (keeping 200 days of data) [2025-09-23T19:29:38.975698] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-23T19:29:39.221991] [DEBUG] [LOCAL ] IR: Primary data saved (52696 records). [2025-09-23T19:29:39.222149] [INFO ] [MAIN ] IR: Full history saved. [2025-09-23T19:29:39.222273] [INFO ] [MAIN ] Update Progress: 1128/2372 symbols completed. IR took 37.7s. Estimated remaining: 2h 44m 59s. Rate: 7.5 symbols/min [2025-09-23T19:29:39.396276] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:29:39.402248] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-02. [2025-09-23T19:29:39.446994] [DEBUG] [LOCAL ] IT: Loaded 41446 existing records from primary storage. [2025-09-23T19:29:39.447232] [INFO ] [MAIN ] IT: Loaded 41446 existing records. [2025-09-23T19:29:39.625703] [WARN ] [MAIN ] IT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:29:39.625989] [INFO ] [MAIN ] IT: Wiping existing primary data before full refresh. [2025-09-23T19:29:39.626049] [INFO ] [LOCAL ] IT: Starting deletion of primary data. [2025-09-23T19:29:39.627156] [DEBUG] [LOCAL ] IT: Deleted primary data file. [2025-09-23T19:29:39.627217] [INFO ] [MAIN ] IT: Starting full primary refresh. [2025-09-23T19:29:39.991460] [INFO ] [REMOTE ] IT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:29:40.115003] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-23T19:29:40.202160] [INFO ] [REMOTE ] IT: Fetching primary data for 2024-12. [2025-09-23T19:29:40.372528] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-23T19:29:41.002225] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-03. [2025-09-23T19:29:41.492092] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-23T19:29:41.802198] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-01. [2025-09-23T19:29:41.934483] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-23T19:29:42.602280] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-04. [2025-09-23T19:29:42.872861] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-23T19:29:43.232397] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-23T19:29:43.402207] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-02. [2025-09-23T19:29:44.202204] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-05. [2025-09-23T19:29:44.414569] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-23T19:29:45.002180] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-08. [2025-09-23T19:29:45.064441] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-23T19:29:45.802236] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-03. [2025-09-23T19:29:46.191492] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-23T19:29:46.602236] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-09. [2025-09-23T19:29:47.342012] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-23T19:29:47.402169] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-02. [2025-09-23T19:29:47.904770] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-23T19:29:47.910551] [INFO ] [REMOTE ] IRS: Full fetch complete (32174 records). [2025-09-23T19:29:47.910679] [DEBUG] [VALIDATOR ] IRS: Validating primary data. [2025-09-23T19:29:48.207774] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-04. [2025-09-23T19:29:48.308071] [DEBUG] [VALIDATOR ] IRS: All expected trading days are present. [2025-09-23T19:29:48.308160] [DEBUG] [VALIDATOR ] IRS: Primary data validation passed. [2025-09-23T19:29:48.308807] [INFO ] [MAIN ] IRS: Fetched primary data is valid. [2025-09-23T19:29:48.308869] [DEBUG] [LOCAL ] IRS: Saving primary data. [2025-09-23T19:29:48.310931] [DEBUG] [LOCAL ] IRS: Trimmed 32174 records to 21668 (keeping 200 days of data) [2025-09-23T19:29:48.449290] [DEBUG] [LOCAL ] IRS: Primary data saved (21668 records). [2025-09-23T19:29:48.449427] [INFO ] [MAIN ] IRS: Full history saved. [2025-09-23T19:29:48.449535] [INFO ] [MAIN ] Update Progress: 1129/2372 symbols completed. IRS took 27.6s. Estimated remaining: 2h 44m 53s. Rate: 7.5 symbols/min [2025-09-23T19:29:48.631278] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:29:48.677475] [DEBUG] [LOCAL ] ITGR: Loaded 31574 existing records from primary storage. [2025-09-23T19:29:48.699453] [INFO ] [MAIN ] ITGR: Loaded 31574 existing records. [2025-09-23T19:29:48.783504] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-23T19:29:48.905850] [WARN ] [MAIN ] ITGR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:29:48.906193] [INFO ] [MAIN ] ITGR: Wiping existing primary data before full refresh. [2025-09-23T19:29:48.906242] [INFO ] [LOCAL ] ITGR: Starting deletion of primary data. [2025-09-23T19:29:48.907295] [DEBUG] [LOCAL ] ITGR: Deleted primary data file. [2025-09-23T19:29:48.907362] [INFO ] [MAIN ] ITGR: Starting full primary refresh. [2025-09-23T19:29:49.007418] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-06. [2025-09-23T19:29:49.303631] [INFO ] [REMOTE ] ITGR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:29:49.762671] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-23T19:29:49.802849] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-05. [2025-09-23T19:29:49.804850] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-23T19:29:50.602229] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2024-12. [2025-09-23T19:29:51.306893] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-23T19:29:51.402180] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-03. [2025-09-23T19:29:51.657697] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-23T19:29:52.202195] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-07. [2025-09-23T19:29:52.892086] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-23T19:29:53.002200] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-04. [2025-09-23T19:29:53.135890] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-23T19:29:53.802197] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-08. [2025-09-23T19:29:54.282624] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-23T19:29:54.602199] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-06. [2025-09-23T19:29:54.634521] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-23T19:29:55.402200] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-01. [2025-09-23T19:29:55.785664] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-23T19:29:56.163161] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-23T19:29:56.202155] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-02. [2025-09-23T19:29:57.002206] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-05. [2025-09-23T19:29:57.369284] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-23T19:29:57.802250] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-03. [2025-09-23T19:29:58.436989] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-23T19:29:58.602269] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-06. [2025-09-23T19:29:58.835761] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-23T19:29:59.402223] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-07. [2025-09-23T19:30:00.178556] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-23T19:30:00.202268] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-04. [2025-09-23T19:30:00.653940] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-23T19:30:01.002205] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-08. [2025-09-23T19:30:01.505300] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-23T19:30:01.802299] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-09. [2025-09-23T19:30:02.602202] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-05. [2025-09-23T19:30:03.297368] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-09-23T19:30:03.402210] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-07. [2025-09-23T19:30:04.202196] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-09. [2025-09-23T19:30:04.379370] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-09 (2.58 seconds). [2025-09-23T19:30:04.382191] [INFO ] [REMOTE ] ISD: Full fetch complete (23802 records). [2025-09-23T19:30:04.382270] [DEBUG] [VALIDATOR ] ISD: Validating primary data. [2025-09-23T19:30:04.775976] [DEBUG] [VALIDATOR ] ISD: All expected trading days are present. [2025-09-23T19:30:04.776070] [DEBUG] [VALIDATOR ] ISD: Primary data validation passed. [2025-09-23T19:30:04.776579] [INFO ] [MAIN ] ISD: Fetched primary data is valid. [2025-09-23T19:30:04.776620] [DEBUG] [LOCAL ] ISD: Saving primary data. [2025-09-23T19:30:04.777276] [DEBUG] [LOCAL ] ISD: Trimmed 23802 records to 15567 (keeping 200 days of data) [2025-09-23T19:30:04.872506] [DEBUG] [LOCAL ] ISD: Primary data saved (15567 records). [2025-09-23T19:30:04.872698] [INFO ] [MAIN ] ISD: Full history saved. [2025-09-23T19:30:04.872816] [INFO ] [MAIN ] Update Progress: 1130/2372 symbols completed. ISD took 31.7s. Estimated remaining: 2h 44m 54s. Rate: 7.5 symbols/min [2025-09-23T19:30:05.048375] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:30:05.089017] [DEBUG] [LOCAL ] ITT: Loaded 33181 existing records from primary storage. [2025-09-23T19:30:05.089178] [INFO ] [MAIN ] ITT: Loaded 33181 existing records. [2025-09-23T19:30:05.275166] [WARN ] [MAIN ] ITT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:30:05.275426] [INFO ] [MAIN ] ITT: Wiping existing primary data before full refresh. [2025-09-23T19:30:05.275475] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-09-23T19:30:05.276586] [DEBUG] [LOCAL ] ITT: Deleted primary data file. [2025-09-23T19:30:05.276683] [INFO ] [MAIN ] ITT: Starting full primary refresh. [2025-09-23T19:30:05.655395] [INFO ] [REMOTE ] ITT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:30:05.655842] [INFO ] [REMOTE ] ITT: Fetching primary data for 2024-12. [2025-09-23T19:30:05.905926] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-09-23T19:30:05.938797] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-08. [2025-09-23T19:30:05.939913] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-05 (3.34 seconds). [2025-09-23T19:30:06.565318] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-09-23T19:30:06.573372] [INFO ] [REMOTE ] IT: Full fetch complete (55195 records). [2025-09-23T19:30:06.573549] [DEBUG] [VALIDATOR ] IT: Validating primary data. [2025-09-23T19:30:06.607293] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-06. [2025-09-23T19:30:06.997347] [DEBUG] [VALIDATOR ] IT: All expected trading days are present. [2025-09-23T19:30:06.997582] [DEBUG] [VALIDATOR ] IT: Primary data validation passed. [2025-09-23T19:30:06.998714] [INFO ] [MAIN ] IT: Fetched primary data is valid. [2025-09-23T19:30:06.998800] [DEBUG] [LOCAL ] IT: Saving primary data. [2025-09-23T19:30:07.000572] [DEBUG] [LOCAL ] IT: Trimmed 55195 records to 41528 (keeping 200 days of data) [2025-09-23T19:30:07.123111] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-23T19:30:07.293819] [DEBUG] [LOCAL ] IT: Primary data saved (41528 records). [2025-09-23T19:30:07.294001] [INFO ] [MAIN ] IT: Full history saved. [2025-09-23T19:30:07.294130] [INFO ] [MAIN ] Update Progress: 1131/2372 symbols completed. IT took 28.1s. Estimated remaining: 2h 44m 40s. Rate: 7.5 symbols/min [2025-09-23T19:30:07.407428] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-01. [2025-09-23T19:30:07.502595] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:30:07.541130] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-23T19:30:07.581432] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-23T19:30:07.633594] [DEBUG] [LOCAL ] ITUB: Loaded 53299 existing records from primary storage. [2025-09-23T19:30:07.633817] [INFO ] [MAIN ] ITUB: Loaded 53299 existing records. [2025-09-23T19:30:07.816338] [WARN ] [MAIN ] ITUB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:30:07.816638] [INFO ] [MAIN ] ITUB: Wiping existing primary data before full refresh. [2025-09-23T19:30:07.816732] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-09-23T19:30:07.817963] [DEBUG] [LOCAL ] ITUB: Deleted primary data file. [2025-09-23T19:30:07.818025] [INFO ] [MAIN ] ITUB: Starting full primary refresh. [2025-09-23T19:30:08.207334] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-07. [2025-09-23T19:30:08.211312] [INFO ] [REMOTE ] ITUB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:30:08.407335] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-23T19:30:09.002209] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-09. [2025-09-23T19:30:09.210416] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-23T19:30:09.802244] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2024-12. [2025-09-23T19:30:10.430034] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-23T19:30:10.439176] [INFO ] [REMOTE ] IRT: Full fetch complete (72354 records). [2025-09-23T19:30:10.439374] [DEBUG] [VALIDATOR ] IRT: Validating primary data. [2025-09-23T19:30:10.611003] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-08. [2025-09-23T19:30:10.876669] [DEBUG] [VALIDATOR ] IRT: All expected trading days are present. [2025-09-23T19:30:10.876785] [DEBUG] [VALIDATOR ] IRT: Primary data validation passed. [2025-09-23T19:30:10.877737] [INFO ] [MAIN ] IRT: Fetched primary data is valid. [2025-09-23T19:30:10.877811] [DEBUG] [LOCAL ] IRT: Saving primary data. [2025-09-23T19:30:10.879402] [DEBUG] [LOCAL ] IRT: Trimmed 72354 records to 50392 (keeping 200 days of data) [2025-09-23T19:30:11.209746] [DEBUG] [LOCAL ] IRT: Primary data saved (50392 records). [2025-09-23T19:30:11.209932] [INFO ] [MAIN ] IRT: Full history saved. [2025-09-23T19:30:11.210054] [INFO ] [MAIN ] Update Progress: 1132/2372 symbols completed. IRT took 40.0s. Estimated remaining: 2h 44m 27s. Rate: 7.5 symbols/min [2025-09-23T19:30:11.391088] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:30:11.402194] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-02. [2025-09-23T19:30:11.440945] [DEBUG] [LOCAL ] ITW: Loaded 46386 existing records from primary storage. [2025-09-23T19:30:11.441144] [INFO ] [MAIN ] ITW: Loaded 46386 existing records. [2025-09-23T19:30:11.638960] [WARN ] [MAIN ] ITW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:30:11.639376] [INFO ] [MAIN ] ITW: Wiping existing primary data before full refresh. [2025-09-23T19:30:11.639465] [INFO ] [LOCAL ] ITW: Starting deletion of primary data. [2025-09-23T19:30:11.641216] [DEBUG] [LOCAL ] ITW: Deleted primary data file. [2025-09-23T19:30:11.641282] [INFO ] [MAIN ] ITW: Starting full primary refresh. [2025-09-23T19:30:11.853697] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-23T19:30:11.878446] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-23T19:30:12.121947] [INFO ] [REMOTE ] ITW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:30:12.202225] [INFO ] [REMOTE ] ITW: Fetching primary data for 2024-12. [2025-09-23T19:30:12.839618] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-23T19:30:13.002189] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-01. [2025-09-23T19:30:13.480253] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-23T19:30:13.802198] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-03. [2025-09-23T19:30:13.904270] [DEBUG] [REMOTE ] ITT: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-09-23T19:30:13.904584] [WARN ] [REMOTE ] ITT: No data returned for month 2025-03 [2025-09-23T19:30:14.602195] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-09. [2025-09-23T19:30:14.781063] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-23T19:30:15.402204] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-02. [2025-09-23T19:30:16.014343] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-23T19:30:16.019921] [INFO ] [REMOTE ] ITGR: Full fetch complete (41221 records). [2025-09-23T19:30:16.020090] [DEBUG] [VALIDATOR ] ITGR: Validating primary data. [2025-09-23T19:30:16.207358] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-01. [2025-09-23T19:30:16.398828] [DEBUG] [VALIDATOR ] ITGR: All expected trading days are present. [2025-09-23T19:30:16.398923] [DEBUG] [VALIDATOR ] ITGR: Primary data validation passed. [2025-09-23T19:30:16.399593] [INFO ] [MAIN ] ITGR: Fetched primary data is valid. [2025-09-23T19:30:16.399634] [DEBUG] [LOCAL ] ITGR: Saving primary data. [2025-09-23T19:30:16.400538] [DEBUG] [LOCAL ] ITGR: Trimmed 41221 records to 31561 (keeping 200 days of data) [2025-09-23T19:30:16.588085] [DEBUG] [LOCAL ] ITGR: Primary data saved (31561 records). [2025-09-23T19:30:16.588230] [INFO ] [MAIN ] ITGR: Full history saved. [2025-09-23T19:30:16.588315] [INFO ] [MAIN ] Update Progress: 1133/2372 symbols completed. ITGR took 28.1s. Estimated remaining: 2h 44m 17s. Rate: 7.5 symbols/min [2025-09-23T19:30:16.754600] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:30:16.799401] [DEBUG] [LOCAL ] IVR: Loaded 47819 existing records from primary storage. [2025-09-23T19:30:16.799563] [INFO ] [MAIN ] IVR: Loaded 47819 existing records. [2025-09-23T19:30:16.976392] [WARN ] [MAIN ] IVR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:30:16.976714] [INFO ] [MAIN ] IVR: Wiping existing primary data before full refresh. [2025-09-23T19:30:16.976774] [INFO ] [LOCAL ] IVR: Starting deletion of primary data. [2025-09-23T19:30:16.977848] [DEBUG] [LOCAL ] IVR: Deleted primary data file. [2025-09-23T19:30:16.977909] [INFO ] [MAIN ] IVR: Starting full primary refresh. [2025-09-23T19:30:17.011015] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-04. [2025-09-23T19:30:17.356503] [INFO ] [REMOTE ] IVR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:30:17.802170] [INFO ] [REMOTE ] IVR: Fetching primary data for 2024-12. [2025-09-23T19:30:17.992131] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-02 (2.59 seconds). [2025-09-23T19:30:18.602184] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-03. [2025-09-23T19:30:18.737138] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-01 (2.53 seconds). [2025-09-23T19:30:19.402204] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-02. [2025-09-23T19:30:19.484972] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-09-23T19:30:19.658954] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-23T19:30:20.080697] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-23T19:30:20.202244] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-04. [2025-09-23T19:30:20.952971] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-23T19:30:21.002206] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-03. [2025-09-23T19:30:21.802244] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-01. [2025-09-23T19:30:22.083687] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-23T19:30:22.349990] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-23T19:30:22.602216] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-05. [2025-09-23T19:30:23.402172] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-04. [2025-09-23T19:30:23.430140] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-23T19:30:23.732355] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-23T19:30:24.202230] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-05. [2025-09-23T19:30:25.002181] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-02. [2025-09-23T19:30:25.366541] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-23T19:30:25.802201] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-06. [2025-09-23T19:30:26.103539] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-23T19:30:26.598745] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-23T19:30:26.607267] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-06. [2025-09-23T19:30:27.147016] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-23T19:30:27.402208] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-03. [2025-09-23T19:30:28.123107] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-23T19:30:28.202204] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-07. [2025-09-23T19:30:29.002218] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-05. [2025-09-23T19:30:29.099389] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-23T19:30:29.620452] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-23T19:30:29.802229] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-07. [2025-09-23T19:30:30.602219] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-04. [2025-09-23T19:30:30.695420] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-23T19:30:31.402207] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-06. [2025-09-23T19:30:32.202311] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-08. [2025-09-23T19:30:32.799882] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-07 (3.00 seconds). [2025-09-23T19:30:32.882315] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-23T19:30:33.002218] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-05. [2025-09-23T19:30:33.088528] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-23T19:30:33.230358] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-23T19:30:33.802233] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-09. [2025-09-23T19:30:34.581635] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-23T19:30:34.602179] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-06. [2025-09-23T19:30:34.695188] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-23T19:30:34.700498] [INFO ] [REMOTE ] ITT: Full fetch complete (41377 records). [2025-09-23T19:30:34.700693] [DEBUG] [VALIDATOR ] ITT: Validating primary data. [2025-09-23T19:30:34.908141] [WARN ] [VALIDATOR ] ITT: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-23T19:30:34.908719] [FATAL] [MAIN ] ITT: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:30:34.908806] [WARN ] [MAIN ] ITT: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:30:34.908884] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-09-23T19:30:34.908959] [DEBUG] [LOCAL ] ITT: No primary data file found to delete. [2025-09-23T19:30:34.909011] [INFO ] [LOCAL ] ITT: Starting deletion of derivative data. [2025-09-23T19:30:34.909516] [DEBUG] [LOCAL ] ITT: Deleted derivative data file. [2025-09-23T19:30:34.909635] [INFO ] [MAIN ] Update Progress: 1134/2372 symbols completed. ITT took 30.0s. Estimated remaining: 2h 44m 20s. Rate: 7.5 symbols/min [2025-09-23T19:30:35.096882] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:30:35.136558] [DEBUG] [LOCAL ] IVT: Loaded 30914 existing records from primary storage. [2025-09-23T19:30:35.136822] [INFO ] [MAIN ] IVT: Loaded 30914 existing records. [2025-09-23T19:30:35.320511] [WARN ] [MAIN ] IVT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:30:35.320879] [INFO ] [MAIN ] IVT: Wiping existing primary data before full refresh. [2025-09-23T19:30:35.320930] [INFO ] [LOCAL ] IVT: Starting deletion of primary data. [2025-09-23T19:30:35.321773] [DEBUG] [LOCAL ] IVT: Deleted primary data file. [2025-09-23T19:30:35.321833] [INFO ] [MAIN ] IVT: Starting full primary refresh. [2025-09-23T19:30:35.407403] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-08. [2025-09-23T19:30:35.688693] [INFO ] [REMOTE ] IVT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:30:35.879661] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-23T19:30:36.202275] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-07. [2025-09-23T19:30:37.002216] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-07. [2025-09-23T19:30:37.158799] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-23T19:30:37.802256] [INFO ] [REMOTE ] IVT: Fetching primary data for 2024-12. [2025-09-23T19:30:37.864548] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-23T19:30:38.602174] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-09. [2025-09-23T19:30:39.068278] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-23T19:30:39.193176] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-23T19:30:39.402209] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-01. [2025-09-23T19:30:40.120033] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-23T19:30:40.129157] [INFO ] [REMOTE ] ITUB: Full fetch complete (77160 records). [2025-09-23T19:30:40.129331] [DEBUG] [VALIDATOR ] ITUB: Validating primary data. [2025-09-23T19:30:40.207282] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-08. [2025-09-23T19:30:40.554468] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-23T19:30:40.554732] [DEBUG] [VALIDATOR ] ITUB: All expected trading days are present. [2025-09-23T19:30:40.561120] [DEBUG] [VALIDATOR ] ITUB: Primary data validation passed. [2025-09-23T19:30:40.562602] [INFO ] [MAIN ] ITUB: Fetched primary data is valid. [2025-09-23T19:30:40.562714] [DEBUG] [LOCAL ] ITUB: Saving primary data. [2025-09-23T19:30:40.564385] [DEBUG] [LOCAL ] ITUB: Trimmed 77160 records to 53304 (keeping 200 days of data) [2025-09-23T19:30:40.881606] [DEBUG] [LOCAL ] ITUB: Primary data saved (53304 records). [2025-09-23T19:30:40.881792] [INFO ] [MAIN ] ITUB: Full history saved. [2025-09-23T19:30:40.881919] [INFO ] [MAIN ] Update Progress: 1135/2372 symbols completed. ITUB took 33.6s. Estimated remaining: 2h 44m 10s. Rate: 7.5 symbols/min [2025-09-23T19:30:41.007261] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-08. [2025-09-23T19:30:41.059227] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:30:41.113050] [DEBUG] [LOCAL ] IVZ: Loaded 53143 existing records from primary storage. [2025-09-23T19:30:41.113233] [INFO ] [MAIN ] IVZ: Loaded 53143 existing records. [2025-09-23T19:30:41.295027] [WARN ] [MAIN ] IVZ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:30:41.295309] [INFO ] [MAIN ] IVZ: Wiping existing primary data before full refresh. [2025-09-23T19:30:41.295358] [INFO ] [LOCAL ] IVZ: Starting deletion of primary data. [2025-09-23T19:30:41.296608] [DEBUG] [LOCAL ] IVZ: Deleted primary data file. [2025-09-23T19:30:41.296692] [INFO ] [MAIN ] IVZ: Starting full primary refresh. [2025-09-23T19:30:41.675513] [INFO ] [REMOTE ] IVZ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:30:41.802174] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-02. [2025-09-23T19:30:41.911498] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-23T19:30:42.602267] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-09. [2025-09-23T19:30:42.766587] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-23T19:30:42.835022] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-23T19:30:43.402244] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-09. [2025-09-23T19:30:43.936470] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-23T19:30:43.945003] [INFO ] [REMOTE ] ITW: Full fetch complete (66562 records). [2025-09-23T19:30:43.945228] [DEBUG] [VALIDATOR ] ITW: Validating primary data. [2025-09-23T19:30:44.211298] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2024-12. [2025-09-23T19:30:44.359228] [DEBUG] [VALIDATOR ] ITW: All expected trading days are present. [2025-09-23T19:30:44.359340] [DEBUG] [VALIDATOR ] ITW: Primary data validation passed. [2025-09-23T19:30:44.360585] [INFO ] [MAIN ] ITW: Fetched primary data is valid. [2025-09-23T19:30:44.360674] [DEBUG] [LOCAL ] ITW: Saving primary data. [2025-09-23T19:30:44.362559] [DEBUG] [LOCAL ] ITW: Trimmed 66562 records to 46324 (keeping 200 days of data) [2025-09-23T19:30:44.693746] [DEBUG] [LOCAL ] ITW: Primary data saved (46324 records). [2025-09-23T19:30:44.694005] [INFO ] [MAIN ] ITW: Full history saved. [2025-09-23T19:30:44.694142] [INFO ] [MAIN ] Update Progress: 1136/2372 symbols completed. ITW took 33.5s. Estimated remaining: 2h 43m 57s. Rate: 7.5 symbols/min [2025-09-23T19:30:44.887428] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:30:44.911019] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-23T19:30:44.919589] [INFO ] [REMOTE ] IVR: Full fetch complete (68932 records). [2025-09-23T19:30:44.919847] [DEBUG] [VALIDATOR ] IVR: Validating primary data. [2025-09-23T19:30:45.013351] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-03. [2025-09-23T19:30:45.195520] [DEBUG] [LOCAL ] IX: Loaded 22628 existing records from primary storage. [2025-09-23T19:30:45.247341] [INFO ] [MAIN ] IX: Loaded 22628 existing records. [2025-09-23T19:30:45.534146] [DEBUG] [VALIDATOR ] IVR: All expected trading days are present. [2025-09-23T19:30:45.539745] [DEBUG] [VALIDATOR ] IVR: Primary data validation passed. [2025-09-23T19:30:45.569087] [INFO ] [MAIN ] IVR: Fetched primary data is valid. [2025-09-23T19:30:45.572855] [DEBUG] [LOCAL ] IVR: Saving primary data. [2025-09-23T19:30:45.573022] [WARN ] [MAIN ] IX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:30:45.573534] [INFO ] [MAIN ] IX: Wiping existing primary data before full refresh. [2025-09-23T19:30:45.573584] [INFO ] [LOCAL ] IX: Starting deletion of primary data. [2025-09-23T19:30:45.574300] [DEBUG] [LOCAL ] IX: Deleted primary data file. [2025-09-23T19:30:45.574367] [INFO ] [MAIN ] IX: Starting full primary refresh. [2025-09-23T19:30:45.619492] [DEBUG] [LOCAL ] IVR: Trimmed 68932 records to 47868 (keeping 200 days of data) [2025-09-23T19:30:46.044837] [INFO ] [REMOTE ] IX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:30:46.047092] [INFO ] [REMOTE ] IX: Fetching primary data for 2024-12. [2025-09-23T19:30:46.098202] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-23T19:30:46.271658] [DEBUG] [LOCAL ] IVR: Primary data saved (47868 records). [2025-09-23T19:30:46.271815] [INFO ] [MAIN ] IVR: Full history saved. [2025-09-23T19:30:46.271907] [INFO ] [MAIN ] Update Progress: 1137/2372 symbols completed. IVR took 29.7s. Estimated remaining: 2h 43m 42s. Rate: 7.5 symbols/min [2025-09-23T19:30:46.453107] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:30:46.471940] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-23T19:30:46.520938] [DEBUG] [LOCAL ] J: Loaded 40502 existing records from primary storage. [2025-09-23T19:30:46.521136] [INFO ] [MAIN ] J: Loaded 40502 existing records. [2025-09-23T19:30:46.612050] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-01. [2025-09-23T19:30:46.705190] [WARN ] [MAIN ] J: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:30:46.705623] [INFO ] [MAIN ] J: Wiping existing primary data before full refresh. [2025-09-23T19:30:46.705708] [INFO ] [LOCAL ] J: Starting deletion of primary data. [2025-09-23T19:30:46.707184] [DEBUG] [LOCAL ] J: Deleted primary data file. [2025-09-23T19:30:46.707246] [INFO ] [MAIN ] J: Starting full primary refresh. [2025-09-23T19:30:46.871238] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-23T19:30:47.081089] [INFO ] [REMOTE ] J: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:30:47.402260] [INFO ] [REMOTE ] J: Fetching primary data for 2024-12. [2025-09-23T19:30:48.202160] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-04. [2025-09-23T19:30:48.243420] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-23T19:30:48.986612] [INFO ] [REMOTE ] J: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-23T19:30:49.002140] [INFO ] [REMOTE ] J: Fetching primary data for 2025-01. [2025-09-23T19:30:49.611710] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-23T19:30:49.802203] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-02. [2025-09-23T19:30:50.591147] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-23T19:30:50.602134] [INFO ] [REMOTE ] J: Fetching primary data for 2025-02. [2025-09-23T19:30:51.402168] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-01. [2025-09-23T19:30:51.503486] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-23T19:30:51.863453] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-23T19:30:52.186470] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-23T19:30:52.202140] [INFO ] [REMOTE ] J: Fetching primary data for 2025-03. [2025-09-23T19:30:53.002275] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-02. [2025-09-23T19:30:53.496059] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-23T19:30:53.776860] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-23T19:30:53.802262] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-05. [2025-09-23T19:30:54.602262] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-03. [2025-09-23T19:30:54.765273] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-23T19:30:55.402209] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-06. [2025-09-23T19:30:55.597554] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-23T19:30:56.202205] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-03. [2025-09-23T19:30:56.226154] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-23T19:30:57.002276] [INFO ] [REMOTE ] J: Fetching primary data for 2025-04. [2025-09-23T19:30:57.802218] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-04. [2025-09-23T19:30:58.065025] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-23T19:30:58.504215] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-23T19:30:58.602247] [INFO ] [REMOTE ] J: Fetching primary data for 2025-05. [2025-09-23T19:30:58.761400] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-23T19:30:59.402209] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-07. [2025-09-23T19:31:00.202267] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-04. [2025-09-23T19:31:00.376351] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-23T19:31:00.549165] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-23T19:31:01.002239] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-05. [2025-09-23T19:31:01.802161] [INFO ] [REMOTE ] J: Fetching primary data for 2025-06. [2025-09-23T19:31:01.943758] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-23T19:31:02.209604] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-23T19:31:02.602197] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-05. [2025-09-23T19:31:03.008839] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-23T19:31:03.402219] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-08. [2025-09-23T19:31:04.202169] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-06. [2025-09-23T19:31:04.285932] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-23T19:31:04.695950] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-23T19:31:05.002164] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-06. [2025-09-23T19:31:05.340072] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-23T19:31:05.802215] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-09. [2025-09-23T19:31:06.602175] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-07. [2025-09-23T19:31:06.698712] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-23T19:31:06.852200] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-23T19:31:06.857678] [INFO ] [REMOTE ] IVT: Full fetch complete (45647 records). [2025-09-23T19:31:06.857868] [DEBUG] [VALIDATOR ] IVT: Validating primary data. [2025-09-23T19:31:07.241662] [DEBUG] [VALIDATOR ] IVT: All expected trading days are present. [2025-09-23T19:31:07.241762] [DEBUG] [VALIDATOR ] IVT: Primary data validation passed. [2025-09-23T19:31:07.242474] [INFO ] [MAIN ] IVT: Fetched primary data is valid. [2025-09-23T19:31:07.242537] [DEBUG] [LOCAL ] IVT: Saving primary data. [2025-09-23T19:31:07.243639] [DEBUG] [LOCAL ] IVT: Trimmed 45647 records to 30966 (keeping 200 days of data) [2025-09-23T19:31:07.363596] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-23T19:31:07.423443] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-07. [2025-09-23T19:31:07.466798] [DEBUG] [LOCAL ] IVT: Primary data saved (30966 records). [2025-09-23T19:31:07.466974] [INFO ] [MAIN ] IVT: Full history saved. [2025-09-23T19:31:07.467073] [INFO ] [MAIN ] Update Progress: 1138/2372 symbols completed. IVT took 32.6s. Estimated remaining: 2h 43m 49s. Rate: 7.5 symbols/min [2025-09-23T19:31:07.644445] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:31:07.686424] [DEBUG] [LOCAL ] JBGS: Loaded 42420 existing records from primary storage. [2025-09-23T19:31:07.686588] [INFO ] [MAIN ] JBGS: Loaded 42420 existing records. [2025-09-23T19:31:07.863944] [WARN ] [MAIN ] JBGS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:31:07.864200] [INFO ] [MAIN ] JBGS: Wiping existing primary data before full refresh. [2025-09-23T19:31:07.864250] [INFO ] [LOCAL ] JBGS: Starting deletion of primary data. [2025-09-23T19:31:07.865442] [DEBUG] [LOCAL ] JBGS: Deleted primary data file. [2025-09-23T19:31:07.865515] [INFO ] [MAIN ] JBGS: Starting full primary refresh. [2025-09-23T19:31:08.207337] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-08. [2025-09-23T19:31:08.245223] [INFO ] [REMOTE ] JBGS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:31:09.002197] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2024-12. [2025-09-23T19:31:09.216699] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-23T19:31:09.293395] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-23T19:31:09.802194] [INFO ] [REMOTE ] J: Fetching primary data for 2025-07. [2025-09-23T19:31:10.193570] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-23T19:31:10.602208] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-08. [2025-09-23T19:31:11.001105] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-23T19:31:11.402204] [INFO ] [REMOTE ] J: Fetching primary data for 2025-08. [2025-09-23T19:31:12.202162] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-09. [2025-09-23T19:31:12.285480] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-23T19:31:12.877153] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-23T19:31:13.002190] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-01. [2025-09-23T19:31:13.221346] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-23T19:31:13.225062] [INFO ] [REMOTE ] IX: Full fetch complete (26764 records). [2025-09-23T19:31:13.225197] [DEBUG] [VALIDATOR ] IX: Validating primary data. [2025-09-23T19:31:13.612066] [DEBUG] [VALIDATOR ] IX: All expected trading days are present. [2025-09-23T19:31:13.612165] [DEBUG] [VALIDATOR ] IX: Primary data validation passed. [2025-09-23T19:31:13.612821] [INFO ] [MAIN ] IX: Fetched primary data is valid. [2025-09-23T19:31:13.612886] [DEBUG] [LOCAL ] IX: Saving primary data. [2025-09-23T19:31:13.613797] [DEBUG] [LOCAL ] IX: Trimmed 26764 records to 22600 (keeping 200 days of data) [2025-09-23T19:31:13.748192] [DEBUG] [LOCAL ] IX: Primary data saved (22600 records). [2025-09-23T19:31:13.748367] [INFO ] [MAIN ] IX: Full history saved. [2025-09-23T19:31:13.748517] [INFO ] [MAIN ] Update Progress: 1139/2372 symbols completed. IX took 29.1s. Estimated remaining: 2h 43m 39s. Rate: 7.5 symbols/min [2025-09-23T19:31:13.808988] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-09. [2025-09-23T19:31:13.950891] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:31:13.994583] [DEBUG] [LOCAL ] JBI: Loaded 44019 existing records from primary storage. [2025-09-23T19:31:13.994783] [INFO ] [MAIN ] JBI: Loaded 44019 existing records. [2025-09-23T19:31:14.181737] [WARN ] [MAIN ] JBI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:31:14.182054] [INFO ] [MAIN ] JBI: Wiping existing primary data before full refresh. [2025-09-23T19:31:14.182104] [INFO ] [LOCAL ] JBI: Starting deletion of primary data. [2025-09-23T19:31:14.183041] [DEBUG] [LOCAL ] JBI: Deleted primary data file. [2025-09-23T19:31:14.183103] [INFO ] [MAIN ] JBI: Starting full primary refresh. [2025-09-23T19:31:14.579549] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-23T19:31:14.602714] [INFO ] [REMOTE ] J: Fetching primary data for 2025-09. [2025-09-23T19:31:14.621628] [INFO ] [REMOTE ] JBI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:31:15.402216] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-02. [2025-09-23T19:31:15.621222] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-23T19:31:15.630128] [INFO ] [REMOTE ] IVZ: Full fetch complete (76741 records). [2025-09-23T19:31:15.630295] [DEBUG] [VALIDATOR ] IVZ: Validating primary data. [2025-09-23T19:31:16.079018] [DEBUG] [VALIDATOR ] IVZ: All expected trading days are present. [2025-09-23T19:31:16.078874] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-23T19:31:16.085674] [DEBUG] [VALIDATOR ] IVZ: Primary data validation passed. [2025-09-23T19:31:16.087706] [INFO ] [MAIN ] IVZ: Fetched primary data is valid. [2025-09-23T19:31:16.087928] [INFO ] [REMOTE ] J: Full fetch complete (59187 records). [2025-09-23T19:31:16.088045] [DEBUG] [LOCAL ] IVZ: Saving primary data. [2025-09-23T19:31:16.088167] [DEBUG] [VALIDATOR ] J: Validating primary data. [2025-09-23T19:31:16.199340] [DEBUG] [LOCAL ] IVZ: Trimmed 76741 records to 53139 (keeping 200 days of data) [2025-09-23T19:31:16.205192] [INFO ] [REMOTE ] JBI: Fetching primary data for 2024-12. [2025-09-23T19:31:16.604888] [DEBUG] [VALIDATOR ] J: All expected trading days are present. [2025-09-23T19:31:16.606247] [DEBUG] [VALIDATOR ] J: Primary data validation passed. [2025-09-23T19:31:16.607360] [INFO ] [MAIN ] J: Fetched primary data is valid. [2025-09-23T19:31:16.608241] [DEBUG] [LOCAL ] J: Saving primary data. [2025-09-23T19:31:16.625137] [DEBUG] [LOCAL ] J: Trimmed 59187 records to 40439 (keeping 200 days of data) [2025-09-23T19:31:16.649437] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-23T19:31:17.007207] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-03. [2025-09-23T19:31:17.142845] [DEBUG] [LOCAL ] IVZ: Primary data saved (53139 records). [2025-09-23T19:31:17.147721] [INFO ] [MAIN ] IVZ: Full history saved. [2025-09-23T19:31:17.148086] [INFO ] [MAIN ] Update Progress: 1140/2372 symbols completed. IVZ took 36.3s. Estimated remaining: 2h 43m 26s. Rate: 7.5 symbols/min [2025-09-23T19:31:17.148601] [DEBUG] [LOCAL ] J: Primary data saved (40439 records). [2025-09-23T19:31:17.154275] [INFO ] [MAIN ] J: Full history saved. [2025-09-23T19:31:17.199132] [INFO ] [MAIN ] Update Progress: 1141/2372 symbols completed. J took 30.9s. Estimated remaining: 2h 43m 10s. Rate: 7.5 symbols/min [2025-09-23T19:31:17.508431] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:31:17.511397] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:31:17.541146] [DEBUG] [LOCAL ] JBND: Loaded 25326 existing records from primary storage. [2025-09-23T19:31:17.541315] [INFO ] [MAIN ] JBND: Loaded 25326 existing records. [2025-09-23T19:31:17.751792] [WARN ] [MAIN ] JBND: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:31:17.769537] [INFO ] [MAIN ] JBND: Wiping existing primary data before full refresh. [2025-09-23T19:31:17.769701] [INFO ] [LOCAL ] JBND: Starting deletion of primary data. [2025-09-23T19:31:17.771040] [DEBUG] [LOCAL ] JBND: Deleted primary data file. [2025-09-23T19:31:17.771302] [INFO ] [MAIN ] JBND: Starting full primary refresh. [2025-09-23T19:31:17.771195] [DEBUG] [LOCAL ] JBL: Loaded 48357 existing records from primary storage. [2025-09-23T19:31:17.805755] [INFO ] [MAIN ] JBL: Loaded 48357 existing records. [2025-09-23T19:31:18.256535] [WARN ] [MAIN ] JBL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:31:18.270293] [INFO ] [MAIN ] JBL: Wiping existing primary data before full refresh. [2025-09-23T19:31:18.270726] [INFO ] [LOCAL ] JBL: Starting deletion of primary data. [2025-09-23T19:31:18.302662] [DEBUG] [LOCAL ] JBL: Deleted primary data file. [2025-09-23T19:31:18.320321] [INFO ] [MAIN ] JBL: Starting full primary refresh. [2025-09-23T19:31:18.370095] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-23T19:31:18.445269] [INFO ] [REMOTE ] JBND: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:31:18.465769] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-01. [2025-09-23T19:31:18.603062] [INFO ] [REMOTE ] JBND: Fetching primary data for 2024-12. [2025-09-23T19:31:18.729483] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-23T19:31:18.821279] [INFO ] [REMOTE ] JBL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:31:19.402236] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-04. [2025-09-23T19:31:19.696096] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-23T19:31:19.881145] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-23T19:31:20.202231] [INFO ] [REMOTE ] JBL: Fetching primary data for 2024-12. [2025-09-23T19:31:21.002183] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-02. [2025-09-23T19:31:21.042950] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-23T19:31:21.475495] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-23T19:31:21.802333] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-05. [2025-09-23T19:31:21.943571] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-23T19:31:22.602247] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-03. [2025-09-23T19:31:23.181155] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-23T19:31:23.402250] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-01. [2025-09-23T19:31:24.202255] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-06. [2025-09-23T19:31:24.272347] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-23T19:31:24.834086] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-23T19:31:25.002167] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-02. [2025-09-23T19:31:25.769246] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-23T19:31:25.802143] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-07. [2025-09-23T19:31:26.602187] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-01. [2025-09-23T19:31:26.676797] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-23T19:31:26.888765] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-23T19:31:27.139107] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-23T19:31:27.402191] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-08. [2025-09-23T19:31:28.202211] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-02. [2025-09-23T19:31:28.844070] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-23T19:31:29.002192] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-03. [2025-09-23T19:31:29.147404] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-23T19:31:29.802227] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-09. [2025-09-23T19:31:30.602239] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-03. [2025-09-23T19:31:30.991529] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-23T19:31:31.237178] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-23T19:31:31.245103] [INFO ] [REMOTE ] JBGS: Full fetch complete (58949 records). [2025-09-23T19:31:31.245290] [DEBUG] [VALIDATOR ] JBGS: Validating primary data. [2025-09-23T19:31:31.406830] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-04. [2025-09-23T19:31:31.680119] [DEBUG] [VALIDATOR ] JBGS: All expected trading days are present. [2025-09-23T19:31:31.680316] [DEBUG] [VALIDATOR ] JBGS: Primary data validation passed. [2025-09-23T19:31:31.681313] [INFO ] [MAIN ] JBGS: Fetched primary data is valid. [2025-09-23T19:31:31.681449] [DEBUG] [LOCAL ] JBGS: Saving primary data. [2025-09-23T19:31:31.698388] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-23T19:31:31.703383] [DEBUG] [LOCAL ] JBGS: Trimmed 58949 records to 42430 (keeping 200 days of data) [2025-09-23T19:31:31.982314] [DEBUG] [LOCAL ] JBGS: Primary data saved (42430 records). [2025-09-23T19:31:31.982456] [INFO ] [MAIN ] JBGS: Full history saved. [2025-09-23T19:31:31.982581] [INFO ] [MAIN ] Update Progress: 1142/2372 symbols completed. JBGS took 24.5s. Estimated remaining: 2h 43m 9s. Rate: 7.5 symbols/min [2025-09-23T19:31:32.168879] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:31:32.169294] [DEBUG] [LOCAL ] JBS: No existing data file found in primary storage. [2025-09-23T19:31:32.169351] [WARN ] [MAIN ] JBS: No existing data found, performing full refresh instead. [2025-09-23T19:31:32.169632] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-09-23T19:31:32.169729] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-09-23T19:31:32.169798] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-09-23T19:31:32.169835] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-09-23T19:31:32.207348] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-04. [2025-09-23T19:31:32.546263] [INFO ] [REMOTE ] JBS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:31:32.879578] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-23T19:31:33.002157] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-05. [2025-09-23T19:31:33.399185] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-23T19:31:33.802239] [INFO ] [REMOTE ] JBS: Fetching primary data for 2024-12. [2025-09-23T19:31:34.042367] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:31:34.042741] [WARN ] [REMOTE ] JBS: No data returned for month 2024-12 [2025-09-23T19:31:34.576160] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-23T19:31:34.602197] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-06. [2025-09-23T19:31:35.402253] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-04. [2025-09-23T19:31:36.152294] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-23T19:31:36.202177] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-07. [2025-09-23T19:31:36.655183] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-23T19:31:37.002189] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-05. [2025-09-23T19:31:37.626713] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-23T19:31:37.802218] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-05. [2025-09-23T19:31:38.161879] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-23T19:31:38.518697] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-23T19:31:38.602212] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-01. [2025-09-23T19:31:38.803182] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:31:38.803471] [WARN ] [REMOTE ] JBS: No data returned for month 2025-01 [2025-09-23T19:31:39.402227] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-02. [2025-09-23T19:31:39.608136] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:31:39.608518] [WARN ] [REMOTE ] JBS: No data returned for month 2025-02 [2025-09-23T19:31:40.202242] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-06. [2025-09-23T19:31:40.861099] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-23T19:31:41.002210] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-08. [2025-09-23T19:31:41.802193] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-07. [2025-09-23T19:31:42.602255] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-06. [2025-09-23T19:31:42.724666] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-23T19:31:43.042141] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-23T19:31:43.402225] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-08. [2025-09-23T19:31:44.065292] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-23T19:31:44.202257] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-03. [2025-09-23T19:31:44.410456] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:31:44.410810] [WARN ] [REMOTE ] JBS: No data returned for month 2025-03 [2025-09-23T19:31:44.550577] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-23T19:31:45.002175] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-04. [2025-09-23T19:31:45.201793] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:31:45.202122] [WARN ] [REMOTE ] JBS: No data returned for month 2025-04 [2025-09-23T19:31:45.802227] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-09. [2025-09-23T19:31:46.602201] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-05. [2025-09-23T19:31:46.806621] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:31:46.807134] [WARN ] [REMOTE ] JBS: No data returned for month 2025-05 [2025-09-23T19:31:47.402335] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-09. [2025-09-23T19:31:47.691163] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-23T19:31:47.700091] [INFO ] [REMOTE ] JBL: Full fetch complete (69915 records). [2025-09-23T19:31:47.700239] [DEBUG] [VALIDATOR ] JBL: Validating primary data. [2025-09-23T19:31:48.133970] [DEBUG] [VALIDATOR ] JBL: All expected trading days are present. [2025-09-23T19:31:48.134096] [DEBUG] [VALIDATOR ] JBL: Primary data validation passed. [2025-09-23T19:31:48.135517] [INFO ] [MAIN ] JBL: Fetched primary data is valid. [2025-09-23T19:31:48.135637] [DEBUG] [LOCAL ] JBL: Saving primary data. [2025-09-23T19:31:48.138119] [DEBUG] [LOCAL ] JBL: Trimmed 69915 records to 48368 (keeping 200 days of data) [2025-09-23T19:31:48.207740] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-07. [2025-09-23T19:31:48.402445] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-23T19:31:48.410400] [INFO ] [REMOTE ] JBND: Full fetch complete (33224 records). [2025-09-23T19:31:48.411075] [DEBUG] [VALIDATOR ] JBND: Validating primary data. [2025-09-23T19:31:48.841552] [DEBUG] [VALIDATOR ] JBND: All expected trading days are present. [2025-09-23T19:31:48.842411] [DEBUG] [VALIDATOR ] JBND: Primary data validation passed. [2025-09-23T19:31:48.843452] [INFO ] [MAIN ] JBND: Fetched primary data is valid. [2025-09-23T19:31:48.843792] [DEBUG] [LOCAL ] JBND: Saving primary data. [2025-09-23T19:31:48.848055] [DEBUG] [LOCAL ] JBND: Trimmed 33224 records to 25406 (keeping 200 days of data) [2025-09-23T19:31:49.003188] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-06. [2025-09-23T19:31:49.008852] [DEBUG] [LOCAL ] JBL: Primary data saved (48368 records). [2025-09-23T19:31:49.009450] [INFO ] [MAIN ] JBL: Full history saved. [2025-09-23T19:31:49.009882] [INFO ] [MAIN ] Update Progress: 1143/2372 symbols completed. JBL took 31.9s. Estimated remaining: 2h 43m 11s. Rate: 7.5 symbols/min [2025-09-23T19:31:49.210221] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:31:49.211790] [DEBUG] [LOCAL ] JBTM: No existing data file found in primary storage. [2025-09-23T19:31:49.212502] [WARN ] [MAIN ] JBTM: No existing data found, performing full refresh instead. [2025-09-23T19:31:49.214300] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-09-23T19:31:49.214615] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-09-23T19:31:49.215247] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-09-23T19:31:49.216169] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-09-23T19:31:49.666606] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:31:49.666749] [DEBUG] [LOCAL ] JBND: Primary data saved (25406 records). [2025-09-23T19:31:49.667094] [INFO ] [MAIN ] JBND: Full history saved. [2025-09-23T19:31:49.667674] [INFO ] [MAIN ] Update Progress: 1144/2372 symbols completed. JBND took 32.4s. Estimated remaining: 2h 42m 55s. Rate: 7.5 symbols/min [2025-09-23T19:31:49.804486] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2024-12. [2025-09-23T19:31:49.867148] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-23T19:31:49.889472] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:31:49.937966] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-23T19:31:49.947772] [DEBUG] [LOCAL ] JCE: Loaded 6457 existing records from primary storage. [2025-09-23T19:31:49.947921] [INFO ] [MAIN ] JCE: Loaded 6457 existing records. [2025-09-23T19:31:50.138858] [WARN ] [MAIN ] JCE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:31:50.139767] [DEBUG] [REMOTE ] JBTM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:31:50.139902] [INFO ] [MAIN ] JCE: Wiping existing primary data before full refresh. [2025-09-23T19:31:50.140136] [WARN ] [REMOTE ] JBTM: No data returned for month 2024-12 [2025-09-23T19:31:50.140215] [INFO ] [LOCAL ] JCE: Starting deletion of primary data. [2025-09-23T19:31:50.140919] [DEBUG] [LOCAL ] JCE: Deleted primary data file. [2025-09-23T19:31:50.140980] [INFO ] [MAIN ] JCE: Starting full primary refresh. [2025-09-23T19:31:50.495191] [INFO ] [REMOTE ] JCE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:31:50.602150] [INFO ] [REMOTE ] JCE: Fetching primary data for 2024-12. [2025-09-23T19:31:51.246321] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-23T19:31:51.402219] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-01. [2025-09-23T19:31:52.202249] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-08. [2025-09-23T19:31:52.330499] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-23T19:31:53.002247] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-07. [2025-09-23T19:31:53.598707] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-23T19:31:53.802202] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-09. [2025-09-23T19:31:54.602169] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-01. [2025-09-23T19:31:54.735826] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-23T19:31:55.009097] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-23T19:31:55.142560] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-23T19:31:55.152109] [INFO ] [REMOTE ] JBI: Full fetch complete (64631 records). [2025-09-23T19:31:55.152263] [DEBUG] [VALIDATOR ] JBI: Validating primary data. [2025-09-23T19:31:55.412028] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-02. [2025-09-23T19:31:55.565431] [DEBUG] [VALIDATOR ] JBI: All expected trading days are present. [2025-09-23T19:31:55.565518] [DEBUG] [VALIDATOR ] JBI: Primary data validation passed. [2025-09-23T19:31:55.566386] [INFO ] [MAIN ] JBI: Fetched primary data is valid. [2025-09-23T19:31:55.566453] [DEBUG] [LOCAL ] JBI: Saving primary data. [2025-09-23T19:31:55.567826] [DEBUG] [LOCAL ] JBI: Trimmed 64631 records to 44004 (keeping 200 days of data) [2025-09-23T19:31:55.839221] [DEBUG] [LOCAL ] JBI: Primary data saved (44004 records). [2025-09-23T19:31:55.839364] [INFO ] [MAIN ] JBI: Full history saved. [2025-09-23T19:31:55.839469] [INFO ] [MAIN ] Update Progress: 1145/2372 symbols completed. JBI took 42.1s. Estimated remaining: 2h 42m 45s. Rate: 7.5 symbols/min [2025-09-23T19:31:56.032927] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:31:56.093189] [DEBUG] [LOCAL ] JCI: Loaded 53548 existing records from primary storage. [2025-09-23T19:31:56.093582] [INFO ] [MAIN ] JCI: Loaded 53548 existing records. [2025-09-23T19:31:56.202331] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-08. [2025-09-23T19:31:56.208913] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-23T19:31:56.289342] [WARN ] [MAIN ] JCI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:31:56.289700] [INFO ] [MAIN ] JCI: Wiping existing primary data before full refresh. [2025-09-23T19:31:56.289757] [INFO ] [LOCAL ] JCI: Starting deletion of primary data. [2025-09-23T19:31:56.291401] [DEBUG] [LOCAL ] JCI: Deleted primary data file. [2025-09-23T19:31:56.291463] [INFO ] [MAIN ] JCI: Starting full primary refresh. [2025-09-23T19:31:56.650212] [INFO ] [REMOTE ] JCI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:31:57.002182] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-03. [2025-09-23T19:31:57.609566] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-23T19:31:57.802193] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-02. [2025-09-23T19:31:58.051170] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-23T19:31:58.602228] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-09. [2025-09-23T19:31:58.705545] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-23T19:31:59.402213] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-04. [2025-09-23T19:32:00.088253] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-23T19:32:00.202232] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-03. [2025-09-23T19:32:00.506376] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-23T19:32:00.517455] [INFO ] [REMOTE ] JBS: Full fetch complete (26371 records). [2025-09-23T19:32:00.517765] [DEBUG] [VALIDATOR ] JBS: Validating primary data. [2025-09-23T19:32:00.810489] [WARN ] [VALIDATOR ] JBS: Validation failed - insufficient historical data. Have 69 unique days, need 200 days [2025-09-23T19:32:00.811124] [FATAL] [MAIN ] JBS: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:32:00.811300] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:32:00.811382] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-09-23T19:32:00.811489] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-09-23T19:32:00.811553] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-09-23T19:32:00.811805] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-09-23T19:32:00.812034] [INFO ] [MAIN ] Update Progress: 1146/2372 symbols completed. JBS took 28.8s. Estimated remaining: 2h 42m 34s. Rate: 7.5 symbols/min [2025-09-23T19:32:01.004493] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-05. [2025-09-23T19:32:01.092209] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:32:01.092624] [DEBUG] [LOCAL ] JEF: No existing data file found in primary storage. [2025-09-23T19:32:01.092773] [WARN ] [MAIN ] JEF: No existing data found, performing full refresh instead. [2025-09-23T19:32:01.093129] [INFO ] [MAIN ] JEF: Wiping existing primary data before full refresh. [2025-09-23T19:32:01.093254] [INFO ] [LOCAL ] JEF: Starting deletion of primary data. [2025-09-23T19:32:01.093342] [DEBUG] [LOCAL ] JEF: No primary data file found to delete. [2025-09-23T19:32:01.093696] [INFO ] [MAIN ] JEF: Starting full primary refresh. [2025-09-23T19:32:01.483810] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-23T19:32:01.558298] [INFO ] [REMOTE ] JEF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:32:01.660007] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-23T19:32:01.802200] [INFO ] [REMOTE ] JEF: Fetching primary data for 2024-12. [2025-09-23T19:32:02.602270] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-06. [2025-09-23T19:32:03.416002] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-23T19:32:03.415149] [INFO ] [REMOTE ] JCI: Fetching primary data for 2024-12. [2025-09-23T19:32:03.429667] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-23T19:32:04.202313] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-07. [2025-09-23T19:32:04.789463] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-23T19:32:05.002225] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-01. [2025-09-23T19:32:05.075745] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-23T19:32:05.802247] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-08. [2025-09-23T19:32:06.414428] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-23T19:32:06.603770] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-09. [2025-09-23T19:32:06.609928] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-23T19:32:07.402241] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-04. [2025-09-23T19:32:07.459961] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-23T19:32:07.462918] [INFO ] [REMOTE ] JCE: Full fetch complete (9046 records). [2025-09-23T19:32:07.463034] [DEBUG] [VALIDATOR ] JCE: Validating primary data. [2025-09-23T19:32:07.872680] [DEBUG] [VALIDATOR ] JCE: All expected trading days are present. [2025-09-23T19:32:07.873025] [DEBUG] [VALIDATOR ] JCE: Primary data validation passed. [2025-09-23T19:32:07.873464] [INFO ] [MAIN ] JCE: Fetched primary data is valid. [2025-09-23T19:32:07.873511] [DEBUG] [LOCAL ] JCE: Saving primary data. [2025-09-23T19:32:07.874206] [DEBUG] [LOCAL ] JCE: Trimmed 9046 records to 6442 (keeping 200 days of data) [2025-09-23T19:32:07.920077] [DEBUG] [LOCAL ] JCE: Primary data saved (6442 records). [2025-09-23T19:32:07.920267] [INFO ] [MAIN ] JCE: Full history saved. [2025-09-23T19:32:07.920401] [INFO ] [MAIN ] Update Progress: 1147/2372 symbols completed. JCE took 18.3s. Estimated remaining: 2h 42m 25s. Rate: 7.5 symbols/min [2025-09-23T19:32:08.103569] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:32:08.159384] [DEBUG] [LOCAL ] JELD: Loaded 46169 existing records from primary storage. [2025-09-23T19:32:08.159621] [INFO ] [MAIN ] JELD: Loaded 46169 existing records. [2025-09-23T19:32:08.207398] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-01. [2025-09-23T19:32:08.353616] [WARN ] [MAIN ] JELD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:32:08.354040] [INFO ] [MAIN ] JELD: Wiping existing primary data before full refresh. [2025-09-23T19:32:08.354096] [INFO ] [LOCAL ] JELD: Starting deletion of primary data. [2025-09-23T19:32:08.355956] [DEBUG] [LOCAL ] JELD: Deleted primary data file. [2025-09-23T19:32:08.356020] [INFO ] [MAIN ] JELD: Starting full primary refresh. [2025-09-23T19:32:08.789191] [INFO ] [REMOTE ] JELD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:32:08.871351] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-23T19:32:09.002215] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-02. [2025-09-23T19:32:09.607625] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-23T19:32:09.802277] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-05. [2025-09-23T19:32:10.116846] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-23T19:32:10.602256] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-03. [2025-09-23T19:32:11.043983] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-23T19:32:11.402231] [INFO ] [REMOTE ] JELD: Fetching primary data for 2024-12. [2025-09-23T19:32:12.178099] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-23T19:32:12.202139] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-04. [2025-09-23T19:32:12.829051] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-23T19:32:13.002299] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-01. [2025-09-23T19:32:13.453769] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-23T19:32:13.802367] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-06. [2025-09-23T19:32:13.945725] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-23T19:32:14.614023] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-02. [2025-09-23T19:32:14.617394] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-23T19:32:14.725204] [DEBUG] [REMOTE ] JELD: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-09-23T19:32:14.725542] [WARN ] [REMOTE ] JELD: No data returned for month 2025-02 [2025-09-23T19:32:15.402240] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-05. [2025-09-23T19:32:16.202245] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-07. [2025-09-23T19:32:17.002219] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-02. [2025-09-23T19:32:17.037813] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-23T19:32:17.492796] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-23T19:32:17.802218] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-06. [2025-09-23T19:32:18.602228] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-08. [2025-09-23T19:32:18.713232] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-23T19:32:19.402243] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-03. [2025-09-23T19:32:19.469822] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-23T19:32:19.548725] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-23T19:32:20.202243] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-09. [2025-09-23T19:32:21.002274] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-03. [2025-09-23T19:32:21.094721] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-23T19:32:21.448965] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-23T19:32:21.455108] [INFO ] [REMOTE ] JBTM: Full fetch complete (41795 records). [2025-09-23T19:32:21.455284] [DEBUG] [VALIDATOR ] JBTM: Validating primary data. [2025-09-23T19:32:21.654574] [WARN ] [VALIDATOR ] JBTM: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-23T19:32:21.655216] [FATAL] [MAIN ] JBTM: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:32:21.655296] [WARN ] [MAIN ] JBTM: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:32:21.655378] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-09-23T19:32:21.655452] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-09-23T19:32:21.655492] [INFO ] [LOCAL ] JBTM: Starting deletion of derivative data. [2025-09-23T19:32:21.655532] [DEBUG] [LOCAL ] JBTM: No derivative data file found to delete. [2025-09-23T19:32:21.655628] [INFO ] [MAIN ] Update Progress: 1148/2372 symbols completed. JBTM took 32.6s. Estimated remaining: 2h 42m 23s. Rate: 7.5 symbols/min [2025-09-23T19:32:21.825489] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-04. [2025-09-23T19:32:21.829452] [INFO ] [MAIN ] JEQ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:32:21.842385] [DEBUG] [LOCAL ] JEQ: Loaded 9079 existing records from primary storage. [2025-09-23T19:32:21.842502] [INFO ] [MAIN ] JEQ: Loaded 9079 existing records. [2025-09-23T19:32:22.027079] [WARN ] [MAIN ] JEQ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:32:22.027354] [INFO ] [MAIN ] JEQ: Wiping existing primary data before full refresh. [2025-09-23T19:32:22.027409] [INFO ] [LOCAL ] JEQ: Starting deletion of primary data. [2025-09-23T19:32:22.027865] [DEBUG] [LOCAL ] JEQ: Deleted primary data file. [2025-09-23T19:32:22.027926] [INFO ] [MAIN ] JEQ: Starting full primary refresh. [2025-09-23T19:32:22.423257] [INFO ] [REMOTE ] JEQ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:32:22.456530] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-23T19:32:22.602200] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2024-12. [2025-09-23T19:32:23.204628] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-23T19:32:23.227298] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-23T19:32:23.402268] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-04. [2025-09-23T19:32:24.202282] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-05. [2025-09-23T19:32:24.903363] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-23T19:32:25.002165] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-05. [2025-09-23T19:32:25.802210] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-01. [2025-09-23T19:32:25.956861] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-23T19:32:26.207850] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-23T19:32:26.289940] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-23T19:32:26.602236] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-07. [2025-09-23T19:32:27.402264] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-06. [2025-09-23T19:32:28.202239] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-02. [2025-09-23T19:32:28.334471] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-23T19:32:28.900052] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-23T19:32:28.926144] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-23T19:32:29.002147] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-07. [2025-09-23T19:32:29.802233] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-06. [2025-09-23T19:32:30.234884] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-23T19:32:30.602259] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-03. [2025-09-23T19:32:31.283751] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-23T19:32:31.402195] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-08. [2025-09-23T19:32:31.573788] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-23T19:32:32.202203] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-08. [2025-09-23T19:32:33.002218] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-07. [2025-09-23T19:32:33.063874] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-23T19:32:33.572077] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-23T19:32:33.802210] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-09. [2025-09-23T19:32:34.602221] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-09. [2025-09-23T19:32:34.855954] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-23T19:32:35.001942] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-23T19:32:35.010424] [INFO ] [REMOTE ] JEF: Full fetch complete (72812 records). [2025-09-23T19:32:35.010595] [DEBUG] [VALIDATOR ] JEF: Validating primary data. [2025-09-23T19:32:35.410410] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-08. [2025-09-23T19:32:35.434736] [DEBUG] [VALIDATOR ] JEF: All expected trading days are present. [2025-09-23T19:32:35.434818] [DEBUG] [VALIDATOR ] JEF: Primary data validation passed. [2025-09-23T19:32:35.435770] [INFO ] [MAIN ] JEF: Fetched primary data is valid. [2025-09-23T19:32:35.435929] [DEBUG] [LOCAL ] JEF: Saving primary data. [2025-09-23T19:32:35.437441] [DEBUG] [LOCAL ] JEF: Trimmed 72812 records to 50003 (keeping 200 days of data) [2025-09-23T19:32:35.760070] [DEBUG] [LOCAL ] JEF: Primary data saved (50003 records). [2025-09-23T19:32:35.760240] [INFO ] [MAIN ] JEF: Full history saved. [2025-09-23T19:32:35.760325] [INFO ] [MAIN ] Update Progress: 1149/2372 symbols completed. JEF took 34.9s. Estimated remaining: 2h 42m 22s. Rate: 7.5 symbols/min [2025-09-23T19:32:35.934079] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:32:35.963953] [DEBUG] [LOCAL ] JFR: Loaded 30377 existing records from primary storage. [2025-09-23T19:32:35.964103] [INFO ] [MAIN ] JFR: Loaded 30377 existing records. [2025-09-23T19:32:36.165006] [WARN ] [MAIN ] JFR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:32:36.165483] [INFO ] [MAIN ] JFR: Wiping existing primary data before full refresh. [2025-09-23T19:32:36.165552] [INFO ] [LOCAL ] JFR: Starting deletion of primary data. [2025-09-23T19:32:36.166953] [DEBUG] [LOCAL ] JFR: Deleted primary data file. [2025-09-23T19:32:36.167018] [INFO ] [MAIN ] JFR: Starting full primary refresh. [2025-09-23T19:32:36.210028] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-04. [2025-09-23T19:32:36.323883] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-23T19:32:36.377360] [INFO ] [REMOTE ] JELD: Full fetch complete (57769 records). [2025-09-23T19:32:36.395966] [DEBUG] [VALIDATOR ] JELD: Validating primary data. [2025-09-23T19:32:36.789594] [WARN ] [VALIDATOR ] JELD: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-23T19:32:36.814266] [FATAL] [MAIN ] JELD: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:32:36.812530] [INFO ] [REMOTE ] JFR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:32:36.814976] [WARN ] [MAIN ] JELD: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:32:36.815228] [INFO ] [LOCAL ] JELD: Starting deletion of primary data. [2025-09-23T19:32:36.815685] [DEBUG] [LOCAL ] JELD: No primary data file found to delete. [2025-09-23T19:32:36.815765] [INFO ] [LOCAL ] JELD: Starting deletion of derivative data. [2025-09-23T19:32:36.824693] [DEBUG] [LOCAL ] JELD: Deleted derivative data file. [2025-09-23T19:32:36.824907] [INFO ] [MAIN ] Update Progress: 1150/2372 symbols completed. JELD took 28.9s. Estimated remaining: 2h 42m 7s. Rate: 7.5 symbols/min [2025-09-23T19:32:36.859042] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-23T19:32:37.008396] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:32:37.008509] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-05. [2025-09-23T19:32:37.052007] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-23T19:32:37.057356] [DEBUG] [LOCAL ] JGH: Loaded 10943 existing records from primary storage. [2025-09-23T19:32:37.068984] [INFO ] [MAIN ] JGH: Loaded 10943 existing records. [2025-09-23T19:32:37.256988] [WARN ] [MAIN ] JGH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:32:37.257283] [INFO ] [MAIN ] JGH: Wiping existing primary data before full refresh. [2025-09-23T19:32:37.257410] [INFO ] [LOCAL ] JGH: Starting deletion of primary data. [2025-09-23T19:32:37.257915] [DEBUG] [LOCAL ] JGH: Deleted primary data file. [2025-09-23T19:32:37.257977] [INFO ] [MAIN ] JGH: Starting full primary refresh. [2025-09-23T19:32:37.622220] [INFO ] [REMOTE ] JGH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:32:37.776924] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-23T19:32:37.802191] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-06. [2025-09-23T19:32:38.400038] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-23T19:32:38.602203] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-09. [2025-09-23T19:32:39.402201] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-07. [2025-09-23T19:32:40.024067] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-23T19:32:40.105005] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-23T19:32:40.113897] [INFO ] [REMOTE ] JCI: Full fetch complete (77409 records). [2025-09-23T19:32:40.114072] [DEBUG] [VALIDATOR ] JCI: Validating primary data. [2025-09-23T19:32:40.207349] [INFO ] [REMOTE ] JGH: Fetching primary data for 2024-12. [2025-09-23T19:32:40.521759] [DEBUG] [VALIDATOR ] JCI: All expected trading days are present. [2025-09-23T19:32:40.521867] [DEBUG] [VALIDATOR ] JCI: Primary data validation passed. [2025-09-23T19:32:40.522910] [INFO ] [MAIN ] JCI: Fetched primary data is valid. [2025-09-23T19:32:40.522979] [DEBUG] [LOCAL ] JCI: Saving primary data. [2025-09-23T19:32:40.524621] [DEBUG] [LOCAL ] JCI: Trimmed 77409 records to 53548 (keeping 200 days of data) [2025-09-23T19:32:40.885797] [DEBUG] [LOCAL ] JCI: Primary data saved (53548 records). [2025-09-23T19:32:40.885995] [INFO ] [MAIN ] JCI: Full history saved. [2025-09-23T19:32:40.886093] [INFO ] [MAIN ] Update Progress: 1151/2372 symbols completed. JCI took 45.0s. Estimated remaining: 2h 41m 55s. Rate: 7.5 symbols/min [2025-09-23T19:32:41.007353] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-08. [2025-09-23T19:32:41.078459] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:32:41.086574] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-23T19:32:41.136119] [DEBUG] [LOCAL ] JHG: Loaded 48043 existing records from primary storage. [2025-09-23T19:32:41.136323] [INFO ] [MAIN ] JHG: Loaded 48043 existing records. [2025-09-23T19:32:41.330780] [WARN ] [MAIN ] JHG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:32:41.331062] [INFO ] [MAIN ] JHG: Wiping existing primary data before full refresh. [2025-09-23T19:32:41.331112] [INFO ] [LOCAL ] JHG: Starting deletion of primary data. [2025-09-23T19:32:41.333242] [DEBUG] [LOCAL ] JHG: Deleted primary data file. [2025-09-23T19:32:41.333318] [INFO ] [MAIN ] JHG: Starting full primary refresh. [2025-09-23T19:32:41.723307] [INFO ] [REMOTE ] JHG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:32:41.802174] [INFO ] [REMOTE ] JHG: Fetching primary data for 2024-12. [2025-09-23T19:32:41.993268] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-23T19:32:42.602260] [INFO ] [REMOTE ] JFR: Fetching primary data for 2024-12. [2025-09-23T19:32:43.393785] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-23T19:32:43.403345] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-01. [2025-09-23T19:32:44.096101] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-23T19:32:44.205590] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-01. [2025-09-23T19:32:44.208766] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-23T19:32:45.002192] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-01. [2025-09-23T19:32:45.684979] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-23T19:32:45.802197] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-09. [2025-09-23T19:32:46.042440] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-23T19:32:46.515475] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-23T19:32:46.517467] [INFO ] [REMOTE ] JEQ: Full fetch complete (11379 records). [2025-09-23T19:32:46.517557] [DEBUG] [VALIDATOR ] JEQ: Validating primary data. [2025-09-23T19:32:46.607519] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-02. [2025-09-23T19:32:46.919599] [DEBUG] [VALIDATOR ] JEQ: All expected trading days are present. [2025-09-23T19:32:46.919711] [DEBUG] [VALIDATOR ] JEQ: Primary data validation passed. [2025-09-23T19:32:46.920027] [INFO ] [MAIN ] JEQ: Fetched primary data is valid. [2025-09-23T19:32:46.920068] [DEBUG] [LOCAL ] JEQ: Saving primary data. [2025-09-23T19:32:46.920541] [DEBUG] [LOCAL ] JEQ: Trimmed 11379 records to 9100 (keeping 200 days of data) [2025-09-23T19:32:46.976359] [DEBUG] [LOCAL ] JEQ: Primary data saved (9100 records). [2025-09-23T19:32:46.976526] [INFO ] [MAIN ] JEQ: Full history saved. [2025-09-23T19:32:46.976618] [INFO ] [MAIN ] Update Progress: 1152/2372 symbols completed. JEQ took 25.3s. Estimated remaining: 2h 41m 45s. Rate: 7.5 symbols/min [2025-09-23T19:32:47.158006] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:32:47.164299] [DEBUG] [LOCAL ] JHI: Loaded 3589 existing records from primary storage. [2025-09-23T19:32:47.164418] [INFO ] [MAIN ] JHI: Loaded 3589 existing records. [2025-09-23T19:32:47.343572] [WARN ] [MAIN ] JHI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:32:47.343885] [INFO ] [MAIN ] JHI: Wiping existing primary data before full refresh. [2025-09-23T19:32:47.343932] [INFO ] [LOCAL ] JHI: Starting deletion of primary data. [2025-09-23T19:32:47.344226] [DEBUG] [LOCAL ] JHI: Deleted primary data file. [2025-09-23T19:32:47.344287] [INFO ] [MAIN ] JHI: Starting full primary refresh. [2025-09-23T19:32:47.407298] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-02. [2025-09-23T19:32:47.738283] [INFO ] [REMOTE ] JHI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:32:48.046948] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-23T19:32:48.086057] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-23T19:32:48.202189] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-03. [2025-09-23T19:32:49.002196] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-02. [2025-09-23T19:32:49.807463] [INFO ] [REMOTE ] JHI: Fetching primary data for 2024-12. [2025-09-23T19:32:49.822267] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-23T19:32:50.071204] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-23T19:32:50.384806] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-23T19:32:50.602200] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-03. [2025-09-23T19:32:51.402212] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-01. [2025-09-23T19:32:51.795778] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-23T19:32:51.935631] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-23T19:32:52.202241] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-02. [2025-09-23T19:32:52.704275] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-23T19:32:53.002226] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-04. [2025-09-23T19:32:53.802221] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-03. [2025-09-23T19:32:54.572181] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-23T19:32:54.597610] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-23T19:32:54.602135] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-04. [2025-09-23T19:32:55.394501] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-23T19:32:55.402131] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-05. [2025-09-23T19:32:55.957009] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-23T19:32:56.202399] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-04. [2025-09-23T19:32:57.002227] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-05. [2025-09-23T19:32:57.637393] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-23T19:32:57.802200] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-05. [2025-09-23T19:32:58.602163] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-06. [2025-09-23T19:32:58.707071] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-23T19:32:58.919498] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-23T19:32:59.345203] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-23T19:32:59.402195] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-07. [2025-09-23T19:33:00.188417] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-23T19:33:00.202214] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-08. [2025-09-23T19:33:01.002240] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-03. [2025-09-23T19:33:01.048392] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-23T19:33:01.387296] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-23T19:33:01.802224] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-09. [2025-09-23T19:33:02.602204] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-06. [2025-09-23T19:33:03.402260] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-06. [2025-09-23T19:33:04.202246] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-04. [2025-09-23T19:33:04.995149] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-09 (3.19 seconds). [2025-09-23T19:33:04.998536] [INFO ] [REMOTE ] JGH: Full fetch complete (14763 records). [2025-09-23T19:33:04.998698] [DEBUG] [VALIDATOR ] JGH: Validating primary data. [2025-09-23T19:33:05.118116] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-23T19:33:05.154790] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-05. [2025-09-23T19:33:05.391921] [DEBUG] [VALIDATOR ] JGH: All expected trading days are present. [2025-09-23T19:33:05.392080] [DEBUG] [VALIDATOR ] JGH: Primary data validation passed. [2025-09-23T19:33:05.392494] [INFO ] [MAIN ] JGH: Fetched primary data is valid. [2025-09-23T19:33:05.392557] [DEBUG] [LOCAL ] JGH: Saving primary data. [2025-09-23T19:33:05.393112] [DEBUG] [LOCAL ] JGH: Trimmed 14763 records to 10944 (keeping 200 days of data) [2025-09-23T19:33:05.462960] [DEBUG] [LOCAL ] JGH: Primary data saved (10944 records). [2025-09-23T19:33:05.463169] [INFO ] [MAIN ] JGH: Full history saved. [2025-09-23T19:33:05.463293] [INFO ] [MAIN ] Update Progress: 1153/2372 symbols completed. JGH took 28.6s. Estimated remaining: 2h 41m 48s. Rate: 7.5 symbols/min [2025-09-23T19:33:05.585576] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-06 (2.98 seconds). [2025-09-23T19:33:05.662857] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:33:05.668549] [DEBUG] [LOCAL ] JHS: Loaded 2890 existing records from primary storage. [2025-09-23T19:33:05.668689] [INFO ] [MAIN ] JHS: Loaded 2890 existing records. [2025-09-23T19:33:05.818595] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-07. [2025-09-23T19:33:05.850161] [WARN ] [MAIN ] JHS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:33:05.851535] [INFO ] [MAIN ] JHS: Wiping existing primary data before full refresh. [2025-09-23T19:33:05.851613] [INFO ] [LOCAL ] JHS: Starting deletion of primary data. [2025-09-23T19:33:05.851954] [DEBUG] [LOCAL ] JHS: Deleted primary data file. [2025-09-23T19:33:05.852046] [INFO ] [MAIN ] JHS: Starting full primary refresh. [2025-09-23T19:33:05.892757] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-23T19:33:05.991267] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-06 (2.59 seconds). [2025-09-23T19:33:06.259452] [INFO ] [REMOTE ] JHS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:33:06.602220] [INFO ] [REMOTE ] JHS: Fetching primary data for 2024-12. [2025-09-23T19:33:07.047328] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-23T19:33:07.159624] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-23T19:33:07.402226] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-07. [2025-09-23T19:33:08.202218] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-08. [2025-09-23T19:33:08.984441] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-23T19:33:09.002147] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-08. [2025-09-23T19:33:09.085059] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-23T19:33:09.802204] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-01. [2025-09-23T19:33:10.244306] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-23T19:33:10.359707] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-23T19:33:10.602225] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-09. [2025-09-23T19:33:11.402215] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-06. [2025-09-23T19:33:11.887018] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-23T19:33:11.939592] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-23T19:33:11.945568] [INFO ] [REMOTE ] JFR: Full fetch complete (47937 records). [2025-09-23T19:33:11.945792] [DEBUG] [VALIDATOR ] JFR: Validating primary data. [2025-09-23T19:33:12.207338] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-02. [2025-09-23T19:33:12.334511] [DEBUG] [VALIDATOR ] JFR: All expected trading days are present. [2025-09-23T19:33:12.334613] [DEBUG] [VALIDATOR ] JFR: Primary data validation passed. [2025-09-23T19:33:12.335414] [INFO ] [MAIN ] JFR: Fetched primary data is valid. [2025-09-23T19:33:12.335519] [DEBUG] [LOCAL ] JFR: Saving primary data. [2025-09-23T19:33:12.336770] [DEBUG] [LOCAL ] JFR: Trimmed 47937 records to 30403 (keeping 200 days of data) [2025-09-23T19:33:12.524295] [DEBUG] [LOCAL ] JFR: Primary data saved (30403 records). [2025-09-23T19:33:12.524469] [INFO ] [MAIN ] JFR: Full history saved. [2025-09-23T19:33:12.524574] [INFO ] [MAIN ] Update Progress: 1154/2372 symbols completed. JFR took 36.8s. Estimated remaining: 2h 41m 39s. Rate: 7.5 symbols/min [2025-09-23T19:33:12.695955] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:33:12.744095] [DEBUG] [LOCAL ] JHX: Loaded 49815 existing records from primary storage. [2025-09-23T19:33:12.744268] [INFO ] [MAIN ] JHX: Loaded 49815 existing records. [2025-09-23T19:33:12.915153] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-23T19:33:12.938888] [WARN ] [MAIN ] JHX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:33:12.939812] [INFO ] [MAIN ] JHX: Wiping existing primary data before full refresh. [2025-09-23T19:33:12.939865] [INFO ] [LOCAL ] JHX: Starting deletion of primary data. [2025-09-23T19:33:12.940959] [DEBUG] [LOCAL ] JHX: Deleted primary data file. [2025-09-23T19:33:12.941022] [INFO ] [MAIN ] JHX: Starting full primary refresh. [2025-09-23T19:33:13.007486] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-09. [2025-09-23T19:33:13.302126] [INFO ] [REMOTE ] JHX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:33:13.802232] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-03. [2025-09-23T19:33:14.236908] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-23T19:33:14.602215] [INFO ] [REMOTE ] JHX: Fetching primary data for 2024-12. [2025-09-23T19:33:14.749709] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-23T19:33:14.757614] [INFO ] [REMOTE ] JHG: Full fetch complete (68493 records). [2025-09-23T19:33:14.757842] [DEBUG] [VALIDATOR ] JHG: Validating primary data. [2025-09-23T19:33:15.158504] [DEBUG] [VALIDATOR ] JHG: All expected trading days are present. [2025-09-23T19:33:15.158590] [DEBUG] [VALIDATOR ] JHG: Primary data validation passed. [2025-09-23T19:33:15.159458] [INFO ] [MAIN ] JHG: Fetched primary data is valid. [2025-09-23T19:33:15.159520] [DEBUG] [LOCAL ] JHG: Saving primary data. [2025-09-23T19:33:15.160925] [DEBUG] [LOCAL ] JHG: Trimmed 68493 records to 47972 (keeping 200 days of data) [2025-09-23T19:33:15.289326] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-23T19:33:15.402240] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-01. [2025-09-23T19:33:15.480875] [DEBUG] [LOCAL ] JHG: Primary data saved (47972 records). [2025-09-23T19:33:15.481044] [INFO ] [MAIN ] JHG: Full history saved. [2025-09-23T19:33:15.481136] [INFO ] [MAIN ] Update Progress: 1155/2372 symbols completed. JHG took 34.6s. Estimated remaining: 2h 41m 26s. Rate: 7.5 symbols/min [2025-09-23T19:33:15.655489] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:33:15.673499] [DEBUG] [LOCAL ] JILL: Loaded 16727 existing records from primary storage. [2025-09-23T19:33:15.673675] [INFO ] [MAIN ] JILL: Loaded 16727 existing records. [2025-09-23T19:33:15.855298] [WARN ] [MAIN ] JILL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:33:15.855624] [INFO ] [MAIN ] JILL: Wiping existing primary data before full refresh. [2025-09-23T19:33:15.855701] [INFO ] [LOCAL ] JILL: Starting deletion of primary data. [2025-09-23T19:33:15.856199] [DEBUG] [LOCAL ] JILL: Deleted primary data file. [2025-09-23T19:33:15.856258] [INFO ] [MAIN ] JILL: Starting full primary refresh. [2025-09-23T19:33:16.220547] [INFO ] [REMOTE ] JILL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:33:16.214503] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-04. [2025-09-23T19:33:16.320045] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-23T19:33:16.703213] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-23T19:33:17.002212] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-07. [2025-09-23T19:33:17.620831] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-23T19:33:17.802236] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-08. [2025-09-23T19:33:18.602193] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-02. [2025-09-23T19:33:18.648002] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-23T19:33:19.402165] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-09. [2025-09-23T19:33:19.485769] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-23T19:33:20.173478] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-23T19:33:20.175081] [INFO ] [REMOTE ] JHI: Full fetch complete (5274 records). [2025-09-23T19:33:20.175156] [DEBUG] [VALIDATOR ] JHI: Validating primary data. [2025-09-23T19:33:20.207407] [INFO ] [REMOTE ] JILL: Fetching primary data for 2024-12. [2025-09-23T19:33:20.537263] [DEBUG] [VALIDATOR ] JHI: All expected trading days are present. [2025-09-23T19:33:20.537376] [DEBUG] [VALIDATOR ] JHI: Primary data validation passed. [2025-09-23T19:33:20.537557] [INFO ] [MAIN ] JHI: Fetched primary data is valid. [2025-09-23T19:33:20.537598] [DEBUG] [LOCAL ] JHI: Saving primary data. [2025-09-23T19:33:20.537997] [DEBUG] [LOCAL ] JHI: Trimmed 5274 records to 3572 (keeping 200 days of data) [2025-09-23T19:33:20.559993] [DEBUG] [LOCAL ] JHI: Primary data saved (3572 records). [2025-09-23T19:33:20.560063] [INFO ] [MAIN ] JHI: Full history saved. [2025-09-23T19:33:20.560132] [INFO ] [MAIN ] Update Progress: 1156/2372 symbols completed. JHI took 33.6s. Estimated remaining: 2h 41m 15s. Rate: 7.5 symbols/min [2025-09-23T19:33:20.726992] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:33:20.766555] [DEBUG] [LOCAL ] JKS: Loaded 40152 existing records from primary storage. [2025-09-23T19:33:20.766740] [INFO ] [MAIN ] JKS: Loaded 40152 existing records. [2025-09-23T19:33:20.943248] [WARN ] [MAIN ] JKS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:33:20.943468] [INFO ] [MAIN ] JKS: Wiping existing primary data before full refresh. [2025-09-23T19:33:20.943519] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-09-23T19:33:20.944591] [DEBUG] [LOCAL ] JKS: Deleted primary data file. [2025-09-23T19:33:20.944680] [INFO ] [MAIN ] JKS: Starting full primary refresh. [2025-09-23T19:33:21.007367] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-05. [2025-09-23T19:33:21.313449] [INFO ] [REMOTE ] JKS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:33:21.314711] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-23T19:33:21.603684] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-23T19:33:21.802201] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-01. [2025-09-23T19:33:22.602171] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-03. [2025-09-23T19:33:22.684026] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-23T19:33:23.402194] [INFO ] [REMOTE ] JKS: Fetching primary data for 2024-12. [2025-09-23T19:33:23.826107] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-23T19:33:24.202195] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-04. [2025-09-23T19:33:25.002165] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-06. [2025-09-23T19:33:25.299029] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-23T19:33:25.628206] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-23T19:33:25.802185] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-02. [2025-09-23T19:33:25.846762] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-23T19:33:26.601545] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-23T19:33:26.604440] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-07. [2025-09-23T19:33:27.139414] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-23T19:33:27.402193] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-03. [2025-09-23T19:33:28.202237] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-01. [2025-09-23T19:33:28.427793] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-23T19:33:29.002253] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-04. [2025-09-23T19:33:29.513733] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-23T19:33:29.712786] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-23T19:33:29.802146] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-05. [2025-09-23T19:33:30.602259] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-02. [2025-09-23T19:33:30.635300] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-23T19:33:31.402204] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-08. [2025-09-23T19:33:31.929965] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-23T19:33:31.961058] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-23T19:33:32.202205] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-09. [2025-09-23T19:33:32.973940] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-23T19:33:32.975609] [INFO ] [REMOTE ] JHS: Full fetch complete (4444 records). [2025-09-23T19:33:32.975725] [DEBUG] [VALIDATOR ] JHS: Validating primary data. [2025-09-23T19:33:33.007493] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-05. [2025-09-23T19:33:33.355505] [DEBUG] [VALIDATOR ] JHS: All expected trading days are present. [2025-09-23T19:33:33.355592] [DEBUG] [VALIDATOR ] JHS: Primary data validation passed. [2025-09-23T19:33:33.355763] [INFO ] [MAIN ] JHS: Fetched primary data is valid. [2025-09-23T19:33:33.355829] [DEBUG] [LOCAL ] JHS: Saving primary data. [2025-09-23T19:33:33.356184] [DEBUG] [LOCAL ] JHS: Trimmed 4444 records to 2865 (keeping 200 days of data) [2025-09-23T19:33:33.373784] [DEBUG] [LOCAL ] JHS: Primary data saved (2865 records). [2025-09-23T19:33:33.373849] [INFO ] [MAIN ] JHS: Full history saved. [2025-09-23T19:33:33.373918] [INFO ] [MAIN ] Update Progress: 1157/2372 symbols completed. JHS took 27.9s. Estimated remaining: 2h 41m 12s. Rate: 7.5 symbols/min [2025-09-23T19:33:33.802198] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-03. [2025-09-23T19:33:34.602204] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-06. [2025-09-23T19:33:35.507816] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-09-23T19:33:35.518932] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-06. [2025-09-23T19:33:36.052296] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-23T19:33:36.153268] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-09-23T19:33:36.202166] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-04. [2025-09-23T19:33:36.654639] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-23T19:33:37.002233] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-07. [2025-09-23T19:33:37.543745] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-23T19:33:37.802218] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-07. [2025-09-23T19:33:38.602200] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-05. [2025-09-23T19:33:38.637399] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-23T19:33:38.802876] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-23T19:33:39.402254] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-08. [2025-09-23T19:33:39.838410] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-23T19:33:40.202262] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-08. [2025-09-23T19:33:41.002185] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-06. [2025-09-23T19:33:41.161619] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-23T19:33:41.233817] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-23T19:33:41.802286] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-09. [2025-09-23T19:33:42.392550] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-23T19:33:42.602195] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-07. [2025-09-23T19:33:43.402157] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-09. [2025-09-23T19:33:43.731256] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-23T19:33:43.740274] [INFO ] [REMOTE ] JHX: Full fetch complete (56695 records). [2025-09-23T19:33:43.740436] [DEBUG] [VALIDATOR ] JHX: Validating primary data. [2025-09-23T19:33:44.155064] [DEBUG] [VALIDATOR ] JHX: All expected trading days are present. [2025-09-23T19:33:44.155574] [DEBUG] [VALIDATOR ] JHX: Primary data validation passed. [2025-09-23T19:33:44.156799] [INFO ] [MAIN ] JHX: Fetched primary data is valid. [2025-09-23T19:33:44.156983] [DEBUG] [LOCAL ] JHX: Saving primary data. [2025-09-23T19:33:44.168758] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-23T19:33:44.173220] [INFO ] [REMOTE ] JILL: Full fetch complete (23104 records). [2025-09-23T19:33:44.173484] [DEBUG] [LOCAL ] JHX: Trimmed 56695 records to 50123 (keeping 200 days of data) [2025-09-23T19:33:44.173810] [DEBUG] [VALIDATOR ] JILL: Validating primary data. [2025-09-23T19:33:44.208536] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-23T19:33:44.394496] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-08. [2025-09-23T19:33:44.844820] [DEBUG] [VALIDATOR ] JILL: All expected trading days are present. [2025-09-23T19:33:44.845532] [DEBUG] [VALIDATOR ] JILL: Primary data validation passed. [2025-09-23T19:33:44.846851] [INFO ] [MAIN ] JILL: Fetched primary data is valid. [2025-09-23T19:33:44.847798] [DEBUG] [LOCAL ] JILL: Saving primary data. [2025-09-23T19:33:44.853001] [DEBUG] [LOCAL ] JILL: Trimmed 23104 records to 16755 (keeping 200 days of data) [2025-09-23T19:33:45.020357] [DEBUG] [LOCAL ] JILL: Primary data saved (16755 records). [2025-09-23T19:33:45.021048] [INFO ] [MAIN ] JILL: Full history saved. [2025-09-23T19:33:45.021445] [INFO ] [MAIN ] Update Progress: 1158/2372 symbols completed. JILL took 29.5s. Estimated remaining: 2h 41m 8s. Rate: 7.5 symbols/min [2025-09-23T19:33:45.035001] [DEBUG] [LOCAL ] JHX: Primary data saved (50123 records). [2025-09-23T19:33:45.035156] [INFO ] [MAIN ] JHX: Full history saved. [2025-09-23T19:33:45.035263] [INFO ] [MAIN ] Update Progress: 1159/2372 symbols completed. JHX took 32.5s. Estimated remaining: 2h 40m 51s. Rate: 7.5 symbols/min [2025-09-23T19:33:46.233701] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-23T19:33:46.243001] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-09. [2025-09-23T19:33:47.867883] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-23T19:33:47.874532] [INFO ] [REMOTE ] JKS: Full fetch complete (59489 records). [2025-09-23T19:33:47.874701] [DEBUG] [VALIDATOR ] JKS: Validating primary data. [2025-09-23T19:33:48.271774] [DEBUG] [VALIDATOR ] JKS: All expected trading days are present. [2025-09-23T19:33:48.271933] [DEBUG] [VALIDATOR ] JKS: Primary data validation passed. [2025-09-23T19:33:48.272823] [INFO ] [MAIN ] JKS: Fetched primary data is valid. [2025-09-23T19:33:48.272916] [DEBUG] [LOCAL ] JKS: Saving primary data. [2025-09-23T19:33:48.277082] [DEBUG] [LOCAL ] JKS: Trimmed 59489 records to 40129 (keeping 200 days of data) [2025-09-23T19:33:48.529738] [DEBUG] [LOCAL ] JKS: Primary data saved (40129 records). [2025-09-23T19:33:48.529876] [INFO ] [MAIN ] JKS: Full history saved. [2025-09-23T19:33:48.530105] [INFO ] [MAIN ] Update Progress: 1160/2372 symbols completed. JKS took 28.0s. Estimated remaining: 2h 40m 39s. Rate: 7.5 symbols/min [2025-09-23T19:33:49.403308] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:33:49.396758] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:33:49.428781] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:33:49.474027] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:33:49.474620] [DEBUG] [LOCAL ] JMM: No existing data file found in primary storage. [2025-09-23T19:33:49.474733] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-09-23T19:33:49.475212] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-09-23T19:33:49.478093] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-09-23T19:33:49.484237] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-09-23T19:33:49.483911] [DEBUG] [LOCAL ] JLS: Loaded 4074 existing records from primary storage. [2025-09-23T19:33:49.484418] [INFO ] [MAIN ] JLS: Loaded 4074 existing records. [2025-09-23T19:33:49.484537] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-09-23T19:33:49.879935] [DEBUG] [LOCAL ] JLL: Loaded 32228 existing records from primary storage. [2025-09-23T19:33:49.938356] [INFO ] [MAIN ] JLL: Loaded 32228 existing records. [2025-09-23T19:33:49.938193] [DEBUG] [LOCAL ] JMIA: Loaded 50473 existing records from primary storage. [2025-09-23T19:33:50.003049] [INFO ] [MAIN ] JMIA: Loaded 50473 existing records. [2025-09-23T19:33:50.201569] [WARN ] [MAIN ] JLS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:33:50.348490] [INFO ] [MAIN ] JLS: Wiping existing primary data before full refresh. [2025-09-23T19:33:50.422191] [INFO ] [LOCAL ] JLS: Starting deletion of primary data. [2025-09-23T19:33:50.509268] [DEBUG] [LOCAL ] JLS: Deleted primary data file. [2025-09-23T19:33:50.509419] [INFO ] [MAIN ] JLS: Starting full primary refresh. [2025-09-23T19:33:50.498852] [INFO ] [REMOTE ] JMM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:33:50.639761] [INFO ] [REMOTE ] JMM: Fetching primary data for 2024-12. [2025-09-23T19:33:50.639316] [WARN ] [MAIN ] JMIA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:33:50.703025] [INFO ] [MAIN ] JMIA: Wiping existing primary data before full refresh. [2025-09-23T19:33:50.708405] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-09-23T19:33:50.708245] [WARN ] [MAIN ] JLL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:33:50.726463] [DEBUG] [LOCAL ] JMIA: Deleted primary data file. [2025-09-23T19:33:50.726970] [INFO ] [MAIN ] JMIA: Starting full primary refresh. [2025-09-23T19:33:50.774152] [INFO ] [MAIN ] JLL: Wiping existing primary data before full refresh. [2025-09-23T19:33:50.795466] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-09-23T19:33:50.834681] [DEBUG] [LOCAL ] JLL: Deleted primary data file. [2025-09-23T19:33:50.856795] [INFO ] [MAIN ] JLL: Starting full primary refresh. [2025-09-23T19:33:51.424021] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-23T19:33:51.433560] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-01. [2025-09-23T19:33:51.696607] [INFO ] [REMOTE ] JLS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:33:51.738062] [INFO ] [REMOTE ] JMIA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:33:51.752166] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2024-12. [2025-09-23T19:33:51.743602] [INFO ] [REMOTE ] JLS: Fetching primary data for 2024-12. [2025-09-23T19:33:51.898279] [INFO ] [REMOTE ] JLL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:33:51.898717] [INFO ] [REMOTE ] JLL: Fetching primary data for 2024-12. [2025-09-23T19:33:52.005869] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-23T19:33:52.007001] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-09-23T19:33:52.441912] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-23T19:33:52.443011] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-09-23T19:33:52.576696] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-23T19:33:52.578237] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-01. [2025-09-23T19:33:52.706049] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.26 seconds). [2025-09-23T19:33:52.707151] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-09-23T19:33:53.137997] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-23T19:33:53.139375] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-09-23T19:33:53.146045] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-23T19:33:53.383322] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-23T19:33:53.619625] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-23T19:33:53.802185] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-02. [2025-09-23T19:33:53.940972] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-23T19:33:54.253346] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-23T19:33:54.602202] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-01. [2025-09-23T19:33:55.402203] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-09-23T19:33:55.869120] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-23T19:33:55.887625] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-23T19:33:56.202196] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-02. [2025-09-23T19:33:57.002180] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-03. [2025-09-23T19:33:57.440446] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-23T19:33:57.440296] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-23T19:33:57.802185] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-09-23T19:33:58.243552] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-23T19:33:58.602196] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-01. [2025-09-23T19:33:59.402189] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-04. [2025-09-23T19:33:59.978335] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-23T19:34:00.202166] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-03. [2025-09-23T19:34:00.244717] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-23T19:34:01.002201] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-02. [2025-09-23T19:34:01.575536] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-23T19:34:01.802204] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-09-23T19:34:02.266632] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-23T19:34:02.602232] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-04. [2025-09-23T19:34:02.900019] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-23T19:34:03.402208] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-03. [2025-09-23T19:34:04.094747] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-23T19:34:04.202230] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-05. [2025-09-23T19:34:05.002217] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-05. [2025-09-23T19:34:05.140995] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-23T19:34:05.176306] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-23T19:34:05.350628] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-23T19:34:05.802288] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-04. [2025-09-23T19:34:06.602255] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-06. [2025-09-23T19:34:06.953142] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-23T19:34:07.142893] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-23T19:34:07.402214] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-06. [2025-09-23T19:34:08.202209] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-07. [2025-09-23T19:34:08.628477] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-23T19:34:08.797323] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-23T19:34:09.002229] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-05. [2025-09-23T19:34:09.802202] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-08. [2025-09-23T19:34:10.364765] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-23T19:34:10.602172] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-09-23T19:34:10.892681] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-23T19:34:11.043163] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-23T19:34:11.044081] [INFO ] [REMOTE ] JMM: Full fetch complete (2287 records). [2025-09-23T19:34:11.044168] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-09-23T19:34:11.227994] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-09-23T19:34:11.228523] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:34:11.228610] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:34:11.228702] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-09-23T19:34:11.228793] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-09-23T19:34:11.228853] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-09-23T19:34:11.228911] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-09-23T19:34:11.229046] [INFO ] [MAIN ] Update Progress: 1161/2372 symbols completed. JMM took 22.7s. Estimated remaining: 2h 40m 46s. Rate: 7.5 symbols/min [2025-09-23T19:34:11.398349] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:34:11.402168] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-09. [2025-09-23T19:34:11.474607] [DEBUG] [LOCAL ] JNJ: Loaded 53753 existing records from primary storage. [2025-09-23T19:34:11.474815] [INFO ] [MAIN ] JNJ: Loaded 53753 existing records. [2025-09-23T19:34:11.651925] [WARN ] [MAIN ] JNJ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:34:11.652178] [INFO ] [MAIN ] JNJ: Wiping existing primary data before full refresh. [2025-09-23T19:34:11.652226] [INFO ] [LOCAL ] JNJ: Starting deletion of primary data. [2025-09-23T19:34:11.654012] [DEBUG] [LOCAL ] JNJ: Deleted primary data file. [2025-09-23T19:34:11.654073] [INFO ] [MAIN ] JNJ: Starting full primary refresh. [2025-09-23T19:34:12.025210] [INFO ] [REMOTE ] JNJ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:34:12.061600] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-23T19:34:12.063306] [INFO ] [REMOTE ] JLS: Full fetch complete (5781 records). [2025-09-23T19:34:12.063417] [DEBUG] [VALIDATOR ] JLS: Validating primary data. [2025-09-23T19:34:12.207311] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2024-12. [2025-09-23T19:34:12.428876] [DEBUG] [VALIDATOR ] JLS: All expected trading days are present. [2025-09-23T19:34:12.428974] [DEBUG] [VALIDATOR ] JLS: Primary data validation passed. [2025-09-23T19:34:12.429163] [INFO ] [MAIN ] JLS: Fetched primary data is valid. [2025-09-23T19:34:12.429201] [DEBUG] [LOCAL ] JLS: Saving primary data. [2025-09-23T19:34:12.429877] [DEBUG] [LOCAL ] JLS: Trimmed 5781 records to 4092 (keeping 200 days of data) [2025-09-23T19:34:12.456825] [DEBUG] [LOCAL ] JLS: Primary data saved (4092 records). [2025-09-23T19:34:12.456979] [INFO ] [MAIN ] JLS: Full history saved. [2025-09-23T19:34:12.457114] [INFO ] [MAIN ] Update Progress: 1162/2372 symbols completed. JLS took 23.9s. Estimated remaining: 2h 40m 31s. Rate: 7.5 symbols/min [2025-09-23T19:34:12.627082] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:34:12.697794] [DEBUG] [LOCAL ] JOBY: Loaded 53799 existing records from primary storage. [2025-09-23T19:34:12.697981] [INFO ] [MAIN ] JOBY: Loaded 53799 existing records. [2025-09-23T19:34:12.874578] [WARN ] [MAIN ] JOBY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:34:12.874894] [INFO ] [MAIN ] JOBY: Wiping existing primary data before full refresh. [2025-09-23T19:34:12.874960] [INFO ] [LOCAL ] JOBY: Starting deletion of primary data. [2025-09-23T19:34:12.876485] [DEBUG] [LOCAL ] JOBY: Deleted primary data file. [2025-09-23T19:34:12.876546] [INFO ] [MAIN ] JOBY: Starting full primary refresh. [2025-09-23T19:34:13.014015] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-06. [2025-09-23T19:34:13.238590] [INFO ] [REMOTE ] JOBY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:34:13.802205] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2024-12. [2025-09-23T19:34:14.602187] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-07. [2025-09-23T19:34:14.733900] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2024-12 (2.53 seconds). [2025-09-23T19:34:14.787991] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-23T19:34:15.402263] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-07. [2025-09-23T19:34:16.016995] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-23T19:34:16.180550] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-09-23T19:34:16.202140] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-01. [2025-09-23T19:34:16.749250] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-23T19:34:17.002171] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-08. [2025-09-23T19:34:17.802189] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-08. [2025-09-23T19:34:18.442358] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-09-23T19:34:18.552036] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-23T19:34:18.602149] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-09. [2025-09-23T19:34:19.402195] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-01. [2025-09-23T19:34:20.202183] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-02. [2025-09-23T19:34:20.325200] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-09-23T19:34:20.514276] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-23T19:34:20.523994] [INFO ] [REMOTE ] JMIA: Full fetch complete (73261 records). [2025-09-23T19:34:20.524201] [DEBUG] [VALIDATOR ] JMIA: Validating primary data. [2025-09-23T19:34:20.939169] [DEBUG] [VALIDATOR ] JMIA: All expected trading days are present. [2025-09-23T19:34:20.939318] [DEBUG] [VALIDATOR ] JMIA: Primary data validation passed. [2025-09-23T19:34:20.940611] [INFO ] [MAIN ] JMIA: Fetched primary data is valid. [2025-09-23T19:34:20.940712] [DEBUG] [LOCAL ] JMIA: Saving primary data. [2025-09-23T19:34:20.942400] [DEBUG] [LOCAL ] JMIA: Trimmed 73261 records to 50490 (keeping 200 days of data) [2025-09-23T19:34:21.003993] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-09. [2025-09-23T19:34:21.262981] [DEBUG] [LOCAL ] JMIA: Primary data saved (50490 records). [2025-09-23T19:34:21.263156] [INFO ] [MAIN ] JMIA: Full history saved. [2025-09-23T19:34:21.263268] [INFO ] [MAIN ] Update Progress: 1163/2372 symbols completed. JMIA took 32.7s. Estimated remaining: 2h 40m 24s. Rate: 7.5 symbols/min [2025-09-23T19:34:21.442415] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:34:21.467595] [DEBUG] [LOCAL ] JOE: Loaded 24699 existing records from primary storage. [2025-09-23T19:34:21.467818] [INFO ] [MAIN ] JOE: Loaded 24699 existing records. [2025-09-23T19:34:21.670432] [WARN ] [MAIN ] JOE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:34:21.670992] [INFO ] [MAIN ] JOE: Wiping existing primary data before full refresh. [2025-09-23T19:34:21.671165] [INFO ] [LOCAL ] JOE: Starting deletion of primary data. [2025-09-23T19:34:21.680884] [DEBUG] [LOCAL ] JOE: Deleted primary data file. [2025-09-23T19:34:21.695105] [INFO ] [MAIN ] JOE: Starting full primary refresh. [2025-09-23T19:34:21.784497] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-09-23T19:34:21.829734] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-02. [2025-09-23T19:34:22.083744] [INFO ] [REMOTE ] JOE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:34:22.354836] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-23T19:34:22.360696] [INFO ] [REMOTE ] JLL: Full fetch complete (44795 records). [2025-09-23T19:34:22.360818] [DEBUG] [VALIDATOR ] JLL: Validating primary data. [2025-09-23T19:34:22.607503] [INFO ] [REMOTE ] JOE: Fetching primary data for 2024-12. [2025-09-23T19:34:22.806614] [DEBUG] [VALIDATOR ] JLL: All expected trading days are present. [2025-09-23T19:34:22.806930] [DEBUG] [VALIDATOR ] JLL: Primary data validation passed. [2025-09-23T19:34:22.808248] [INFO ] [MAIN ] JLL: Fetched primary data is valid. [2025-09-23T19:34:22.809517] [DEBUG] [LOCAL ] JLL: Saving primary data. [2025-09-23T19:34:22.809421] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-02 (2.61 seconds). [2025-09-23T19:34:22.821130] [DEBUG] [LOCAL ] JLL: Trimmed 44795 records to 32090 (keeping 200 days of data) [2025-09-23T19:34:23.020282] [DEBUG] [LOCAL ] JLL: Primary data saved (32090 records). [2025-09-23T19:34:23.020432] [INFO ] [MAIN ] JLL: Full history saved. [2025-09-23T19:34:23.020533] [INFO ] [MAIN ] Update Progress: 1164/2372 symbols completed. JLL took 34.5s. Estimated remaining: 2h 40m 10s. Rate: 7.5 symbols/min [2025-09-23T19:34:23.189270] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:34:23.198125] [DEBUG] [LOCAL ] JOF: Loaded 7137 existing records from primary storage. [2025-09-23T19:34:23.198243] [INFO ] [MAIN ] JOF: Loaded 7137 existing records. [2025-09-23T19:34:23.390619] [WARN ] [MAIN ] JOF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:34:23.390902] [INFO ] [MAIN ] JOF: Wiping existing primary data before full refresh. [2025-09-23T19:34:23.390951] [INFO ] [LOCAL ] JOF: Starting deletion of primary data. [2025-09-23T19:34:23.391508] [DEBUG] [LOCAL ] JOF: Deleted primary data file. [2025-09-23T19:34:23.391569] [INFO ] [MAIN ] JOF: Starting full primary refresh. [2025-09-23T19:34:23.424520] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-03. [2025-09-23T19:34:23.792697] [INFO ] [REMOTE ] JOF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:34:23.918911] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-23T19:34:23.979923] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-23T19:34:24.202261] [INFO ] [REMOTE ] JOF: Fetching primary data for 2024-12. [2025-09-23T19:34:25.002192] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-01. [2025-09-23T19:34:25.046368] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-23T19:34:25.449613] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-23T19:34:25.802393] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-01. [2025-09-23T19:34:26.040581] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-23T19:34:26.121353] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-09-23T19:34:26.602245] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-02. [2025-09-23T19:34:27.180686] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-23T19:34:27.402196] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-02. [2025-09-23T19:34:28.202167] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-03. [2025-09-23T19:34:28.483112] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-23T19:34:29.002240] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-03. [2025-09-23T19:34:29.802219] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-04. [2025-09-23T19:34:30.076042] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-23T19:34:30.411031] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-23T19:34:30.602209] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-03. [2025-09-23T19:34:31.402212] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-04. [2025-09-23T19:34:31.421849] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-23T19:34:31.820825] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-23T19:34:32.202194] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-04. [2025-09-23T19:34:33.002196] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-05. [2025-09-23T19:34:33.435165] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-23T19:34:33.801418] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-09-23T19:34:33.811733] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-04. [2025-09-23T19:34:34.602183] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-05. [2025-09-23T19:34:34.639160] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-23T19:34:35.402160] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-05. [2025-09-23T19:34:35.529855] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-09-23T19:34:36.183304] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-23T19:34:36.202148] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-06. [2025-09-23T19:34:36.480011] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-23T19:34:37.002226] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-06. [2025-09-23T19:34:37.296941] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-23T19:34:37.802236] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-05. [2025-09-23T19:34:38.448372] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-23T19:34:38.602167] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-06. [2025-09-23T19:34:39.402173] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-06. [2025-09-23T19:34:39.462957] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-09-23T19:34:39.783420] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-23T19:34:40.202154] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-07. [2025-09-23T19:34:40.373979] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-23T19:34:40.705021] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-23T19:34:41.002205] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-07. [2025-09-23T19:34:41.811207] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-08. [2025-09-23T19:34:41.818094] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-23T19:34:42.580894] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-23T19:34:42.602243] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-08. [2025-09-23T19:34:43.402171] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-09. [2025-09-23T19:34:43.776300] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-23T19:34:44.202247] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-07. [2025-09-23T19:34:44.363360] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-23T19:34:44.365591] [INFO ] [REMOTE ] JOF: Full fetch complete (9525 records). [2025-09-23T19:34:44.365753] [DEBUG] [VALIDATOR ] JOF: Validating primary data. [2025-09-23T19:34:44.743985] [DEBUG] [VALIDATOR ] JOF: All expected trading days are present. [2025-09-23T19:34:44.744076] [DEBUG] [VALIDATOR ] JOF: Primary data validation passed. [2025-09-23T19:34:44.744299] [INFO ] [MAIN ] JOF: Fetched primary data is valid. [2025-09-23T19:34:44.744337] [DEBUG] [LOCAL ] JOF: Saving primary data. [2025-09-23T19:34:44.744823] [DEBUG] [LOCAL ] JOF: Trimmed 9525 records to 7131 (keeping 200 days of data) [2025-09-23T19:34:44.788217] [DEBUG] [LOCAL ] JOF: Primary data saved (7131 records). [2025-09-23T19:34:44.788344] [INFO ] [MAIN ] JOF: Full history saved. [2025-09-23T19:34:44.788425] [INFO ] [MAIN ] Update Progress: 1165/2372 symbols completed. JOF took 21.8s. Estimated remaining: 2h 40m 16s. Rate: 7.5 symbols/min [2025-09-23T19:34:44.956563] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:34:44.995040] [DEBUG] [LOCAL ] JPC: Loaded 37152 existing records from primary storage. [2025-09-23T19:34:44.995200] [INFO ] [MAIN ] JPC: Loaded 37152 existing records. [2025-09-23T19:34:45.007983] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-07. [2025-09-23T19:34:45.178865] [WARN ] [MAIN ] JPC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:34:45.179137] [INFO ] [MAIN ] JPC: Wiping existing primary data before full refresh. [2025-09-23T19:34:45.179194] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-09-23T19:34:45.180270] [DEBUG] [LOCAL ] JPC: Deleted primary data file. [2025-09-23T19:34:45.180331] [INFO ] [MAIN ] JPC: Starting full primary refresh. [2025-09-23T19:34:45.533215] [INFO ] [REMOTE ] JPC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:34:45.802202] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-09. [2025-09-23T19:34:46.602247] [INFO ] [REMOTE ] JPC: Fetching primary data for 2024-12. [2025-09-23T19:34:47.101746] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-23T19:34:47.106245] [INFO ] [REMOTE ] JOE: Full fetch complete (36396 records). [2025-09-23T19:34:47.106338] [DEBUG] [VALIDATOR ] JOE: Validating primary data. [2025-09-23T19:34:47.522265] [DEBUG] [VALIDATOR ] JOE: All expected trading days are present. [2025-09-23T19:34:47.523089] [DEBUG] [VALIDATOR ] JOE: Primary data validation passed. [2025-09-23T19:34:47.525108] [INFO ] [MAIN ] JOE: Fetched primary data is valid. [2025-09-23T19:34:47.524373] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-07 (3.32 seconds). [2025-09-23T19:34:47.525233] [DEBUG] [LOCAL ] JOE: Saving primary data. [2025-09-23T19:34:47.538661] [DEBUG] [LOCAL ] JOE: Trimmed 36396 records to 24662 (keeping 200 days of data) [2025-09-23T19:34:47.538526] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-08. [2025-09-23T19:34:47.665554] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-07 (2.66 seconds). [2025-09-23T19:34:47.743373] [DEBUG] [LOCAL ] JOE: Primary data saved (24662 records). [2025-09-23T19:34:47.743526] [INFO ] [MAIN ] JOE: Full history saved. [2025-09-23T19:34:47.743614] [INFO ] [MAIN ] Update Progress: 1166/2372 symbols completed. JOE took 26.5s. Estimated remaining: 2h 40m 3s. Rate: 7.5 symbols/min [2025-09-23T19:34:47.909402] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:34:47.966169] [DEBUG] [LOCAL ] JPM: Loaded 53794 existing records from primary storage. [2025-09-23T19:34:47.966326] [INFO ] [MAIN ] JPM: Loaded 53794 existing records. [2025-09-23T19:34:48.144197] [WARN ] [MAIN ] JPM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:34:48.144464] [INFO ] [MAIN ] JPM: Wiping existing primary data before full refresh. [2025-09-23T19:34:48.144512] [INFO ] [LOCAL ] JPM: Starting deletion of primary data. [2025-09-23T19:34:48.146365] [DEBUG] [LOCAL ] JPM: Deleted primary data file. [2025-09-23T19:34:48.146426] [INFO ] [MAIN ] JPM: Starting full primary refresh. [2025-09-23T19:34:48.213906] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-08. [2025-09-23T19:34:48.511043] [INFO ] [REMOTE ] JPM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:34:48.551105] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-23T19:34:49.002216] [INFO ] [REMOTE ] JPM: Fetching primary data for 2024-12. [2025-09-23T19:34:49.802274] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-01. [2025-09-23T19:34:50.008979] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-09-23T19:34:50.095764] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-23T19:34:50.602197] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-09. [2025-09-23T19:34:50.919843] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-23T19:34:51.334233] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-09-23T19:34:51.402143] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-01. [2025-09-23T19:34:52.202281] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-02. [2025-09-23T19:34:53.002203] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-09. [2025-09-23T19:34:53.190877] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-09 (2.59 seconds). [2025-09-23T19:34:53.200443] [INFO ] [REMOTE ] JOBY: Full fetch complete (77971 records). [2025-09-23T19:34:53.200624] [DEBUG] [VALIDATOR ] JOBY: Validating primary data. [2025-09-23T19:34:53.414558] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-23T19:34:53.664543] [DEBUG] [VALIDATOR ] JOBY: All expected trading days are present. [2025-09-23T19:34:53.664845] [DEBUG] [VALIDATOR ] JOBY: Primary data validation passed. [2025-09-23T19:34:53.665916] [INFO ] [MAIN ] JOBY: Fetched primary data is valid. [2025-09-23T19:34:53.665981] [DEBUG] [LOCAL ] JOBY: Saving primary data. [2025-09-23T19:34:53.708193] [DEBUG] [LOCAL ] JOBY: Trimmed 77971 records to 53799 (keeping 200 days of data) [2025-09-23T19:34:53.729292] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-09-23T19:34:53.819118] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-02. [2025-09-23T19:34:54.060420] [DEBUG] [LOCAL ] JOBY: Primary data saved (53799 records). [2025-09-23T19:34:54.060587] [INFO ] [MAIN ] JOBY: Full history saved. [2025-09-23T19:34:54.060701] [INFO ] [MAIN ] Update Progress: 1167/2372 symbols completed. JOBY took 41.6s. Estimated remaining: 2h 39m 53s. Rate: 7.5 symbols/min [2025-09-23T19:34:54.233465] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:34:54.269401] [DEBUG] [LOCAL ] JQC: Loaded 33859 existing records from primary storage. [2025-09-23T19:34:54.269605] [INFO ] [MAIN ] JQC: Loaded 33859 existing records. [2025-09-23T19:34:54.470986] [WARN ] [MAIN ] JQC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:34:54.471325] [INFO ] [MAIN ] JQC: Wiping existing primary data before full refresh. [2025-09-23T19:34:54.471383] [INFO ] [LOCAL ] JQC: Starting deletion of primary data. [2025-09-23T19:34:54.473074] [DEBUG] [LOCAL ] JQC: Deleted primary data file. [2025-09-23T19:34:54.473149] [INFO ] [MAIN ] JQC: Starting full primary refresh. [2025-09-23T19:34:54.607335] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-03. [2025-09-23T19:34:54.846531] [INFO ] [REMOTE ] JQC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:34:55.260546] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-09-23T19:34:55.273380] [INFO ] [REMOTE ] JNJ: Full fetch complete (77855 records). [2025-09-23T19:34:55.273686] [DEBUG] [VALIDATOR ] JNJ: Validating primary data. [2025-09-23T19:34:55.407273] [INFO ] [REMOTE ] JQC: Fetching primary data for 2024-12. [2025-09-23T19:34:55.726407] [DEBUG] [VALIDATOR ] JNJ: All expected trading days are present. [2025-09-23T19:34:55.726768] [DEBUG] [VALIDATOR ] JNJ: Primary data validation passed. [2025-09-23T19:34:55.728775] [INFO ] [MAIN ] JNJ: Fetched primary data is valid. [2025-09-23T19:34:55.729069] [DEBUG] [LOCAL ] JNJ: Saving primary data. [2025-09-23T19:34:55.732829] [DEBUG] [LOCAL ] JNJ: Trimmed 77855 records to 53753 (keeping 200 days of data) [2025-09-23T19:34:55.855973] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-23T19:34:55.907213] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-23T19:34:56.196325] [DEBUG] [LOCAL ] JNJ: Primary data saved (53753 records). [2025-09-23T19:34:56.196536] [INFO ] [MAIN ] JNJ: Full history saved. [2025-09-23T19:34:56.198300] [INFO ] [MAIN ] Update Progress: 1168/2372 symbols completed. JNJ took 45.0s. Estimated remaining: 2h 39m 39s. Rate: 7.5 symbols/min [2025-09-23T19:34:56.209979] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-03. [2025-09-23T19:34:56.379682] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:34:56.402069] [DEBUG] [LOCAL ] JRI: Loaded 15004 existing records from primary storage. [2025-09-23T19:34:56.402287] [INFO ] [MAIN ] JRI: Loaded 15004 existing records. [2025-09-23T19:34:56.598308] [WARN ] [MAIN ] JRI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:34:56.599128] [INFO ] [MAIN ] JRI: Wiping existing primary data before full refresh. [2025-09-23T19:34:56.599276] [INFO ] [LOCAL ] JRI: Starting deletion of primary data. [2025-09-23T19:34:56.606207] [DEBUG] [LOCAL ] JRI: Deleted primary data file. [2025-09-23T19:34:56.616604] [INFO ] [MAIN ] JRI: Starting full primary refresh. [2025-09-23T19:34:56.623293] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-23T19:34:57.006228] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-04. [2025-09-23T19:34:57.011142] [INFO ] [REMOTE ] JRI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:34:57.802203] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-01. [2025-09-23T19:34:58.486765] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-23T19:34:58.602188] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-05. [2025-09-23T19:34:58.747501] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-03 (2.54 seconds). [2025-09-23T19:34:58.783693] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-23T19:34:59.402194] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-04. [2025-09-23T19:35:00.090961] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-23T19:35:00.202217] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-06. [2025-09-23T19:35:01.002301] [INFO ] [REMOTE ] JRI: Fetching primary data for 2024-12. [2025-09-23T19:35:01.577438] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-23T19:35:01.773901] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-09-23T19:35:01.802318] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-05. [2025-09-23T19:35:01.903007] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-23T19:35:02.602219] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-07. [2025-09-23T19:35:03.402181] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-01. [2025-09-23T19:35:04.001595] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-23T19:35:04.140499] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-09-23T19:35:04.152409] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-23T19:35:04.202192] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-02. [2025-09-23T19:35:05.002163] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-08. [2025-09-23T19:35:05.238421] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-23T19:35:05.802215] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-02. [2025-09-23T19:35:06.212252] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-23T19:35:06.602202] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-06. [2025-09-23T19:35:07.324589] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-23T19:35:07.402226] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-09. [2025-09-23T19:35:08.202215] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-03. [2025-09-23T19:35:08.837064] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-09-23T19:35:09.002184] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-03. [2025-09-23T19:35:09.156287] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-23T19:35:09.254196] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-23T19:35:09.261177] [INFO ] [REMOTE ] JPC: Full fetch complete (55736 records). [2025-09-23T19:35:09.261372] [DEBUG] [VALIDATOR ] JPC: Validating primary data. [2025-09-23T19:35:09.660822] [DEBUG] [VALIDATOR ] JPC: All expected trading days are present. [2025-09-23T19:35:09.660916] [DEBUG] [VALIDATOR ] JPC: Primary data validation passed. [2025-09-23T19:35:09.661712] [INFO ] [MAIN ] JPC: Fetched primary data is valid. [2025-09-23T19:35:09.661777] [DEBUG] [LOCAL ] JPC: Saving primary data. [2025-09-23T19:35:09.663058] [DEBUG] [LOCAL ] JPC: Trimmed 55736 records to 37051 (keeping 200 days of data) [2025-09-23T19:35:09.823279] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-04. [2025-09-23T19:35:09.885751] [DEBUG] [LOCAL ] JPC: Primary data saved (37051 records). [2025-09-23T19:35:09.885935] [INFO ] [MAIN ] JPC: Full history saved. [2025-09-23T19:35:09.886036] [INFO ] [MAIN ] Update Progress: 1169/2372 symbols completed. JPC took 25.1s. Estimated remaining: 2h 39m 37s. Rate: 7.5 symbols/min [2025-09-23T19:35:10.088547] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:35:10.100698] [DEBUG] [LOCAL ] JRS: Loaded 11083 existing records from primary storage. [2025-09-23T19:35:10.100846] [INFO ] [MAIN ] JRS: Loaded 11083 existing records. [2025-09-23T19:35:10.289535] [WARN ] [MAIN ] JRS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:35:10.290177] [INFO ] [MAIN ] JRS: Wiping existing primary data before full refresh. [2025-09-23T19:35:10.290288] [INFO ] [LOCAL ] JRS: Starting deletion of primary data. [2025-09-23T19:35:10.290909] [DEBUG] [LOCAL ] JRS: Deleted primary data file. [2025-09-23T19:35:10.290975] [INFO ] [MAIN ] JRS: Starting full primary refresh. [2025-09-23T19:35:10.468421] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-23T19:35:10.604423] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-07. [2025-09-23T19:35:10.709874] [INFO ] [REMOTE ] JRS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:35:10.810548] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-23T19:35:11.402205] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-04. [2025-09-23T19:35:12.202260] [INFO ] [REMOTE ] JRS: Fetching primary data for 2024-12. [2025-09-23T19:35:12.889888] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-23T19:35:13.002213] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-05. [2025-09-23T19:35:13.203610] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-09-23T19:35:13.227988] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-23T19:35:13.802171] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-01. [2025-09-23T19:35:13.914675] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-23T19:35:14.355699] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-23T19:35:14.602202] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-02. [2025-09-23T19:35:15.376851] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-23T19:35:15.402207] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-06. [2025-09-23T19:35:16.202199] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-08. [2025-09-23T19:35:16.240295] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-23T19:35:17.002204] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-05. [2025-09-23T19:35:17.802249] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-03. [2025-09-23T19:35:18.301733] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-23T19:35:18.434784] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-23T19:35:18.572368] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-23T19:35:18.602178] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-09. [2025-09-23T19:35:19.402232] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-07. [2025-09-23T19:35:20.202186] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-06. [2025-09-23T19:35:20.443270] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-23T19:35:20.686135] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-23T19:35:20.696256] [INFO ] [REMOTE ] JPM: Full fetch complete (77892 records). [2025-09-23T19:35:20.696440] [DEBUG] [VALIDATOR ] JPM: Validating primary data. [2025-09-23T19:35:21.004040] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-08. [2025-09-23T19:35:21.107240] [DEBUG] [VALIDATOR ] JPM: All expected trading days are present. [2025-09-23T19:35:21.107345] [DEBUG] [VALIDATOR ] JPM: Primary data validation passed. [2025-09-23T19:35:21.108451] [INFO ] [MAIN ] JPM: Fetched primary data is valid. [2025-09-23T19:35:21.108544] [DEBUG] [LOCAL ] JPM: Saving primary data. [2025-09-23T19:35:21.110235] [DEBUG] [LOCAL ] JPM: Trimmed 77892 records to 53794 (keeping 200 days of data) [2025-09-23T19:35:21.484835] [DEBUG] [LOCAL ] JPM: Primary data saved (53794 records). [2025-09-23T19:35:21.485576] [INFO ] [MAIN ] JPM: Full history saved. [2025-09-23T19:35:21.486579] [INFO ] [MAIN ] Update Progress: 1170/2372 symbols completed. JPM took 33.7s. Estimated remaining: 2h 39m 33s. Rate: 7.5 symbols/min [2025-09-23T19:35:21.486392] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-23T19:35:21.683778] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-23T19:35:21.685778] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:35:21.735692] [DEBUG] [LOCAL ] JXN: Loaded 46037 existing records from primary storage. [2025-09-23T19:35:21.735868] [INFO ] [MAIN ] JXN: Loaded 46037 existing records. [2025-09-23T19:35:21.807399] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-09. [2025-09-23T19:35:21.933057] [WARN ] [MAIN ] JXN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:35:21.933323] [INFO ] [MAIN ] JXN: Wiping existing primary data before full refresh. [2025-09-23T19:35:21.933374] [INFO ] [LOCAL ] JXN: Starting deletion of primary data. [2025-09-23T19:35:21.934855] [DEBUG] [LOCAL ] JXN: Deleted primary data file. [2025-09-23T19:35:21.934961] [INFO ] [MAIN ] JXN: Starting full primary refresh. [2025-09-23T19:35:22.315995] [INFO ] [REMOTE ] JXN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:35:22.602219] [INFO ] [REMOTE ] JXN: Fetching primary data for 2024-12. [2025-09-23T19:35:22.979766] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-23T19:35:22.983525] [INFO ] [REMOTE ] JRI: Full fetch complete (23155 records). [2025-09-23T19:35:22.983665] [DEBUG] [VALIDATOR ] JRI: Validating primary data. [2025-09-23T19:35:23.382765] [DEBUG] [VALIDATOR ] JRI: All expected trading days are present. [2025-09-23T19:35:23.382856] [DEBUG] [VALIDATOR ] JRI: Primary data validation passed. [2025-09-23T19:35:23.383398] [INFO ] [MAIN ] JRI: Fetched primary data is valid. [2025-09-23T19:35:23.383440] [DEBUG] [LOCAL ] JRI: Saving primary data. [2025-09-23T19:35:23.384270] [DEBUG] [LOCAL ] JRI: Trimmed 23155 records to 14888 (keeping 200 days of data) [2025-09-23T19:35:23.436049] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-04. [2025-09-23T19:35:23.492691] [DEBUG] [LOCAL ] JRI: Primary data saved (14888 records). [2025-09-23T19:35:23.492865] [INFO ] [MAIN ] JRI: Full history saved. [2025-09-23T19:35:23.492957] [INFO ] [MAIN ] Update Progress: 1171/2372 symbols completed. JRI took 27.3s. Estimated remaining: 2h 39m 19s. Rate: 7.5 symbols/min [2025-09-23T19:35:23.666516] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:35:23.714345] [DEBUG] [LOCAL ] K: Loaded 49811 existing records from primary storage. [2025-09-23T19:35:23.714497] [INFO ] [MAIN ] K: Loaded 49811 existing records. [2025-09-23T19:35:23.926999] [WARN ] [MAIN ] K: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:35:23.927424] [INFO ] [MAIN ] K: Wiping existing primary data before full refresh. [2025-09-23T19:35:23.927505] [INFO ] [LOCAL ] K: Starting deletion of primary data. [2025-09-23T19:35:23.929115] [DEBUG] [LOCAL ] K: Deleted primary data file. [2025-09-23T19:35:23.929201] [INFO ] [MAIN ] K: Starting full primary refresh. [2025-09-23T19:35:24.205697] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-07. [2025-09-23T19:35:24.318816] [INFO ] [REMOTE ] K: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:35:24.348058] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-23T19:35:24.349399] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-23T19:35:25.002211] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-05. [2025-09-23T19:35:25.525443] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-23T19:35:25.796986] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-23T19:35:25.802144] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-06. [2025-09-23T19:35:26.599635] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-23T19:35:26.602592] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-08. [2025-09-23T19:35:27.402215] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-01. [2025-09-23T19:35:28.004990] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-23T19:35:28.202248] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-07. [2025-09-23T19:35:28.969402] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-23T19:35:29.003639] [INFO ] [REMOTE ] K: Fetching primary data for 2024-12. [2025-09-23T19:35:29.006569] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-23T19:35:29.802258] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-02. [2025-09-23T19:35:30.602218] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-08. [2025-09-23T19:35:30.912804] [INFO ] [REMOTE ] K: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-23T19:35:31.005638] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-23T19:35:31.402163] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-03. [2025-09-23T19:35:31.441714] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-23T19:35:32.202229] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-09. [2025-09-23T19:35:33.002165] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-09. [2025-09-23T19:35:33.165812] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-23T19:35:33.183472] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-23T19:35:33.185991] [INFO ] [REMOTE ] JRS: Full fetch complete (16074 records). [2025-09-23T19:35:33.186075] [DEBUG] [VALIDATOR ] JRS: Validating primary data. [2025-09-23T19:35:33.550443] [DEBUG] [VALIDATOR ] JRS: All expected trading days are present. [2025-09-23T19:35:33.550540] [DEBUG] [VALIDATOR ] JRS: Primary data validation passed. [2025-09-23T19:35:33.550918] [INFO ] [MAIN ] JRS: Fetched primary data is valid. [2025-09-23T19:35:33.550980] [DEBUG] [LOCAL ] JRS: Saving primary data. [2025-09-23T19:35:33.551522] [DEBUG] [LOCAL ] JRS: Trimmed 16074 records to 11097 (keeping 200 days of data) [2025-09-23T19:35:33.617093] [DEBUG] [LOCAL ] JRS: Primary data saved (11097 records). [2025-09-23T19:35:33.617243] [INFO ] [MAIN ] JRS: Full history saved. [2025-09-23T19:35:33.617331] [INFO ] [MAIN ] Update Progress: 1172/2372 symbols completed. JRS took 23.7s. Estimated remaining: 2h 39m 13s. Rate: 7.5 symbols/min [2025-09-23T19:35:33.785891] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:35:33.800716] [DEBUG] [LOCAL ] KAI: Loaded 13617 existing records from primary storage. [2025-09-23T19:35:33.800845] [INFO ] [MAIN ] KAI: Loaded 13617 existing records. [2025-09-23T19:35:33.812121] [INFO ] [REMOTE ] K: Fetching primary data for 2025-01. [2025-09-23T19:35:33.982813] [WARN ] [MAIN ] KAI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:35:33.983275] [INFO ] [MAIN ] KAI: Wiping existing primary data before full refresh. [2025-09-23T19:35:33.983330] [INFO ] [LOCAL ] KAI: Starting deletion of primary data. [2025-09-23T19:35:33.983970] [DEBUG] [LOCAL ] KAI: Deleted primary data file. [2025-09-23T19:35:33.984032] [INFO ] [MAIN ] KAI: Starting full primary refresh. [2025-09-23T19:35:34.353214] [INFO ] [REMOTE ] KAI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:35:34.370578] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-23T19:35:34.377599] [INFO ] [REMOTE ] JQC: Full fetch complete (48482 records). [2025-09-23T19:35:34.377831] [DEBUG] [VALIDATOR ] JQC: Validating primary data. [2025-09-23T19:35:34.610939] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-04. [2025-09-23T19:35:34.769568] [DEBUG] [VALIDATOR ] JQC: All expected trading days are present. [2025-09-23T19:35:34.769683] [DEBUG] [VALIDATOR ] JQC: Primary data validation passed. [2025-09-23T19:35:34.770404] [INFO ] [MAIN ] JQC: Fetched primary data is valid. [2025-09-23T19:35:34.770448] [DEBUG] [LOCAL ] JQC: Saving primary data. [2025-09-23T19:35:34.771514] [DEBUG] [LOCAL ] JQC: Trimmed 48482 records to 33665 (keeping 200 days of data) [2025-09-23T19:35:34.975414] [DEBUG] [LOCAL ] JQC: Primary data saved (33665 records). [2025-09-23T19:35:34.975565] [INFO ] [MAIN ] JQC: Full history saved. [2025-09-23T19:35:34.975672] [INFO ] [MAIN ] Update Progress: 1173/2372 symbols completed. JQC took 40.9s. Estimated remaining: 2h 38m 59s. Rate: 7.5 symbols/min [2025-09-23T19:35:35.148945] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:35:35.188685] [DEBUG] [LOCAL ] KAR: Loaded 39949 existing records from primary storage. [2025-09-23T19:35:35.188836] [INFO ] [MAIN ] KAR: Loaded 39949 existing records. [2025-09-23T19:35:35.372677] [WARN ] [MAIN ] KAR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:35:35.397089] [INFO ] [MAIN ] KAR: Wiping existing primary data before full refresh. [2025-09-23T19:35:35.397196] [INFO ] [LOCAL ] KAR: Starting deletion of primary data. [2025-09-23T19:35:35.402063] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-23T19:35:35.402255] [INFO ] [REMOTE ] KAI: Fetching primary data for 2024-12. [2025-09-23T19:35:35.402141] [DEBUG] [LOCAL ] KAR: Deleted primary data file. [2025-09-23T19:35:35.402702] [INFO ] [MAIN ] KAR: Starting full primary refresh. [2025-09-23T19:35:35.767435] [INFO ] [REMOTE ] KAR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:35:36.077674] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-23T19:35:36.202220] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-05. [2025-09-23T19:35:36.232196] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-23T19:35:37.002197] [INFO ] [REMOTE ] K: Fetching primary data for 2025-02. [2025-09-23T19:35:37.802175] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-01. [2025-09-23T19:35:37.846364] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-23T19:35:38.124954] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-23T19:35:38.602233] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-06. [2025-09-23T19:35:38.644710] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-23T19:35:39.402206] [INFO ] [REMOTE ] KAR: Fetching primary data for 2024-12. [2025-09-23T19:35:40.108013] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-23T19:35:40.202195] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-07. [2025-09-23T19:35:40.746064] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-23T19:35:41.002225] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-02. [2025-09-23T19:35:41.731384] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-23T19:35:41.775524] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-23T19:35:41.802177] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-03. [2025-09-23T19:35:42.602233] [INFO ] [REMOTE ] K: Fetching primary data for 2025-03. [2025-09-23T19:35:42.796394] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-23T19:35:43.402215] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-04. [2025-09-23T19:35:44.202167] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-08. [2025-09-23T19:35:44.292401] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-23T19:35:44.347467] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-23T19:35:45.002222] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-05. [2025-09-23T19:35:45.730994] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-23T19:35:45.772918] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-23T19:35:45.802150] [INFO ] [REMOTE ] K: Fetching primary data for 2025-04. [2025-09-23T19:35:46.602247] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-06. [2025-09-23T19:35:47.402216] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-09. [2025-09-23T19:35:47.535274] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-23T19:35:47.548312] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-23T19:35:48.202195] [INFO ] [REMOTE ] K: Fetching primary data for 2025-05. [2025-09-23T19:35:48.904241] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-23T19:35:48.912514] [INFO ] [REMOTE ] JXN: Full fetch complete (65342 records). [2025-09-23T19:35:48.912716] [DEBUG] [VALIDATOR ] JXN: Validating primary data. [2025-09-23T19:35:49.007269] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-01. [2025-09-23T19:35:49.316109] [DEBUG] [VALIDATOR ] JXN: All expected trading days are present. [2025-09-23T19:35:49.316254] [DEBUG] [VALIDATOR ] JXN: Primary data validation passed. [2025-09-23T19:35:49.317226] [INFO ] [MAIN ] JXN: Fetched primary data is valid. [2025-09-23T19:35:49.317300] [DEBUG] [LOCAL ] JXN: Saving primary data. [2025-09-23T19:35:49.318927] [DEBUG] [LOCAL ] JXN: Trimmed 65342 records to 46012 (keeping 200 days of data) [2025-09-23T19:35:49.612158] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-23T19:35:49.669519] [DEBUG] [LOCAL ] JXN: Primary data saved (46012 records). [2025-09-23T19:35:49.669687] [INFO ] [MAIN ] JXN: Full history saved. [2025-09-23T19:35:49.669787] [INFO ] [MAIN ] Update Progress: 1174/2372 symbols completed. JXN took 28.2s. Estimated remaining: 2h 38m 58s. Rate: 7.5 symbols/min [2025-09-23T19:35:49.811858] [INFO ] [REMOTE ] K: Fetching primary data for 2025-06. [2025-09-23T19:35:49.845888] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:35:49.869201] [DEBUG] [LOCAL ] KB: Loaded 24236 existing records from primary storage. [2025-09-23T19:35:49.869363] [INFO ] [MAIN ] KB: Loaded 24236 existing records. [2025-09-23T19:35:50.073261] [WARN ] [MAIN ] KB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:35:50.073879] [INFO ] [MAIN ] KB: Wiping existing primary data before full refresh. [2025-09-23T19:35:50.073968] [INFO ] [LOCAL ] KB: Starting deletion of primary data. [2025-09-23T19:35:50.074668] [DEBUG] [LOCAL ] KB: Deleted primary data file. [2025-09-23T19:35:50.074731] [INFO ] [MAIN ] KB: Starting full primary refresh. [2025-09-23T19:35:50.445893] [INFO ] [REMOTE ] KB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:35:50.466847] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-23T19:35:50.602198] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-07. [2025-09-23T19:35:51.404771] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-02. [2025-09-23T19:35:51.410866] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-23T19:35:51.457154] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-23T19:35:52.202241] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-08. [2025-09-23T19:35:52.826152] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-23T19:35:53.002195] [INFO ] [REMOTE ] KB: Fetching primary data for 2024-12. [2025-09-23T19:35:53.245999] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-23T19:35:53.802275] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-09. [2025-09-23T19:35:54.396519] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-23T19:35:54.602181] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-03. [2025-09-23T19:35:54.644283] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-23T19:35:54.646798] [INFO ] [REMOTE ] KAI: Full fetch complete (18789 records). [2025-09-23T19:35:54.646880] [DEBUG] [VALIDATOR ] KAI: Validating primary data. [2025-09-23T19:35:55.059331] [DEBUG] [VALIDATOR ] KAI: All expected trading days are present. [2025-09-23T19:35:55.059441] [DEBUG] [VALIDATOR ] KAI: Primary data validation passed. [2025-09-23T19:35:55.059863] [INFO ] [MAIN ] KAI: Fetched primary data is valid. [2025-09-23T19:35:55.059924] [DEBUG] [LOCAL ] KAI: Saving primary data. [2025-09-23T19:35:55.060471] [DEBUG] [LOCAL ] KAI: Trimmed 18789 records to 13631 (keeping 200 days of data) [2025-09-23T19:35:55.147236] [DEBUG] [LOCAL ] KAI: Primary data saved (13631 records). [2025-09-23T19:35:55.147395] [INFO ] [MAIN ] KAI: Full history saved. [2025-09-23T19:35:55.147482] [INFO ] [MAIN ] Update Progress: 1175/2372 symbols completed. KAI took 21.5s. Estimated remaining: 2h 38m 47s. Rate: 7.5 symbols/min [2025-09-23T19:35:55.319678] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:35:55.345227] [DEBUG] [LOCAL ] KBDC: Loaded 20592 existing records from primary storage. [2025-09-23T19:35:55.345394] [INFO ] [MAIN ] KBDC: Loaded 20592 existing records. [2025-09-23T19:35:55.410487] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-01. [2025-09-23T19:35:55.529355] [WARN ] [MAIN ] KBDC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:35:55.529627] [INFO ] [MAIN ] KBDC: Wiping existing primary data before full refresh. [2025-09-23T19:35:55.529711] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-09-23T19:35:55.530424] [DEBUG] [LOCAL ] KBDC: Deleted primary data file. [2025-09-23T19:35:55.530487] [INFO ] [MAIN ] KBDC: Starting full primary refresh. [2025-09-23T19:35:55.910048] [INFO ] [REMOTE ] KBDC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:35:56.044193] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-23T19:35:56.179964] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-23T19:35:56.202172] [INFO ] [REMOTE ] K: Fetching primary data for 2025-07. [2025-09-23T19:35:57.002191] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-02. [2025-09-23T19:35:57.802197] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-04. [2025-09-23T19:35:58.046442] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-23T19:35:58.082287] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-23T19:35:58.602243] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2024-12. [2025-09-23T19:35:58.902782] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-23T19:35:59.334909] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-23T19:35:59.402225] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-03. [2025-09-23T19:36:00.202230] [INFO ] [REMOTE ] K: Fetching primary data for 2025-08. [2025-09-23T19:36:00.834701] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-23T19:36:01.002204] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-05. [2025-09-23T19:36:01.802198] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-04. [2025-09-23T19:36:02.602232] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-01. [2025-09-23T19:36:02.897445] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-23T19:36:02.907522] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-08 (2.71 seconds). [2025-09-23T19:36:03.402191] [INFO ] [REMOTE ] K: Fetching primary data for 2025-09. [2025-09-23T19:36:03.883847] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-23T19:36:04.202248] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-06. [2025-09-23T19:36:05.002568] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-02. [2025-09-23T19:36:05.056060] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-04 (3.25 seconds). [2025-09-23T19:36:05.700392] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-09-23T19:36:05.725145] [INFO ] [REMOTE ] K: Full fetch complete (71833 records). [2025-09-23T19:36:05.725553] [DEBUG] [VALIDATOR ] K: Validating primary data. [2025-09-23T19:36:05.809034] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-05. [2025-09-23T19:36:06.059975] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-23T19:36:06.137452] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-23T19:36:06.214193] [DEBUG] [VALIDATOR ] K: All expected trading days are present. [2025-09-23T19:36:06.214280] [DEBUG] [VALIDATOR ] K: Primary data validation passed. [2025-09-23T19:36:06.215217] [INFO ] [MAIN ] K: Fetched primary data is valid. [2025-09-23T19:36:06.215343] [DEBUG] [LOCAL ] K: Saving primary data. [2025-09-23T19:36:06.217238] [DEBUG] [LOCAL ] K: Trimmed 71833 records to 49850 (keeping 200 days of data) [2025-09-23T19:36:06.555131] [DEBUG] [LOCAL ] K: Primary data saved (49850 records). [2025-09-23T19:36:06.555360] [INFO ] [MAIN ] K: Full history saved. [2025-09-23T19:36:06.555793] [INFO ] [MAIN ] Update Progress: 1176/2372 symbols completed. K took 43.1s. Estimated remaining: 2h 38m 43s. Rate: 7.5 symbols/min [2025-09-23T19:36:06.613710] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-07. [2025-09-23T19:36:06.736179] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:36:06.792408] [DEBUG] [LOCAL ] KBH: Loaded 48917 existing records from primary storage. [2025-09-23T19:36:06.792581] [INFO ] [MAIN ] KBH: Loaded 48917 existing records. [2025-09-23T19:36:06.978705] [WARN ] [MAIN ] KBH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:36:06.979315] [INFO ] [MAIN ] KBH: Wiping existing primary data before full refresh. [2025-09-23T19:36:06.979373] [INFO ] [LOCAL ] KBH: Starting deletion of primary data. [2025-09-23T19:36:06.981424] [DEBUG] [LOCAL ] KBH: Deleted primary data file. [2025-09-23T19:36:06.981506] [INFO ] [MAIN ] KBH: Starting full primary refresh. [2025-09-23T19:36:07.167134] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-23T19:36:07.375158] [INFO ] [REMOTE ] KBH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:36:07.402158] [INFO ] [REMOTE ] KBH: Fetching primary data for 2024-12. [2025-09-23T19:36:08.147547] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-23T19:36:08.202188] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-08. [2025-09-23T19:36:08.686515] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-23T19:36:09.002249] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-03. [2025-09-23T19:36:09.702879] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-23T19:36:09.802183] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-09. [2025-09-23T19:36:10.105441] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-23T19:36:10.602192] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-06. [2025-09-23T19:36:11.029778] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-23T19:36:11.036819] [INFO ] [REMOTE ] KAR: Full fetch complete (56648 records). [2025-09-23T19:36:11.036952] [DEBUG] [VALIDATOR ] KAR: Validating primary data. [2025-09-23T19:36:11.403877] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-01. [2025-09-23T19:36:11.422469] [DEBUG] [VALIDATOR ] KAR: All expected trading days are present. [2025-09-23T19:36:11.422636] [DEBUG] [VALIDATOR ] KAR: Primary data validation passed. [2025-09-23T19:36:11.423520] [INFO ] [MAIN ] KAR: Fetched primary data is valid. [2025-09-23T19:36:11.423791] [DEBUG] [LOCAL ] KAR: Saving primary data. [2025-09-23T19:36:11.425348] [DEBUG] [LOCAL ] KAR: Trimmed 56648 records to 39918 (keeping 200 days of data) [2025-09-23T19:36:11.539162] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-23T19:36:11.694812] [DEBUG] [LOCAL ] KAR: Primary data saved (39918 records). [2025-09-23T19:36:11.695008] [INFO ] [MAIN ] KAR: Full history saved. [2025-09-23T19:36:11.695122] [INFO ] [MAIN ] Update Progress: 1177/2372 symbols completed. KAR took 36.7s. Estimated remaining: 2h 38m 32s. Rate: 7.5 symbols/min [2025-09-23T19:36:11.866251] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:36:11.913103] [DEBUG] [LOCAL ] KBR: Loaded 48204 existing records from primary storage. [2025-09-23T19:36:11.913282] [INFO ] [MAIN ] KBR: Loaded 48204 existing records. [2025-09-23T19:36:12.086622] [WARN ] [MAIN ] KBR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:36:12.086971] [INFO ] [MAIN ] KBR: Wiping existing primary data before full refresh. [2025-09-23T19:36:12.087031] [INFO ] [LOCAL ] KBR: Starting deletion of primary data. [2025-09-23T19:36:12.088324] [DEBUG] [LOCAL ] KBR: Deleted primary data file. [2025-09-23T19:36:12.088384] [INFO ] [MAIN ] KBR: Starting full primary refresh. [2025-09-23T19:36:12.207285] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-07. [2025-09-23T19:36:12.452024] [INFO ] [REMOTE ] KBR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:36:13.002164] [INFO ] [REMOTE ] KBR: Fetching primary data for 2024-12. [2025-09-23T19:36:13.184384] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-23T19:36:13.246028] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-23T19:36:13.802198] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-04. [2025-09-23T19:36:14.602274] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-08. [2025-09-23T19:36:14.732709] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-23T19:36:14.826515] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-23T19:36:15.402255] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-05. [2025-09-23T19:36:15.764166] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-23T19:36:16.175051] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-23T19:36:16.202165] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-06. [2025-09-23T19:36:16.939330] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-23T19:36:17.002212] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-02. [2025-09-23T19:36:17.802240] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-01. [2025-09-23T19:36:18.602202] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-07. [2025-09-23T19:36:19.402190] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-09. [2025-09-23T19:36:19.533872] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-02 (2.53 seconds). [2025-09-23T19:36:20.062557] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-09-23T19:36:20.098413] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-23T19:36:20.202700] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-23T19:36:20.202170] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-03. [2025-09-23T19:36:20.207356] [INFO ] [REMOTE ] KB: Full fetch complete (34700 records). [2025-09-23T19:36:20.207489] [DEBUG] [VALIDATOR ] KB: Validating primary data. [2025-09-23T19:36:20.587990] [DEBUG] [VALIDATOR ] KB: All expected trading days are present. [2025-09-23T19:36:20.588109] [DEBUG] [VALIDATOR ] KB: Primary data validation passed. [2025-09-23T19:36:20.588758] [INFO ] [MAIN ] KB: Fetched primary data is valid. [2025-09-23T19:36:20.588824] [DEBUG] [LOCAL ] KB: Saving primary data. [2025-09-23T19:36:20.589934] [DEBUG] [LOCAL ] KB: Trimmed 34700 records to 24164 (keeping 200 days of data) [2025-09-23T19:36:20.748820] [DEBUG] [LOCAL ] KB: Primary data saved (24164 records). [2025-09-23T19:36:20.748978] [INFO ] [MAIN ] KB: Full history saved. [2025-09-23T19:36:20.749083] [INFO ] [MAIN ] Update Progress: 1178/2372 symbols completed. KB took 31.1s. Estimated remaining: 2h 38m 25s. Rate: 7.5 symbols/min [2025-09-23T19:36:20.918667] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:36:20.980417] [DEBUG] [LOCAL ] KD: Loaded 52291 existing records from primary storage. [2025-09-23T19:36:20.980712] [INFO ] [MAIN ] KD: Loaded 52291 existing records. [2025-09-23T19:36:21.013782] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-02. [2025-09-23T19:36:21.174678] [WARN ] [MAIN ] KD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:36:21.175016] [INFO ] [MAIN ] KD: Wiping existing primary data before full refresh. [2025-09-23T19:36:21.175074] [INFO ] [LOCAL ] KD: Starting deletion of primary data. [2025-09-23T19:36:21.176200] [DEBUG] [LOCAL ] KD: Deleted primary data file. [2025-09-23T19:36:21.176265] [INFO ] [MAIN ] KD: Starting full primary refresh. [2025-09-23T19:36:21.538713] [INFO ] [REMOTE ] KD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:36:21.802267] [INFO ] [REMOTE ] KD: Fetching primary data for 2024-12. [2025-09-23T19:36:21.923283] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-23T19:36:22.610884] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-08. [2025-09-23T19:36:22.617461] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-23T19:36:23.402211] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-04. [2025-09-23T19:36:23.463028] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-23T19:36:23.592622] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-23T19:36:24.202264] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-03. [2025-09-23T19:36:24.857600] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-23T19:36:25.002165] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-05. [2025-09-23T19:36:25.495778] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-23T19:36:25.802208] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-04. [2025-09-23T19:36:26.095219] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-23T19:36:26.602205] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-01. [2025-09-23T19:36:27.266247] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-23T19:36:27.402210] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-09. [2025-09-23T19:36:28.202191] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-05. [2025-09-23T19:36:28.384294] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-23T19:36:28.435895] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-23T19:36:28.441020] [INFO ] [REMOTE ] KBDC: Full fetch complete (27791 records). [2025-09-23T19:36:28.441131] [DEBUG] [VALIDATOR ] KBDC: Validating primary data. [2025-09-23T19:36:28.832455] [DEBUG] [VALIDATOR ] KBDC: All expected trading days are present. [2025-09-23T19:36:28.832540] [DEBUG] [VALIDATOR ] KBDC: Primary data validation passed. [2025-09-23T19:36:28.833274] [INFO ] [MAIN ] KBDC: Fetched primary data is valid. [2025-09-23T19:36:28.833338] [DEBUG] [LOCAL ] KBDC: Saving primary data. [2025-09-23T19:36:28.834085] [DEBUG] [LOCAL ] KBDC: Trimmed 27791 records to 20649 (keeping 200 days of data) [2025-09-23T19:36:28.969388] [DEBUG] [LOCAL ] KBDC: Primary data saved (20649 records). [2025-09-23T19:36:28.969516] [INFO ] [MAIN ] KBDC: Full history saved. [2025-09-23T19:36:28.969611] [INFO ] [MAIN ] Update Progress: 1179/2372 symbols completed. KBDC took 33.8s. Estimated remaining: 2h 38m 17s. Rate: 7.5 symbols/min [2025-09-23T19:36:29.007286] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-02. [2025-09-23T19:36:29.144378] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:36:29.150780] [DEBUG] [LOCAL ] KEN: Loaded 4763 existing records from primary storage. [2025-09-23T19:36:29.150878] [INFO ] [MAIN ] KEN: Loaded 4763 existing records. [2025-09-23T19:36:29.331056] [WARN ] [MAIN ] KEN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:36:29.331322] [INFO ] [MAIN ] KEN: Wiping existing primary data before full refresh. [2025-09-23T19:36:29.331369] [INFO ] [LOCAL ] KEN: Starting deletion of primary data. [2025-09-23T19:36:29.331768] [DEBUG] [LOCAL ] KEN: Deleted primary data file. [2025-09-23T19:36:29.331828] [INFO ] [MAIN ] KEN: Starting full primary refresh. [2025-09-23T19:36:29.706990] [INFO ] [REMOTE ] KEN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:36:29.751511] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-23T19:36:29.802190] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-06. [2025-09-23T19:36:30.602266] [INFO ] [REMOTE ] KEN: Fetching primary data for 2024-12. [2025-09-23T19:36:30.872992] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-23T19:36:31.098606] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-23T19:36:31.268506] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-23T19:36:31.402262] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-01. [2025-09-23T19:36:31.929791] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-23T19:36:32.202279] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-07. [2025-09-23T19:36:33.002268] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-02. [2025-09-23T19:36:33.790720] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-23T19:36:33.802132] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-03. [2025-09-23T19:36:34.602250] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-06. [2025-09-23T19:36:34.863372] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-07 (2.66 seconds). [2025-09-23T19:36:35.030738] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-23T19:36:35.402224] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-03. [2025-09-23T19:36:36.202219] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-08. [2025-09-23T19:36:36.557169] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-23T19:36:36.917697] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-23T19:36:37.002154] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-04. [2025-09-23T19:36:37.802163] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-07. [2025-09-23T19:36:37.931104] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-23T19:36:38.424839] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-23T19:36:38.602207] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-05. [2025-09-23T19:36:39.402190] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-04. [2025-09-23T19:36:39.535775] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-23T19:36:40.005035] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-23T19:36:40.154146] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-23T19:36:40.202201] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-06. [2025-09-23T19:36:41.002214] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-09. [2025-09-23T19:36:41.802225] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-05. [2025-09-23T19:36:41.959497] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-23T19:36:42.220699] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-23T19:36:42.229002] [INFO ] [REMOTE ] KBR: Full fetch complete (69825 records). [2025-09-23T19:36:42.229146] [DEBUG] [VALIDATOR ] KBR: Validating primary data. [2025-09-23T19:36:42.355836] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-23T19:36:42.607407] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-08. [2025-09-23T19:36:42.666453] [DEBUG] [VALIDATOR ] KBR: All expected trading days are present. [2025-09-23T19:36:42.666539] [DEBUG] [VALIDATOR ] KBR: Primary data validation passed. [2025-09-23T19:36:42.667421] [INFO ] [MAIN ] KBR: Fetched primary data is valid. [2025-09-23T19:36:42.667486] [DEBUG] [LOCAL ] KBR: Saving primary data. [2025-09-23T19:36:42.668831] [DEBUG] [LOCAL ] KBR: Trimmed 69825 records to 48140 (keeping 200 days of data) [2025-09-23T19:36:42.969268] [DEBUG] [LOCAL ] KBR: Primary data saved (48140 records). [2025-09-23T19:36:42.969409] [INFO ] [MAIN ] KBR: Full history saved. [2025-09-23T19:36:42.969495] [INFO ] [MAIN ] Update Progress: 1180/2372 symbols completed. KBR took 31.3s. Estimated remaining: 2h 38m 15s. Rate: 7.5 symbols/min [2025-09-23T19:36:43.141837] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:36:43.174711] [DEBUG] [LOCAL ] KEP: Loaded 30456 existing records from primary storage. [2025-09-23T19:36:43.174875] [INFO ] [MAIN ] KEP: Loaded 30456 existing records. [2025-09-23T19:36:43.353311] [WARN ] [MAIN ] KEP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:36:43.353555] [INFO ] [MAIN ] KEP: Wiping existing primary data before full refresh. [2025-09-23T19:36:43.353604] [INFO ] [LOCAL ] KEP: Starting deletion of primary data. [2025-09-23T19:36:43.354383] [DEBUG] [LOCAL ] KEP: Deleted primary data file. [2025-09-23T19:36:43.354452] [INFO ] [MAIN ] KEP: Starting full primary refresh. [2025-09-23T19:36:43.409295] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-07. [2025-09-23T19:36:43.714254] [INFO ] [REMOTE ] KEP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:36:44.110004] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-23T19:36:44.202200] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-09. [2025-09-23T19:36:45.002205] [INFO ] [REMOTE ] KEP: Fetching primary data for 2024-12. [2025-09-23T19:36:45.408979] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-23T19:36:45.445477] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-23T19:36:45.453766] [INFO ] [REMOTE ] KBH: Full fetch complete (70575 records). [2025-09-23T19:36:45.453916] [DEBUG] [VALIDATOR ] KBH: Validating primary data. [2025-09-23T19:36:45.803938] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-06. [2025-09-23T19:36:45.926065] [DEBUG] [VALIDATOR ] KBH: All expected trading days are present. [2025-09-23T19:36:45.926257] [DEBUG] [VALIDATOR ] KBH: Primary data validation passed. [2025-09-23T19:36:45.927721] [INFO ] [MAIN ] KBH: Fetched primary data is valid. [2025-09-23T19:36:45.927860] [DEBUG] [LOCAL ] KBH: Saving primary data. [2025-09-23T19:36:45.930179] [DEBUG] [LOCAL ] KBH: Trimmed 70575 records to 48899 (keeping 200 days of data) [2025-09-23T19:36:45.952327] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-23T19:36:46.423209] [DEBUG] [LOCAL ] KBH: Primary data saved (48899 records). [2025-09-23T19:36:46.423425] [INFO ] [MAIN ] KBH: Full history saved. [2025-09-23T19:36:46.423561] [INFO ] [MAIN ] Update Progress: 1181/2372 symbols completed. KBH took 39.9s. Estimated remaining: 2h 38m 3s. Rate: 7.5 symbols/min [2025-09-23T19:36:46.548938] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-23T19:36:46.607415] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-08. [2025-09-23T19:36:46.677224] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:36:46.722412] [DEBUG] [LOCAL ] KEX: Loaded 37878 existing records from primary storage. [2025-09-23T19:36:46.722576] [INFO ] [MAIN ] KEX: Loaded 37878 existing records. [2025-09-23T19:36:46.962036] [WARN ] [MAIN ] KEX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:36:46.962345] [INFO ] [MAIN ] KEX: Wiping existing primary data before full refresh. [2025-09-23T19:36:46.962404] [INFO ] [LOCAL ] KEX: Starting deletion of primary data. [2025-09-23T19:36:46.963340] [DEBUG] [LOCAL ] KEX: Deleted primary data file. [2025-09-23T19:36:46.963401] [INFO ] [MAIN ] KEX: Starting full primary refresh. [2025-09-23T19:36:47.325542] [INFO ] [REMOTE ] KEX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:36:47.402150] [INFO ] [REMOTE ] KEX: Fetching primary data for 2024-12. [2025-09-23T19:36:48.202196] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-01. [2025-09-23T19:36:48.530709] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-23T19:36:49.002165] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-09. [2025-09-23T19:36:49.152624] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-23T19:36:49.646272] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-23T19:36:49.802224] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-01. [2025-09-23T19:36:50.602196] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-02. [2025-09-23T19:36:50.868231] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-23T19:36:50.877782] [INFO ] [REMOTE ] KD: Full fetch complete (75579 records). [2025-09-23T19:36:50.877979] [DEBUG] [VALIDATOR ] KD: Validating primary data. [2025-09-23T19:36:51.327358] [DEBUG] [VALIDATOR ] KD: All expected trading days are present. [2025-09-23T19:36:51.327535] [DEBUG] [VALIDATOR ] KD: Primary data validation passed. [2025-09-23T19:36:51.329016] [INFO ] [MAIN ] KD: Fetched primary data is valid. [2025-09-23T19:36:51.329313] [DEBUG] [LOCAL ] KD: Saving primary data. [2025-09-23T19:36:51.356010] [DEBUG] [LOCAL ] KD: Trimmed 75579 records to 52293 (keeping 200 days of data) [2025-09-23T19:36:51.358444] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-23T19:36:51.425719] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-02. [2025-09-23T19:36:51.516705] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-23T19:36:51.736107] [DEBUG] [LOCAL ] KD: Primary data saved (52293 records). [2025-09-23T19:36:51.736330] [INFO ] [MAIN ] KD: Full history saved. [2025-09-23T19:36:51.736445] [INFO ] [MAIN ] Update Progress: 1182/2372 symbols completed. KD took 31.0s. Estimated remaining: 2h 37m 52s. Rate: 7.5 symbols/min [2025-09-23T19:36:51.912700] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:36:51.913074] [DEBUG] [LOCAL ] KEY: No existing data file found in primary storage. [2025-09-23T19:36:51.913138] [WARN ] [MAIN ] KEY: No existing data found, performing full refresh instead. [2025-09-23T19:36:51.913372] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-09-23T19:36:51.913427] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-09-23T19:36:51.913534] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-09-23T19:36:51.913578] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-09-23T19:36:52.207386] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-07. [2025-09-23T19:36:52.276566] [INFO ] [REMOTE ] KEY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:36:52.818564] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-23T19:36:52.955932] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-23T19:36:53.002152] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-08. [2025-09-23T19:36:53.622072] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-23T19:36:53.802211] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-03. [2025-09-23T19:36:54.602200] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-03. [2025-09-23T19:36:55.268974] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-23T19:36:55.364599] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-23T19:36:55.402142] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-04. [2025-09-23T19:36:56.202199] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-04. [2025-09-23T19:36:56.688046] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-23T19:36:57.002239] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-09. [2025-09-23T19:36:57.610318] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-23T19:36:57.611596] [INFO ] [REMOTE ] KEN: Full fetch complete (5962 records). [2025-09-23T19:36:57.611717] [DEBUG] [VALIDATOR ] KEN: Validating primary data. [2025-09-23T19:36:57.803757] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-05. [2025-09-23T19:36:57.973674] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-23T19:36:58.042167] [DEBUG] [VALIDATOR ] KEN: All expected trading days are present. [2025-09-23T19:36:58.042273] [DEBUG] [VALIDATOR ] KEN: Primary data validation passed. [2025-09-23T19:36:58.042535] [INFO ] [MAIN ] KEN: Fetched primary data is valid. [2025-09-23T19:36:58.042608] [DEBUG] [LOCAL ] KEN: Saving primary data. [2025-09-23T19:36:58.043098] [DEBUG] [LOCAL ] KEN: Trimmed 5962 records to 4759 (keeping 200 days of data) [2025-09-23T19:36:58.072286] [DEBUG] [LOCAL ] KEN: Primary data saved (4759 records). [2025-09-23T19:36:58.072364] [INFO ] [MAIN ] KEN: Full history saved. [2025-09-23T19:36:58.072448] [INFO ] [MAIN ] Update Progress: 1183/2372 symbols completed. KEN took 29.1s. Estimated remaining: 2h 37m 43s. Rate: 7.5 symbols/min [2025-09-23T19:36:58.249795] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:36:58.300589] [DEBUG] [LOCAL ] KEYS: Loaded 43401 existing records from primary storage. [2025-09-23T19:36:58.300841] [INFO ] [MAIN ] KEYS: Loaded 43401 existing records. [2025-09-23T19:36:58.509141] [WARN ] [MAIN ] KEYS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:36:58.509509] [INFO ] [MAIN ] KEYS: Wiping existing primary data before full refresh. [2025-09-23T19:36:58.509565] [INFO ] [LOCAL ] KEYS: Starting deletion of primary data. [2025-09-23T19:36:58.510563] [DEBUG] [LOCAL ] KEYS: Deleted primary data file. [2025-09-23T19:36:58.510623] [INFO ] [MAIN ] KEYS: Starting full primary refresh. [2025-09-23T19:36:58.611201] [INFO ] [REMOTE ] KEY: Fetching primary data for 2024-12. [2025-09-23T19:36:58.887601] [INFO ] [REMOTE ] KEYS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:36:59.161395] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-23T19:36:59.402203] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2024-12. [2025-09-23T19:37:00.202177] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-05. [2025-09-23T19:37:00.466410] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-23T19:37:01.002256] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-06. [2025-09-23T19:37:01.087383] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-23T19:37:01.675143] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-23T19:37:01.802219] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-06. [2025-09-23T19:37:02.222927] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-23T19:37:02.602196] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-07. [2025-09-23T19:37:03.000944] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-23T19:37:03.402256] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-07. [2025-09-23T19:37:04.163208] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-23T19:37:04.202150] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-08. [2025-09-23T19:37:04.771590] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-23T19:37:05.002224] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-01. [2025-09-23T19:37:05.564997] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-23T19:37:05.802235] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-08. [2025-09-23T19:37:06.602272] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-09. [2025-09-23T19:37:06.840592] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-23T19:37:06.915398] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-23T19:37:07.402206] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-09-23T19:37:07.967235] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-23T19:37:07.972067] [INFO ] [REMOTE ] KEP: Full fetch complete (41571 records). [2025-09-23T19:37:07.972153] [DEBUG] [VALIDATOR ] KEP: Validating primary data. [2025-09-23T19:37:08.211996] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-09. [2025-09-23T19:37:08.352209] [DEBUG] [VALIDATOR ] KEP: All expected trading days are present. [2025-09-23T19:37:08.352306] [DEBUG] [VALIDATOR ] KEP: Primary data validation passed. [2025-09-23T19:37:08.353067] [INFO ] [MAIN ] KEP: Fetched primary data is valid. [2025-09-23T19:37:08.353132] [DEBUG] [LOCAL ] KEP: Saving primary data. [2025-09-23T19:37:08.354194] [DEBUG] [LOCAL ] KEP: Trimmed 41571 records to 30525 (keeping 200 days of data) [2025-09-23T19:37:08.534281] [DEBUG] [LOCAL ] KEP: Primary data saved (30525 records). [2025-09-23T19:37:08.534423] [INFO ] [MAIN ] KEP: Full history saved. [2025-09-23T19:37:08.534511] [INFO ] [MAIN ] Update Progress: 1184/2372 symbols completed. KEP took 25.6s. Estimated remaining: 2h 37m 37s. Rate: 7.5 symbols/min [2025-09-23T19:37:08.712161] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:37:08.717344] [DEBUG] [LOCAL ] KF: Loaded 2480 existing records from primary storage. [2025-09-23T19:37:08.717470] [INFO ] [MAIN ] KF: Loaded 2480 existing records. [2025-09-23T19:37:08.947259] [WARN ] [MAIN ] KF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:37:08.949958] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-23T19:37:08.947966] [INFO ] [MAIN ] KF: Wiping existing primary data before full refresh. [2025-09-23T19:37:08.960273] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-09-23T19:37:08.961534] [DEBUG] [LOCAL ] KF: Deleted primary data file. [2025-09-23T19:37:08.961609] [INFO ] [MAIN ] KF: Starting full primary refresh. [2025-09-23T19:37:09.008675] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-09-23T19:37:09.361767] [INFO ] [REMOTE ] KF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:37:09.810737] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-01. [2025-09-23T19:37:09.813752] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-23T19:37:09.821885] [INFO ] [REMOTE ] KEX: Full fetch complete (55346 records). [2025-09-23T19:37:09.822047] [DEBUG] [VALIDATOR ] KEX: Validating primary data. [2025-09-23T19:37:10.205844] [DEBUG] [VALIDATOR ] KEX: All expected trading days are present. [2025-09-23T19:37:10.205926] [DEBUG] [VALIDATOR ] KEX: Primary data validation passed. [2025-09-23T19:37:10.206695] [INFO ] [MAIN ] KEX: Fetched primary data is valid. [2025-09-23T19:37:10.206756] [DEBUG] [LOCAL ] KEX: Saving primary data. [2025-09-23T19:37:10.207912] [DEBUG] [LOCAL ] KEX: Trimmed 55346 records to 37961 (keeping 200 days of data) [2025-09-23T19:37:10.432808] [DEBUG] [LOCAL ] KEX: Primary data saved (37961 records). [2025-09-23T19:37:10.432967] [INFO ] [MAIN ] KEX: Full history saved. [2025-09-23T19:37:10.433066] [INFO ] [MAIN ] Update Progress: 1185/2372 symbols completed. KEX took 24.0s. Estimated remaining: 2h 37m 23s. Rate: 7.5 symbols/min [2025-09-23T19:37:10.603538] [INFO ] [REMOTE ] KF: Fetching primary data for 2024-12. [2025-09-23T19:37:10.606201] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:37:10.627777] [DEBUG] [LOCAL ] KFRC: Loaded 19257 existing records from primary storage. [2025-09-23T19:37:10.627914] [INFO ] [MAIN ] KFRC: Loaded 19257 existing records. [2025-09-23T19:37:10.810541] [WARN ] [MAIN ] KFRC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:37:10.811005] [INFO ] [MAIN ] KFRC: Wiping existing primary data before full refresh. [2025-09-23T19:37:10.811195] [INFO ] [LOCAL ] KFRC: Starting deletion of primary data. [2025-09-23T19:37:10.824092] [DEBUG] [LOCAL ] KFRC: Deleted primary data file. [2025-09-23T19:37:10.829322] [INFO ] [MAIN ] KFRC: Starting full primary refresh. [2025-09-23T19:37:10.952328] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-23T19:37:11.224906] [INFO ] [REMOTE ] KFRC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:37:11.251669] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-23T19:37:11.402220] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2024-12. [2025-09-23T19:37:11.508976] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-23T19:37:12.202209] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-01. [2025-09-23T19:37:12.544739] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-23T19:37:12.649035] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-23T19:37:13.002234] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-09-23T19:37:13.802193] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-02. [2025-09-23T19:37:14.233671] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-23T19:37:14.602212] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-03. [2025-09-23T19:37:14.950716] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-23T19:37:15.152951] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-23T19:37:15.402258] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-02. [2025-09-23T19:37:16.202224] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-04. [2025-09-23T19:37:16.651467] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-23T19:37:17.002173] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-05. [2025-09-23T19:37:17.115209] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-23T19:37:17.335480] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-23T19:37:17.802246] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-03. [2025-09-23T19:37:18.602258] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-06. [2025-09-23T19:37:19.355357] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-23T19:37:19.388951] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-23T19:37:19.402133] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-04. [2025-09-23T19:37:20.202205] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-01. [2025-09-23T19:37:21.005417] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-09-23T19:37:21.008773] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-23T19:37:21.107482] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-23T19:37:21.802233] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-05. [2025-09-23T19:37:22.602167] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-07. [2025-09-23T19:37:22.839206] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-23T19:37:23.041830] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-23T19:37:23.361378] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-23T19:37:23.402234] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-02. [2025-09-23T19:37:24.202280] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-06. [2025-09-23T19:37:24.433715] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-23T19:37:25.002245] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-03. [2025-09-23T19:37:25.351289] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-23T19:37:25.601706] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-23T19:37:25.802232] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-07. [2025-09-23T19:37:26.602194] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-04. [2025-09-23T19:37:27.303611] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-23T19:37:27.402267] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-08. [2025-09-23T19:37:27.750770] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-23T19:37:27.834485] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-23T19:37:28.202220] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-09-23T19:37:29.002251] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-09. [2025-09-23T19:37:29.518014] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-23T19:37:29.519086] [INFO ] [REMOTE ] KF: Full fetch complete (3783 records). [2025-09-23T19:37:29.519155] [DEBUG] [VALIDATOR ] KF: Validating primary data. [2025-09-23T19:37:29.806524] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-05. [2025-09-23T19:37:29.893965] [DEBUG] [VALIDATOR ] KF: All expected trading days are present. [2025-09-23T19:37:29.894183] [DEBUG] [VALIDATOR ] KF: Primary data validation passed. [2025-09-23T19:37:29.894452] [INFO ] [MAIN ] KF: Fetched primary data is valid. [2025-09-23T19:37:29.894534] [DEBUG] [LOCAL ] KF: Saving primary data. [2025-09-23T19:37:29.895221] [DEBUG] [LOCAL ] KF: Trimmed 3783 records to 2471 (keeping 200 days of data) [2025-09-23T19:37:29.951525] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-23T19:37:29.952168] [DEBUG] [LOCAL ] KF: Primary data saved (2471 records). [2025-09-23T19:37:29.952436] [INFO ] [MAIN ] KF: Full history saved. [2025-09-23T19:37:29.963610] [INFO ] [MAIN ] Update Progress: 1186/2372 symbols completed. KF took 21.4s. Estimated remaining: 2h 37m 27s. Rate: 7.5 symbols/min [2025-09-23T19:37:30.136074] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:37:30.146463] [DEBUG] [LOCAL ] KFS: Loaded 8242 existing records from primary storage. [2025-09-23T19:37:30.146588] [INFO ] [MAIN ] KFS: Loaded 8242 existing records. [2025-09-23T19:37:30.326727] [WARN ] [MAIN ] KFS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:37:30.327012] [INFO ] [MAIN ] KFS: Wiping existing primary data before full refresh. [2025-09-23T19:37:30.327061] [INFO ] [LOCAL ] KFS: Starting deletion of primary data. [2025-09-23T19:37:30.327424] [DEBUG] [LOCAL ] KFS: Deleted primary data file. [2025-09-23T19:37:30.327497] [INFO ] [MAIN ] KFS: Starting full primary refresh. [2025-09-23T19:37:30.605193] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-09-23T19:37:30.690044] [INFO ] [REMOTE ] KFS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:37:30.777902] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-23T19:37:31.402286] [INFO ] [REMOTE ] KFS: Fetching primary data for 2024-12. [2025-09-23T19:37:31.883447] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-23T19:37:32.202229] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-01. [2025-09-23T19:37:32.520617] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-23T19:37:32.820064] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-23T19:37:33.002232] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-02. [2025-09-23T19:37:33.562531] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-23T19:37:33.802219] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-03. [2025-09-23T19:37:34.400229] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-23T19:37:34.602224] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-04. [2025-09-23T19:37:35.323683] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-23T19:37:35.402240] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-08. [2025-09-23T19:37:36.202201] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-09-23T19:37:36.973910] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-23T19:37:37.002165] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-06. [2025-09-23T19:37:37.802248] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-09. [2025-09-23T19:37:38.047983] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-23T19:37:38.079246] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-23T19:37:38.602276] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-07. [2025-09-23T19:37:39.402242] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-09-23T19:37:39.552100] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-23T19:37:39.564687] [INFO ] [REMOTE ] KEYS: Full fetch complete (62941 records). [2025-09-23T19:37:39.565177] [DEBUG] [VALIDATOR ] KEYS: Validating primary data. [2025-09-23T19:37:39.746088] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-23T19:37:40.003857] [DEBUG] [VALIDATOR ] KEYS: All expected trading days are present. [2025-09-23T19:37:40.003964] [DEBUG] [VALIDATOR ] KEYS: Primary data validation passed. [2025-09-23T19:37:40.005199] [INFO ] [MAIN ] KEYS: Fetched primary data is valid. [2025-09-23T19:37:40.005269] [DEBUG] [LOCAL ] KEYS: Saving primary data. [2025-09-23T19:37:40.007022] [DEBUG] [LOCAL ] KEYS: Trimmed 62941 records to 43332 (keeping 200 days of data) [2025-09-23T19:37:40.203891] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-05. [2025-09-23T19:37:40.294969] [DEBUG] [LOCAL ] KEYS: Primary data saved (43332 records). [2025-09-23T19:37:40.295186] [INFO ] [MAIN ] KEYS: Full history saved. [2025-09-23T19:37:40.295302] [INFO ] [MAIN ] Update Progress: 1187/2372 symbols completed. KEYS took 42.2s. Estimated remaining: 2h 37m 21s. Rate: 7.5 symbols/min [2025-09-23T19:37:40.472875] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:37:40.509097] [DEBUG] [LOCAL ] KFY: Loaded 30690 existing records from primary storage. [2025-09-23T19:37:40.509292] [INFO ] [MAIN ] KFY: Loaded 30690 existing records. [2025-09-23T19:37:40.699331] [WARN ] [MAIN ] KFY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:37:40.700062] [INFO ] [MAIN ] KFY: Wiping existing primary data before full refresh. [2025-09-23T19:37:40.700246] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-09-23T19:37:40.701410] [DEBUG] [LOCAL ] KFY: Deleted primary data file. [2025-09-23T19:37:40.701477] [INFO ] [MAIN ] KFY: Starting full primary refresh. [2025-09-23T19:37:41.022379] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-08. [2025-09-23T19:37:41.024875] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-23T19:37:41.099732] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-23T19:37:41.163324] [INFO ] [REMOTE ] KEY: Full fetch complete (77253 records). [2025-09-23T19:37:41.167867] [INFO ] [REMOTE ] KFY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:37:41.168241] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-09-23T19:37:41.363704] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-23T19:37:41.364492] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:37:41.364566] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:37:41.364665] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-09-23T19:37:41.364768] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-09-23T19:37:41.364826] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-09-23T19:37:41.364884] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-09-23T19:37:41.364990] [INFO ] [MAIN ] Update Progress: 1188/2372 symbols completed. KEY took 49.6s. Estimated remaining: 2h 37m 6s. Rate: 7.5 symbols/min [2025-09-23T19:37:41.531349] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:37:41.589631] [DEBUG] [LOCAL ] KGC: Loaded 53699 existing records from primary storage. [2025-09-23T19:37:41.589831] [INFO ] [MAIN ] KGC: Loaded 53699 existing records. [2025-09-23T19:37:41.771246] [WARN ] [MAIN ] KGC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:37:41.771519] [INFO ] [MAIN ] KGC: Wiping existing primary data before full refresh. [2025-09-23T19:37:41.771566] [INFO ] [LOCAL ] KGC: Starting deletion of primary data. [2025-09-23T19:37:41.773043] [DEBUG] [LOCAL ] KGC: Deleted primary data file. [2025-09-23T19:37:41.773104] [INFO ] [MAIN ] KGC: Starting full primary refresh. [2025-09-23T19:37:41.807497] [INFO ] [REMOTE ] KFY: Fetching primary data for 2024-12. [2025-09-23T19:37:42.138561] [INFO ] [REMOTE ] KGC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:37:42.155843] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-23T19:37:42.602245] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-06. [2025-09-23T19:37:43.011618] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-23T19:37:43.402228] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-01. [2025-09-23T19:37:43.611608] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-23T19:37:44.202148] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-07. [2025-09-23T19:37:44.606368] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-23T19:37:44.722570] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-23T19:37:45.002217] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-09. [2025-09-23T19:37:45.802158] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-02. [2025-09-23T19:37:46.201374] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-23T19:37:46.206035] [INFO ] [REMOTE ] KFRC: Full fetch complete (25224 records). [2025-09-23T19:37:46.206152] [DEBUG] [VALIDATOR ] KFRC: Validating primary data. [2025-09-23T19:37:46.574686] [DEBUG] [VALIDATOR ] KFRC: All expected trading days are present. [2025-09-23T19:37:46.574781] [DEBUG] [VALIDATOR ] KFRC: Primary data validation passed. [2025-09-23T19:37:46.575373] [INFO ] [MAIN ] KFRC: Fetched primary data is valid. [2025-09-23T19:37:46.575432] [DEBUG] [LOCAL ] KFRC: Saving primary data. [2025-09-23T19:37:46.576128] [DEBUG] [LOCAL ] KFRC: Trimmed 25224 records to 19348 (keeping 200 days of data) [2025-09-23T19:37:46.626065] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-08. [2025-09-23T19:37:46.699824] [DEBUG] [LOCAL ] KFRC: Primary data saved (19348 records). [2025-09-23T19:37:46.699989] [INFO ] [MAIN ] KFRC: Full history saved. [2025-09-23T19:37:46.700119] [INFO ] [MAIN ] Update Progress: 1189/2372 symbols completed. KFRC took 36.3s. Estimated remaining: 2h 36m 56s. Rate: 7.5 symbols/min [2025-09-23T19:37:46.873460] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:37:46.917053] [DEBUG] [LOCAL ] KGS: Loaded 45789 existing records from primary storage. [2025-09-23T19:37:46.917215] [INFO ] [MAIN ] KGS: Loaded 45789 existing records. [2025-09-23T19:37:47.134459] [WARN ] [MAIN ] KGS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:37:47.134897] [INFO ] [MAIN ] KGS: Wiping existing primary data before full refresh. [2025-09-23T19:37:47.134987] [INFO ] [LOCAL ] KGS: Starting deletion of primary data. [2025-09-23T19:37:47.141449] [DEBUG] [LOCAL ] KGS: Deleted primary data file. [2025-09-23T19:37:47.151467] [INFO ] [MAIN ] KGS: Starting full primary refresh. [2025-09-23T19:37:47.185635] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-23T19:37:47.405719] [INFO ] [REMOTE ] KGC: Fetching primary data for 2024-12. [2025-09-23T19:37:47.444615] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-23T19:37:47.541209] [INFO ] [REMOTE ] KGS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:37:48.202187] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-09. [2025-09-23T19:37:49.002232] [INFO ] [REMOTE ] KGS: Fetching primary data for 2024-12. [2025-09-23T19:37:49.090195] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-23T19:37:49.092480] [INFO ] [REMOTE ] KFS: Full fetch complete (10452 records). [2025-09-23T19:37:49.092567] [DEBUG] [VALIDATOR ] KFS: Validating primary data. [2025-09-23T19:37:49.493937] [DEBUG] [VALIDATOR ] KFS: All expected trading days are present. [2025-09-23T19:37:49.494082] [DEBUG] [VALIDATOR ] KFS: Primary data validation passed. [2025-09-23T19:37:49.494390] [INFO ] [MAIN ] KFS: Fetched primary data is valid. [2025-09-23T19:37:49.494472] [DEBUG] [LOCAL ] KFS: Saving primary data. [2025-09-23T19:37:49.495430] [DEBUG] [LOCAL ] KFS: Trimmed 10452 records to 8312 (keeping 200 days of data) [2025-09-23T19:37:49.564035] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-23T19:37:49.589370] [DEBUG] [LOCAL ] KFS: Primary data saved (8312 records). [2025-09-23T19:37:49.589537] [INFO ] [MAIN ] KFS: Full history saved. [2025-09-23T19:37:49.589636] [INFO ] [MAIN ] Update Progress: 1190/2372 symbols completed. KFS took 19.6s. Estimated remaining: 2h 36m 43s. Rate: 7.5 symbols/min [2025-09-23T19:37:49.777378] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:37:49.802225] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-01. [2025-09-23T19:37:49.841039] [DEBUG] [LOCAL ] KIM: Loaded 53071 existing records from primary storage. [2025-09-23T19:37:49.841234] [INFO ] [MAIN ] KIM: Loaded 53071 existing records. [2025-09-23T19:37:50.022360] [WARN ] [MAIN ] KIM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:37:50.022701] [INFO ] [MAIN ] KIM: Wiping existing primary data before full refresh. [2025-09-23T19:37:50.022761] [INFO ] [LOCAL ] KIM: Starting deletion of primary data. [2025-09-23T19:37:50.024066] [DEBUG] [LOCAL ] KIM: Deleted primary data file. [2025-09-23T19:37:50.024130] [INFO ] [MAIN ] KIM: Starting full primary refresh. [2025-09-23T19:37:50.400430] [INFO ] [REMOTE ] KIM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:37:50.560971] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-23T19:37:50.602162] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-01. [2025-09-23T19:37:51.402277] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-03. [2025-09-23T19:37:51.656941] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-23T19:37:52.187606] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-23T19:37:52.202164] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-02. [2025-09-23T19:37:52.331599] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-23T19:37:53.002244] [INFO ] [REMOTE ] KIM: Fetching primary data for 2024-12. [2025-09-23T19:37:53.366413] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-23T19:37:53.802214] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-02. [2025-09-23T19:37:54.602190] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-04. [2025-09-23T19:37:54.716735] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-23T19:37:55.287460] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-23T19:37:55.402234] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-03. [2025-09-23T19:37:55.633629] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-23T19:37:56.202232] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-01. [2025-09-23T19:37:57.002244] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-05. [2025-09-23T19:37:57.091320] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-23T19:37:57.548929] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-23T19:37:57.802267] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-02. [2025-09-23T19:37:58.275261] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-23T19:37:58.602190] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-04. [2025-09-23T19:37:59.402172] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-03. [2025-09-23T19:37:59.432094] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-23T19:38:00.202261] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-03. [2025-09-23T19:38:01.002154] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-06. [2025-09-23T19:38:01.055171] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-23T19:38:01.152207] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-09-23T19:38:01.802265] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-05. [2025-09-23T19:38:02.096542] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-23T19:38:02.180994] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-23T19:38:02.602233] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-07. [2025-09-23T19:38:03.402155] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-04. [2025-09-23T19:38:03.661632] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-23T19:38:03.703036] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-23T19:38:04.202207] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-06. [2025-09-23T19:38:05.002187] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-04. [2025-09-23T19:38:05.264705] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-23T19:38:05.802223] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-05. [2025-09-23T19:38:06.236946] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-23T19:38:06.602194] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-07. [2025-09-23T19:38:06.875614] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-23T19:38:07.393987] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-23T19:38:07.402505] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-08. [2025-09-23T19:38:08.202253] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-06. [2025-09-23T19:38:08.567901] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-23T19:38:08.649722] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-23T19:38:09.002264] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-09. [2025-09-23T19:38:09.375936] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-23T19:38:09.802271] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-07. [2025-09-23T19:38:10.503685] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-23T19:38:10.514216] [INFO ] [REMOTE ] KFY: Full fetch complete (43792 records). [2025-09-23T19:38:10.514389] [DEBUG] [VALIDATOR ] KFY: Validating primary data. [2025-09-23T19:38:10.611221] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-08. [2025-09-23T19:38:10.974333] [DEBUG] [VALIDATOR ] KFY: All expected trading days are present. [2025-09-23T19:38:10.974523] [DEBUG] [VALIDATOR ] KFY: Primary data validation passed. [2025-09-23T19:38:10.975473] [INFO ] [MAIN ] KFY: Fetched primary data is valid. [2025-09-23T19:38:10.975597] [DEBUG] [LOCAL ] KFY: Saving primary data. [2025-09-23T19:38:10.976933] [DEBUG] [LOCAL ] KFY: Trimmed 43792 records to 30672 (keeping 200 days of data) [2025-09-23T19:38:11.190055] [DEBUG] [LOCAL ] KFY: Primary data saved (30672 records). [2025-09-23T19:38:11.190245] [INFO ] [MAIN ] KFY: Full history saved. [2025-09-23T19:38:11.190496] [INFO ] [MAIN ] Update Progress: 1191/2372 symbols completed. KFY took 30.9s. Estimated remaining: 2h 36m 48s. Rate: 7.5 symbols/min [2025-09-23T19:38:11.370317] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:38:11.394203] [DEBUG] [LOCAL ] KIO: Loaded 21326 existing records from primary storage. [2025-09-23T19:38:11.394456] [INFO ] [MAIN ] KIO: Loaded 21326 existing records. [2025-09-23T19:38:11.407398] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-05. [2025-09-23T19:38:11.596732] [WARN ] [MAIN ] KIO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:38:11.611636] [INFO ] [MAIN ] KIO: Wiping existing primary data before full refresh. [2025-09-23T19:38:11.611790] [INFO ] [LOCAL ] KIO: Starting deletion of primary data. [2025-09-23T19:38:11.615827] [DEBUG] [LOCAL ] KIO: Deleted primary data file. [2025-09-23T19:38:11.617329] [INFO ] [MAIN ] KIO: Starting full primary refresh. [2025-09-23T19:38:11.617244] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-23T19:38:12.004489] [INFO ] [REMOTE ] KIO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:38:12.202268] [INFO ] [REMOTE ] KIO: Fetching primary data for 2024-12. [2025-09-23T19:38:12.314491] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-23T19:38:12.910204] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-23T19:38:12.985480] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-23T19:38:13.002195] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-06. [2025-09-23T19:38:13.802274] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-08. [2025-09-23T19:38:14.602190] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-01. [2025-09-23T19:38:14.706532] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-23T19:38:15.404020] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-23T19:38:15.404209] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-09. [2025-09-23T19:38:15.765102] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-23T19:38:16.202254] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-02. [2025-09-23T19:38:17.002286] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-09. [2025-09-23T19:38:17.373992] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-23T19:38:17.541467] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-23T19:38:17.550743] [INFO ] [REMOTE ] KGC: Full fetch complete (77690 records). [2025-09-23T19:38:17.550959] [DEBUG] [VALIDATOR ] KGC: Validating primary data. [2025-09-23T19:38:17.813801] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-07. [2025-09-23T19:38:17.955389] [DEBUG] [VALIDATOR ] KGC: All expected trading days are present. [2025-09-23T19:38:17.955502] [DEBUG] [VALIDATOR ] KGC: Primary data validation passed. [2025-09-23T19:38:17.956563] [INFO ] [MAIN ] KGC: Fetched primary data is valid. [2025-09-23T19:38:17.956694] [DEBUG] [LOCAL ] KGC: Saving primary data. [2025-09-23T19:38:17.959015] [DEBUG] [LOCAL ] KGC: Trimmed 77690 records to 53699 (keeping 200 days of data) [2025-09-23T19:38:18.323231] [DEBUG] [LOCAL ] KGC: Primary data saved (53699 records). [2025-09-23T19:38:18.323449] [INFO ] [MAIN ] KGC: Full history saved. [2025-09-23T19:38:18.323686] [INFO ] [MAIN ] Update Progress: 1192/2372 symbols completed. KGC took 37.0s. Estimated remaining: 2h 36m 40s. Rate: 7.5 symbols/min [2025-09-23T19:38:18.518900] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:38:18.546423] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-23T19:38:18.555973] [INFO ] [REMOTE ] KGS: Full fetch complete (65836 records). [2025-09-23T19:38:18.556147] [DEBUG] [VALIDATOR ] KGS: Validating primary data. [2025-09-23T19:38:18.603577] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-03. [2025-09-23T19:38:18.902403] [DEBUG] [LOCAL ] KKR: Loaded 53505 existing records from primary storage. [2025-09-23T19:38:18.918273] [INFO ] [MAIN ] KKR: Loaded 53505 existing records. [2025-09-23T19:38:19.113628] [DEBUG] [VALIDATOR ] KGS: All expected trading days are present. [2025-09-23T19:38:19.129150] [DEBUG] [VALIDATOR ] KGS: Primary data validation passed. [2025-09-23T19:38:19.149065] [INFO ] [MAIN ] KGS: Fetched primary data is valid. [2025-09-23T19:38:19.161274] [DEBUG] [LOCAL ] KGS: Saving primary data. [2025-09-23T19:38:19.185853] [WARN ] [MAIN ] KKR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:38:19.186162] [INFO ] [MAIN ] KKR: Wiping existing primary data before full refresh. [2025-09-23T19:38:19.186206] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-09-23T19:38:19.187349] [DEBUG] [LOCAL ] KGS: Trimmed 65836 records to 45785 (keeping 200 days of data) [2025-09-23T19:38:19.188824] [DEBUG] [LOCAL ] KKR: Deleted primary data file. [2025-09-23T19:38:19.188905] [INFO ] [MAIN ] KKR: Starting full primary refresh. [2025-09-23T19:38:19.685035] [INFO ] [REMOTE ] KKR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:38:19.690138] [INFO ] [REMOTE ] KKR: Fetching primary data for 2024-12. [2025-09-23T19:38:19.806954] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-23T19:38:19.852871] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-23T19:38:19.927850] [DEBUG] [LOCAL ] KGS: Primary data saved (45785 records). [2025-09-23T19:38:19.928004] [INFO ] [MAIN ] KGS: Full history saved. [2025-09-23T19:38:19.928132] [INFO ] [MAIN ] Update Progress: 1193/2372 symbols completed. KGS took 33.2s. Estimated remaining: 2h 36m 25s. Rate: 7.5 symbols/min [2025-09-23T19:38:20.115742] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:38:20.126558] [DEBUG] [LOCAL ] KKRS: Loaded 5760 existing records from primary storage. [2025-09-23T19:38:20.126713] [INFO ] [MAIN ] KKRS: Loaded 5760 existing records. [2025-09-23T19:38:20.207324] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-08. [2025-09-23T19:38:20.310585] [WARN ] [MAIN ] KKRS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:38:20.310868] [INFO ] [MAIN ] KKRS: Wiping existing primary data before full refresh. [2025-09-23T19:38:20.310931] [INFO ] [LOCAL ] KKRS: Starting deletion of primary data. [2025-09-23T19:38:20.311252] [DEBUG] [LOCAL ] KKRS: Deleted primary data file. [2025-09-23T19:38:20.311311] [INFO ] [MAIN ] KKRS: Starting full primary refresh. [2025-09-23T19:38:20.695247] [INFO ] [REMOTE ] KKRS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:38:21.002190] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-04. [2025-09-23T19:38:21.651960] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-23T19:38:21.802173] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-01. [2025-09-23T19:38:21.921365] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-23T19:38:21.966133] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-23T19:38:22.602193] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-05. [2025-09-23T19:38:23.357515] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-23T19:38:23.386449] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-23T19:38:23.402142] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-06. [2025-09-23T19:38:24.202178] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-09. [2025-09-23T19:38:24.350847] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-23T19:38:25.002222] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2024-12. [2025-09-23T19:38:25.723672] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-23T19:38:25.802166] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-01. [2025-09-23T19:38:26.056135] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-23T19:38:26.065253] [INFO ] [REMOTE ] KIM: Full fetch complete (76816 records). [2025-09-23T19:38:26.065453] [DEBUG] [VALIDATOR ] KIM: Validating primary data. [2025-09-23T19:38:26.372344] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-23T19:38:26.468743] [DEBUG] [VALIDATOR ] KIM: All expected trading days are present. [2025-09-23T19:38:26.468833] [DEBUG] [VALIDATOR ] KIM: Primary data validation passed. [2025-09-23T19:38:26.469767] [INFO ] [MAIN ] KIM: Fetched primary data is valid. [2025-09-23T19:38:26.469829] [DEBUG] [LOCAL ] KIM: Saving primary data. [2025-09-23T19:38:26.474165] [DEBUG] [LOCAL ] KIM: Trimmed 76816 records to 53067 (keeping 200 days of data) [2025-09-23T19:38:26.604497] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-07. [2025-09-23T19:38:26.814316] [DEBUG] [LOCAL ] KIM: Primary data saved (53067 records). [2025-09-23T19:38:26.814463] [INFO ] [MAIN ] KIM: Full history saved. [2025-09-23T19:38:26.814549] [INFO ] [MAIN ] Update Progress: 1194/2372 symbols completed. KIM took 37.2s. Estimated remaining: 2h 36m 16s. Rate: 7.5 symbols/min [2025-09-23T19:38:26.980491] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:38:26.980671] [DEBUG] [LOCAL ] KKRT: No existing data file found in primary storage. [2025-09-23T19:38:26.980725] [WARN ] [MAIN ] KKRT: No existing data found, performing full refresh instead. [2025-09-23T19:38:26.980934] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-09-23T19:38:26.980976] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-09-23T19:38:26.981067] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-09-23T19:38:26.981107] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-09-23T19:38:27.335022] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:38:27.402143] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2024-12. [2025-09-23T19:38:27.601954] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:38:27.602199] [WARN ] [REMOTE ] KKRT: No data returned for month 2024-12 [2025-09-23T19:38:27.851395] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-23T19:38:28.202193] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-02. [2025-09-23T19:38:29.002195] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-08. [2025-09-23T19:38:29.802185] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-02. [2025-09-23T19:38:29.958737] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-23T19:38:29.998473] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-23T19:38:30.167382] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-23T19:38:30.602267] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-03. [2025-09-23T19:38:31.229612] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-23T19:38:31.402258] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-01. [2025-09-23T19:38:31.603394] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:38:31.603790] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-01 [2025-09-23T19:38:32.202212] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-09. [2025-09-23T19:38:33.002217] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-04. [2025-09-23T19:38:33.297147] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-23T19:38:33.303097] [INFO ] [REMOTE ] KIO: Full fetch complete (30882 records). [2025-09-23T19:38:33.303250] [DEBUG] [VALIDATOR ] KIO: Validating primary data. [2025-09-23T19:38:33.693097] [DEBUG] [VALIDATOR ] KIO: All expected trading days are present. [2025-09-23T19:38:33.693440] [DEBUG] [VALIDATOR ] KIO: Primary data validation passed. [2025-09-23T19:38:33.694077] [INFO ] [MAIN ] KIO: Fetched primary data is valid. [2025-09-23T19:38:33.694140] [DEBUG] [LOCAL ] KIO: Saving primary data. [2025-09-23T19:38:33.696107] [DEBUG] [LOCAL ] KIO: Trimmed 30882 records to 21283 (keeping 200 days of data) [2025-09-23T19:38:33.791318] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-23T19:38:33.803301] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-02. [2025-09-23T19:38:33.838973] [DEBUG] [LOCAL ] KIO: Primary data saved (21283 records). [2025-09-23T19:38:33.839114] [INFO ] [MAIN ] KIO: Full history saved. [2025-09-23T19:38:33.839225] [INFO ] [MAIN ] Update Progress: 1195/2372 symbols completed. KIO took 22.6s. Estimated remaining: 2h 36m 7s. Rate: 7.5 symbols/min [2025-09-23T19:38:34.009728] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:38:34.009946] [DEBUG] [LOCAL ] KLAR: No existing data file found in primary storage. [2025-09-23T19:38:34.010001] [WARN ] [MAIN ] KLAR: No existing data found, performing full refresh instead. [2025-09-23T19:38:34.010184] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-09-23T19:38:34.010227] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-09-23T19:38:34.010269] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-09-23T19:38:34.010301] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-09-23T19:38:34.054788] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:38:34.092728] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-02 [2025-09-23T19:38:34.380603] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:38:34.602199] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-05. [2025-09-23T19:38:35.328099] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-23T19:38:35.402196] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-03. [2025-09-23T19:38:36.202198] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-06. [2025-09-23T19:38:36.732436] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-23T19:38:37.002205] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-07. [2025-09-23T19:38:37.594000] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-23T19:38:37.595621] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-23T19:38:37.802222] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2024-12. [2025-09-23T19:38:37.991373] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:38:37.991738] [WARN ] [REMOTE ] KLAR: No data returned for month 2024-12 [2025-09-23T19:38:38.602203] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-04. [2025-09-23T19:38:39.402215] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-03. [2025-09-23T19:38:39.601412] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:38:39.601810] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-03 [2025-09-23T19:38:40.202158] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-04. [2025-09-23T19:38:40.397037] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:38:40.397361] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-04 [2025-09-23T19:38:40.635367] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-23T19:38:41.002201] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-01. [2025-09-23T19:38:41.241280] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:38:41.241601] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-01 [2025-09-23T19:38:41.802193] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-08. [2025-09-23T19:38:42.240449] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-23T19:38:42.602195] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-02. [2025-09-23T19:38:42.789279] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:38:42.789671] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-02 [2025-09-23T19:38:43.402205] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-05. [2025-09-23T19:38:44.202189] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-03. [2025-09-23T19:38:44.392815] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:38:44.393151] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-03 [2025-09-23T19:38:45.002164] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-05. [2025-09-23T19:38:45.413349] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-23T19:38:45.472138] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-23T19:38:45.802216] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-06. [2025-09-23T19:38:46.602196] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-06. [2025-09-23T19:38:46.878492] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-23T19:38:47.402188] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-04. [2025-09-23T19:38:47.596434] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:38:47.596795] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-04 [2025-09-23T19:38:48.202157] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-09. [2025-09-23T19:38:48.291382] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-23T19:38:48.900037] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-23T19:38:48.901356] [INFO ] [REMOTE ] KKRS: Full fetch complete (8046 records). [2025-09-23T19:38:48.901429] [DEBUG] [VALIDATOR ] KKRS: Validating primary data. [2025-09-23T19:38:49.005413] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-05. [2025-09-23T19:38:49.255674] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:38:49.282053] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-05 [2025-09-23T19:38:49.290333] [DEBUG] [VALIDATOR ] KKRS: All expected trading days are present. [2025-09-23T19:38:49.290668] [DEBUG] [VALIDATOR ] KKRS: Primary data validation passed. [2025-09-23T19:38:49.290907] [INFO ] [MAIN ] KKRS: Fetched primary data is valid. [2025-09-23T19:38:49.290950] [DEBUG] [LOCAL ] KKRS: Saving primary data. [2025-09-23T19:38:49.291391] [DEBUG] [LOCAL ] KKRS: Trimmed 8046 records to 5751 (keeping 200 days of data) [2025-09-23T19:38:49.327320] [DEBUG] [LOCAL ] KKRS: Primary data saved (5751 records). [2025-09-23T19:38:49.327468] [INFO ] [MAIN ] KKRS: Full history saved. [2025-09-23T19:38:49.327578] [INFO ] [MAIN ] Update Progress: 1196/2372 symbols completed. KKRS took 29.4s. Estimated remaining: 2h 36m 7s. Rate: 7.5 symbols/min [2025-09-23T19:38:49.507757] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:38:49.547922] [DEBUG] [LOCAL ] KLC: Loaded 36380 existing records from primary storage. [2025-09-23T19:38:49.548065] [INFO ] [MAIN ] KLC: Loaded 36380 existing records. [2025-09-23T19:38:49.722250] [WARN ] [MAIN ] KLC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:38:49.722506] [INFO ] [MAIN ] KLC: Wiping existing primary data before full refresh. [2025-09-23T19:38:49.722555] [INFO ] [LOCAL ] KLC: Starting deletion of primary data. [2025-09-23T19:38:49.723513] [DEBUG] [LOCAL ] KLC: Deleted primary data file. [2025-09-23T19:38:49.723576] [INFO ] [MAIN ] KLC: Starting full primary refresh. [2025-09-23T19:38:49.807374] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-07. [2025-09-23T19:38:50.076700] [INFO ] [REMOTE ] KLC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:38:50.602240] [INFO ] [REMOTE ] KLC: Fetching primary data for 2024-12. [2025-09-23T19:38:51.402239] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-07. [2025-09-23T19:38:51.783199] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-23T19:38:52.206388] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-06. [2025-09-23T19:38:52.197963] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-23T19:38:52.231323] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-23T19:38:52.442577] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:38:52.443028] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-06 [2025-09-23T19:38:53.002186] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-08. [2025-09-23T19:38:53.802266] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-08. [2025-09-23T19:38:53.816357] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-23T19:38:54.602256] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-01. [2025-09-23T19:38:55.402222] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-07. [2025-09-23T19:38:55.596806] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:38:55.597366] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-07 [2025-09-23T19:38:55.672857] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-23T19:38:55.725369] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-23T19:38:56.202247] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-08. [2025-09-23T19:38:56.395889] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:38:56.396220] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-08 [2025-09-23T19:38:57.002215] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-09. [2025-09-23T19:38:57.802172] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-09. [2025-09-23T19:38:57.913578] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-23T19:38:57.915947] [INFO ] [REMOTE ] KKRT: Full fetch complete (8461 records). [2025-09-23T19:38:57.916019] [DEBUG] [VALIDATOR ] KKRT: Validating primary data. [2025-09-23T19:38:58.104797] [WARN ] [VALIDATOR ] KKRT: Validation failed - insufficient historical data. Have 80 unique days, need 200 days [2025-09-23T19:38:58.108373] [FATAL] [MAIN ] KKRT: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:38:58.108471] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:38:58.108545] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-09-23T19:38:58.108612] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-09-23T19:38:58.108686] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-09-23T19:38:58.108767] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-09-23T19:38:58.108848] [INFO ] [MAIN ] Update Progress: 1197/2372 symbols completed. KKRT took 31.3s. Estimated remaining: 2h 35m 60s. Rate: 7.5 symbols/min [2025-09-23T19:38:58.602222] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-02. [2025-09-23T19:38:59.402205] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-09. [2025-09-23T19:38:59.680482] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-23T19:38:59.745085] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-23T19:38:59.754018] [INFO ] [REMOTE ] KKR: Full fetch complete (77440 records). [2025-09-23T19:38:59.754146] [DEBUG] [VALIDATOR ] KKR: Validating primary data. [2025-09-23T19:39:00.162827] [DEBUG] [VALIDATOR ] KKR: All expected trading days are present. [2025-09-23T19:39:00.162924] [DEBUG] [VALIDATOR ] KKR: Primary data validation passed. [2025-09-23T19:39:00.164082] [INFO ] [MAIN ] KKR: Fetched primary data is valid. [2025-09-23T19:39:00.164149] [DEBUG] [LOCAL ] KKR: Saving primary data. [2025-09-23T19:39:00.165824] [DEBUG] [LOCAL ] KKR: Trimmed 77440 records to 53502 (keeping 200 days of data) [2025-09-23T19:39:00.226383] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-03. [2025-09-23T19:39:00.508749] [DEBUG] [LOCAL ] KKR: Primary data saved (53502 records). [2025-09-23T19:39:00.508929] [INFO ] [MAIN ] KKR: Full history saved. [2025-09-23T19:39:00.509033] [INFO ] [MAIN ] Update Progress: 1198/2372 symbols completed. KKR took 42.2s. Estimated remaining: 2h 35m 46s. Rate: 7.5 symbols/min [2025-09-23T19:39:00.810579] [INFO ] [REMOTE ] KLAR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-23T19:39:00.816383] [INFO ] [REMOTE ] KLAR: Full fetch complete (3679 records). [2025-09-23T19:39:00.816495] [DEBUG] [VALIDATOR ] KLAR: Validating primary data. [2025-09-23T19:39:01.016771] [WARN ] [VALIDATOR ] KLAR: Validation failed - insufficient historical data. Have 10 unique days, need 200 days [2025-09-23T19:39:01.017085] [FATAL] [MAIN ] KLAR: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:39:01.017160] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:39:01.017240] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-09-23T19:39:01.017318] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-09-23T19:39:01.017358] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-09-23T19:39:01.017443] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-09-23T19:39:01.017541] [INFO ] [MAIN ] Update Progress: 1199/2372 symbols completed. KLAR took 27.2s. Estimated remaining: 2h 35m 31s. Rate: 7.5 symbols/min [2025-09-23T19:39:01.790285] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-23T19:39:01.798578] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-04. [2025-09-23T19:39:04.559223] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-04 (2.76 seconds). [2025-09-23T19:39:04.567763] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-05. [2025-09-23T19:39:05.974360] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-23T19:39:05.982380] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-06. [2025-09-23T19:39:07.348173] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-23T19:39:07.355497] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-07. [2025-09-23T19:39:08.677856] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-23T19:39:08.686228] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-08. [2025-09-23T19:39:10.123435] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-23T19:39:10.131869] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-09. [2025-09-23T19:39:11.581977] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-23T19:39:11.588402] [INFO ] [REMOTE ] KLC: Full fetch complete (50794 records). [2025-09-23T19:39:11.588543] [DEBUG] [VALIDATOR ] KLC: Validating primary data. [2025-09-23T19:39:11.978696] [DEBUG] [VALIDATOR ] KLC: All expected trading days are present. [2025-09-23T19:39:11.978788] [DEBUG] [VALIDATOR ] KLC: Primary data validation passed. [2025-09-23T19:39:11.979522] [INFO ] [MAIN ] KLC: Fetched primary data is valid. [2025-09-23T19:39:11.979562] [DEBUG] [LOCAL ] KLC: Saving primary data. [2025-09-23T19:39:11.980589] [DEBUG] [LOCAL ] KLC: Trimmed 50794 records to 36503 (keeping 200 days of data) [2025-09-23T19:39:12.186005] [DEBUG] [LOCAL ] KLC: Primary data saved (36503 records). [2025-09-23T19:39:12.186154] [INFO ] [MAIN ] KLC: Full history saved. [2025-09-23T19:39:12.186239] [INFO ] [MAIN ] Update Progress: 1200/2372 symbols completed. KLC took 22.9s. Estimated remaining: 2h 35m 26s. Rate: 7.5 symbols/min [2025-09-23T19:39:12.828248] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:39:12.825347] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:39:12.880363] [INFO ] [MAIN ] KLG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:39:12.899570] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:39:12.904314] [DEBUG] [LOCAL ] KMPB: Loaded 3581 existing records from primary storage. [2025-09-23T19:39:12.905176] [INFO ] [MAIN ] KMPB: Loaded 3581 existing records. [2025-09-23T19:39:13.130115] [WARN ] [MAIN ] KMPB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:39:13.130494] [INFO ] [MAIN ] KMPB: Wiping existing primary data before full refresh. [2025-09-23T19:39:13.130544] [INFO ] [LOCAL ] KMPB: Starting deletion of primary data. [2025-09-23T19:39:13.130861] [DEBUG] [LOCAL ] KMPB: Deleted primary data file. [2025-09-23T19:39:13.130921] [INFO ] [MAIN ] KMPB: Starting full primary refresh. [2025-09-23T19:39:13.273820] [DEBUG] [LOCAL ] KMI: Loaded 53693 existing records from primary storage. [2025-09-23T19:39:13.275534] [INFO ] [MAIN ] KMI: Loaded 53693 existing records. [2025-09-23T19:39:13.275286] [DEBUG] [LOCAL ] KLG: Loaded 41901 existing records from primary storage. [2025-09-23T19:39:13.281694] [DEBUG] [LOCAL ] KMPR: Loaded 38145 existing records from primary storage. [2025-09-23T19:39:13.316155] [INFO ] [MAIN ] KMPR: Loaded 38145 existing records. [2025-09-23T19:39:13.302202] [INFO ] [MAIN ] KLG: Loaded 41901 existing records. [2025-09-23T19:39:13.936749] [WARN ] [MAIN ] KMI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:39:14.048305] [WARN ] [MAIN ] KMPR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:39:14.048531] [INFO ] [MAIN ] KMI: Wiping existing primary data before full refresh. [2025-09-23T19:39:14.056856] [INFO ] [MAIN ] KMPR: Wiping existing primary data before full refresh. [2025-09-23T19:39:14.053967] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-09-23T19:39:14.060259] [WARN ] [MAIN ] KLG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:39:14.056949] [INFO ] [LOCAL ] KMPR: Starting deletion of primary data. [2025-09-23T19:39:14.060618] [INFO ] [MAIN ] KLG: Wiping existing primary data before full refresh. [2025-09-23T19:39:14.060720] [INFO ] [LOCAL ] KLG: Starting deletion of primary data. [2025-09-23T19:39:14.061576] [DEBUG] [LOCAL ] KMPR: Deleted primary data file. [2025-09-23T19:39:14.061672] [DEBUG] [LOCAL ] KMI: Deleted primary data file. [2025-09-23T19:39:14.061732] [INFO ] [MAIN ] KMPR: Starting full primary refresh. [2025-09-23T19:39:14.067370] [INFO ] [MAIN ] KMI: Starting full primary refresh. [2025-09-23T19:39:14.062156] [DEBUG] [LOCAL ] KLG: Deleted primary data file. [2025-09-23T19:39:14.094348] [INFO ] [MAIN ] KLG: Starting full primary refresh. [2025-09-23T19:39:14.400050] [INFO ] [REMOTE ] KMPB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:39:14.470336] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2024-12. [2025-09-23T19:39:15.035010] [INFO ] [REMOTE ] KMI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:39:15.116110] [INFO ] [REMOTE ] KMI: Fetching primary data for 2024-12. [2025-09-23T19:39:15.190407] [INFO ] [REMOTE ] KMPR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:39:15.220309] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2024-12. [2025-09-23T19:39:15.261290] [INFO ] [REMOTE ] KLG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:39:15.261664] [INFO ] [REMOTE ] KLG: Fetching primary data for 2024-12. [2025-09-23T19:39:15.857796] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-23T19:39:15.859257] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-01. [2025-09-23T19:39:16.442834] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-23T19:39:16.444077] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-02. [2025-09-23T19:39:16.792363] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-23T19:39:16.793677] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-03. [2025-09-23T19:39:17.036664] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-23T19:39:17.042266] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-01. [2025-09-23T19:39:17.163199] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-23T19:39:17.164927] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-04. [2025-09-23T19:39:17.769618] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2024-12 (2.51 seconds). [2025-09-23T19:39:17.780034] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-01. [2025-09-23T19:39:17.810937] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-23T19:39:17.812319] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-05. [2025-09-23T19:39:17.869910] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2024-12 (2.75 seconds). [2025-09-23T19:39:17.882122] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-01. [2025-09-23T19:39:18.009789] [DEBUG] [REMOTE ] KMI: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-09-23T19:39:18.010140] [WARN ] [REMOTE ] KMI: No data returned for month 2025-01 [2025-09-23T19:39:18.010605] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-02. [2025-09-23T19:39:18.277192] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-23T19:39:18.283515] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-02. [2025-09-23T19:39:18.437633] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-23T19:39:18.439202] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-06. [2025-09-23T19:39:19.013689] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-23T19:39:19.015496] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-07. [2025-09-23T19:39:19.303104] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-23T19:39:19.312481] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-02. [2025-09-23T19:39:19.359359] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-23T19:39:19.402173] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-03. [2025-09-23T19:39:19.489215] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-23T19:39:19.866495] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-23T19:39:20.202281] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-08. [2025-09-23T19:39:20.561855] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-23T19:39:20.576865] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-23T19:39:20.782016] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-23T19:39:21.002234] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-03. [2025-09-23T19:39:21.802234] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-03. [2025-09-23T19:39:22.602199] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-09. [2025-09-23T19:39:23.006436] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-23T19:39:23.025469] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-23T19:39:23.026639] [INFO ] [REMOTE ] KMPB: Full fetch complete (4877 records). [2025-09-23T19:39:23.026743] [DEBUG] [VALIDATOR ] KMPB: Validating primary data. [2025-09-23T19:39:23.407639] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-04. [2025-09-23T19:39:23.436525] [DEBUG] [VALIDATOR ] KMPB: All expected trading days are present. [2025-09-23T19:39:23.436918] [DEBUG] [VALIDATOR ] KMPB: Primary data validation passed. [2025-09-23T19:39:23.437639] [INFO ] [MAIN ] KMPB: Fetched primary data is valid. [2025-09-23T19:39:23.439543] [DEBUG] [LOCAL ] KMPB: Saving primary data. [2025-09-23T19:39:23.439409] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-23T19:39:23.449532] [DEBUG] [LOCAL ] KMPB: Trimmed 4877 records to 3582 (keeping 200 days of data) [2025-09-23T19:39:23.474299] [DEBUG] [LOCAL ] KMPB: Primary data saved (3582 records). [2025-09-23T19:39:23.474437] [INFO ] [MAIN ] KMPB: Full history saved. [2025-09-23T19:39:23.474531] [INFO ] [MAIN ] Update Progress: 1201/2372 symbols completed. KMPB took 11.3s. Estimated remaining: 2h 35m 21s. Rate: 7.5 symbols/min [2025-09-23T19:39:23.650755] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:39:23.695254] [DEBUG] [LOCAL ] KMT: Loaded 43079 existing records from primary storage. [2025-09-23T19:39:23.695437] [INFO ] [MAIN ] KMT: Loaded 43079 existing records. [2025-09-23T19:39:23.886947] [WARN ] [MAIN ] KMT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:39:23.887298] [INFO ] [MAIN ] KMT: Wiping existing primary data before full refresh. [2025-09-23T19:39:23.887364] [INFO ] [LOCAL ] KMT: Starting deletion of primary data. [2025-09-23T19:39:23.888685] [DEBUG] [LOCAL ] KMT: Deleted primary data file. [2025-09-23T19:39:23.888763] [INFO ] [MAIN ] KMT: Starting full primary refresh. [2025-09-23T19:39:24.207280] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-04. [2025-09-23T19:39:24.263062] [INFO ] [REMOTE ] KMT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:39:25.002244] [INFO ] [REMOTE ] KMT: Fetching primary data for 2024-12. [2025-09-23T19:39:25.517080] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-23T19:39:25.589962] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-23T19:39:25.802205] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-05. [2025-09-23T19:39:26.059380] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-23T19:39:26.602218] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-04. [2025-09-23T19:39:27.114672] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-23T19:39:27.402216] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-05. [2025-09-23T19:39:28.202213] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-06. [2025-09-23T19:39:28.975009] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-09-23T19:39:29.002277] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-05. [2025-09-23T19:39:29.412483] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-23T19:39:29.802233] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-06. [2025-09-23T19:39:29.861578] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-23T19:39:30.607309] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-07. [2025-09-23T19:39:30.628305] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-23T19:39:31.402169] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-06. [2025-09-23T19:39:31.631725] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-23T19:39:32.202190] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-07. [2025-09-23T19:39:32.233550] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-23T19:39:32.580712] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-23T19:39:33.002196] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-08. [2025-09-23T19:39:33.802194] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-07. [2025-09-23T19:39:34.317908] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-23T19:39:34.443412] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-23T19:39:34.602204] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-09. [2025-09-23T19:39:35.251407] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-23T19:39:35.402187] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-08. [2025-09-23T19:39:35.844225] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-23T19:39:35.852954] [INFO ] [REMOTE ] KMPR: Full fetch complete (50402 records). [2025-09-23T19:39:35.853256] [DEBUG] [VALIDATOR ] KMPR: Validating primary data. [2025-09-23T19:39:36.206527] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-08. [2025-09-23T19:39:36.242467] [DEBUG] [VALIDATOR ] KMPR: All expected trading days are present. [2025-09-23T19:39:36.242557] [DEBUG] [VALIDATOR ] KMPR: Primary data validation passed. [2025-09-23T19:39:36.243361] [INFO ] [MAIN ] KMPR: Fetched primary data is valid. [2025-09-23T19:39:36.243424] [DEBUG] [LOCAL ] KMPR: Saving primary data. [2025-09-23T19:39:36.244740] [DEBUG] [LOCAL ] KMPR: Trimmed 50402 records to 38267 (keeping 200 days of data) [2025-09-23T19:39:36.476474] [DEBUG] [LOCAL ] KMPR: Primary data saved (38267 records). [2025-09-23T19:39:36.476673] [INFO ] [MAIN ] KMPR: Full history saved. [2025-09-23T19:39:36.476787] [INFO ] [MAIN ] Update Progress: 1202/2372 symbols completed. KMPR took 24.3s. Estimated remaining: 2h 35m 18s. Rate: 7.5 symbols/min [2025-09-23T19:39:36.656388] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:39:36.707554] [DEBUG] [LOCAL ] KMX: Loaded 53109 existing records from primary storage. [2025-09-23T19:39:36.707746] [INFO ] [MAIN ] KMX: Loaded 53109 existing records. [2025-09-23T19:39:36.898914] [WARN ] [MAIN ] KMX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:39:36.911794] [INFO ] [MAIN ] KMX: Wiping existing primary data before full refresh. [2025-09-23T19:39:36.912107] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-09-23T19:39:36.913463] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-23T19:39:36.916496] [DEBUG] [LOCAL ] KMX: Deleted primary data file. [2025-09-23T19:39:36.921629] [INFO ] [MAIN ] KMX: Starting full primary refresh. [2025-09-23T19:39:37.007425] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-01. [2025-09-23T19:39:37.289417] [INFO ] [REMOTE ] KMX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:39:37.802211] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-09. [2025-09-23T19:39:38.374289] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-23T19:39:38.428411] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-23T19:39:38.602162] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-02. [2025-09-23T19:39:39.365165] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-23T19:39:39.372197] [INFO ] [REMOTE ] KLG: Full fetch complete (61825 records). [2025-09-23T19:39:39.372438] [DEBUG] [VALIDATOR ] KLG: Validating primary data. [2025-09-23T19:39:39.407325] [INFO ] [REMOTE ] KMX: Fetching primary data for 2024-12. [2025-09-23T19:39:39.766869] [DEBUG] [VALIDATOR ] KLG: All expected trading days are present. [2025-09-23T19:39:39.766991] [DEBUG] [VALIDATOR ] KLG: Primary data validation passed. [2025-09-23T19:39:39.767946] [INFO ] [MAIN ] KLG: Fetched primary data is valid. [2025-09-23T19:39:39.768086] [DEBUG] [LOCAL ] KLG: Saving primary data. [2025-09-23T19:39:39.769767] [DEBUG] [LOCAL ] KLG: Trimmed 61825 records to 41973 (keeping 200 days of data) [2025-09-23T19:39:39.882358] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-23T19:39:40.057043] [DEBUG] [LOCAL ] KLG: Primary data saved (41973 records). [2025-09-23T19:39:40.057183] [INFO ] [MAIN ] KLG: Full history saved. [2025-09-23T19:39:40.057274] [INFO ] [MAIN ] Update Progress: 1203/2372 symbols completed. KLG took 27.9s. Estimated remaining: 2h 35m 6s. Rate: 7.5 symbols/min [2025-09-23T19:39:40.205240] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-03. [2025-09-23T19:39:40.228163] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:39:40.270219] [DEBUG] [LOCAL ] KN: Loaded 38942 existing records from primary storage. [2025-09-23T19:39:40.270369] [INFO ] [MAIN ] KN: Loaded 38942 existing records. [2025-09-23T19:39:40.452232] [WARN ] [MAIN ] KN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:39:40.452509] [INFO ] [MAIN ] KN: Wiping existing primary data before full refresh. [2025-09-23T19:39:40.452558] [INFO ] [LOCAL ] KN: Starting deletion of primary data. [2025-09-23T19:39:40.453543] [DEBUG] [LOCAL ] KN: Deleted primary data file. [2025-09-23T19:39:40.453608] [INFO ] [MAIN ] KN: Starting full primary refresh. [2025-09-23T19:39:40.841880] [INFO ] [REMOTE ] KN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:39:40.873394] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-23T19:39:41.002191] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-01. [2025-09-23T19:39:41.395917] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-23T19:39:41.802274] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-09. [2025-09-23T19:39:42.602172] [INFO ] [REMOTE ] KN: Fetching primary data for 2024-12. [2025-09-23T19:39:42.752874] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-23T19:39:43.402237] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-04. [2025-09-23T19:39:43.601349] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-23T19:39:43.680443] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-23T19:39:43.690708] [INFO ] [REMOTE ] KMI: Full fetch complete (69964 records). [2025-09-23T19:39:43.690851] [DEBUG] [VALIDATOR ] KMI: Validating primary data. [2025-09-23T19:39:43.890483] [WARN ] [VALIDATOR ] KMI: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-23T19:39:43.891213] [FATAL] [MAIN ] KMI: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:39:43.891285] [WARN ] [MAIN ] KMI: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:39:43.891359] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-09-23T19:39:43.891445] [DEBUG] [LOCAL ] KMI: No primary data file found to delete. [2025-09-23T19:39:43.891501] [INFO ] [LOCAL ] KMI: Starting deletion of derivative data. [2025-09-23T19:39:43.891944] [DEBUG] [LOCAL ] KMI: Deleted derivative data file. [2025-09-23T19:39:43.892059] [INFO ] [MAIN ] Update Progress: 1204/2372 symbols completed. KMI took 31.7s. Estimated remaining: 2h 34m 54s. Rate: 7.5 symbols/min [2025-09-23T19:39:44.062135] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:39:44.097002] [DEBUG] [LOCAL ] KNF: Loaded 35762 existing records from primary storage. [2025-09-23T19:39:44.097141] [INFO ] [MAIN ] KNF: Loaded 35762 existing records. [2025-09-23T19:39:44.207295] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-01. [2025-09-23T19:39:44.293342] [WARN ] [MAIN ] KNF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:39:44.293664] [INFO ] [MAIN ] KNF: Wiping existing primary data before full refresh. [2025-09-23T19:39:44.293727] [INFO ] [LOCAL ] KNF: Starting deletion of primary data. [2025-09-23T19:39:44.294606] [DEBUG] [LOCAL ] KNF: Deleted primary data file. [2025-09-23T19:39:44.294710] [INFO ] [MAIN ] KNF: Starting full primary refresh. [2025-09-23T19:39:44.674702] [INFO ] [REMOTE ] KNF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:39:44.814173] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-23T19:39:45.002222] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-02. [2025-09-23T19:39:45.621145] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-23T19:39:45.802187] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-02. [2025-09-23T19:39:46.542607] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-23T19:39:46.602190] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-05. [2025-09-23T19:39:46.807406] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-23T19:39:47.402199] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-03. [2025-09-23T19:39:47.829388] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-23T19:39:48.202237] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-06. [2025-09-23T19:39:48.596382] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-23T19:39:49.002253] [INFO ] [REMOTE ] KNF: Fetching primary data for 2024-12. [2025-09-23T19:39:49.668927] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-23T19:39:49.802270] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-07. [2025-09-23T19:39:50.412718] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-23T19:39:50.602212] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-01. [2025-09-23T19:39:51.029802] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-23T19:39:51.402303] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-08. [2025-09-23T19:39:52.091535] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-23T19:39:52.202238] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-02. [2025-09-23T19:39:53.007305] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-04. [2025-09-23T19:39:53.028814] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-23T19:39:53.540762] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-23T19:39:53.802237] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-09. [2025-09-23T19:39:54.602211] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-03. [2025-09-23T19:39:54.823053] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-23T19:39:55.410457] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-03. [2025-09-23T19:39:55.416366] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-23T19:39:55.424559] [INFO ] [REMOTE ] KMT: Full fetch complete (61983 records). [2025-09-23T19:39:55.424813] [DEBUG] [VALIDATOR ] KMT: Validating primary data. [2025-09-23T19:39:55.862414] [DEBUG] [VALIDATOR ] KMT: All expected trading days are present. [2025-09-23T19:39:55.862524] [DEBUG] [VALIDATOR ] KMT: Primary data validation passed. [2025-09-23T19:39:55.863445] [INFO ] [MAIN ] KMT: Fetched primary data is valid. [2025-09-23T19:39:55.863527] [DEBUG] [LOCAL ] KMT: Saving primary data. [2025-09-23T19:39:55.886593] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-23T19:39:55.894479] [DEBUG] [LOCAL ] KMT: Trimmed 61983 records to 43103 (keeping 200 days of data) [2025-09-23T19:39:56.159849] [DEBUG] [LOCAL ] KMT: Primary data saved (43103 records). [2025-09-23T19:39:56.159990] [INFO ] [MAIN ] KMT: Full history saved. [2025-09-23T19:39:56.160077] [INFO ] [MAIN ] Update Progress: 1205/2372 symbols completed. KMT took 32.7s. Estimated remaining: 2h 34m 50s. Rate: 7.5 symbols/min [2025-09-23T19:39:56.214135] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-05. [2025-09-23T19:39:56.334980] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:39:56.345727] [DEBUG] [LOCAL ] KNOP: Loaded 9908 existing records from primary storage. [2025-09-23T19:39:56.345891] [INFO ] [MAIN ] KNOP: Loaded 9908 existing records. [2025-09-23T19:39:56.521099] [WARN ] [MAIN ] KNOP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:39:56.521398] [INFO ] [MAIN ] KNOP: Wiping existing primary data before full refresh. [2025-09-23T19:39:56.521453] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-09-23T19:39:56.521991] [DEBUG] [LOCAL ] KNOP: Deleted primary data file. [2025-09-23T19:39:56.522051] [INFO ] [MAIN ] KNOP: Starting full primary refresh. [2025-09-23T19:39:56.883536] [INFO ] [REMOTE ] KNOP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:39:56.995268] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-23T19:39:57.006003] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-04. [2025-09-23T19:39:57.724415] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-23T19:39:57.802160] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-04. [2025-09-23T19:39:58.399825] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-23T19:39:58.602250] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-05. [2025-09-23T19:39:59.402193] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-06. [2025-09-23T19:39:59.774045] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-23T19:39:59.959578] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-23T19:40:00.202197] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-06. [2025-09-23T19:40:00.799268] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-23T19:40:01.002287] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2024-12. [2025-09-23T19:40:01.581070] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-23T19:40:01.662500] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-23T19:40:01.802247] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-01. [2025-09-23T19:40:02.602250] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-05. [2025-09-23T19:40:02.651842] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-23T19:40:03.402209] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-07. [2025-09-23T19:40:04.202199] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-02. [2025-09-23T19:40:04.410416] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-23T19:40:04.646364] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-23T19:40:04.997391] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-23T19:40:05.006216] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-07. [2025-09-23T19:40:05.802213] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-08. [2025-09-23T19:40:06.467232] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-23T19:40:06.602170] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-08. [2025-09-23T19:40:07.209568] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-23T19:40:07.402215] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-09. [2025-09-23T19:40:08.110036] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-23T19:40:08.202211] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-09. [2025-09-23T19:40:08.577379] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-23T19:40:08.586020] [INFO ] [REMOTE ] KNF: Full fetch complete (50308 records). [2025-09-23T19:40:08.586264] [DEBUG] [VALIDATOR ] KNF: Validating primary data. [2025-09-23T19:40:09.011670] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-06. [2025-09-23T19:40:09.015329] [DEBUG] [VALIDATOR ] KNF: All expected trading days are present. [2025-09-23T19:40:09.015388] [DEBUG] [VALIDATOR ] KNF: Primary data validation passed. [2025-09-23T19:40:09.016159] [INFO ] [MAIN ] KNF: Fetched primary data is valid. [2025-09-23T19:40:09.016223] [DEBUG] [LOCAL ] KNF: Saving primary data. [2025-09-23T19:40:09.017429] [DEBUG] [LOCAL ] KNF: Trimmed 50308 records to 35846 (keeping 200 days of data) [2025-09-23T19:40:09.230911] [DEBUG] [LOCAL ] KNF: Primary data saved (35846 records). [2025-09-23T19:40:09.231832] [INFO ] [MAIN ] KNF: Full history saved. [2025-09-23T19:40:09.232135] [INFO ] [MAIN ] Update Progress: 1206/2372 symbols completed. KNF took 25.3s. Estimated remaining: 2h 34m 47s. Rate: 7.5 symbols/min [2025-09-23T19:40:09.407453] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:40:09.427710] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-23T19:40:09.435600] [INFO ] [REMOTE ] KN: Full fetch complete (56386 records). [2025-09-23T19:40:09.435788] [DEBUG] [VALIDATOR ] KN: Validating primary data. [2025-09-23T19:40:09.569540] [DEBUG] [LOCAL ] KNSL: Loaded 18127 existing records from primary storage. [2025-09-23T19:40:09.580000] [INFO ] [MAIN ] KNSL: Loaded 18127 existing records. [2025-09-23T19:40:09.803675] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-03. [2025-09-23T19:40:09.969487] [WARN ] [MAIN ] KNSL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:40:09.995154] [INFO ] [MAIN ] KNSL: Wiping existing primary data before full refresh. [2025-09-23T19:40:10.010737] [INFO ] [LOCAL ] KNSL: Starting deletion of primary data. [2025-09-23T19:40:10.062558] [DEBUG] [LOCAL ] KNSL: Deleted primary data file. [2025-09-23T19:40:10.084362] [DEBUG] [VALIDATOR ] KN: All expected trading days are present. [2025-09-23T19:40:10.084113] [INFO ] [MAIN ] KNSL: Starting full primary refresh. [2025-09-23T19:40:10.084504] [DEBUG] [VALIDATOR ] KN: Primary data validation passed. [2025-09-23T19:40:10.090603] [INFO ] [MAIN ] KN: Fetched primary data is valid. [2025-09-23T19:40:10.129691] [DEBUG] [LOCAL ] KN: Saving primary data. [2025-09-23T19:40:10.204209] [DEBUG] [LOCAL ] KN: Trimmed 56386 records to 38940 (keeping 200 days of data) [2025-09-23T19:40:10.664468] [INFO ] [REMOTE ] KNSL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:40:10.665374] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2024-12. [2025-09-23T19:40:10.728034] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-23T19:40:10.794952] [DEBUG] [LOCAL ] KN: Primary data saved (38940 records). [2025-09-23T19:40:10.795140] [INFO ] [MAIN ] KN: Full history saved. [2025-09-23T19:40:10.795252] [INFO ] [MAIN ] Update Progress: 1207/2372 symbols completed. KN took 30.7s. Estimated remaining: 2h 34m 33s. Rate: 7.5 symbols/min [2025-09-23T19:40:10.968188] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:40:10.997767] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-23T19:40:11.049886] [DEBUG] [LOCAL ] KNTK: Loaded 46086 existing records from primary storage. [2025-09-23T19:40:11.050065] [INFO ] [MAIN ] KNTK: Loaded 46086 existing records. [2025-09-23T19:40:11.228483] [WARN ] [MAIN ] KNTK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:40:11.228797] [INFO ] [MAIN ] KNTK: Wiping existing primary data before full refresh. [2025-09-23T19:40:11.228855] [INFO ] [LOCAL ] KNTK: Starting deletion of primary data. [2025-09-23T19:40:11.230240] [DEBUG] [LOCAL ] KNTK: Deleted primary data file. [2025-09-23T19:40:11.230302] [INFO ] [MAIN ] KNTK: Starting full primary refresh. [2025-09-23T19:40:11.405069] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-04. [2025-09-23T19:40:11.590659] [INFO ] [REMOTE ] KNTK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:40:11.752778] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-23T19:40:12.202239] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2024-12. [2025-09-23T19:40:12.457866] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-23T19:40:13.002216] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-01. [2025-09-23T19:40:13.385564] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-23T19:40:13.741296] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-23T19:40:13.802152] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-02. [2025-09-23T19:40:14.602209] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-07. [2025-09-23T19:40:14.901774] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-23T19:40:15.402206] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-01. [2025-09-23T19:40:16.202185] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-05. [2025-09-23T19:40:16.625545] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-23T19:40:16.732863] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-23T19:40:16.774621] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-23T19:40:17.002261] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-06. [2025-09-23T19:40:17.516296] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-23T19:40:17.802222] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-03. [2025-09-23T19:40:18.602168] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-07. [2025-09-23T19:40:18.913074] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-23T19:40:19.402301] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-02. [2025-09-23T19:40:19.415289] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-23T19:40:20.202189] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-08. [2025-09-23T19:40:20.777751] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-23T19:40:20.897731] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-23T19:40:21.002153] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-09. [2025-09-23T19:40:21.802289] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-08. [2025-09-23T19:40:21.885108] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-23T19:40:21.887729] [INFO ] [REMOTE ] KNOP: Full fetch complete (14618 records). [2025-09-23T19:40:21.887859] [DEBUG] [VALIDATOR ] KNOP: Validating primary data. [2025-09-23T19:40:22.266488] [DEBUG] [VALIDATOR ] KNOP: All expected trading days are present. [2025-09-23T19:40:22.266597] [DEBUG] [VALIDATOR ] KNOP: Primary data validation passed. [2025-09-23T19:40:22.267053] [INFO ] [MAIN ] KNOP: Fetched primary data is valid. [2025-09-23T19:40:22.267116] [DEBUG] [LOCAL ] KNOP: Saving primary data. [2025-09-23T19:40:22.267777] [DEBUG] [LOCAL ] KNOP: Trimmed 14618 records to 9921 (keeping 200 days of data) [2025-09-23T19:40:22.325614] [DEBUG] [LOCAL ] KNOP: Primary data saved (9921 records). [2025-09-23T19:40:22.325782] [INFO ] [MAIN ] KNOP: Full history saved. [2025-09-23T19:40:22.325890] [INFO ] [MAIN ] Update Progress: 1208/2372 symbols completed. KNOP took 26.2s. Estimated remaining: 2h 34m 29s. Rate: 7.5 symbols/min [2025-09-23T19:40:22.503332] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:40:22.554030] [DEBUG] [LOCAL ] KNX: Loaded 52594 existing records from primary storage. [2025-09-23T19:40:22.554204] [INFO ] [MAIN ] KNX: Loaded 52594 existing records. [2025-09-23T19:40:22.612270] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-04. [2025-09-23T19:40:22.762292] [WARN ] [MAIN ] KNX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:40:22.762639] [INFO ] [MAIN ] KNX: Wiping existing primary data before full refresh. [2025-09-23T19:40:22.762736] [INFO ] [LOCAL ] KNX: Starting deletion of primary data. [2025-09-23T19:40:22.764557] [DEBUG] [LOCAL ] KNX: Deleted primary data file. [2025-09-23T19:40:22.764624] [INFO ] [MAIN ] KNX: Starting full primary refresh. [2025-09-23T19:40:23.138336] [INFO ] [REMOTE ] KNX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:40:23.402228] [INFO ] [REMOTE ] KNX: Fetching primary data for 2024-12. [2025-09-23T19:40:23.577109] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-23T19:40:23.612417] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-23T19:40:24.202234] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-09. [2025-09-23T19:40:25.004499] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-05. [2025-09-23T19:40:25.008967] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-23T19:40:25.802186] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-01. [2025-09-23T19:40:25.869151] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-23T19:40:25.878295] [INFO ] [REMOTE ] KMX: Full fetch complete (75921 records). [2025-09-23T19:40:25.878499] [DEBUG] [VALIDATOR ] KMX: Validating primary data. [2025-09-23T19:40:26.199142] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-23T19:40:26.334614] [DEBUG] [VALIDATOR ] KMX: All expected trading days are present. [2025-09-23T19:40:26.334742] [DEBUG] [VALIDATOR ] KMX: Primary data validation passed. [2025-09-23T19:40:26.335896] [INFO ] [MAIN ] KMX: Fetched primary data is valid. [2025-09-23T19:40:26.335977] [DEBUG] [LOCAL ] KMX: Saving primary data. [2025-09-23T19:40:26.340476] [DEBUG] [LOCAL ] KMX: Trimmed 75921 records to 53112 (keeping 200 days of data) [2025-09-23T19:40:26.620723] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-03. [2025-09-23T19:40:26.673138] [DEBUG] [LOCAL ] KMX: Primary data saved (53112 records). [2025-09-23T19:40:26.673313] [INFO ] [MAIN ] KMX: Full history saved. [2025-09-23T19:40:26.673453] [INFO ] [MAIN ] Update Progress: 1209/2372 symbols completed. KMX took 50.2s. Estimated remaining: 2h 34m 17s. Rate: 7.5 symbols/min [2025-09-23T19:40:26.842449] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:40:26.842676] [DEBUG] [LOCAL ] KO: No existing data file found in primary storage. [2025-09-23T19:40:26.842733] [WARN ] [MAIN ] KO: No existing data found, performing full refresh instead. [2025-09-23T19:40:26.842889] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-09-23T19:40:26.842943] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-09-23T19:40:26.843010] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-09-23T19:40:26.843045] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-09-23T19:40:27.227701] [INFO ] [REMOTE ] KO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:40:27.264230] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-23T19:40:27.402244] [INFO ] [REMOTE ] KO: Fetching primary data for 2024-12. [2025-09-23T19:40:28.202234] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-06. [2025-09-23T19:40:29.002153] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-02. [2025-09-23T19:40:29.217303] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-23T19:40:29.802240] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-07. [2025-09-23T19:40:30.093446] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2024-12 (2.69 seconds). [2025-09-23T19:40:30.178941] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-03 (3.56 seconds). [2025-09-23T19:40:30.602168] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-04. [2025-09-23T19:40:30.644835] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-23T19:40:30.914508] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-23T19:40:31.402247] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-03. [2025-09-23T19:40:32.202211] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-01. [2025-09-23T19:40:32.247698] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-23T19:40:33.002185] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-08. [2025-09-23T19:40:33.226958] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-23T19:40:33.802190] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-05. [2025-09-23T19:40:34.392631] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-23T19:40:34.430403] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-09-23T19:40:34.602388] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-09. [2025-09-23T19:40:35.122422] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-23T19:40:35.402183] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-09-23T19:40:35.893947] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-23T19:40:35.897453] [INFO ] [REMOTE ] KNSL: Full fetch complete (26745 records). [2025-09-23T19:40:35.897705] [DEBUG] [VALIDATOR ] KNSL: Validating primary data. [2025-09-23T19:40:36.207287] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-04. [2025-09-23T19:40:36.279764] [DEBUG] [VALIDATOR ] KNSL: All expected trading days are present. [2025-09-23T19:40:36.279849] [DEBUG] [VALIDATOR ] KNSL: Primary data validation passed. [2025-09-23T19:40:36.280437] [INFO ] [MAIN ] KNSL: Fetched primary data is valid. [2025-09-23T19:40:36.280557] [DEBUG] [LOCAL ] KNSL: Saving primary data. [2025-09-23T19:40:36.281426] [DEBUG] [LOCAL ] KNSL: Trimmed 26745 records to 18092 (keeping 200 days of data) [2025-09-23T19:40:36.419413] [DEBUG] [LOCAL ] KNSL: Primary data saved (18092 records). [2025-09-23T19:40:36.419577] [INFO ] [MAIN ] KNSL: Full history saved. [2025-09-23T19:40:36.419738] [INFO ] [MAIN ] Update Progress: 1210/2372 symbols completed. KNSL took 27.2s. Estimated remaining: 2h 34m 11s. Rate: 7.5 symbols/min [2025-09-23T19:40:36.600715] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:40:36.649977] [DEBUG] [LOCAL ] KODK: Loaded 43420 existing records from primary storage. [2025-09-23T19:40:36.650138] [INFO ] [MAIN ] KODK: Loaded 43420 existing records. [2025-09-23T19:40:36.830761] [WARN ] [MAIN ] KODK: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:40:36.831032] [INFO ] [MAIN ] KODK: Wiping existing primary data before full refresh. [2025-09-23T19:40:36.831083] [INFO ] [LOCAL ] KODK: Starting deletion of primary data. [2025-09-23T19:40:36.832169] [DEBUG] [LOCAL ] KODK: Deleted primary data file. [2025-09-23T19:40:36.832252] [INFO ] [MAIN ] KODK: Starting full primary refresh. [2025-09-23T19:40:37.007349] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-06. [2025-09-23T19:40:37.247000] [INFO ] [REMOTE ] KODK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:40:37.768810] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-09-23T19:40:37.802201] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-09-23T19:40:37.852675] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-23T19:40:38.602176] [INFO ] [REMOTE ] KODK: Fetching primary data for 2024-12. [2025-09-23T19:40:38.786998] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-23T19:40:39.402202] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-07. [2025-09-23T19:40:40.055521] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-23T19:40:40.202202] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-01. [2025-09-23T19:40:40.503751] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (2.70 seconds). [2025-09-23T19:40:40.628084] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-23T19:40:41.002201] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-05. [2025-09-23T19:40:41.512210] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-23T19:40:41.802215] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-09-23T19:40:42.602197] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-02. [2025-09-23T19:40:42.671319] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-23T19:40:43.402209] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-06. [2025-09-23T19:40:44.134673] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-23T19:40:44.208764] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-03. [2025-09-23T19:40:44.214832] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-09-23T19:40:44.880177] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-23T19:40:45.002230] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-08. [2025-09-23T19:40:45.812471] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-07. [2025-09-23T19:40:45.840477] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-23T19:40:46.562990] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-23T19:40:46.602157] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-09. [2025-09-23T19:40:47.402209] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-09-23T19:40:48.202234] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-04. [2025-09-23T19:40:48.312745] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-09-23T19:40:48.378583] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-23T19:40:48.386744] [INFO ] [REMOTE ] KNTK: Full fetch complete (63963 records). [2025-09-23T19:40:48.386941] [DEBUG] [VALIDATOR ] KNTK: Validating primary data. [2025-09-23T19:40:48.797954] [DEBUG] [VALIDATOR ] KNTK: All expected trading days are present. [2025-09-23T19:40:48.798096] [DEBUG] [VALIDATOR ] KNTK: Primary data validation passed. [2025-09-23T19:40:48.799057] [INFO ] [MAIN ] KNTK: Fetched primary data is valid. [2025-09-23T19:40:48.799123] [DEBUG] [LOCAL ] KNTK: Saving primary data. [2025-09-23T19:40:48.800635] [DEBUG] [LOCAL ] KNTK: Trimmed 63963 records to 46111 (keeping 200 days of data) [2025-09-23T19:40:49.022017] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-08. [2025-09-23T19:40:49.101872] [DEBUG] [LOCAL ] KNTK: Primary data saved (46111 records). [2025-09-23T19:40:49.102022] [INFO ] [MAIN ] KNTK: Full history saved. [2025-09-23T19:40:49.102119] [INFO ] [MAIN ] Update Progress: 1211/2372 symbols completed. KNTK took 38.3s. Estimated remaining: 2h 34m 8s. Rate: 7.5 symbols/min [2025-09-23T19:40:49.273949] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:40:49.301359] [DEBUG] [LOCAL ] KOF: Loaded 25911 existing records from primary storage. [2025-09-23T19:40:49.301515] [INFO ] [MAIN ] KOF: Loaded 25911 existing records. [2025-09-23T19:40:49.484084] [WARN ] [MAIN ] KOF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:40:49.484442] [INFO ] [MAIN ] KOF: Wiping existing primary data before full refresh. [2025-09-23T19:40:49.484504] [INFO ] [LOCAL ] KOF: Starting deletion of primary data. [2025-09-23T19:40:49.485423] [DEBUG] [LOCAL ] KOF: Deleted primary data file. [2025-09-23T19:40:49.485484] [INFO ] [MAIN ] KOF: Starting full primary refresh. [2025-09-23T19:40:49.878552] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-23T19:40:49.925536] [INFO ] [REMOTE ] KOF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:40:49.926575] [INFO ] [REMOTE ] KOF: Fetching primary data for 2024-12. [2025-09-23T19:40:50.006540] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (2.60 seconds). [2025-09-23T19:40:50.380885] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-23T19:40:50.602278] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-09. [2025-09-23T19:40:50.654271] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-23T19:40:51.402261] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-05. [2025-09-23T19:40:52.202548] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-01. [2025-09-23T19:40:52.324460] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-23T19:40:52.334160] [INFO ] [REMOTE ] KNX: Full fetch complete (75692 records). [2025-09-23T19:40:52.334373] [DEBUG] [VALIDATOR ] KNX: Validating primary data. [2025-09-23T19:40:52.739464] [DEBUG] [VALIDATOR ] KNX: All expected trading days are present. [2025-09-23T19:40:52.739659] [DEBUG] [VALIDATOR ] KNX: Primary data validation passed. [2025-09-23T19:40:52.740608] [INFO ] [MAIN ] KNX: Fetched primary data is valid. [2025-09-23T19:40:52.740754] [DEBUG] [LOCAL ] KNX: Saving primary data. [2025-09-23T19:40:52.742222] [DEBUG] [LOCAL ] KNX: Trimmed 75692 records to 52600 (keeping 200 days of data) [2025-09-23T19:40:53.032560] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-09-23T19:40:53.080706] [DEBUG] [LOCAL ] KNX: Primary data saved (52600 records). [2025-09-23T19:40:53.080857] [INFO ] [MAIN ] KNX: Full history saved. [2025-09-23T19:40:53.080955] [INFO ] [MAIN ] Update Progress: 1212/2372 symbols completed. KNX took 30.8s. Estimated remaining: 2h 33m 56s. Rate: 7.5 symbols/min [2025-09-23T19:40:53.261628] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-23T19:40:53.288948] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:40:53.318174] [DEBUG] [LOCAL ] KOP: Loaded 17960 existing records from primary storage. [2025-09-23T19:40:53.318311] [INFO ] [MAIN ] KOP: Loaded 17960 existing records. [2025-09-23T19:40:53.501039] [WARN ] [MAIN ] KOP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:40:53.516627] [INFO ] [MAIN ] KOP: Wiping existing primary data before full refresh. [2025-09-23T19:40:53.517285] [INFO ] [LOCAL ] KOP: Starting deletion of primary data. [2025-09-23T19:40:53.517982] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-23T19:40:53.523503] [DEBUG] [LOCAL ] KOP: Deleted primary data file. [2025-09-23T19:40:53.524331] [INFO ] [MAIN ] KOP: Starting full primary refresh. [2025-09-23T19:40:53.807462] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-02. [2025-09-23T19:40:53.873666] [INFO ] [REMOTE ] KOP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:40:54.602200] [INFO ] [REMOTE ] KOP: Fetching primary data for 2024-12. [2025-09-23T19:40:55.016078] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-23T19:40:55.252701] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-23T19:40:55.402217] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-01. [2025-09-23T19:40:55.527815] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (2.50 seconds). [2025-09-23T19:40:56.202159] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-03. [2025-09-23T19:40:56.426300] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-23T19:40:57.002212] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-06. [2025-09-23T19:40:57.334145] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-23T19:40:57.802195] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-04. [2025-09-23T19:40:58.490367] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-23T19:40:58.602221] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-09-23T19:40:59.274088] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-23T19:40:59.402215] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-02. [2025-09-23T19:41:00.202187] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-07. [2025-09-23T19:41:00.494233] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-23T19:41:01.002219] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-05. [2025-09-23T19:41:01.628923] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (3.03 seconds). [2025-09-23T19:41:01.802242] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-03. [2025-09-23T19:41:01.906003] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-23T19:41:02.330679] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-23T19:41:02.602215] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-06. [2025-09-23T19:41:02.884193] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-23T19:41:03.402235] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-04. [2025-09-23T19:41:03.901911] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-23T19:41:04.202213] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-08. [2025-09-23T19:41:04.567386] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-23T19:41:05.002238] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-05. [2025-09-23T19:41:05.803207] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-07. [2025-09-23T19:41:05.809510] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-23T19:41:06.034412] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-23T19:41:06.602212] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-09. [2025-09-23T19:41:07.015173] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-23T19:41:07.402243] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-09-23T19:41:08.085605] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-23T19:41:08.092749] [INFO ] [REMOTE ] KODK: Full fetch complete (63610 records). [2025-09-23T19:41:08.092905] [DEBUG] [VALIDATOR ] KODK: Validating primary data. [2025-09-23T19:41:08.207290] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-06. [2025-09-23T19:41:08.491660] [DEBUG] [VALIDATOR ] KODK: All expected trading days are present. [2025-09-23T19:41:08.491754] [DEBUG] [VALIDATOR ] KODK: Primary data validation passed. [2025-09-23T19:41:08.492685] [INFO ] [MAIN ] KODK: Fetched primary data is valid. [2025-09-23T19:41:08.492749] [DEBUG] [LOCAL ] KODK: Saving primary data. [2025-09-23T19:41:08.494023] [DEBUG] [LOCAL ] KODK: Trimmed 63610 records to 43429 (keeping 200 days of data) [2025-09-23T19:41:08.758399] [DEBUG] [LOCAL ] KODK: Primary data saved (43429 records). [2025-09-23T19:41:08.758529] [INFO ] [MAIN ] KODK: Full history saved. [2025-09-23T19:41:08.758626] [INFO ] [MAIN ] Update Progress: 1213/2372 symbols completed. KODK took 32.3s. Estimated remaining: 2h 33m 55s. Rate: 7.5 symbols/min [2025-09-23T19:41:08.946094] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:41:08.951191] [DEBUG] [LOCAL ] KORE: Loaded 1940 existing records from primary storage. [2025-09-23T19:41:08.951309] [INFO ] [MAIN ] KORE: Loaded 1940 existing records. [2025-09-23T19:41:09.012949] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-08. [2025-09-23T19:41:09.138485] [WARN ] [MAIN ] KORE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:41:09.138804] [INFO ] [MAIN ] KORE: Wiping existing primary data before full refresh. [2025-09-23T19:41:09.138856] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-09-23T19:41:09.139159] [DEBUG] [LOCAL ] KORE: Deleted primary data file. [2025-09-23T19:41:09.139244] [INFO ] [MAIN ] KORE: Starting full primary refresh. [2025-09-23T19:41:09.359703] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-23T19:41:09.558004] [INFO ] [REMOTE ] KORE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:41:09.667014] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-09-23T19:41:09.796268] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-23T19:41:09.802131] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-09. [2025-09-23T19:41:10.602196] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-09-23T19:41:11.104189] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-23T19:41:11.109818] [INFO ] [REMOTE ] KOF: Full fetch complete (36932 records). [2025-09-23T19:41:11.109994] [DEBUG] [VALIDATOR ] KOF: Validating primary data. [2025-09-23T19:41:11.407301] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-07. [2025-09-23T19:41:11.513278] [DEBUG] [VALIDATOR ] KOF: All expected trading days are present. [2025-09-23T19:41:11.513373] [DEBUG] [VALIDATOR ] KOF: Primary data validation passed. [2025-09-23T19:41:11.514042] [INFO ] [MAIN ] KOF: Fetched primary data is valid. [2025-09-23T19:41:11.514107] [DEBUG] [LOCAL ] KOF: Saving primary data. [2025-09-23T19:41:11.515185] [DEBUG] [LOCAL ] KOF: Trimmed 36932 records to 25835 (keeping 200 days of data) [2025-09-23T19:41:11.681769] [DEBUG] [LOCAL ] KOF: Primary data saved (25835 records). [2025-09-23T19:41:11.681931] [INFO ] [MAIN ] KOF: Full history saved. [2025-09-23T19:41:11.682074] [INFO ] [MAIN ] Update Progress: 1214/2372 symbols completed. KOF took 22.6s. Estimated remaining: 2h 33m 42s. Rate: 7.5 symbols/min [2025-09-23T19:41:11.876057] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:41:11.927045] [DEBUG] [LOCAL ] KOS: Loaded 53066 existing records from primary storage. [2025-09-23T19:41:11.927196] [INFO ] [MAIN ] KOS: Loaded 53066 existing records. [2025-09-23T19:41:12.108157] [WARN ] [MAIN ] KOS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:41:12.108420] [INFO ] [MAIN ] KOS: Wiping existing primary data before full refresh. [2025-09-23T19:41:12.108469] [INFO ] [LOCAL ] KOS: Starting deletion of primary data. [2025-09-23T19:41:12.110753] [DEBUG] [LOCAL ] KOS: Deleted primary data file. [2025-09-23T19:41:12.110821] [INFO ] [MAIN ] KOS: Starting full primary refresh. [2025-09-23T19:41:12.204499] [INFO ] [REMOTE ] KORE: Fetching primary data for 2024-12. [2025-09-23T19:41:12.479481] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-23T19:41:12.515339] [INFO ] [REMOTE ] KOS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:41:12.924672] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-09-23T19:41:12.943614] [INFO ] [REMOTE ] KO: Full fetch complete (77604 records). [2025-09-23T19:41:12.944471] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-23T19:41:12.944597] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-09-23T19:41:13.009328] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-08. [2025-09-23T19:41:13.144773] [WARN ] [VALIDATOR ] KO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-23T19:41:13.145546] [FATAL] [MAIN ] KO: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:41:13.145631] [WARN ] [MAIN ] KO: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:41:13.145726] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-09-23T19:41:13.145797] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-09-23T19:41:13.145844] [INFO ] [LOCAL ] KO: Starting deletion of derivative data. [2025-09-23T19:41:13.145924] [DEBUG] [LOCAL ] KO: No derivative data file found to delete. [2025-09-23T19:41:13.146022] [INFO ] [MAIN ] Update Progress: 1215/2372 symbols completed. KO took 46.5s. Estimated remaining: 2h 33m 28s. Rate: 7.5 symbols/min [2025-09-23T19:41:13.314210] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:41:13.379091] [DEBUG] [LOCAL ] KR: Loaded 53682 existing records from primary storage. [2025-09-23T19:41:13.379270] [INFO ] [MAIN ] KR: Loaded 53682 existing records. [2025-09-23T19:41:13.619991] [WARN ] [MAIN ] KR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:41:13.620260] [INFO ] [MAIN ] KR: Wiping existing primary data before full refresh. [2025-09-23T19:41:13.620334] [INFO ] [LOCAL ] KR: Starting deletion of primary data. [2025-09-23T19:41:13.621831] [DEBUG] [LOCAL ] KR: Deleted primary data file. [2025-09-23T19:41:13.621893] [INFO ] [MAIN ] KR: Starting full primary refresh. [2025-09-23T19:41:13.802343] [INFO ] [REMOTE ] KOS: Fetching primary data for 2024-12. [2025-09-23T19:41:14.027282] [INFO ] [REMOTE ] KR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:41:14.070929] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-23T19:41:14.602201] [INFO ] [REMOTE ] KR: Fetching primary data for 2024-12. [2025-09-23T19:41:15.402180] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-01. [2025-09-23T19:41:15.571778] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-23T19:41:15.923065] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-23T19:41:16.202196] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-01. [2025-09-23T19:41:16.481049] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-23T19:41:17.002223] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-01. [2025-09-23T19:41:17.802216] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-09. [2025-09-23T19:41:18.026966] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-23T19:41:18.570137] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-23T19:41:18.602198] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-02. [2025-09-23T19:41:18.656023] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-23T19:41:18.662488] [INFO ] [REMOTE ] KOP: Full fetch complete (25444 records). [2025-09-23T19:41:18.662711] [DEBUG] [VALIDATOR ] KOP: Validating primary data. [2025-09-23T19:41:19.029990] [DEBUG] [VALIDATOR ] KOP: All expected trading days are present. [2025-09-23T19:41:19.030080] [DEBUG] [VALIDATOR ] KOP: Primary data validation passed. [2025-09-23T19:41:19.030593] [INFO ] [MAIN ] KOP: Fetched primary data is valid. [2025-09-23T19:41:19.030633] [DEBUG] [LOCAL ] KOP: Saving primary data. [2025-09-23T19:41:19.031305] [DEBUG] [LOCAL ] KOP: Trimmed 25444 records to 17936 (keeping 200 days of data) [2025-09-23T19:41:19.143263] [DEBUG] [LOCAL ] KOP: Primary data saved (17936 records). [2025-09-23T19:41:19.143424] [INFO ] [MAIN ] KOP: Full history saved. [2025-09-23T19:41:19.143547] [INFO ] [MAIN ] Update Progress: 1216/2372 symbols completed. KOP took 26.1s. Estimated remaining: 2h 33m 18s. Rate: 7.5 symbols/min [2025-09-23T19:41:19.314660] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:41:19.362296] [DEBUG] [LOCAL ] KRC: Loaded 48433 existing records from primary storage. [2025-09-23T19:41:19.362455] [INFO ] [MAIN ] KRC: Loaded 48433 existing records. [2025-09-23T19:41:19.407480] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-02. [2025-09-23T19:41:19.560523] [WARN ] [MAIN ] KRC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:41:19.560853] [INFO ] [MAIN ] KRC: Wiping existing primary data before full refresh. [2025-09-23T19:41:19.560913] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-09-23T19:41:19.562794] [DEBUG] [LOCAL ] KRC: Deleted primary data file. [2025-09-23T19:41:19.562859] [INFO ] [MAIN ] KRC: Starting full primary refresh. [2025-09-23T19:41:19.892990] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-23T19:41:19.989825] [INFO ] [REMOTE ] KRC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:41:20.182551] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-23T19:41:20.202166] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-03. [2025-09-23T19:41:21.002240] [INFO ] [REMOTE ] KRC: Fetching primary data for 2024-12. [2025-09-23T19:41:21.802255] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-02. [2025-09-23T19:41:22.002270] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-23T19:41:22.602211] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-03. [2025-09-23T19:41:22.683004] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-23T19:41:23.021740] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-23T19:41:23.367384] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-23T19:41:23.402143] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-03. [2025-09-23T19:41:24.202195] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-01. [2025-09-23T19:41:25.002273] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-04. [2025-09-23T19:41:25.584356] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-23T19:41:25.690017] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-23T19:41:25.726335] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-23T19:41:25.802197] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-05. [2025-09-23T19:41:26.170424] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-23T19:41:26.602265] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-02. [2025-09-23T19:41:27.402253] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-04. [2025-09-23T19:41:28.194367] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-23T19:41:28.203501] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-06. [2025-09-23T19:41:28.696460] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-23T19:41:29.002184] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-07. [2025-09-23T19:41:29.431717] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-23T19:41:29.504039] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-23T19:41:29.802201] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-04. [2025-09-23T19:41:30.602196] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-08. [2025-09-23T19:41:31.045116] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-23T19:41:31.402172] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-05. [2025-09-23T19:41:31.646031] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-23T19:41:32.202213] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-05. [2025-09-23T19:41:33.002190] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-09. [2025-09-23T19:41:33.481573] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-23T19:41:33.482752] [INFO ] [REMOTE ] KORE: Full fetch complete (6091 records). [2025-09-23T19:41:33.482823] [DEBUG] [VALIDATOR ] KORE: Validating primary data. [2025-09-23T19:41:33.619628] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-23T19:41:33.807395] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-03. [2025-09-23T19:41:33.903271] [DEBUG] [VALIDATOR ] KORE: All expected trading days are present. [2025-09-23T19:41:33.903350] [DEBUG] [VALIDATOR ] KORE: Primary data validation passed. [2025-09-23T19:41:33.903528] [INFO ] [MAIN ] KORE: Fetched primary data is valid. [2025-09-23T19:41:33.903566] [DEBUG] [LOCAL ] KORE: Saving primary data. [2025-09-23T19:41:33.903966] [DEBUG] [LOCAL ] KORE: Trimmed 6091 records to 1946 (keeping 200 days of data) [2025-09-23T19:41:33.914912] [DEBUG] [LOCAL ] KORE: Primary data saved (1946 records). [2025-09-23T19:41:33.915033] [INFO ] [MAIN ] KORE: Full history saved. [2025-09-23T19:41:33.915156] [INFO ] [MAIN ] Update Progress: 1217/2372 symbols completed. KORE took 25.2s. Estimated remaining: 2h 33m 17s. Rate: 7.5 symbols/min [2025-09-23T19:41:34.091785] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:41:34.123710] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-23T19:41:34.163330] [DEBUG] [LOCAL ] KREF: Loaded 37002 existing records from primary storage. [2025-09-23T19:41:34.163477] [INFO ] [MAIN ] KREF: Loaded 37002 existing records. [2025-09-23T19:41:34.341192] [WARN ] [MAIN ] KREF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:41:34.341432] [INFO ] [MAIN ] KREF: Wiping existing primary data before full refresh. [2025-09-23T19:41:34.341479] [INFO ] [LOCAL ] KREF: Starting deletion of primary data. [2025-09-23T19:41:34.342378] [DEBUG] [LOCAL ] KREF: Deleted primary data file. [2025-09-23T19:41:34.342438] [INFO ] [MAIN ] KREF: Starting full primary refresh. [2025-09-23T19:41:34.607270] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-06. [2025-09-23T19:41:34.709771] [INFO ] [REMOTE ] KREF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:41:35.286490] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-23T19:41:35.402189] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-04. [2025-09-23T19:41:36.058027] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-23T19:41:36.202194] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-06. [2025-09-23T19:41:36.690472] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-23T19:41:37.002191] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-07. [2025-09-23T19:41:37.802209] [INFO ] [REMOTE ] KREF: Fetching primary data for 2024-12. [2025-09-23T19:41:38.062900] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-23T19:41:38.602229] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-05. [2025-09-23T19:41:38.851491] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-23T19:41:39.018184] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-23T19:41:39.402208] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-08. [2025-09-23T19:41:40.009491] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-23T19:41:40.202206] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-01. [2025-09-23T19:41:40.927292] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-23T19:41:41.002151] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-06. [2025-09-23T19:41:41.431157] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-23T19:41:41.802194] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-07. [2025-09-23T19:41:42.526541] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-23T19:41:42.602228] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-02. [2025-09-23T19:41:43.334009] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-23T19:41:43.402169] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-07. [2025-09-23T19:41:43.871957] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-23T19:41:44.202258] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-08. [2025-09-23T19:41:44.986815] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-23T19:41:45.002156] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-08. [2025-09-23T19:41:45.802177] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-03. [2025-09-23T19:41:46.059925] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-23T19:41:46.536769] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-23T19:41:46.602172] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-09. [2025-09-23T19:41:46.885244] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-23T19:41:47.402213] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-04. [2025-09-23T19:41:48.202161] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-09. [2025-09-23T19:41:48.311522] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-23T19:41:48.319755] [INFO ] [REMOTE ] KRC: Full fetch complete (69573 records). [2025-09-23T19:41:48.319896] [DEBUG] [VALIDATOR ] KRC: Validating primary data. [2025-09-23T19:41:48.735978] [DEBUG] [VALIDATOR ] KRC: All expected trading days are present. [2025-09-23T19:41:48.736090] [DEBUG] [VALIDATOR ] KRC: Primary data validation passed. [2025-09-23T19:41:48.737245] [INFO ] [MAIN ] KRC: Fetched primary data is valid. [2025-09-23T19:41:48.737336] [DEBUG] [LOCAL ] KRC: Saving primary data. [2025-09-23T19:41:48.760409] [DEBUG] [LOCAL ] KRC: Trimmed 69573 records to 48420 (keeping 200 days of data) [2025-09-23T19:41:48.762341] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-23T19:41:49.002958] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-09. [2025-09-23T19:41:49.085709] [DEBUG] [LOCAL ] KRC: Primary data saved (48420 records). [2025-09-23T19:41:49.085862] [INFO ] [MAIN ] KRC: Full history saved. [2025-09-23T19:41:49.085965] [INFO ] [MAIN ] Update Progress: 1218/2372 symbols completed. KRC took 29.9s. Estimated remaining: 2h 33m 16s. Rate: 7.5 symbols/min [2025-09-23T19:41:49.261582] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:41:49.307778] [DEBUG] [LOCAL ] KRG: Loaded 49118 existing records from primary storage. [2025-09-23T19:41:49.307954] [INFO ] [MAIN ] KRG: Loaded 49118 existing records. [2025-09-23T19:41:49.484814] [WARN ] [MAIN ] KRG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:41:49.485122] [INFO ] [MAIN ] KRG: Wiping existing primary data before full refresh. [2025-09-23T19:41:49.485173] [INFO ] [LOCAL ] KRG: Starting deletion of primary data. [2025-09-23T19:41:49.486390] [DEBUG] [LOCAL ] KRG: Deleted primary data file. [2025-09-23T19:41:49.486454] [INFO ] [MAIN ] KRG: Starting full primary refresh. [2025-09-23T19:41:49.807007] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-05. [2025-09-23T19:41:49.903317] [INFO ] [REMOTE ] KRG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:41:49.919230] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-23T19:41:49.928859] [INFO ] [REMOTE ] KOS: Full fetch complete (76840 records). [2025-09-23T19:41:49.929045] [DEBUG] [VALIDATOR ] KOS: Validating primary data. [2025-09-23T19:41:50.328561] [DEBUG] [VALIDATOR ] KOS: All expected trading days are present. [2025-09-23T19:41:50.328673] [DEBUG] [VALIDATOR ] KOS: Primary data validation passed. [2025-09-23T19:41:50.329628] [INFO ] [MAIN ] KOS: Fetched primary data is valid. [2025-09-23T19:41:50.329717] [DEBUG] [LOCAL ] KOS: Saving primary data. [2025-09-23T19:41:50.331182] [DEBUG] [LOCAL ] KOS: Trimmed 76840 records to 53066 (keeping 200 days of data) [2025-09-23T19:41:50.609603] [INFO ] [REMOTE ] KRG: Fetching primary data for 2024-12. [2025-09-23T19:41:50.632458] [DEBUG] [LOCAL ] KOS: Primary data saved (53066 records). [2025-09-23T19:41:50.632552] [INFO ] [MAIN ] KOS: Full history saved. [2025-09-23T19:41:50.632661] [INFO ] [MAIN ] Update Progress: 1219/2372 symbols completed. KOS took 39.0s. Estimated remaining: 2h 33m 2s. Rate: 7.5 symbols/min [2025-09-23T19:41:50.808808] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:41:50.808992] [DEBUG] [LOCAL ] KRMN: No existing data file found in primary storage. [2025-09-23T19:41:50.809045] [WARN ] [MAIN ] KRMN: No existing data found, performing full refresh instead. [2025-09-23T19:41:50.809189] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-09-23T19:41:50.809232] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-09-23T19:41:50.809272] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-09-23T19:41:50.809304] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-09-23T19:41:51.181674] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:41:51.205241] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-23T19:41:51.214152] [INFO ] [REMOTE ] KR: Full fetch complete (77679 records). [2025-09-23T19:41:51.214362] [DEBUG] [VALIDATOR ] KR: Validating primary data. [2025-09-23T19:41:51.416045] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2024-12. [2025-09-23T19:41:51.544024] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-23T19:41:51.654172] [DEBUG] [VALIDATOR ] KR: All expected trading days are present. [2025-09-23T19:41:51.654269] [DEBUG] [VALIDATOR ] KR: Primary data validation passed. [2025-09-23T19:41:51.655446] [INFO ] [MAIN ] KR: Fetched primary data is valid. [2025-09-23T19:41:51.655758] [DEBUG] [LOCAL ] KR: Saving primary data. [2025-09-23T19:41:51.658610] [DEBUG] [LOCAL ] KR: Trimmed 77679 records to 53682 (keeping 200 days of data) [2025-09-23T19:41:52.007221] [DEBUG] [LOCAL ] KR: Primary data saved (53682 records). [2025-09-23T19:41:52.007385] [INFO ] [MAIN ] KR: Full history saved. [2025-09-23T19:41:52.007479] [INFO ] [MAIN ] Update Progress: 1220/2372 symbols completed. KR took 38.9s. Estimated remaining: 2h 32m 48s. Rate: 7.5 symbols/min [2025-09-23T19:41:52.109705] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:41:52.123466] [WARN ] [REMOTE ] KRMN: No data returned for month 2024-12 [2025-09-23T19:41:52.209943] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:41:52.204614] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-06. [2025-09-23T19:41:52.241911] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-23T19:41:52.273103] [DEBUG] [LOCAL ] KRO: Loaded 25937 existing records from primary storage. [2025-09-23T19:41:52.273255] [INFO ] [MAIN ] KRO: Loaded 25937 existing records. [2025-09-23T19:41:52.452989] [WARN ] [MAIN ] KRO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:41:52.453275] [INFO ] [MAIN ] KRO: Wiping existing primary data before full refresh. [2025-09-23T19:41:52.453329] [INFO ] [LOCAL ] KRO: Starting deletion of primary data. [2025-09-23T19:41:52.454099] [DEBUG] [LOCAL ] KRO: Deleted primary data file. [2025-09-23T19:41:52.454160] [INFO ] [MAIN ] KRO: Starting full primary refresh. [2025-09-23T19:41:52.812786] [INFO ] [REMOTE ] KRO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:41:53.002250] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-01. [2025-09-23T19:41:53.194356] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:41:53.194841] [WARN ] [REMOTE ] KRMN: No data returned for month 2025-01 [2025-09-23T19:41:53.617362] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-23T19:41:53.802217] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-07. [2025-09-23T19:41:54.602251] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-01. [2025-09-23T19:41:55.224721] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-23T19:41:55.402187] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-08. [2025-09-23T19:41:56.170862] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-23T19:41:56.202141] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-02. [2025-09-23T19:41:56.233556] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-23T19:41:57.002242] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-02. [2025-09-23T19:41:57.689419] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-23T19:41:57.784847] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-23T19:41:57.802132] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-03. [2025-09-23T19:41:58.602210] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-03. [2025-09-23T19:41:59.375440] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-23T19:41:59.402172] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-04. [2025-09-23T19:42:00.202183] [INFO ] [REMOTE ] KRO: Fetching primary data for 2024-12. [2025-09-23T19:42:00.337002] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-23T19:42:01.002208] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-04. [2025-09-23T19:42:01.122762] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-23T19:42:01.320846] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-23T19:42:01.802230] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-09. [2025-09-23T19:42:02.602210] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-05. [2025-09-23T19:42:03.402240] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-01. [2025-09-23T19:42:03.697766] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-04 (2.70 seconds). [2025-09-23T19:42:04.202244] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-05. [2025-09-23T19:42:04.515507] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-09 (2.71 seconds). [2025-09-23T19:42:04.521768] [INFO ] [REMOTE ] KREF: Full fetch complete (51713 records). [2025-09-23T19:42:04.521894] [DEBUG] [VALIDATOR ] KREF: Validating primary data. [2025-09-23T19:42:04.924934] [DEBUG] [VALIDATOR ] KREF: All expected trading days are present. [2025-09-23T19:42:04.934919] [DEBUG] [VALIDATOR ] KREF: Primary data validation passed. [2025-09-23T19:42:04.935880] [INFO ] [MAIN ] KREF: Fetched primary data is valid. [2025-09-23T19:42:04.935968] [DEBUG] [LOCAL ] KREF: Saving primary data. [2025-09-23T19:42:04.937807] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-23T19:42:04.945542] [DEBUG] [LOCAL ] KREF: Trimmed 51713 records to 37022 (keeping 200 days of data) [2025-09-23T19:42:05.008432] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-02. [2025-09-23T19:42:05.169780] [DEBUG] [LOCAL ] KREF: Primary data saved (37022 records). [2025-09-23T19:42:05.169929] [INFO ] [MAIN ] KREF: Full history saved. [2025-09-23T19:42:05.170033] [INFO ] [MAIN ] Update Progress: 1221/2372 symbols completed. KREF took 31.3s. Estimated remaining: 2h 32m 45s. Rate: 7.5 symbols/min [2025-09-23T19:42:05.377246] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-05 (2.78 seconds). [2025-09-23T19:42:05.379397] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:42:05.425457] [DEBUG] [LOCAL ] KRP: Loaded 37738 existing records from primary storage. [2025-09-23T19:42:05.425667] [INFO ] [MAIN ] KRP: Loaded 37738 existing records. [2025-09-23T19:42:05.612079] [WARN ] [MAIN ] KRP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:42:05.612827] [INFO ] [MAIN ] KRP: Wiping existing primary data before full refresh. [2025-09-23T19:42:05.612948] [INFO ] [LOCAL ] KRP: Starting deletion of primary data. [2025-09-23T19:42:05.614138] [DEBUG] [LOCAL ] KRP: Deleted primary data file. [2025-09-23T19:42:05.614222] [INFO ] [MAIN ] KRP: Starting full primary refresh. [2025-09-23T19:42:05.764545] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-23T19:42:05.804229] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-06. [2025-09-23T19:42:06.037883] [INFO ] [REMOTE ] KRP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:42:06.053866] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-23T19:42:06.602215] [INFO ] [REMOTE ] KRP: Fetching primary data for 2024-12. [2025-09-23T19:42:07.402194] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-03. [2025-09-23T19:42:07.487146] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-23T19:42:07.554170] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-23T19:42:08.102728] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-23T19:42:08.202213] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-07. [2025-09-23T19:42:09.002213] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-01. [2025-09-23T19:42:09.802220] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-04. [2025-09-23T19:42:10.111754] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-23T19:42:10.602161] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-08. [2025-09-23T19:42:10.628263] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-23T19:42:11.096212] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-23T19:42:11.402191] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-02. [2025-09-23T19:42:12.081418] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-23T19:42:12.202243] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-09. [2025-09-23T19:42:12.838349] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-23T19:42:13.002205] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-03. [2025-09-23T19:42:13.802221] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-05. [2025-09-23T19:42:13.928268] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-23T19:42:13.936453] [INFO ] [REMOTE ] KRMN: Full fetch complete (49561 records). [2025-09-23T19:42:13.936570] [DEBUG] [VALIDATOR ] KRMN: Validating primary data. [2025-09-23T19:42:14.133904] [WARN ] [VALIDATOR ] KRMN: Validation failed - insufficient historical data. Have 153 unique days, need 200 days [2025-09-23T19:42:14.134693] [FATAL] [MAIN ] KRMN: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:42:14.134786] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:42:14.134887] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-09-23T19:42:14.135011] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-09-23T19:42:14.135068] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-09-23T19:42:14.135129] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-09-23T19:42:14.135261] [INFO ] [MAIN ] Update Progress: 1222/2372 symbols completed. KRMN took 23.5s. Estimated remaining: 2h 32m 38s. Rate: 7.5 symbols/min [2025-09-23T19:42:14.312704] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:42:14.368159] [DEBUG] [LOCAL ] KSS: Loaded 53610 existing records from primary storage. [2025-09-23T19:42:14.368373] [INFO ] [MAIN ] KSS: Loaded 53610 existing records. [2025-09-23T19:42:14.595253] [WARN ] [MAIN ] KSS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:42:14.595613] [INFO ] [MAIN ] KSS: Wiping existing primary data before full refresh. [2025-09-23T19:42:14.595708] [INFO ] [LOCAL ] KSS: Starting deletion of primary data. [2025-09-23T19:42:14.597377] [DEBUG] [LOCAL ] KSS: Deleted primary data file. [2025-09-23T19:42:14.597458] [INFO ] [MAIN ] KSS: Starting full primary refresh. [2025-09-23T19:42:14.618863] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-06. [2025-09-23T19:42:14.974273] [INFO ] [REMOTE ] KSS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:42:15.402156] [INFO ] [REMOTE ] KSS: Fetching primary data for 2024-12. [2025-09-23T19:42:15.823848] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-03 (2.82 seconds). [2025-09-23T19:42:15.925693] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-23T19:42:16.202225] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-04. [2025-09-23T19:42:16.936388] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-09-23T19:42:17.002186] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-07. [2025-09-23T19:42:17.361942] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-23T19:42:17.690730] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-09-23T19:42:17.802232] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-01. [2025-09-23T19:42:18.305704] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-23T19:42:18.602258] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-06. [2025-09-23T19:42:18.713685] [DEBUG] [REMOTE ] KRO: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-09-23T19:42:18.714162] [WARN ] [REMOTE ] KRO: No data returned for month 2025-06 [2025-09-23T19:42:19.402275] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-07. [2025-09-23T19:42:19.661179] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-23T19:42:20.193419] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-23T19:42:20.202167] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-08. [2025-09-23T19:42:21.002223] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-05. [2025-09-23T19:42:21.561012] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-23T19:42:21.802223] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-02. [2025-09-23T19:42:22.106316] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-23T19:42:22.602220] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-08. [2025-09-23T19:42:23.402219] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-09. [2025-09-23T19:42:23.446378] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-23T19:42:24.180295] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-23T19:42:24.202152] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-09. [2025-09-23T19:42:24.536977] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-23T19:42:24.541863] [INFO ] [REMOTE ] KRO: Full fetch complete (31146 records). [2025-09-23T19:42:24.541947] [DEBUG] [VALIDATOR ] KRO: Validating primary data. [2025-09-23T19:42:24.726218] [WARN ] [VALIDATOR ] KRO: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-23T19:42:24.726756] [FATAL] [MAIN ] KRO: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:42:24.726841] [WARN ] [MAIN ] KRO: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:42:24.726923] [INFO ] [LOCAL ] KRO: Starting deletion of primary data. [2025-09-23T19:42:24.727034] [DEBUG] [LOCAL ] KRO: No primary data file found to delete. [2025-09-23T19:42:24.727108] [INFO ] [LOCAL ] KRO: Starting deletion of derivative data. [2025-09-23T19:42:24.727638] [DEBUG] [LOCAL ] KRO: Deleted derivative data file. [2025-09-23T19:42:24.727781] [INFO ] [MAIN ] Update Progress: 1223/2372 symbols completed. KRO took 32.7s. Estimated remaining: 2h 32m 32s. Rate: 7.5 symbols/min [2025-09-23T19:42:24.895261] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:42:24.943516] [DEBUG] [LOCAL ] KT: Loaded 45662 existing records from primary storage. [2025-09-23T19:42:24.943690] [INFO ] [MAIN ] KT: Loaded 45662 existing records. [2025-09-23T19:42:25.009257] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-06. [2025-09-23T19:42:25.136348] [WARN ] [MAIN ] KT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:42:25.136696] [INFO ] [MAIN ] KT: Wiping existing primary data before full refresh. [2025-09-23T19:42:25.136777] [INFO ] [LOCAL ] KT: Starting deletion of primary data. [2025-09-23T19:42:25.137933] [DEBUG] [LOCAL ] KT: Deleted primary data file. [2025-09-23T19:42:25.137996] [INFO ] [MAIN ] KT: Starting full primary refresh. [2025-09-23T19:42:25.546554] [INFO ] [REMOTE ] KT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:42:25.686551] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-23T19:42:25.698084] [INFO ] [REMOTE ] KRG: Full fetch complete (70955 records). [2025-09-23T19:42:25.698268] [DEBUG] [VALIDATOR ] KRG: Validating primary data. [2025-09-23T19:42:25.807292] [INFO ] [REMOTE ] KT: Fetching primary data for 2024-12. [2025-09-23T19:42:26.123954] [DEBUG] [VALIDATOR ] KRG: All expected trading days are present. [2025-09-23T19:42:26.124053] [DEBUG] [VALIDATOR ] KRG: Primary data validation passed. [2025-09-23T19:42:26.124964] [INFO ] [MAIN ] KRG: Fetched primary data is valid. [2025-09-23T19:42:26.125053] [DEBUG] [LOCAL ] KRG: Saving primary data. [2025-09-23T19:42:26.126609] [DEBUG] [LOCAL ] KRG: Trimmed 70955 records to 49153 (keeping 200 days of data) [2025-09-23T19:42:26.479664] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-23T19:42:26.505195] [DEBUG] [LOCAL ] KRG: Primary data saved (49153 records). [2025-09-23T19:42:26.505395] [INFO ] [MAIN ] KRG: Full history saved. [2025-09-23T19:42:26.505690] [INFO ] [MAIN ] Update Progress: 1224/2372 symbols completed. KRG took 37.4s. Estimated remaining: 2h 32m 18s. Rate: 7.5 symbols/min [2025-09-23T19:42:26.607533] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-03. [2025-09-23T19:42:26.684434] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:42:26.730219] [DEBUG] [LOCAL ] KTB: Loaded 41193 existing records from primary storage. [2025-09-23T19:42:26.730395] [INFO ] [MAIN ] KTB: Loaded 41193 existing records. [2025-09-23T19:42:26.918174] [WARN ] [MAIN ] KTB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:42:26.918451] [INFO ] [MAIN ] KTB: Wiping existing primary data before full refresh. [2025-09-23T19:42:26.918595] [INFO ] [LOCAL ] KTB: Starting deletion of primary data. [2025-09-23T19:42:26.919696] [DEBUG] [LOCAL ] KTB: Deleted primary data file. [2025-09-23T19:42:26.919758] [INFO ] [MAIN ] KTB: Starting full primary refresh. [2025-09-23T19:42:27.306263] [INFO ] [REMOTE ] KTB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:42:27.402225] [INFO ] [REMOTE ] KTB: Fetching primary data for 2024-12. [2025-09-23T19:42:27.462614] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-23T19:42:28.202295] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-01. [2025-09-23T19:42:29.002349] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-07. [2025-09-23T19:42:29.428975] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-23T19:42:29.735799] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-03 (3.13 seconds). [2025-09-23T19:42:29.802229] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-01. [2025-09-23T19:42:30.177532] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-23T19:42:30.250683] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-09-23T19:42:30.602191] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-02. [2025-09-23T19:42:30.796118] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-23T19:42:31.402216] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-02. [2025-09-23T19:42:32.072046] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-23T19:42:32.202142] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-03. [2025-09-23T19:42:32.695690] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-23T19:42:33.002193] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-03. [2025-09-23T19:42:33.793505] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-23T19:42:33.803089] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-08. [2025-09-23T19:42:34.486249] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-23T19:42:34.602221] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-04. [2025-09-23T19:42:35.358857] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-23T19:42:35.402250] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-04. [2025-09-23T19:42:36.202199] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-04. [2025-09-23T19:42:36.643393] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-23T19:42:37.002179] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-09. [2025-09-23T19:42:37.039847] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-23T19:42:37.802201] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-05. [2025-09-23T19:42:37.848874] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-23T19:42:38.408033] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-23T19:42:38.414006] [INFO ] [REMOTE ] KRP: Full fetch complete (54899 records). [2025-09-23T19:42:38.414172] [DEBUG] [VALIDATOR ] KRP: Validating primary data. [2025-09-23T19:42:38.603671] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-05. [2025-09-23T19:42:38.813160] [DEBUG] [VALIDATOR ] KRP: All expected trading days are present. [2025-09-23T19:42:38.813257] [DEBUG] [VALIDATOR ] KRP: Primary data validation passed. [2025-09-23T19:42:38.814109] [INFO ] [MAIN ] KRP: Fetched primary data is valid. [2025-09-23T19:42:38.814246] [DEBUG] [LOCAL ] KRP: Saving primary data. [2025-09-23T19:42:38.818759] [DEBUG] [LOCAL ] KRP: Trimmed 54899 records to 37613 (keeping 200 days of data) [2025-09-23T19:42:39.079165] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-23T19:42:39.110139] [DEBUG] [LOCAL ] KRP: Primary data saved (37613 records). [2025-09-23T19:42:39.110312] [INFO ] [MAIN ] KRP: Full history saved. [2025-09-23T19:42:39.110576] [INFO ] [MAIN ] Update Progress: 1225/2372 symbols completed. KRP took 33.9s. Estimated remaining: 2h 32m 15s. Rate: 7.5 symbols/min [2025-09-23T19:42:39.290869] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:42:39.306994] [DEBUG] [LOCAL ] KTF: Loaded 13028 existing records from primary storage. [2025-09-23T19:42:39.307177] [INFO ] [MAIN ] KTF: Loaded 13028 existing records. [2025-09-23T19:42:39.410085] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-06. [2025-09-23T19:42:39.494370] [WARN ] [MAIN ] KTF: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:42:39.494669] [INFO ] [MAIN ] KTF: Wiping existing primary data before full refresh. [2025-09-23T19:42:39.494730] [INFO ] [LOCAL ] KTF: Starting deletion of primary data. [2025-09-23T19:42:39.495219] [DEBUG] [LOCAL ] KTF: Deleted primary data file. [2025-09-23T19:42:39.495299] [INFO ] [MAIN ] KTF: Starting full primary refresh. [2025-09-23T19:42:39.868764] [INFO ] [REMOTE ] KTF: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:42:40.202192] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-05. [2025-09-23T19:42:40.561482] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-23T19:42:40.847447] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-23T19:42:41.002205] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-07. [2025-09-23T19:42:41.802244] [INFO ] [REMOTE ] KTF: Fetching primary data for 2024-12. [2025-09-23T19:42:42.125562] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-23T19:42:42.602173] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-06. [2025-09-23T19:42:42.723326] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-23T19:42:42.759028] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-23T19:42:43.402221] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-01. [2025-09-23T19:42:43.982164] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-23T19:42:44.202179] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-06. [2025-09-23T19:42:44.239358] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-23T19:42:45.002250] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-08. [2025-09-23T19:42:45.801798] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-23T19:42:45.810319] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-07. [2025-09-23T19:42:46.199112] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-23T19:42:46.602203] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-09. [2025-09-23T19:42:47.402200] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-07. [2025-09-23T19:42:47.715864] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-23T19:42:48.086821] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-23T19:42:48.093273] [INFO ] [REMOTE ] KTB: Full fetch complete (57393 records). [2025-09-23T19:42:48.093387] [DEBUG] [VALIDATOR ] KTB: Validating primary data. [2025-09-23T19:42:48.207344] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-08. [2025-09-23T19:42:48.489149] [DEBUG] [VALIDATOR ] KTB: All expected trading days are present. [2025-09-23T19:42:48.489261] [DEBUG] [VALIDATOR ] KTB: Primary data validation passed. [2025-09-23T19:42:48.490199] [INFO ] [MAIN ] KTB: Fetched primary data is valid. [2025-09-23T19:42:48.490268] [DEBUG] [LOCAL ] KTB: Saving primary data. [2025-09-23T19:42:48.491603] [DEBUG] [LOCAL ] KTB: Trimmed 57393 records to 41133 (keeping 200 days of data) [2025-09-23T19:42:48.786384] [DEBUG] [LOCAL ] KTB: Primary data saved (41133 records). [2025-09-23T19:42:48.786994] [INFO ] [MAIN ] KTB: Full history saved. [2025-09-23T19:42:48.788935] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-23T19:42:48.787897] [INFO ] [MAIN ] Update Progress: 1226/2372 symbols completed. KTB took 22.3s. Estimated remaining: 2h 32m 8s. Rate: 7.5 symbols/min [2025-09-23T19:42:48.971830] [INFO ] [MAIN ] KUKE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:42:48.972026] [DEBUG] [LOCAL ] KUKE: No existing data file found in primary storage. [2025-09-23T19:42:48.972063] [WARN ] [MAIN ] KUKE: No existing data found, performing full refresh instead. [2025-09-23T19:42:48.972216] [INFO ] [MAIN ] KUKE: Wiping existing primary data before full refresh. [2025-09-23T19:42:48.972271] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-09-23T19:42:48.972339] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-09-23T19:42:48.972375] [INFO ] [MAIN ] KUKE: Starting full primary refresh. [2025-09-23T19:42:49.007358] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-02. [2025-09-23T19:42:49.373744] [INFO ] [REMOTE ] KUKE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:42:49.711436] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-23T19:42:49.802196] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-03. [2025-09-23T19:42:50.075401] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-23T19:42:50.468879] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-23T19:42:50.602181] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-04. [2025-09-23T19:42:51.402178] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-09. [2025-09-23T19:42:51.623738] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-23T19:42:52.202243] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-08. [2025-09-23T19:42:53.002228] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2024-12. [2025-09-23T19:42:53.627828] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-09-23T19:42:53.636770] [INFO ] [REMOTE ] KSS: Full fetch complete (77640 records). [2025-09-23T19:42:53.636911] [DEBUG] [VALIDATOR ] KSS: Validating primary data. [2025-09-23T19:42:53.802354] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-05. [2025-09-23T19:42:53.874411] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-23T19:42:53.996582] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-23T19:42:54.115440] [DEBUG] [VALIDATOR ] KSS: All expected trading days are present. [2025-09-23T19:42:54.115577] [DEBUG] [VALIDATOR ] KSS: Primary data validation passed. [2025-09-23T19:42:54.116697] [INFO ] [MAIN ] KSS: Fetched primary data is valid. [2025-09-23T19:42:54.116765] [DEBUG] [LOCAL ] KSS: Saving primary data. [2025-09-23T19:42:54.121368] [DEBUG] [LOCAL ] KSS: Trimmed 77640 records to 53608 (keeping 200 days of data) [2025-09-23T19:42:54.476725] [DEBUG] [LOCAL ] KSS: Primary data saved (53608 records). [2025-09-23T19:42:54.476868] [INFO ] [MAIN ] KSS: Full history saved. [2025-09-23T19:42:54.477049] [INFO ] [MAIN ] Update Progress: 1227/2372 symbols completed. KSS took 40.3s. Estimated remaining: 2h 31m 58s. Rate: 7.5 symbols/min [2025-09-23T19:42:54.603991] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-01. [2025-09-23T19:42:54.656961] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:42:54.682724] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-23T19:42:54.726703] [DEBUG] [LOCAL ] KVUE: Loaded 53667 existing records from primary storage. [2025-09-23T19:42:54.726890] [INFO ] [MAIN ] KVUE: Loaded 53667 existing records. [2025-09-23T19:42:54.911848] [WARN ] [MAIN ] KVUE: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:42:54.913167] [INFO ] [MAIN ] KVUE: Wiping existing primary data before full refresh. [2025-09-23T19:42:54.913224] [INFO ] [LOCAL ] KVUE: Starting deletion of primary data. [2025-09-23T19:42:54.914969] [DEBUG] [LOCAL ] KVUE: Deleted primary data file. [2025-09-23T19:42:54.915061] [INFO ] [MAIN ] KVUE: Starting full primary refresh. [2025-09-23T19:42:55.275102] [INFO ] [REMOTE ] KVUE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:42:55.402145] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2024-12. [2025-09-23T19:42:55.487112] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-23T19:42:56.202189] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-09. [2025-09-23T19:42:57.002168] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-02. [2025-09-23T19:42:57.247994] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-23T19:42:57.452110] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-23T19:42:57.549736] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-23T19:42:57.558617] [INFO ] [REMOTE ] KT: Full fetch complete (66827 records). [2025-09-23T19:42:57.558755] [DEBUG] [VALIDATOR ] KT: Validating primary data. [2025-09-23T19:42:57.807374] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-03. [2025-09-23T19:42:57.957406] [DEBUG] [VALIDATOR ] KT: All expected trading days are present. [2025-09-23T19:42:57.957500] [DEBUG] [VALIDATOR ] KT: Primary data validation passed. [2025-09-23T19:42:57.958575] [INFO ] [MAIN ] KT: Fetched primary data is valid. [2025-09-23T19:42:57.958659] [DEBUG] [LOCAL ] KT: Saving primary data. [2025-09-23T19:42:57.960149] [DEBUG] [LOCAL ] KT: Trimmed 66827 records to 45670 (keeping 200 days of data) [2025-09-23T19:42:58.245093] [DEBUG] [LOCAL ] KT: Primary data saved (45670 records). [2025-09-23T19:42:58.245268] [INFO ] [MAIN ] KT: Full history saved. [2025-09-23T19:42:58.245395] [INFO ] [MAIN ] Update Progress: 1228/2372 symbols completed. KT took 33.5s. Estimated remaining: 2h 31m 46s. Rate: 7.5 symbols/min [2025-09-23T19:42:58.416622] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:42:58.466426] [DEBUG] [LOCAL ] KVYO: Loaded 49852 existing records from primary storage. [2025-09-23T19:42:58.466607] [INFO ] [MAIN ] KVYO: Loaded 49852 existing records. [2025-09-23T19:42:58.608315] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-06. [2025-09-23T19:42:58.650234] [WARN ] [MAIN ] KVYO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:42:58.650527] [INFO ] [MAIN ] KVYO: Wiping existing primary data before full refresh. [2025-09-23T19:42:58.650573] [INFO ] [LOCAL ] KVYO: Starting deletion of primary data. [2025-09-23T19:42:58.651796] [DEBUG] [LOCAL ] KVYO: Deleted primary data file. [2025-09-23T19:42:58.651856] [INFO ] [MAIN ] KVYO: Starting full primary refresh. [2025-09-23T19:42:58.928348] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-23T19:42:59.044145] [INFO ] [REMOTE ] KVYO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:42:59.402194] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2024-12. [2025-09-23T19:42:59.566971] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-23T19:43:00.202237] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-04. [2025-09-23T19:43:00.783380] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-23T19:43:01.002253] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-07. [2025-09-23T19:43:01.165056] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-23T19:43:01.796427] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-23T19:43:01.802171] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-01. [2025-09-23T19:43:02.602201] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-08. [2025-09-23T19:43:03.273263] [DEBUG] [REMOTE ] KVUE: Error fetching primary data for 2025-01: ("Connection broken: InvalidChunkLength(got length b'', 0 bytes read)", InvalidChunkLength(got length b'', 0 bytes read)) [2025-09-23T19:43:03.273443] [WARN ] [REMOTE ] KVUE: No data returned for month 2025-01 [2025-09-23T19:43:03.402208] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-01. [2025-09-23T19:43:03.425008] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-23T19:43:04.202239] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-09. [2025-09-23T19:43:05.007276] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-05. [2025-09-23T19:43:05.018451] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-23T19:43:05.277309] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-23T19:43:05.279384] [INFO ] [REMOTE ] KTF: Full fetch complete (18298 records). [2025-09-23T19:43:05.279454] [DEBUG] [VALIDATOR ] KTF: Validating primary data. [2025-09-23T19:43:05.399857] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-23T19:43:05.684556] [DEBUG] [VALIDATOR ] KTF: All expected trading days are present. [2025-09-23T19:43:05.684640] [DEBUG] [VALIDATOR ] KTF: Primary data validation passed. [2025-09-23T19:43:05.685152] [INFO ] [MAIN ] KTF: Fetched primary data is valid. [2025-09-23T19:43:05.685215] [DEBUG] [LOCAL ] KTF: Saving primary data. [2025-09-23T19:43:05.686453] [DEBUG] [LOCAL ] KTF: Trimmed 18298 records to 13055 (keeping 200 days of data) [2025-09-23T19:43:05.763125] [DEBUG] [LOCAL ] KTF: Primary data saved (13055 records). [2025-09-23T19:43:05.763258] [INFO ] [MAIN ] KTF: Full history saved. [2025-09-23T19:43:05.763342] [INFO ] [MAIN ] Update Progress: 1229/2372 symbols completed. KTF took 26.7s. Estimated remaining: 2h 31m 38s. Rate: 7.5 symbols/min [2025-09-23T19:43:05.807399] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-06. [2025-09-23T19:43:05.938772] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:43:05.983264] [DEBUG] [LOCAL ] KW: Loaded 40648 existing records from primary storage. [2025-09-23T19:43:05.983409] [INFO ] [MAIN ] KW: Loaded 40648 existing records. [2025-09-23T19:43:06.166236] [WARN ] [MAIN ] KW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:43:06.166521] [INFO ] [MAIN ] KW: Wiping existing primary data before full refresh. [2025-09-23T19:43:06.166570] [INFO ] [LOCAL ] KW: Starting deletion of primary data. [2025-09-23T19:43:06.167452] [DEBUG] [LOCAL ] KW: Deleted primary data file. [2025-09-23T19:43:06.167512] [INFO ] [MAIN ] KW: Starting full primary refresh. [2025-09-23T19:43:06.325291] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-23T19:43:06.530138] [INFO ] [REMOTE ] KW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:43:06.602212] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-07. [2025-09-23T19:43:07.027760] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-23T19:43:07.402199] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-02. [2025-09-23T19:43:08.202223] [INFO ] [REMOTE ] KW: Fetching primary data for 2024-12. [2025-09-23T19:43:08.993156] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-23T19:43:09.002153] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-08. [2025-09-23T19:43:09.534897] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-23T19:43:09.628912] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-23T19:43:09.802236] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-09. [2025-09-23T19:43:10.539845] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-23T19:43:10.541223] [INFO ] [REMOTE ] KUKE: Full fetch complete (7852 records). [2025-09-23T19:43:10.541292] [DEBUG] [VALIDATOR ] KUKE: Validating primary data. [2025-09-23T19:43:10.607401] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-01. [2025-09-23T19:43:10.726489] [WARN ] [VALIDATOR ] KUKE: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-23T19:43:10.726770] [FATAL] [MAIN ] KUKE: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:43:10.726855] [WARN ] [MAIN ] KUKE: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:43:10.726928] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-09-23T19:43:10.726992] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-09-23T19:43:10.727044] [INFO ] [LOCAL ] KUKE: Starting deletion of derivative data. [2025-09-23T19:43:10.727110] [DEBUG] [LOCAL ] KUKE: No derivative data file found to delete. [2025-09-23T19:43:10.727192] [INFO ] [MAIN ] Update Progress: 1230/2372 symbols completed. KUKE took 21.9s. Estimated remaining: 2h 31m 27s. Rate: 7.5 symbols/min [2025-09-23T19:43:10.903939] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:43:10.922561] [DEBUG] [LOCAL ] KWR: Loaded 16817 existing records from primary storage. [2025-09-23T19:43:10.922735] [INFO ] [MAIN ] KWR: Loaded 16817 existing records. [2025-09-23T19:43:11.103011] [WARN ] [MAIN ] KWR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:43:11.103248] [INFO ] [MAIN ] KWR: Wiping existing primary data before full refresh. [2025-09-23T19:43:11.103295] [INFO ] [LOCAL ] KWR: Starting deletion of primary data. [2025-09-23T19:43:11.103848] [DEBUG] [LOCAL ] KWR: Deleted primary data file. [2025-09-23T19:43:11.103907] [INFO ] [MAIN ] KWR: Starting full primary refresh. [2025-09-23T19:43:11.407335] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-02. [2025-09-23T19:43:11.474515] [INFO ] [REMOTE ] KWR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:43:12.113102] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-23T19:43:12.202190] [INFO ] [REMOTE ] KWR: Fetching primary data for 2024-12. [2025-09-23T19:43:13.002162] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-03. [2025-09-23T19:43:13.219313] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-23T19:43:13.396196] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-23T19:43:13.802196] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-02. [2025-09-23T19:43:14.454024] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-23T19:43:14.602225] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-04. [2025-09-23T19:43:15.251205] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-23T19:43:15.402206] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-03. [2025-09-23T19:43:16.202169] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-03. [2025-09-23T19:43:16.326506] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-23T19:43:16.576532] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-23T19:43:17.002230] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-05. [2025-09-23T19:43:17.802228] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-01. [2025-09-23T19:43:18.077799] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-23T19:43:18.602188] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-04. [2025-09-23T19:43:18.839157] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-23T19:43:18.960255] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-23T19:43:19.402213] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-06. [2025-09-23T19:43:19.997190] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-23T19:43:20.202237] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-05. [2025-09-23T19:43:21.004338] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-04. [2025-09-23T19:43:21.011490] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-23T19:43:21.801207] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-23T19:43:21.810461] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-02. [2025-09-23T19:43:22.372026] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-23T19:43:22.451880] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-23T19:43:22.602197] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-03. [2025-09-23T19:43:23.402225] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-06. [2025-09-23T19:43:23.515191] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-23T19:43:24.202193] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-05. [2025-09-23T19:43:24.932922] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-23T19:43:25.002225] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-07. [2025-09-23T19:43:25.802226] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-07. [2025-09-23T19:43:25.990150] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-23T19:43:26.359343] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-23T19:43:26.602197] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-08. [2025-09-23T19:43:27.218511] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-23T19:43:27.402203] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-08. [2025-09-23T19:43:28.017023] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-23T19:43:28.202192] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-09. [2025-09-23T19:43:29.002265] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-06. [2025-09-23T19:43:29.087576] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-23T19:43:29.678123] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-23T19:43:29.690138] [INFO ] [REMOTE ] KW: Full fetch complete (56838 records). [2025-09-23T19:43:29.690450] [DEBUG] [VALIDATOR ] KW: Validating primary data. [2025-09-23T19:43:29.808723] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-09. [2025-09-23T19:43:30.285661] [DEBUG] [VALIDATOR ] KW: All expected trading days are present. [2025-09-23T19:43:30.285818] [DEBUG] [VALIDATOR ] KW: Primary data validation passed. [2025-09-23T19:43:30.286739] [INFO ] [MAIN ] KW: Fetched primary data is valid. [2025-09-23T19:43:30.286802] [DEBUG] [LOCAL ] KW: Saving primary data. [2025-09-23T19:43:30.288226] [DEBUG] [LOCAL ] KW: Trimmed 56838 records to 40660 (keeping 200 days of data) [2025-09-23T19:43:30.537915] [DEBUG] [LOCAL ] KW: Primary data saved (40660 records). [2025-09-23T19:43:30.538095] [INFO ] [MAIN ] KW: Full history saved. [2025-09-23T19:43:30.538194] [INFO ] [MAIN ] Update Progress: 1231/2372 symbols completed. KW took 24.8s. Estimated remaining: 2h 31m 30s. Rate: 7.5 symbols/min [2025-09-23T19:43:30.607357] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-04. [2025-09-23T19:43:30.726024] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:43:30.775811] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-23T19:43:30.803875] [DEBUG] [LOCAL ] KYN: Loaded 30236 existing records from primary storage. [2025-09-23T19:43:30.804268] [INFO ] [MAIN ] KYN: Loaded 30236 existing records. [2025-09-23T19:43:31.000342] [WARN ] [MAIN ] KYN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:43:31.000741] [INFO ] [MAIN ] KYN: Wiping existing primary data before full refresh. [2025-09-23T19:43:31.000818] [INFO ] [LOCAL ] KYN: Starting deletion of primary data. [2025-09-23T19:43:31.001919] [DEBUG] [LOCAL ] KYN: Deleted primary data file. [2025-09-23T19:43:31.001999] [INFO ] [MAIN ] KYN: Starting full primary refresh. [2025-09-23T19:43:31.371895] [INFO ] [REMOTE ] KYN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:43:31.402190] [INFO ] [REMOTE ] KYN: Fetching primary data for 2024-12. [2025-09-23T19:43:31.505063] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-23T19:43:31.514489] [INFO ] [REMOTE ] KVYO: Full fetch complete (71365 records). [2025-09-23T19:43:31.514732] [DEBUG] [VALIDATOR ] KVYO: Validating primary data. [2025-09-23T19:43:31.684282] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-23T19:43:31.964527] [DEBUG] [VALIDATOR ] KVYO: All expected trading days are present. [2025-09-23T19:43:31.964632] [DEBUG] [VALIDATOR ] KVYO: Primary data validation passed. [2025-09-23T19:43:31.965926] [INFO ] [MAIN ] KVYO: Fetched primary data is valid. [2025-09-23T19:43:31.965991] [DEBUG] [LOCAL ] KVYO: Saving primary data. [2025-09-23T19:43:31.967413] [DEBUG] [LOCAL ] KVYO: Trimmed 71365 records to 49905 (keeping 200 days of data) [2025-09-23T19:43:32.224775] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-05. [2025-09-23T19:43:32.260816] [DEBUG] [LOCAL ] KVYO: Primary data saved (49905 records). [2025-09-23T19:43:32.260959] [INFO ] [MAIN ] KVYO: Full history saved. [2025-09-23T19:43:32.261059] [INFO ] [MAIN ] Update Progress: 1232/2372 symbols completed. KVYO took 34.0s. Estimated remaining: 2h 31m 17s. Rate: 7.5 symbols/min [2025-09-23T19:43:32.434759] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:43:32.477307] [DEBUG] [LOCAL ] L: Loaded 40967 existing records from primary storage. [2025-09-23T19:43:32.477480] [INFO ] [MAIN ] L: Loaded 40967 existing records. [2025-09-23T19:43:32.662713] [WARN ] [MAIN ] L: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:43:32.663013] [INFO ] [MAIN ] L: Wiping existing primary data before full refresh. [2025-09-23T19:43:32.663062] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-09-23T19:43:32.664111] [DEBUG] [LOCAL ] L: Deleted primary data file. [2025-09-23T19:43:32.664172] [INFO ] [MAIN ] L: Starting full primary refresh. [2025-09-23T19:43:33.004588] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-07. [2025-09-23T19:43:33.063396] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-23T19:43:33.089359] [INFO ] [REMOTE ] L: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:43:33.239047] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-23T19:43:33.802193] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-06. [2025-09-23T19:43:34.602203] [INFO ] [REMOTE ] L: Fetching primary data for 2024-12. [2025-09-23T19:43:34.778738] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-23T19:43:34.954765] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-23T19:43:35.402230] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-08. [2025-09-23T19:43:36.128575] [INFO ] [REMOTE ] L: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-23T19:43:36.202223] [INFO ] [REMOTE ] L: Fetching primary data for 2025-01. [2025-09-23T19:43:36.788751] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-23T19:43:37.002200] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-01. [2025-09-23T19:43:37.627432] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-23T19:43:37.802204] [INFO ] [REMOTE ] L: Fetching primary data for 2025-02. [2025-09-23T19:43:38.379095] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-23T19:43:38.602222] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-09. [2025-09-23T19:43:38.967756] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-23T19:43:39.402268] [INFO ] [REMOTE ] L: Fetching primary data for 2025-03. [2025-09-23T19:43:40.202242] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-07. [2025-09-23T19:43:40.530019] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-23T19:43:40.539105] [INFO ] [REMOTE ] KVUE: Full fetch complete (69875 records). [2025-09-23T19:43:40.539261] [DEBUG] [VALIDATOR ] KVUE: Validating primary data. [2025-09-23T19:43:40.733913] [WARN ] [VALIDATOR ] KVUE: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-23T19:43:40.734835] [FATAL] [MAIN ] KVUE: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:43:40.734953] [WARN ] [MAIN ] KVUE: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:43:40.735060] [INFO ] [LOCAL ] KVUE: Starting deletion of primary data. [2025-09-23T19:43:40.735200] [DEBUG] [LOCAL ] KVUE: No primary data file found to delete. [2025-09-23T19:43:40.735256] [INFO ] [LOCAL ] KVUE: Starting deletion of derivative data. [2025-09-23T19:43:40.735710] [DEBUG] [LOCAL ] KVUE: Deleted derivative data file. [2025-09-23T19:43:40.735816] [INFO ] [MAIN ] Update Progress: 1233/2372 symbols completed. KVUE took 46.3s. Estimated remaining: 2h 31m 9s. Rate: 7.5 symbols/min [2025-09-23T19:43:40.925701] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:43:40.939687] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-23T19:43:40.994708] [DEBUG] [LOCAL ] LAC: Loaded 52302 existing records from primary storage. [2025-09-23T19:43:40.994870] [INFO ] [MAIN ] LAC: Loaded 52302 existing records. [2025-09-23T19:43:41.007798] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-08. [2025-09-23T19:43:41.176919] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-23T19:43:41.216396] [WARN ] [MAIN ] LAC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:43:41.216880] [INFO ] [MAIN ] LAC: Wiping existing primary data before full refresh. [2025-09-23T19:43:41.216938] [INFO ] [LOCAL ] LAC: Starting deletion of primary data. [2025-09-23T19:43:41.218016] [DEBUG] [LOCAL ] LAC: Deleted primary data file. [2025-09-23T19:43:41.218078] [INFO ] [MAIN ] LAC: Starting full primary refresh. [2025-09-23T19:43:41.589775] [INFO ] [REMOTE ] LAC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:43:41.802275] [INFO ] [REMOTE ] LAC: Fetching primary data for 2024-12. [2025-09-23T19:43:42.091504] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-23T19:43:42.602227] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-02. [2025-09-23T19:43:43.402177] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-09. [2025-09-23T19:43:43.756637] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-23T19:43:43.802554] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-23T19:43:44.202240] [INFO ] [REMOTE ] L: Fetching primary data for 2025-04. [2025-09-23T19:43:44.312793] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-23T19:43:44.316518] [INFO ] [REMOTE ] KWR: Full fetch complete (24011 records). [2025-09-23T19:43:44.316684] [DEBUG] [VALIDATOR ] KWR: Validating primary data. [2025-09-23T19:43:44.693279] [DEBUG] [VALIDATOR ] KWR: All expected trading days are present. [2025-09-23T19:43:44.693366] [DEBUG] [VALIDATOR ] KWR: Primary data validation passed. [2025-09-23T19:43:44.693899] [INFO ] [MAIN ] KWR: Fetched primary data is valid. [2025-09-23T19:43:44.693959] [DEBUG] [LOCAL ] KWR: Saving primary data. [2025-09-23T19:43:44.694634] [DEBUG] [LOCAL ] KWR: Trimmed 24011 records to 16787 (keeping 200 days of data) [2025-09-23T19:43:44.805277] [DEBUG] [LOCAL ] KWR: Primary data saved (16787 records). [2025-09-23T19:43:44.805433] [INFO ] [MAIN ] KWR: Full history saved. [2025-09-23T19:43:44.805520] [INFO ] [MAIN ] Update Progress: 1234/2372 symbols completed. KWR took 34.1s. Estimated remaining: 2h 30m 58s. Rate: 7.5 symbols/min [2025-09-23T19:43:44.975900] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:43:44.999389] [DEBUG] [LOCAL ] LAD: Loaded 23764 existing records from primary storage. [2025-09-23T19:43:44.999523] [INFO ] [MAIN ] LAD: Loaded 23764 existing records. [2025-09-23T19:43:45.010584] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-03. [2025-09-23T19:43:45.182818] [WARN ] [MAIN ] LAD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:43:45.183058] [INFO ] [MAIN ] LAD: Wiping existing primary data before full refresh. [2025-09-23T19:43:45.183106] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-09-23T19:43:45.183816] [DEBUG] [LOCAL ] LAD: Deleted primary data file. [2025-09-23T19:43:45.183878] [INFO ] [MAIN ] LAD: Starting full primary refresh. [2025-09-23T19:43:45.544280] [INFO ] [REMOTE ] LAD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:43:45.802217] [INFO ] [REMOTE ] LAD: Fetching primary data for 2024-12. [2025-09-23T19:43:45.849032] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-23T19:43:46.433543] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-23T19:43:46.602222] [INFO ] [REMOTE ] L: Fetching primary data for 2025-05. [2025-09-23T19:43:47.059959] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-23T19:43:47.402206] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-04. [2025-09-23T19:43:48.072617] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-23T19:43:48.202194] [INFO ] [REMOTE ] L: Fetching primary data for 2025-06. [2025-09-23T19:43:48.849779] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-23T19:43:49.002201] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-05. [2025-09-23T19:43:49.408150] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-23T19:43:49.802263] [INFO ] [REMOTE ] L: Fetching primary data for 2025-07. [2025-09-23T19:43:50.317287] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-23T19:43:50.602210] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-01. [2025-09-23T19:43:51.206070] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-23T19:43:51.402215] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-06. [2025-09-23T19:43:51.533921] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-23T19:43:52.202181] [INFO ] [REMOTE ] L: Fetching primary data for 2025-08. [2025-09-23T19:43:52.656346] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-23T19:43:53.002245] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-01. [2025-09-23T19:43:53.439833] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-23T19:43:53.802244] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-07. [2025-09-23T19:43:54.602205] [INFO ] [REMOTE ] L: Fetching primary data for 2025-09. [2025-09-23T19:43:54.851788] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-23T19:43:54.904350] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-23T19:43:55.402237] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-08. [2025-09-23T19:43:55.727917] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-23T19:43:55.734929] [INFO ] [REMOTE ] L: Full fetch complete (59551 records). [2025-09-23T19:43:55.735076] [DEBUG] [VALIDATOR ] L: Validating primary data. [2025-09-23T19:43:56.116204] [DEBUG] [VALIDATOR ] L: All expected trading days are present. [2025-09-23T19:43:56.116291] [DEBUG] [VALIDATOR ] L: Primary data validation passed. [2025-09-23T19:43:56.117181] [INFO ] [MAIN ] L: Fetched primary data is valid. [2025-09-23T19:43:56.117245] [DEBUG] [LOCAL ] L: Saving primary data. [2025-09-23T19:43:56.118480] [DEBUG] [LOCAL ] L: Trimmed 59551 records to 40938 (keeping 200 days of data) [2025-09-23T19:43:56.211359] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-02. [2025-09-23T19:43:56.379045] [DEBUG] [LOCAL ] L: Primary data saved (40938 records). [2025-09-23T19:43:56.379184] [INFO ] [MAIN ] L: Full history saved. [2025-09-23T19:43:56.379271] [INFO ] [MAIN ] Update Progress: 1235/2372 symbols completed. L took 24.1s. Estimated remaining: 2h 30m 53s. Rate: 7.5 symbols/min [2025-09-23T19:43:56.562619] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:43:56.582321] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-23T19:43:56.624147] [DEBUG] [LOCAL ] LADR: Loaded 38703 existing records from primary storage. [2025-09-23T19:43:56.624307] [INFO ] [MAIN ] LADR: Loaded 38703 existing records. [2025-09-23T19:43:56.811991] [WARN ] [MAIN ] LADR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:43:56.812255] [INFO ] [MAIN ] LADR: Wiping existing primary data before full refresh. [2025-09-23T19:43:56.812304] [INFO ] [LOCAL ] LADR: Starting deletion of primary data. [2025-09-23T19:43:56.813238] [DEBUG] [LOCAL ] LADR: Deleted primary data file. [2025-09-23T19:43:56.813301] [INFO ] [MAIN ] LADR: Starting full primary refresh. [2025-09-23T19:43:57.002196] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-02. [2025-09-23T19:43:57.198276] [INFO ] [REMOTE ] LADR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:43:57.442490] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-23T19:43:57.802286] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-09. [2025-09-23T19:43:58.602274] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-03. [2025-09-23T19:43:58.901567] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-23T19:43:58.955064] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-23T19:43:58.960339] [INFO ] [REMOTE ] KYN: Full fetch complete (44940 records). [2025-09-23T19:43:58.960519] [DEBUG] [VALIDATOR ] KYN: Validating primary data. [2025-09-23T19:43:59.336155] [DEBUG] [VALIDATOR ] KYN: All expected trading days are present. [2025-09-23T19:43:59.336235] [DEBUG] [VALIDATOR ] KYN: Primary data validation passed. [2025-09-23T19:43:59.336913] [INFO ] [MAIN ] KYN: Fetched primary data is valid. [2025-09-23T19:43:59.336975] [DEBUG] [LOCAL ] KYN: Saving primary data. [2025-09-23T19:43:59.337953] [DEBUG] [LOCAL ] KYN: Trimmed 44940 records to 30159 (keeping 200 days of data) [2025-09-23T19:43:59.425873] [INFO ] [REMOTE ] LADR: Fetching primary data for 2024-12. [2025-09-23T19:43:59.531002] [DEBUG] [LOCAL ] KYN: Primary data saved (30159 records). [2025-09-23T19:43:59.531234] [INFO ] [MAIN ] KYN: Full history saved. [2025-09-23T19:43:59.531443] [INFO ] [MAIN ] Update Progress: 1236/2372 symbols completed. KYN took 29.0s. Estimated remaining: 2h 30m 40s. Rate: 7.5 symbols/min [2025-09-23T19:43:59.709376] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:43:59.727043] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-23T19:43:59.737343] [DEBUG] [LOCAL ] LANV: Loaded 2697 existing records from primary storage. [2025-09-23T19:43:59.737450] [INFO ] [MAIN ] LANV: Loaded 2697 existing records. [2025-09-23T19:43:59.910844] [WARN ] [MAIN ] LANV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:43:59.911161] [INFO ] [MAIN ] LANV: Wiping existing primary data before full refresh. [2025-09-23T19:43:59.911217] [INFO ] [LOCAL ] LANV: Starting deletion of primary data. [2025-09-23T19:43:59.911445] [DEBUG] [LOCAL ] LANV: Deleted primary data file. [2025-09-23T19:43:59.911546] [INFO ] [MAIN ] LANV: Starting full primary refresh. [2025-09-23T19:44:00.207296] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-04. [2025-09-23T19:44:00.272426] [INFO ] [REMOTE ] LANV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:44:00.967998] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-23T19:44:01.002165] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-01. [2025-09-23T19:44:01.271304] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-23T19:44:01.802250] [INFO ] [REMOTE ] LANV: Fetching primary data for 2024-12. [2025-09-23T19:44:02.357500] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-23T19:44:02.390371] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-23T19:44:02.602241] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-02. [2025-09-23T19:44:03.402229] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-05. [2025-09-23T19:44:03.908113] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-23T19:44:04.106991] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-23T19:44:04.202213] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-03. [2025-09-23T19:44:05.002205] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-01. [2025-09-23T19:44:05.558596] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-23T19:44:05.802189] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-06. [2025-09-23T19:44:05.904406] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-23T19:44:06.602871] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-03. [2025-09-23T19:44:06.605882] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-23T19:44:07.402233] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-04. [2025-09-23T19:44:08.004094] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-23T19:44:08.202191] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-02. [2025-09-23T19:44:08.535133] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-23T19:44:09.007392] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-07. [2025-09-23T19:44:09.033546] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-23T19:44:09.802237] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-03. [2025-09-23T19:44:10.287571] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-23T19:44:10.371611] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-23T19:44:10.602260] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-04. [2025-09-23T19:44:11.034405] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-23T19:44:11.402259] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-05. [2025-09-23T19:44:11.680085] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-09-23T19:44:12.202249] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-06. [2025-09-23T19:44:12.569746] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-23T19:44:13.002298] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-07. [2025-09-23T19:44:13.589994] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-23T19:44:13.802252] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-08. [2025-09-23T19:44:14.602272] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-04. [2025-09-23T19:44:14.955142] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-23T19:44:15.402212] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-09. [2025-09-23T19:44:16.187428] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-23T19:44:16.202148] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-05. [2025-09-23T19:44:16.315863] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-23T19:44:16.319737] [INFO ] [REMOTE ] LAD: Full fetch complete (35212 records). [2025-09-23T19:44:16.319845] [DEBUG] [VALIDATOR ] LAD: Validating primary data. [2025-09-23T19:44:16.728893] [DEBUG] [VALIDATOR ] LAD: All expected trading days are present. [2025-09-23T19:44:16.729017] [DEBUG] [VALIDATOR ] LAD: Primary data validation passed. [2025-09-23T19:44:16.729681] [INFO ] [MAIN ] LAD: Fetched primary data is valid. [2025-09-23T19:44:16.729743] [DEBUG] [LOCAL ] LAD: Saving primary data. [2025-09-23T19:44:16.730598] [DEBUG] [LOCAL ] LAD: Trimmed 35212 records to 23712 (keeping 200 days of data) [2025-09-23T19:44:16.889590] [DEBUG] [LOCAL ] LAD: Primary data saved (23712 records). [2025-09-23T19:44:16.889756] [INFO ] [MAIN ] LAD: Full history saved. [2025-09-23T19:44:16.889854] [INFO ] [MAIN ] Update Progress: 1237/2372 symbols completed. LAD took 32.1s. Estimated remaining: 2h 30m 41s. Rate: 7.5 symbols/min [2025-09-23T19:44:17.002201] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-05. [2025-09-23T19:44:17.215209] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-23T19:44:17.802211] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-06. [2025-09-23T19:44:18.602279] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-08. [2025-09-23T19:44:18.743592] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-23T19:44:18.792036] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-23T19:44:19.142535] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-23T19:44:19.402253] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-06. [2025-09-23T19:44:20.202240] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-09. [2025-09-23T19:44:20.962851] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-23T19:44:20.964287] [INFO ] [REMOTE ] LANV: Full fetch complete (4392 records). [2025-09-23T19:44:20.964358] [DEBUG] [VALIDATOR ] LANV: Validating primary data. [2025-09-23T19:44:21.007708] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-07. [2025-09-23T19:44:21.344934] [DEBUG] [VALIDATOR ] LANV: All expected trading days are present. [2025-09-23T19:44:21.345141] [DEBUG] [VALIDATOR ] LANV: Primary data validation passed. [2025-09-23T19:44:21.345502] [INFO ] [MAIN ] LANV: Fetched primary data is valid. [2025-09-23T19:44:21.358231] [DEBUG] [LOCAL ] LANV: Saving primary data. [2025-09-23T19:44:21.380874] [DEBUG] [LOCAL ] LANV: Trimmed 4392 records to 2730 (keeping 200 days of data) [2025-09-23T19:44:21.384147] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-23T19:44:21.420776] [DEBUG] [LOCAL ] LANV: Primary data saved (2730 records). [2025-09-23T19:44:21.420961] [INFO ] [MAIN ] LANV: Full history saved. [2025-09-23T19:44:21.421088] [INFO ] [MAIN ] Update Progress: 1238/2372 symbols completed. LANV took 21.9s. Estimated remaining: 2h 30m 30s. Rate: 7.5 symbols/min [2025-09-23T19:44:21.802390] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-07. [2025-09-23T19:44:22.867816] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-23T19:44:22.877399] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-08. [2025-09-23T19:44:23.780518] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-23T19:44:23.792549] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-08. [2025-09-23T19:44:23.896483] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-23T19:44:24.202236] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-09. [2025-09-23T19:44:25.794919] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-23T19:44:25.802056] [INFO ] [REMOTE ] LADR: Full fetch complete (54987 records). [2025-09-23T19:44:25.802211] [DEBUG] [VALIDATOR ] LADR: Validating primary data. [2025-09-23T19:44:26.216863] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-09-23T19:44:26.240821] [DEBUG] [VALIDATOR ] LADR: All expected trading days are present. [2025-09-23T19:44:26.240899] [DEBUG] [VALIDATOR ] LADR: Primary data validation passed. [2025-09-23T19:44:26.242247] [INFO ] [MAIN ] LADR: Fetched primary data is valid. [2025-09-23T19:44:26.242330] [DEBUG] [LOCAL ] LADR: Saving primary data. [2025-09-23T19:44:26.243606] [DEBUG] [LOCAL ] LADR: Trimmed 54987 records to 38692 (keeping 200 days of data) [2025-09-23T19:44:26.244604] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-09. [2025-09-23T19:44:26.489636] [DEBUG] [LOCAL ] LADR: Primary data saved (38692 records). [2025-09-23T19:44:26.489814] [INFO ] [MAIN ] LADR: Full history saved. [2025-09-23T19:44:26.489900] [INFO ] [MAIN ] Update Progress: 1239/2372 symbols completed. LADR took 30.1s. Estimated remaining: 2h 30m 19s. Rate: 7.5 symbols/min [2025-09-23T19:44:28.290874] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-23T19:44:28.300607] [INFO ] [REMOTE ] LAC: Full fetch complete (75968 records). [2025-09-23T19:44:28.300788] [DEBUG] [VALIDATOR ] LAC: Validating primary data. [2025-09-23T19:44:28.692676] [DEBUG] [VALIDATOR ] LAC: All expected trading days are present. [2025-09-23T19:44:28.692776] [DEBUG] [VALIDATOR ] LAC: Primary data validation passed. [2025-09-23T19:44:28.693739] [INFO ] [MAIN ] LAC: Fetched primary data is valid. [2025-09-23T19:44:28.693803] [DEBUG] [LOCAL ] LAC: Saving primary data. [2025-09-23T19:44:28.695323] [DEBUG] [LOCAL ] LAC: Trimmed 75968 records to 52304 (keeping 200 days of data) [2025-09-23T19:44:29.004756] [DEBUG] [LOCAL ] LAC: Primary data saved (52304 records). [2025-09-23T19:44:29.004926] [INFO ] [MAIN ] LAC: Full history saved. [2025-09-23T19:44:29.005060] [INFO ] [MAIN ] Update Progress: 1240/2372 symbols completed. LAC took 48.3s. Estimated remaining: 2h 30m 7s. Rate: 7.5 symbols/min [2025-09-23T19:44:29.557570] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:44:29.599022] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:44:29.759871] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:44:29.741831] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:44:29.767886] [DEBUG] [LOCAL ] LAR: No existing data file found in primary storage. [2025-09-23T19:44:29.768931] [DEBUG] [LOCAL ] LAW: Loaded 13887 existing records from primary storage. [2025-09-23T19:44:29.769270] [WARN ] [MAIN ] LAR: No existing data found, performing full refresh instead. [2025-09-23T19:44:29.769184] [INFO ] [MAIN ] LAW: Loaded 13887 existing records. [2025-09-23T19:44:29.781908] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-09-23T19:44:29.782000] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-09-23T19:44:29.803921] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-09-23T19:44:29.820806] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-09-23T19:44:30.128404] [DEBUG] [LOCAL ] LAZ: Loaded 45362 existing records from primary storage. [2025-09-23T19:44:30.157063] [INFO ] [MAIN ] LAZ: Loaded 45362 existing records. [2025-09-23T19:44:30.156957] [WARN ] [MAIN ] LAW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:44:30.239216] [INFO ] [MAIN ] LAW: Wiping existing primary data before full refresh. [2025-09-23T19:44:30.202722] [DEBUG] [LOCAL ] LB: Loaded 37682 existing records from primary storage. [2025-09-23T19:44:30.261579] [INFO ] [LOCAL ] LAW: Starting deletion of primary data. [2025-09-23T19:44:30.261700] [INFO ] [MAIN ] LB: Loaded 37682 existing records. [2025-09-23T19:44:30.373720] [DEBUG] [LOCAL ] LAW: Deleted primary data file. [2025-09-23T19:44:30.539749] [INFO ] [MAIN ] LAW: Starting full primary refresh. [2025-09-23T19:44:30.800671] [WARN ] [MAIN ] LAZ: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:44:30.902945] [INFO ] [REMOTE ] LAR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:44:30.899737] [WARN ] [MAIN ] LB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:44:30.903440] [INFO ] [MAIN ] LAZ: Wiping existing primary data before full refresh. [2025-09-23T19:44:30.904198] [INFO ] [REMOTE ] LAR: Fetching primary data for 2024-12. [2025-09-23T19:44:30.904335] [INFO ] [LOCAL ] LAZ: Starting deletion of primary data. [2025-09-23T19:44:30.914866] [INFO ] [MAIN ] LB: Wiping existing primary data before full refresh. [2025-09-23T19:44:30.917023] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-09-23T19:44:30.928048] [DEBUG] [LOCAL ] LB: Deleted primary data file. [2025-09-23T19:44:30.947256] [INFO ] [MAIN ] LB: Starting full primary refresh. [2025-09-23T19:44:30.947182] [DEBUG] [LOCAL ] LAZ: Deleted primary data file. [2025-09-23T19:44:31.067334] [INFO ] [MAIN ] LAZ: Starting full primary refresh. [2025-09-23T19:44:31.149048] [DEBUG] [REMOTE ] LAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:44:31.205795] [WARN ] [REMOTE ] LAR: No data returned for month 2024-12 [2025-09-23T19:44:31.273884] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-01. [2025-09-23T19:44:31.530699] [INFO ] [REMOTE ] LAW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:44:31.554521] [INFO ] [REMOTE ] LAW: Fetching primary data for 2024-12. [2025-09-23T19:44:31.854378] [INFO ] [REMOTE ] LB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:44:31.888258] [INFO ] [REMOTE ] LB: Fetching primary data for 2024-12. [2025-09-23T19:44:31.909939] [INFO ] [REMOTE ] LAZ: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:44:31.910293] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2024-12. [2025-09-23T19:44:32.366772] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-23T19:44:32.370259] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-02. [2025-09-23T19:44:32.574482] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-23T19:44:32.578940] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-01. [2025-09-23T19:44:33.084287] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-23T19:44:33.094361] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-01. [2025-09-23T19:44:33.124011] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-23T19:44:33.127795] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-02. [2025-09-23T19:44:33.469633] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-23T19:44:33.478477] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-01. [2025-09-23T19:44:33.932399] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-23T19:44:33.947334] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-03. [2025-09-23T19:44:33.956166] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-23T19:44:34.602221] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-03. [2025-09-23T19:44:34.924393] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-23T19:44:34.985997] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-23T19:44:35.402178] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-02. [2025-09-23T19:44:35.455181] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-23T19:44:35.545298] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-23T19:44:36.202223] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-04. [2025-09-23T19:44:36.885451] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-23T19:44:37.002226] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-03. [2025-09-23T19:44:37.290285] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-23T19:44:37.802206] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-05. [2025-09-23T19:44:38.554427] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-23T19:44:38.575413] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-23T19:44:38.602157] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-04. [2025-09-23T19:44:39.402302] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-04. [2025-09-23T19:44:40.158830] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-23T19:44:40.202163] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-05. [2025-09-23T19:44:41.000134] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-23T19:44:41.003753] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-06. [2025-09-23T19:44:41.684737] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-23T19:44:41.689430] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-23T19:44:41.802248] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-07. [2025-09-23T19:44:42.602182] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-02. [2025-09-23T19:44:42.762324] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-23T19:44:43.402259] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-05. [2025-09-23T19:44:43.891583] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-23T19:44:44.202216] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-06. [2025-09-23T19:44:44.904724] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-23T19:44:45.002205] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-06. [2025-09-23T19:44:45.235722] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-23T19:44:45.802239] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-07. [2025-09-23T19:44:46.506794] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-23T19:44:46.602212] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-07. [2025-09-23T19:44:47.373771] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-23T19:44:47.402156] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-08. [2025-09-23T19:44:48.202197] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-08. [2025-09-23T19:44:48.368901] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-23T19:44:48.814744] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-23T19:44:48.872015] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-23T19:44:49.002243] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-09. [2025-09-23T19:44:49.802248] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-08. [2025-09-23T19:44:49.940687] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-23T19:44:49.943683] [INFO ] [REMOTE ] LAW: Full fetch complete (20759 records). [2025-09-23T19:44:49.943813] [DEBUG] [VALIDATOR ] LAW: Validating primary data. [2025-09-23T19:44:50.319504] [DEBUG] [VALIDATOR ] LAW: All expected trading days are present. [2025-09-23T19:44:50.319610] [DEBUG] [VALIDATOR ] LAW: Primary data validation passed. [2025-09-23T19:44:50.320155] [INFO ] [MAIN ] LAW: Fetched primary data is valid. [2025-09-23T19:44:50.320271] [DEBUG] [LOCAL ] LAW: Saving primary data. [2025-09-23T19:44:50.321200] [DEBUG] [LOCAL ] LAW: Trimmed 20759 records to 13871 (keeping 200 days of data) [2025-09-23T19:44:50.407249] [DEBUG] [LOCAL ] LAW: Primary data saved (13871 records). [2025-09-23T19:44:50.407433] [INFO ] [MAIN ] LAW: Full history saved. [2025-09-23T19:44:50.407628] [INFO ] [MAIN ] Update Progress: 1241/2372 symbols completed. LAW took 21.4s. Estimated remaining: 2h 30m 11s. Rate: 7.5 symbols/min [2025-09-23T19:44:50.581831] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:44:50.602282] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-09. [2025-09-23T19:44:50.649897] [DEBUG] [LOCAL ] LBRT: Loaded 52920 existing records from primary storage. [2025-09-23T19:44:50.650052] [INFO ] [MAIN ] LBRT: Loaded 52920 existing records. [2025-09-23T19:44:50.835611] [WARN ] [MAIN ] LBRT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:44:50.835925] [INFO ] [MAIN ] LBRT: Wiping existing primary data before full refresh. [2025-09-23T19:44:50.835991] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-09-23T19:44:50.838254] [DEBUG] [LOCAL ] LBRT: Deleted primary data file. [2025-09-23T19:44:50.838334] [INFO ] [MAIN ] LBRT: Starting full primary refresh. [2025-09-23T19:44:51.206885] [INFO ] [REMOTE ] LBRT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:44:51.402256] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2024-12. [2025-09-23T19:44:51.640206] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-23T19:44:51.924015] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-23T19:44:51.934169] [INFO ] [REMOTE ] LB: Full fetch complete (56151 records). [2025-09-23T19:44:51.934347] [DEBUG] [VALIDATOR ] LB: Validating primary data. [2025-09-23T19:44:52.211062] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-03. [2025-09-23T19:44:52.357323] [DEBUG] [VALIDATOR ] LB: All expected trading days are present. [2025-09-23T19:44:52.357412] [DEBUG] [VALIDATOR ] LB: Primary data validation passed. [2025-09-23T19:44:52.358449] [INFO ] [MAIN ] LB: Fetched primary data is valid. [2025-09-23T19:44:52.358522] [DEBUG] [LOCAL ] LB: Saving primary data. [2025-09-23T19:44:52.359848] [DEBUG] [LOCAL ] LB: Trimmed 56151 records to 37675 (keeping 200 days of data) [2025-09-23T19:44:52.614795] [DEBUG] [LOCAL ] LB: Primary data saved (37675 records). [2025-09-23T19:44:52.614950] [INFO ] [MAIN ] LB: Full history saved. [2025-09-23T19:44:52.615133] [INFO ] [MAIN ] Update Progress: 1242/2372 symbols completed. LB took 23.6s. Estimated remaining: 2h 29m 58s. Rate: 7.5 symbols/min [2025-09-23T19:44:52.797779] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:44:52.850692] [DEBUG] [LOCAL ] LC: Loaded 47959 existing records from primary storage. [2025-09-23T19:44:52.850876] [INFO ] [MAIN ] LC: Loaded 47959 existing records. [2025-09-23T19:44:53.008781] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-09. [2025-09-23T19:44:53.042362] [WARN ] [MAIN ] LC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:44:53.042849] [INFO ] [MAIN ] LC: Wiping existing primary data before full refresh. [2025-09-23T19:44:53.053048] [INFO ] [LOCAL ] LC: Starting deletion of primary data. [2025-09-23T19:44:53.072523] [DEBUG] [LOCAL ] LC: Deleted primary data file. [2025-09-23T19:44:53.072793] [INFO ] [MAIN ] LC: Starting full primary refresh. [2025-09-23T19:44:53.127474] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-23T19:44:53.466868] [INFO ] [REMOTE ] LC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:44:53.795808] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-23T19:44:53.805479] [INFO ] [REMOTE ] LC: Fetching primary data for 2024-12. [2025-09-23T19:44:54.602261] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-04. [2025-09-23T19:44:54.906760] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-23T19:44:54.915069] [INFO ] [REMOTE ] LAR: Full fetch complete (54384 records). [2025-09-23T19:44:54.915254] [DEBUG] [VALIDATOR ] LAR: Validating primary data. [2025-09-23T19:44:55.117440] [WARN ] [VALIDATOR ] LAR: Validation failed - insufficient historical data. Have 166 unique days, need 200 days [2025-09-23T19:44:55.118441] [FATAL] [MAIN ] LAR: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:44:55.118559] [WARN ] [MAIN ] LAR: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:44:55.118702] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-09-23T19:44:55.118820] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-09-23T19:44:55.118923] [INFO ] [LOCAL ] LAR: Starting deletion of derivative data. [2025-09-23T19:44:55.119036] [DEBUG] [LOCAL ] LAR: No derivative data file found to delete. [2025-09-23T19:44:55.119163] [INFO ] [MAIN ] Update Progress: 1243/2372 symbols completed. LAR took 26.1s. Estimated remaining: 2h 29m 45s. Rate: 7.5 symbols/min [2025-09-23T19:44:55.297133] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:44:55.338540] [DEBUG] [LOCAL ] LCII: Loaded 28723 existing records from primary storage. [2025-09-23T19:44:55.338718] [INFO ] [MAIN ] LCII: Loaded 28723 existing records. [2025-09-23T19:44:55.403911] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-01. [2025-09-23T19:44:55.525152] [WARN ] [MAIN ] LCII: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:44:55.525636] [INFO ] [MAIN ] LCII: Wiping existing primary data before full refresh. [2025-09-23T19:44:55.525800] [INFO ] [LOCAL ] LCII: Starting deletion of primary data. [2025-09-23T19:44:55.538617] [DEBUG] [LOCAL ] LCII: Deleted primary data file. [2025-09-23T19:44:55.553721] [INFO ] [MAIN ] LCII: Starting full primary refresh. [2025-09-23T19:44:55.650687] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-23T19:44:55.949532] [INFO ] [REMOTE ] LCII: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:44:55.982242] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-23T19:44:56.202182] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-05. [2025-09-23T19:44:56.966441] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-23T19:44:57.002213] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-02. [2025-09-23T19:44:57.479496] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-23T19:44:57.802235] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-06. [2025-09-23T19:44:58.274941] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-23T19:44:58.602209] [INFO ] [REMOTE ] LCII: Fetching primary data for 2024-12. [2025-09-23T19:44:59.384379] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-23T19:44:59.402149] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-07. [2025-09-23T19:44:59.438029] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-23T19:45:00.202252] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-01. [2025-09-23T19:45:01.002192] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-01. [2025-09-23T19:45:01.118818] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-23T19:45:01.379005] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-23T19:45:01.802253] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-03. [2025-09-23T19:45:02.602215] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-08. [2025-09-23T19:45:03.300806] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-09-23T19:45:03.402184] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-02. [2025-09-23T19:45:04.202228] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-02. [2025-09-23T19:45:05.595108] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-03 (3.79 seconds). [2025-09-23T19:45:05.606540] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-04. [2025-09-23T19:45:06.420566] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-08 (3.82 seconds). [2025-09-23T19:45:06.432011] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-09. [2025-09-23T19:45:06.933035] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-02 (3.53 seconds). [2025-09-23T19:45:06.942855] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-03. [2025-09-23T19:45:07.004484] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-02 (2.80 seconds). [2025-09-23T19:45:07.402194] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-03. [2025-09-23T19:45:07.738935] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-23T19:45:08.193878] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-23T19:45:08.201603] [INFO ] [REMOTE ] LAZ: Full fetch complete (65830 records). [2025-09-23T19:45:08.201789] [DEBUG] [VALIDATOR ] LAZ: Validating primary data. [2025-09-23T19:45:08.202218] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-05. [2025-09-23T19:45:08.624527] [DEBUG] [VALIDATOR ] LAZ: All expected trading days are present. [2025-09-23T19:45:08.624800] [DEBUG] [VALIDATOR ] LAZ: Primary data validation passed. [2025-09-23T19:45:08.625827] [INFO ] [MAIN ] LAZ: Fetched primary data is valid. [2025-09-23T19:45:08.625937] [DEBUG] [LOCAL ] LAZ: Saving primary data. [2025-09-23T19:45:08.642959] [DEBUG] [LOCAL ] LAZ: Trimmed 65830 records to 45286 (keeping 200 days of data) [2025-09-23T19:45:08.658403] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-23T19:45:08.935811] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-23T19:45:08.983885] [DEBUG] [LOCAL ] LAZ: Primary data saved (45286 records). [2025-09-23T19:45:08.984020] [INFO ] [MAIN ] LAZ: Full history saved. [2025-09-23T19:45:08.984120] [INFO ] [MAIN ] Update Progress: 1244/2372 symbols completed. LAZ took 40.0s. Estimated remaining: 2h 29m 42s. Rate: 7.5 symbols/min [2025-09-23T19:45:09.007331] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-04. [2025-09-23T19:45:09.162458] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:45:09.208721] [DEBUG] [LOCAL ] LDI: Loaded 43700 existing records from primary storage. [2025-09-23T19:45:09.208869] [INFO ] [MAIN ] LDI: Loaded 43700 existing records. [2025-09-23T19:45:09.386858] [WARN ] [MAIN ] LDI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:45:09.387124] [INFO ] [MAIN ] LDI: Wiping existing primary data before full refresh. [2025-09-23T19:45:09.387172] [INFO ] [LOCAL ] LDI: Starting deletion of primary data. [2025-09-23T19:45:09.388292] [DEBUG] [LOCAL ] LDI: Deleted primary data file. [2025-09-23T19:45:09.388353] [INFO ] [MAIN ] LDI: Starting full primary refresh. [2025-09-23T19:45:09.746759] [INFO ] [REMOTE ] LDI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:45:09.802180] [INFO ] [REMOTE ] LDI: Fetching primary data for 2024-12. [2025-09-23T19:45:10.085415] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-23T19:45:10.269978] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-23T19:45:10.602246] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-04. [2025-09-23T19:45:11.402196] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-06. [2025-09-23T19:45:11.467041] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-23T19:45:12.202302] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-05. [2025-09-23T19:45:12.350402] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-23T19:45:12.673104] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-23T19:45:13.002240] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-05. [2025-09-23T19:45:13.583469] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-23T19:45:13.802212] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-01. [2025-09-23T19:45:14.491353] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-23T19:45:14.602155] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-06. [2025-09-23T19:45:14.713379] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-23T19:45:15.402273] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-02. [2025-09-23T19:45:16.202246] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-07. [2025-09-23T19:45:16.687539] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-23T19:45:17.002201] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-06. [2025-09-23T19:45:17.393412] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-23T19:45:17.802232] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-07. [2025-09-23T19:45:18.602224] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-03. [2025-09-23T19:45:18.727428] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-23T19:45:19.112678] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-07 (2.91 seconds). [2025-09-23T19:45:19.317935] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-23T19:45:19.402155] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-08. [2025-09-23T19:45:19.831924] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-23T19:45:20.202207] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-04. [2025-09-23T19:45:20.871995] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-23T19:45:21.002223] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-07. [2025-09-23T19:45:21.776714] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-23T19:45:21.802275] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-08. [2025-09-23T19:45:21.867920] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-23T19:45:22.602245] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-09. [2025-09-23T19:45:23.402267] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-05. [2025-09-23T19:45:23.668226] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-23T19:45:23.852546] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-23T19:45:23.860539] [INFO ] [REMOTE ] LC: Full fetch complete (70305 records). [2025-09-23T19:45:23.860727] [DEBUG] [VALIDATOR ] LC: Validating primary data. [2025-09-23T19:45:24.207639] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-09. [2025-09-23T19:45:24.324941] [DEBUG] [VALIDATOR ] LC: All expected trading days are present. [2025-09-23T19:45:24.325096] [DEBUG] [VALIDATOR ] LC: Primary data validation passed. [2025-09-23T19:45:24.326217] [INFO ] [MAIN ] LC: Fetched primary data is valid. [2025-09-23T19:45:24.326288] [DEBUG] [LOCAL ] LC: Saving primary data. [2025-09-23T19:45:24.327861] [DEBUG] [LOCAL ] LC: Trimmed 70305 records to 47948 (keeping 200 days of data) [2025-09-23T19:45:24.646508] [DEBUG] [LOCAL ] LC: Primary data saved (47948 records). [2025-09-23T19:45:24.646758] [INFO ] [MAIN ] LC: Full history saved. [2025-09-23T19:45:24.646923] [INFO ] [MAIN ] Update Progress: 1245/2372 symbols completed. LC took 32.0s. Estimated remaining: 2h 29m 41s. Rate: 7.5 symbols/min [2025-09-23T19:45:24.854830] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:45:24.899052] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-23T19:45:24.965307] [DEBUG] [LOCAL ] LDOS: Loaded 45918 existing records from primary storage. [2025-09-23T19:45:24.965531] [INFO ] [MAIN ] LDOS: Loaded 45918 existing records. [2025-09-23T19:45:25.007401] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-06. [2025-09-23T19:45:25.165674] [WARN ] [MAIN ] LDOS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:45:25.166041] [INFO ] [MAIN ] LDOS: Wiping existing primary data before full refresh. [2025-09-23T19:45:25.166096] [INFO ] [LOCAL ] LDOS: Starting deletion of primary data. [2025-09-23T19:45:25.167764] [DEBUG] [LOCAL ] LDOS: Deleted primary data file. [2025-09-23T19:45:25.167829] [INFO ] [MAIN ] LDOS: Starting full primary refresh. [2025-09-23T19:45:25.567587] [INFO ] [REMOTE ] LDOS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:45:25.802221] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-08. [2025-09-23T19:45:25.935583] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-23T19:45:25.949509] [INFO ] [REMOTE ] LBRT: Full fetch complete (76511 records). [2025-09-23T19:45:25.949862] [DEBUG] [VALIDATOR ] LBRT: Validating primary data. [2025-09-23T19:45:26.421451] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-23T19:45:26.452518] [DEBUG] [VALIDATOR ] LBRT: All expected trading days are present. [2025-09-23T19:45:26.452817] [DEBUG] [VALIDATOR ] LBRT: Primary data validation passed. [2025-09-23T19:45:26.454142] [INFO ] [MAIN ] LBRT: Fetched primary data is valid. [2025-09-23T19:45:26.454676] [DEBUG] [LOCAL ] LBRT: Saving primary data. [2025-09-23T19:45:26.456959] [DEBUG] [LOCAL ] LBRT: Trimmed 76511 records to 52920 (keeping 200 days of data) [2025-09-23T19:45:26.603082] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-07. [2025-09-23T19:45:26.737421] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-23T19:45:26.878614] [DEBUG] [LOCAL ] LBRT: Primary data saved (52920 records). [2025-09-23T19:45:26.878886] [INFO ] [MAIN ] LBRT: Full history saved. [2025-09-23T19:45:26.879024] [INFO ] [MAIN ] Update Progress: 1246/2372 symbols completed. LBRT took 36.5s. Estimated remaining: 2h 29m 28s. Rate: 7.5 symbols/min [2025-09-23T19:45:27.069364] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:45:27.087123] [DEBUG] [LOCAL ] LDP: Loaded 13072 existing records from primary storage. [2025-09-23T19:45:27.087319] [INFO ] [MAIN ] LDP: Loaded 13072 existing records. [2025-09-23T19:45:27.270686] [WARN ] [MAIN ] LDP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:45:27.270992] [INFO ] [MAIN ] LDP: Wiping existing primary data before full refresh. [2025-09-23T19:45:27.271046] [INFO ] [LOCAL ] LDP: Starting deletion of primary data. [2025-09-23T19:45:27.271612] [DEBUG] [LOCAL ] LDP: Deleted primary data file. [2025-09-23T19:45:27.271705] [INFO ] [MAIN ] LDP: Starting full primary refresh. [2025-09-23T19:45:27.411167] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-09. [2025-09-23T19:45:27.638484] [INFO ] [REMOTE ] LDP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:45:28.202195] [INFO ] [REMOTE ] LDP: Fetching primary data for 2024-12. [2025-09-23T19:45:28.243094] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-23T19:45:28.830146] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-23T19:45:28.834512] [INFO ] [REMOTE ] LCII: Full fetch complete (38979 records). [2025-09-23T19:45:28.834609] [DEBUG] [VALIDATOR ] LCII: Validating primary data. [2025-09-23T19:45:29.013178] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-08. [2025-09-23T19:45:29.249975] [DEBUG] [VALIDATOR ] LCII: All expected trading days are present. [2025-09-23T19:45:29.250108] [DEBUG] [VALIDATOR ] LCII: Primary data validation passed. [2025-09-23T19:45:29.251133] [INFO ] [MAIN ] LCII: Fetched primary data is valid. [2025-09-23T19:45:29.251202] [DEBUG] [LOCAL ] LCII: Saving primary data. [2025-09-23T19:45:29.252442] [DEBUG] [LOCAL ] LCII: Trimmed 38979 records to 28651 (keeping 200 days of data) [2025-09-23T19:45:29.444924] [DEBUG] [LOCAL ] LCII: Primary data saved (28651 records). [2025-09-23T19:45:29.445130] [INFO ] [MAIN ] LCII: Full history saved. [2025-09-23T19:45:29.445233] [INFO ] [MAIN ] Update Progress: 1247/2372 symbols completed. LCII took 34.3s. Estimated remaining: 2h 29m 15s. Rate: 7.5 symbols/min [2025-09-23T19:45:29.623113] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:45:29.664971] [DEBUG] [LOCAL ] LEA: Loaded 41859 existing records from primary storage. [2025-09-23T19:45:29.665212] [INFO ] [MAIN ] LEA: Loaded 41859 existing records. [2025-09-23T19:45:29.807810] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2024-12. [2025-09-23T19:45:29.856730] [WARN ] [MAIN ] LEA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:45:29.857033] [INFO ] [MAIN ] LEA: Wiping existing primary data before full refresh. [2025-09-23T19:45:29.857089] [INFO ] [LOCAL ] LEA: Starting deletion of primary data. [2025-09-23T19:45:29.858470] [DEBUG] [LOCAL ] LEA: Deleted primary data file. [2025-09-23T19:45:29.858536] [INFO ] [MAIN ] LEA: Starting full primary refresh. [2025-09-23T19:45:30.231444] [INFO ] [REMOTE ] LEA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:45:30.382349] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-09-23T19:45:30.602215] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-01. [2025-09-23T19:45:31.249028] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-09-23T19:45:31.362370] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-23T19:45:31.402145] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-09. [2025-09-23T19:45:31.502938] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-23T19:45:32.202231] [INFO ] [REMOTE ] LEA: Fetching primary data for 2024-12. [2025-09-23T19:45:33.002250] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-01. [2025-09-23T19:45:33.516193] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-23T19:45:33.525096] [INFO ] [REMOTE ] LDI: Full fetch complete (60086 records). [2025-09-23T19:45:33.525223] [DEBUG] [VALIDATOR ] LDI: Validating primary data. [2025-09-23T19:45:33.807440] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-02. [2025-09-23T19:45:33.930593] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-23T19:45:34.008524] [DEBUG] [VALIDATOR ] LDI: All expected trading days are present. [2025-09-23T19:45:34.008604] [DEBUG] [VALIDATOR ] LDI: Primary data validation passed. [2025-09-23T19:45:34.009411] [INFO ] [MAIN ] LDI: Fetched primary data is valid. [2025-09-23T19:45:34.009473] [DEBUG] [LOCAL ] LDI: Saving primary data. [2025-09-23T19:45:34.010679] [DEBUG] [LOCAL ] LDI: Trimmed 60086 records to 43871 (keeping 200 days of data) [2025-09-23T19:45:34.283519] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-23T19:45:34.296765] [DEBUG] [LOCAL ] LDI: Primary data saved (43871 records). [2025-09-23T19:45:34.296844] [INFO ] [MAIN ] LDI: Full history saved. [2025-09-23T19:45:34.296916] [INFO ] [MAIN ] Update Progress: 1248/2372 symbols completed. LDI took 25.3s. Estimated remaining: 2h 29m 4s. Rate: 7.5 symbols/min [2025-09-23T19:45:34.472631] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:45:34.519504] [DEBUG] [LOCAL ] LEG: Loaded 50389 existing records from primary storage. [2025-09-23T19:45:34.519668] [INFO ] [MAIN ] LEG: Loaded 50389 existing records. [2025-09-23T19:45:34.607471] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-01. [2025-09-23T19:45:34.705061] [WARN ] [MAIN ] LEG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:45:34.712564] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-23T19:45:34.712725] [INFO ] [MAIN ] LEG: Wiping existing primary data before full refresh. [2025-09-23T19:45:34.715806] [INFO ] [LOCAL ] LEG: Starting deletion of primary data. [2025-09-23T19:45:34.717183] [DEBUG] [LOCAL ] LEG: Deleted primary data file. [2025-09-23T19:45:34.717245] [INFO ] [MAIN ] LEG: Starting full primary refresh. [2025-09-23T19:45:35.072000] [INFO ] [REMOTE ] LEG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:45:35.402165] [INFO ] [REMOTE ] LEG: Fetching primary data for 2024-12. [2025-09-23T19:45:36.119165] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-23T19:45:36.202213] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-02. [2025-09-23T19:45:37.002181] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-03. [2025-09-23T19:45:37.172389] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-23T19:45:37.491064] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-23T19:45:37.802181] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-01. [2025-09-23T19:45:37.902949] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-23T19:45:38.602293] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-03. [2025-09-23T19:45:39.400120] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-23T19:45:39.409444] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-04. [2025-09-23T19:45:40.202186] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-02. [2025-09-23T19:45:40.367879] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-23T19:45:40.410923] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-23T19:45:41.002208] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-04. [2025-09-23T19:45:41.717389] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-23T19:45:41.802390] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-03. [2025-09-23T19:45:42.602215] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-02. [2025-09-23T19:45:42.795227] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-23T19:45:43.212756] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-23T19:45:43.402187] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-05. [2025-09-23T19:45:43.922788] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-23T19:45:44.202207] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-05. [2025-09-23T19:45:45.002178] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-03. [2025-09-23T19:45:45.081113] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-23T19:45:45.139857] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-23T19:45:45.802202] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-06. [2025-09-23T19:45:46.589542] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-23T19:45:46.602153] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-04. [2025-09-23T19:45:47.402170] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-06. [2025-09-23T19:45:47.516523] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-23T19:45:48.202169] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-07. [2025-09-23T19:45:48.390232] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-23T19:45:48.417315] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-23T19:45:49.002198] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-05. [2025-09-23T19:45:49.802168] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-07. [2025-09-23T19:45:49.846310] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-23T19:45:50.263432] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-23T19:45:50.445149] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-23T19:45:50.602207] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-08. [2025-09-23T19:45:51.402203] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-06. [2025-09-23T19:45:52.202179] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-04. [2025-09-23T19:45:52.280169] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-23T19:45:53.002231] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-08. [2025-09-23T19:45:53.726066] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-09-23T19:45:53.802174] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-07. [2025-09-23T19:45:53.870067] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-23T19:45:53.897964] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-23T19:45:54.602199] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-05. [2025-09-23T19:45:55.403371] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-09. [2025-09-23T19:45:55.409729] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-23T19:45:56.130447] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-23T19:45:56.202156] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-06. [2025-09-23T19:45:56.359326] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-23T19:45:56.361755] [INFO ] [REMOTE ] LDP: Full fetch complete (19432 records). [2025-09-23T19:45:56.361831] [DEBUG] [VALIDATOR ] LDP: Validating primary data. [2025-09-23T19:45:56.730467] [DEBUG] [VALIDATOR ] LDP: All expected trading days are present. [2025-09-23T19:45:56.730553] [DEBUG] [VALIDATOR ] LDP: Primary data validation passed. [2025-09-23T19:45:56.731000] [INFO ] [MAIN ] LDP: Fetched primary data is valid. [2025-09-23T19:45:56.731062] [DEBUG] [LOCAL ] LDP: Saving primary data. [2025-09-23T19:45:56.731685] [DEBUG] [LOCAL ] LDP: Trimmed 19432 records to 12995 (keeping 200 days of data) [2025-09-23T19:45:56.813789] [DEBUG] [LOCAL ] LDP: Primary data saved (12995 records). [2025-09-23T19:45:56.813950] [INFO ] [MAIN ] LDP: Full history saved. [2025-09-23T19:45:56.814041] [INFO ] [MAIN ] Update Progress: 1249/2372 symbols completed. LDP took 29.9s. Estimated remaining: 2h 29m 9s. Rate: 7.5 symbols/min [2025-09-23T19:45:56.986446] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:45:57.002186] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-08. [2025-09-23T19:45:57.045428] [DEBUG] [LOCAL ] LEN: Loaded 53191 existing records from primary storage. [2025-09-23T19:45:57.045593] [INFO ] [MAIN ] LEN: Loaded 53191 existing records. [2025-09-23T19:45:57.229855] [WARN ] [MAIN ] LEN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:45:57.230107] [INFO ] [MAIN ] LEN: Wiping existing primary data before full refresh. [2025-09-23T19:45:57.230155] [INFO ] [LOCAL ] LEN: Starting deletion of primary data. [2025-09-23T19:45:57.231844] [DEBUG] [LOCAL ] LEN: Deleted primary data file. [2025-09-23T19:45:57.231906] [INFO ] [MAIN ] LEN: Starting full primary refresh. [2025-09-23T19:45:57.604351] [INFO ] [REMOTE ] LEN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:45:57.638577] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-23T19:45:57.802180] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-09. [2025-09-23T19:45:58.602184] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-07. [2025-09-23T19:45:58.869755] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-23T19:45:59.402208] [INFO ] [REMOTE ] LEN: Fetching primary data for 2024-12. [2025-09-23T19:45:59.432667] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-23T19:45:59.439843] [INFO ] [REMOTE ] LDOS: Full fetch complete (67758 records). [2025-09-23T19:45:59.439968] [DEBUG] [VALIDATOR ] LDOS: Validating primary data. [2025-09-23T19:45:59.831105] [DEBUG] [VALIDATOR ] LDOS: All expected trading days are present. [2025-09-23T19:45:59.831299] [DEBUG] [VALIDATOR ] LDOS: Primary data validation passed. [2025-09-23T19:45:59.832209] [INFO ] [MAIN ] LDOS: Fetched primary data is valid. [2025-09-23T19:45:59.832272] [DEBUG] [LOCAL ] LDOS: Saving primary data. [2025-09-23T19:45:59.833558] [DEBUG] [LOCAL ] LDOS: Trimmed 67758 records to 45814 (keeping 200 days of data) [2025-09-23T19:46:00.127903] [DEBUG] [LOCAL ] LDOS: Primary data saved (45814 records). [2025-09-23T19:46:00.128057] [INFO ] [MAIN ] LDOS: Full history saved. [2025-09-23T19:46:00.130998] [INFO ] [MAIN ] Update Progress: 1250/2372 symbols completed. LDOS took 35.5s. Estimated remaining: 2h 28m 57s. Rate: 7.5 symbols/min [2025-09-23T19:46:00.204725] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-09. [2025-09-23T19:46:00.351947] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:46:00.353952] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-23T19:46:00.382935] [DEBUG] [LOCAL ] LEO: Loaded 17610 existing records from primary storage. [2025-09-23T19:46:00.383085] [INFO ] [MAIN ] LEO: Loaded 17610 existing records. [2025-09-23T19:46:00.561938] [WARN ] [MAIN ] LEO: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:46:00.562200] [INFO ] [MAIN ] LEO: Wiping existing primary data before full refresh. [2025-09-23T19:46:00.562247] [INFO ] [LOCAL ] LEO: Starting deletion of primary data. [2025-09-23T19:46:00.562802] [DEBUG] [LOCAL ] LEO: Deleted primary data file. [2025-09-23T19:46:00.562861] [INFO ] [MAIN ] LEO: Starting full primary refresh. [2025-09-23T19:46:00.922066] [INFO ] [REMOTE ] LEO: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:46:01.002166] [INFO ] [REMOTE ] LEO: Fetching primary data for 2024-12. [2025-09-23T19:46:01.087458] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-23T19:46:01.775142] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-23T19:46:01.802149] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-01. [2025-09-23T19:46:02.092707] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-23T19:46:02.101260] [INFO ] [REMOTE ] LEG: Full fetch complete (73218 records). [2025-09-23T19:46:02.101418] [DEBUG] [VALIDATOR ] LEG: Validating primary data. [2025-09-23T19:46:02.491074] [DEBUG] [VALIDATOR ] LEG: All expected trading days are present. [2025-09-23T19:46:02.491160] [DEBUG] [VALIDATOR ] LEG: Primary data validation passed. [2025-09-23T19:46:02.492077] [INFO ] [MAIN ] LEG: Fetched primary data is valid. [2025-09-23T19:46:02.492138] [DEBUG] [LOCAL ] LEG: Saving primary data. [2025-09-23T19:46:02.493532] [DEBUG] [LOCAL ] LEG: Trimmed 73218 records to 50396 (keeping 200 days of data) [2025-09-23T19:46:02.603352] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-08. [2025-09-23T19:46:02.811347] [DEBUG] [LOCAL ] LEG: Primary data saved (50396 records). [2025-09-23T19:46:02.811613] [INFO ] [MAIN ] LEG: Full history saved. [2025-09-23T19:46:02.811742] [INFO ] [MAIN ] Update Progress: 1251/2372 symbols completed. LEG took 28.5s. Estimated remaining: 2h 28m 45s. Rate: 7.5 symbols/min [2025-09-23T19:46:02.943479] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-23T19:46:03.001404] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:46:03.055601] [DEBUG] [LOCAL ] LEVI: Loaded 51526 existing records from primary storage. [2025-09-23T19:46:03.055817] [INFO ] [MAIN ] LEVI: Loaded 51526 existing records. [2025-09-23T19:46:03.232826] [WARN ] [MAIN ] LEVI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:46:03.233119] [INFO ] [MAIN ] LEVI: Wiping existing primary data before full refresh. [2025-09-23T19:46:03.233166] [INFO ] [LOCAL ] LEVI: Starting deletion of primary data. [2025-09-23T19:46:03.234630] [DEBUG] [LOCAL ] LEVI: Deleted primary data file. [2025-09-23T19:46:03.234713] [INFO ] [MAIN ] LEVI: Starting full primary refresh. [2025-09-23T19:46:03.407545] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-01. [2025-09-23T19:46:03.616507] [INFO ] [REMOTE ] LEVI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:46:04.202200] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-02. [2025-09-23T19:46:04.316454] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-23T19:46:05.002163] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-09. [2025-09-23T19:46:05.147323] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-23T19:46:05.392695] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-23T19:46:05.802252] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-03. [2025-09-23T19:46:06.375569] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-23T19:46:06.383435] [INFO ] [REMOTE ] LEA: Full fetch complete (60974 records). [2025-09-23T19:46:06.383599] [DEBUG] [VALIDATOR ] LEA: Validating primary data. [2025-09-23T19:46:06.607262] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2024-12. [2025-09-23T19:46:06.789146] [DEBUG] [VALIDATOR ] LEA: All expected trading days are present. [2025-09-23T19:46:06.789263] [DEBUG] [VALIDATOR ] LEA: Primary data validation passed. [2025-09-23T19:46:06.790248] [INFO ] [MAIN ] LEA: Fetched primary data is valid. [2025-09-23T19:46:06.790316] [DEBUG] [LOCAL ] LEA: Saving primary data. [2025-09-23T19:46:06.791770] [DEBUG] [LOCAL ] LEA: Trimmed 60974 records to 41822 (keeping 200 days of data) [2025-09-23T19:46:06.899358] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-23T19:46:07.077270] [DEBUG] [LOCAL ] LEA: Primary data saved (41822 records). [2025-09-23T19:46:07.077410] [INFO ] [MAIN ] LEA: Full history saved. [2025-09-23T19:46:07.077496] [INFO ] [MAIN ] Update Progress: 1252/2372 symbols completed. LEA took 37.6s. Estimated remaining: 2h 28m 33s. Rate: 7.5 symbols/min [2025-09-23T19:46:07.251421] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:46:07.270383] [DEBUG] [LOCAL ] LFT: Loaded 17970 existing records from primary storage. [2025-09-23T19:46:07.270525] [INFO ] [MAIN ] LFT: Loaded 17970 existing records. [2025-09-23T19:46:07.407412] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-04. [2025-09-23T19:46:07.487608] [WARN ] [MAIN ] LFT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:46:07.487899] [INFO ] [MAIN ] LFT: Wiping existing primary data before full refresh. [2025-09-23T19:46:07.487951] [INFO ] [LOCAL ] LFT: Starting deletion of primary data. [2025-09-23T19:46:07.488581] [DEBUG] [LOCAL ] LFT: Deleted primary data file. [2025-09-23T19:46:07.488669] [INFO ] [MAIN ] LFT: Starting full primary refresh. [2025-09-23T19:46:08.025158] [INFO ] [REMOTE ] LFT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:46:08.202196] [INFO ] [REMOTE ] LFT: Fetching primary data for 2024-12. [2025-09-23T19:46:08.415286] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-23T19:46:08.633418] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-23T19:46:08.857007] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-23T19:46:09.002243] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-01. [2025-09-23T19:46:09.802214] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-02. [2025-09-23T19:46:09.920249] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-23T19:46:10.602208] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-01. [2025-09-23T19:46:11.305572] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-23T19:46:11.402196] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-03. [2025-09-23T19:46:12.202277] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-02. [2025-09-23T19:46:12.350508] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-23T19:46:13.002179] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-05. [2025-09-23T19:46:13.060388] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-23T19:46:13.144427] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-23T19:46:13.802200] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-04. [2025-09-23T19:46:14.090892] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-23T19:46:14.602247] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-06. [2025-09-23T19:46:15.402166] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-02. [2025-09-23T19:46:15.577179] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-23T19:46:15.653991] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-23T19:46:16.202188] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-05. [2025-09-23T19:46:17.002174] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-07. [2025-09-23T19:46:17.089222] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-23T19:46:17.565962] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-23T19:46:17.802207] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-08. [2025-09-23T19:46:17.860392] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-23T19:46:18.602181] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-03. [2025-09-23T19:46:18.743738] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-23T19:46:19.402206] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-03. [2025-09-23T19:46:20.202155] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-09. [2025-09-23T19:46:20.401896] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-23T19:46:20.570303] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-23T19:46:21.002228] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-04. [2025-09-23T19:46:21.188493] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-23T19:46:21.191581] [INFO ] [REMOTE ] LEO: Full fetch complete (27157 records). [2025-09-23T19:46:21.191683] [DEBUG] [VALIDATOR ] LEO: Validating primary data. [2025-09-23T19:46:21.559872] [DEBUG] [VALIDATOR ] LEO: All expected trading days are present. [2025-09-23T19:46:21.559974] [DEBUG] [VALIDATOR ] LEO: Primary data validation passed. [2025-09-23T19:46:21.560536] [INFO ] [MAIN ] LEO: Fetched primary data is valid. [2025-09-23T19:46:21.560596] [DEBUG] [LOCAL ] LEO: Saving primary data. [2025-09-23T19:46:21.562744] [DEBUG] [LOCAL ] LEO: Trimmed 27157 records to 17672 (keeping 200 days of data) [2025-09-23T19:46:21.669682] [DEBUG] [LOCAL ] LEO: Primary data saved (17672 records). [2025-09-23T19:46:21.669829] [INFO ] [MAIN ] LEO: Full history saved. [2025-09-23T19:46:21.669918] [INFO ] [MAIN ] Update Progress: 1253/2372 symbols completed. LEO took 21.5s. Estimated remaining: 2h 28m 31s. Rate: 7.5 symbols/min [2025-09-23T19:46:21.807841] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-06. [2025-09-23T19:46:21.841070] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:46:21.853919] [DEBUG] [LOCAL ] LGI: Loaded 10075 existing records from primary storage. [2025-09-23T19:46:21.854054] [INFO ] [MAIN ] LGI: Loaded 10075 existing records. [2025-09-23T19:46:22.037199] [WARN ] [MAIN ] LGI: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:46:22.037507] [INFO ] [MAIN ] LGI: Wiping existing primary data before full refresh. [2025-09-23T19:46:22.037565] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-09-23T19:46:22.038049] [DEBUG] [LOCAL ] LGI: Deleted primary data file. [2025-09-23T19:46:22.038110] [INFO ] [MAIN ] LGI: Starting full primary refresh. [2025-09-23T19:46:22.419747] [INFO ] [REMOTE ] LGI: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:46:22.602181] [INFO ] [REMOTE ] LGI: Fetching primary data for 2024-12. [2025-09-23T19:46:22.909202] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-23T19:46:23.017098] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-09-23T19:46:23.402192] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-05. [2025-09-23T19:46:23.704964] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-23T19:46:24.202198] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-04. [2025-09-23T19:46:25.002175] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-07. [2025-09-23T19:46:25.115506] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-23T19:46:25.241849] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-23T19:46:25.802192] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-06. [2025-09-23T19:46:26.602172] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-01. [2025-09-23T19:46:26.956695] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-23T19:46:27.402241] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-08. [2025-09-23T19:46:27.468700] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-23T19:46:27.470426] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-23T19:46:28.202196] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-02. [2025-09-23T19:46:28.919893] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-23T19:46:29.002154] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-07. [2025-09-23T19:46:29.366359] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-23T19:46:29.802196] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-09. [2025-09-23T19:46:30.602179] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-03. [2025-09-23T19:46:30.834011] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-23T19:46:31.077937] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-23T19:46:31.402222] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-08. [2025-09-23T19:46:31.808869] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-23T19:46:31.823048] [INFO ] [REMOTE ] LEN: Full fetch complete (76992 records). [2025-09-23T19:46:31.823221] [DEBUG] [VALIDATOR ] LEN: Validating primary data. [2025-09-23T19:46:32.219769] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-04. [2025-09-23T19:46:32.223551] [DEBUG] [VALIDATOR ] LEN: All expected trading days are present. [2025-09-23T19:46:32.223639] [DEBUG] [VALIDATOR ] LEN: Primary data validation passed. [2025-09-23T19:46:32.231342] [INFO ] [MAIN ] LEN: Fetched primary data is valid. [2025-09-23T19:46:32.231937] [DEBUG] [LOCAL ] LEN: Saving primary data. [2025-09-23T19:46:32.239247] [DEBUG] [LOCAL ] LEN: Trimmed 76992 records to 53191 (keeping 200 days of data) [2025-09-23T19:46:32.602380] [DEBUG] [LOCAL ] LEN: Primary data saved (53191 records). [2025-09-23T19:46:32.602582] [INFO ] [MAIN ] LEN: Full history saved. [2025-09-23T19:46:32.602802] [INFO ] [MAIN ] Update Progress: 1254/2372 symbols completed. LEN took 35.8s. Estimated remaining: 2h 28m 26s. Rate: 7.5 symbols/min [2025-09-23T19:46:32.796923] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:46:32.839420] [DEBUG] [LOCAL ] LH: Loaded 38477 existing records from primary storage. [2025-09-23T19:46:32.839604] [INFO ] [MAIN ] LH: Loaded 38477 existing records. [2025-09-23T19:46:33.027719] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-05. [2025-09-23T19:46:33.034481] [WARN ] [MAIN ] LH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:46:33.036588] [INFO ] [MAIN ] LH: Wiping existing primary data before full refresh. [2025-09-23T19:46:33.036715] [INFO ] [LOCAL ] LH: Starting deletion of primary data. [2025-09-23T19:46:33.049514] [DEBUG] [LOCAL ] LH: Deleted primary data file. [2025-09-23T19:46:33.069035] [INFO ] [MAIN ] LH: Starting full primary refresh. [2025-09-23T19:46:33.097307] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-23T19:46:33.204333] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-23T19:46:33.463260] [INFO ] [REMOTE ] LH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:46:33.802159] [INFO ] [REMOTE ] LH: Fetching primary data for 2024-12. [2025-09-23T19:46:34.111068] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-23T19:46:34.602207] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-06. [2025-09-23T19:46:35.250378] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-23T19:46:35.385791] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-23T19:46:35.402152] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-07. [2025-09-23T19:46:36.202287] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-05. [2025-09-23T19:46:36.272241] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-23T19:46:36.969763] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-23T19:46:37.002150] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-01. [2025-09-23T19:46:37.802215] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-09. [2025-09-23T19:46:38.468493] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-23T19:46:38.602206] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-06. [2025-09-23T19:46:39.367504] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-23T19:46:39.402242] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-08. [2025-09-23T19:46:39.548870] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-23T19:46:39.561791] [INFO ] [REMOTE ] LEVI: Full fetch complete (74440 records). [2025-09-23T19:46:39.561953] [DEBUG] [VALIDATOR ] LEVI: Validating primary data. [2025-09-23T19:46:39.971631] [DEBUG] [VALIDATOR ] LEVI: All expected trading days are present. [2025-09-23T19:46:39.971768] [DEBUG] [VALIDATOR ] LEVI: Primary data validation passed. [2025-09-23T19:46:39.972903] [INFO ] [MAIN ] LEVI: Fetched primary data is valid. [2025-09-23T19:46:39.973019] [DEBUG] [LOCAL ] LEVI: Saving primary data. [2025-09-23T19:46:39.977982] [DEBUG] [LOCAL ] LEVI: Trimmed 74440 records to 51546 (keeping 200 days of data) [2025-09-23T19:46:40.210843] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-07. [2025-09-23T19:46:40.318875] [DEBUG] [LOCAL ] LEVI: Primary data saved (51546 records). [2025-09-23T19:46:40.319066] [INFO ] [MAIN ] LEVI: Full history saved. [2025-09-23T19:46:40.319270] [INFO ] [MAIN ] Update Progress: 1255/2372 symbols completed. LEVI took 37.5s. Estimated remaining: 2h 28m 18s. Rate: 7.5 symbols/min [2025-09-23T19:46:40.534799] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:46:40.536445] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-23T19:46:40.593444] [DEBUG] [LOCAL ] LHX: Loaded 48812 existing records from primary storage. [2025-09-23T19:46:40.593617] [INFO ] [MAIN ] LHX: Loaded 48812 existing records. [2025-09-23T19:46:40.774248] [WARN ] [MAIN ] LHX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:46:40.774512] [INFO ] [MAIN ] LHX: Wiping existing primary data before full refresh. [2025-09-23T19:46:40.774568] [INFO ] [LOCAL ] LHX: Starting deletion of primary data. [2025-09-23T19:46:40.775817] [DEBUG] [LOCAL ] LHX: Deleted primary data file. [2025-09-23T19:46:40.775894] [INFO ] [MAIN ] LHX: Starting full primary refresh. [2025-09-23T19:46:41.007282] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-02. [2025-09-23T19:46:41.053392] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-23T19:46:41.184003] [INFO ] [REMOTE ] LHX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:46:41.802206] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-09. [2025-09-23T19:46:42.602236] [INFO ] [REMOTE ] LHX: Fetching primary data for 2024-12. [2025-09-23T19:46:42.712420] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-23T19:46:42.777275] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-23T19:46:42.781622] [INFO ] [REMOTE ] LFT: Full fetch complete (23937 records). [2025-09-23T19:46:42.781789] [DEBUG] [VALIDATOR ] LFT: Validating primary data. [2025-09-23T19:46:43.151009] [DEBUG] [VALIDATOR ] LFT: All expected trading days are present. [2025-09-23T19:46:43.151103] [DEBUG] [VALIDATOR ] LFT: Primary data validation passed. [2025-09-23T19:46:43.151599] [INFO ] [MAIN ] LFT: Fetched primary data is valid. [2025-09-23T19:46:43.151662] [DEBUG] [LOCAL ] LFT: Saving primary data. [2025-09-23T19:46:43.152581] [DEBUG] [LOCAL ] LFT: Trimmed 23937 records to 18057 (keeping 200 days of data) [2025-09-23T19:46:43.263514] [DEBUG] [LOCAL ] LFT: Primary data saved (18057 records). [2025-09-23T19:46:43.263689] [INFO ] [MAIN ] LFT: Full history saved. [2025-09-23T19:46:43.263831] [INFO ] [MAIN ] Update Progress: 1256/2372 symbols completed. LFT took 36.2s. Estimated remaining: 2h 28m 5s. Rate: 7.5 symbols/min [2025-09-23T19:46:43.407388] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-03. [2025-09-23T19:46:43.441429] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:46:43.477623] [DEBUG] [LOCAL ] LII: Loaded 28510 existing records from primary storage. [2025-09-23T19:46:43.477796] [INFO ] [MAIN ] LII: Loaded 28510 existing records. [2025-09-23T19:46:43.655146] [WARN ] [MAIN ] LII: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:46:43.655572] [INFO ] [MAIN ] LII: Wiping existing primary data before full refresh. [2025-09-23T19:46:43.655664] [INFO ] [LOCAL ] LII: Starting deletion of primary data. [2025-09-23T19:46:43.656551] [DEBUG] [LOCAL ] LII: Deleted primary data file. [2025-09-23T19:46:43.656612] [INFO ] [MAIN ] LII: Starting full primary refresh. [2025-09-23T19:46:44.018724] [INFO ] [REMOTE ] LII: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:46:44.202185] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-08. [2025-09-23T19:46:44.233924] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-23T19:46:44.551826] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-23T19:46:45.002164] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-01. [2025-09-23T19:46:45.135024] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-23T19:46:45.802259] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-04. [2025-09-23T19:46:46.602249] [INFO ] [REMOTE ] LII: Fetching primary data for 2024-12. [2025-09-23T19:46:46.766394] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-23T19:46:47.402190] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-02. [2025-09-23T19:46:47.532602] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-23T19:46:47.655829] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-23T19:46:48.202184] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-05. [2025-09-23T19:46:48.958036] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-23T19:46:49.002175] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-03. [2025-09-23T19:46:49.757120] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-23T19:46:49.802187] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-09. [2025-09-23T19:46:50.556195] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-23T19:46:50.558450] [INFO ] [REMOTE ] LGI: Full fetch complete (14274 records). [2025-09-23T19:46:50.558595] [DEBUG] [VALIDATOR ] LGI: Validating primary data. [2025-09-23T19:46:50.607362] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-06. [2025-09-23T19:46:50.882627] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-23T19:46:50.974233] [DEBUG] [VALIDATOR ] LGI: All expected trading days are present. [2025-09-23T19:46:50.974327] [DEBUG] [VALIDATOR ] LGI: Primary data validation passed. [2025-09-23T19:46:50.974660] [INFO ] [MAIN ] LGI: Fetched primary data is valid. [2025-09-23T19:46:50.974721] [DEBUG] [LOCAL ] LGI: Saving primary data. [2025-09-23T19:46:50.975844] [DEBUG] [LOCAL ] LGI: Trimmed 14274 records to 10013 (keeping 200 days of data) [2025-09-23T19:46:51.045681] [DEBUG] [LOCAL ] LGI: Primary data saved (10013 records). [2025-09-23T19:46:51.045863] [INFO ] [MAIN ] LGI: Full history saved. [2025-09-23T19:46:51.045989] [INFO ] [MAIN ] Update Progress: 1257/2372 symbols completed. LGI took 29.4s. Estimated remaining: 2h 27m 57s. Rate: 7.5 symbols/min [2025-09-23T19:46:51.233041] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:46:51.292902] [DEBUG] [LOCAL ] LION: Loaded 42858 existing records from primary storage. [2025-09-23T19:46:51.293079] [INFO ] [MAIN ] LION: Loaded 42858 existing records. [2025-09-23T19:46:51.407335] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-01. [2025-09-23T19:46:51.481073] [WARN ] [MAIN ] LION: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:46:51.481444] [INFO ] [MAIN ] LION: Wiping existing primary data before full refresh. [2025-09-23T19:46:51.481521] [INFO ] [LOCAL ] LION: Starting deletion of primary data. [2025-09-23T19:46:51.483105] [DEBUG] [LOCAL ] LION: Deleted primary data file. [2025-09-23T19:46:51.483185] [INFO ] [MAIN ] LION: Starting full primary refresh. [2025-09-23T19:46:51.854681] [INFO ] [REMOTE ] LION: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:46:52.134952] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-23T19:46:52.202162] [INFO ] [REMOTE ] LION: Fetching primary data for 2024-12. [2025-09-23T19:46:52.945826] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-23T19:46:53.002180] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-02. [2025-09-23T19:46:53.207789] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-23T19:46:53.802196] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-07. [2025-09-23T19:46:54.425221] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-23T19:46:54.602313] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-03. [2025-09-23T19:46:55.087506] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-23T19:46:55.402216] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-01. [2025-09-23T19:46:55.657983] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-23T19:46:56.202197] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-08. [2025-09-23T19:46:56.481864] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-23T19:46:57.002204] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-02. [2025-09-23T19:46:57.563981] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-23T19:46:57.802192] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-04. [2025-09-23T19:46:58.031920] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-23T19:46:58.602254] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-03. [2025-09-23T19:46:59.402223] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-09. [2025-09-23T19:46:59.669549] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-23T19:46:59.693792] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-23T19:47:00.202181] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-05. [2025-09-23T19:47:00.400073] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-23T19:47:00.405397] [INFO ] [REMOTE ] LH: Full fetch complete (54824 records). [2025-09-23T19:47:00.405521] [DEBUG] [VALIDATOR ] LH: Validating primary data. [2025-09-23T19:47:00.788395] [DEBUG] [VALIDATOR ] LH: All expected trading days are present. [2025-09-23T19:47:00.788480] [DEBUG] [VALIDATOR ] LH: Primary data validation passed. [2025-09-23T19:47:00.789536] [INFO ] [MAIN ] LH: Fetched primary data is valid. [2025-09-23T19:47:00.789602] [DEBUG] [LOCAL ] LH: Saving primary data. [2025-09-23T19:47:00.792885] [DEBUG] [LOCAL ] LH: Trimmed 54824 records to 38380 (keeping 200 days of data) [2025-09-23T19:47:01.012148] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-04. [2025-09-23T19:47:01.051320] [DEBUG] [LOCAL ] LH: Primary data saved (38380 records). [2025-09-23T19:47:01.051490] [INFO ] [MAIN ] LH: Full history saved. [2025-09-23T19:47:01.051629] [INFO ] [MAIN ] Update Progress: 1258/2372 symbols completed. LH took 28.4s. Estimated remaining: 2h 27m 51s. Rate: 7.5 symbols/min [2025-09-23T19:47:01.231609] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:47:01.239347] [DEBUG] [LOCAL ] LITB: Loaded 4300 existing records from primary storage. [2025-09-23T19:47:01.239491] [INFO ] [MAIN ] LITB: Loaded 4300 existing records. [2025-09-23T19:47:01.421783] [WARN ] [MAIN ] LITB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:47:01.422052] [INFO ] [MAIN ] LITB: Wiping existing primary data before full refresh. [2025-09-23T19:47:01.422101] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-09-23T19:47:01.422431] [DEBUG] [LOCAL ] LITB: Deleted primary data file. [2025-09-23T19:47:01.422492] [INFO ] [MAIN ] LITB: Starting full primary refresh. [2025-09-23T19:47:01.803613] [INFO ] [REMOTE ] LITB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:47:01.803766] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-04. [2025-09-23T19:47:02.029485] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-23T19:47:02.602176] [INFO ] [REMOTE ] LITB: Fetching primary data for 2024-12. [2025-09-23T19:47:02.658544] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-23T19:47:02.727591] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-23T19:47:03.067552] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-23T19:47:03.402196] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-05. [2025-09-23T19:47:04.202188] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-05. [2025-09-23T19:47:04.747360] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-23T19:47:05.002214] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-06. [2025-09-23T19:47:05.663974] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-23T19:47:05.802199] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-01. [2025-09-23T19:47:06.222241] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-23T19:47:06.340581] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-23T19:47:06.602227] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-02. [2025-09-23T19:47:07.055074] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-23T19:47:07.402207] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-03. [2025-09-23T19:47:08.035572] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-23T19:47:08.202174] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-04. [2025-09-23T19:47:08.754150] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-23T19:47:09.002224] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-07. [2025-09-23T19:47:09.802198] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-06. [2025-09-23T19:47:10.414918] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-23T19:47:10.602213] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-05. [2025-09-23T19:47:10.954160] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-23T19:47:11.084527] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-23T19:47:11.402187] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-06. [2025-09-23T19:47:12.202210] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-07. [2025-09-23T19:47:13.002173] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-06. [2025-09-23T19:47:13.287795] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-23T19:47:13.301830] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-09-23T19:47:13.534869] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-23T19:47:13.802213] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-08. [2025-09-23T19:47:14.602212] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-08. [2025-09-23T19:47:15.402207] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-07. [2025-09-23T19:47:15.440279] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-23T19:47:15.501687] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-23T19:47:15.866892] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-23T19:47:16.202209] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-09. [2025-09-23T19:47:17.002195] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-08. [2025-09-23T19:47:17.436572] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-23T19:47:17.665102] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-23T19:47:17.673262] [INFO ] [REMOTE ] LION: Full fetch complete (53823 records). [2025-09-23T19:47:17.673400] [DEBUG] [VALIDATOR ] LION: Validating primary data. [2025-09-23T19:47:17.807333] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-09. [2025-09-23T19:47:18.079202] [DEBUG] [VALIDATOR ] LION: All expected trading days are present. [2025-09-23T19:47:18.079309] [DEBUG] [VALIDATOR ] LION: Primary data validation passed. [2025-09-23T19:47:18.080192] [INFO ] [MAIN ] LION: Fetched primary data is valid. [2025-09-23T19:47:18.080253] [DEBUG] [LOCAL ] LION: Saving primary data. [2025-09-23T19:47:18.081621] [DEBUG] [LOCAL ] LION: Trimmed 53823 records to 43086 (keeping 200 days of data) [2025-09-23T19:47:18.326346] [DEBUG] [LOCAL ] LION: Primary data saved (43086 records). [2025-09-23T19:47:18.326482] [INFO ] [MAIN ] LION: Full history saved. [2025-09-23T19:47:18.326566] [INFO ] [MAIN ] Update Progress: 1259/2372 symbols completed. LION took 27.3s. Estimated remaining: 2h 27m 51s. Rate: 7.5 symbols/min [2025-09-23T19:47:18.513101] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:47:18.588546] [DEBUG] [LOCAL ] LLY: Loaded 53294 existing records from primary storage. [2025-09-23T19:47:18.588834] [INFO ] [MAIN ] LLY: Loaded 53294 existing records. [2025-09-23T19:47:18.608844] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-09. [2025-09-23T19:47:18.682107] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-23T19:47:18.749836] [INFO ] [REMOTE ] LITB: Full fetch complete (5566 records). [2025-09-23T19:47:18.760720] [DEBUG] [VALIDATOR ] LITB: Validating primary data. [2025-09-23T19:47:18.915554] [WARN ] [MAIN ] LLY: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:47:18.960049] [INFO ] [MAIN ] LLY: Wiping existing primary data before full refresh. [2025-09-23T19:47:18.960288] [INFO ] [LOCAL ] LLY: Starting deletion of primary data. [2025-09-23T19:47:18.970077] [DEBUG] [LOCAL ] LLY: Deleted primary data file. [2025-09-23T19:47:19.002497] [INFO ] [MAIN ] LLY: Starting full primary refresh. [2025-09-23T19:47:19.428924] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-07. [2025-09-23T19:47:19.918235] [INFO ] [REMOTE ] LLY: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:47:19.965051] [DEBUG] [VALIDATOR ] LITB: All expected trading days are present. [2025-09-23T19:47:19.965200] [DEBUG] [VALIDATOR ] LITB: Primary data validation passed. [2025-09-23T19:47:19.965455] [INFO ] [MAIN ] LITB: Fetched primary data is valid. [2025-09-23T19:47:19.965560] [DEBUG] [LOCAL ] LITB: Saving primary data. [2025-09-23T19:47:19.966327] [DEBUG] [LOCAL ] LITB: Trimmed 5566 records to 4327 (keeping 200 days of data) [2025-09-23T19:47:19.992401] [DEBUG] [LOCAL ] LITB: Primary data saved (4327 records). [2025-09-23T19:47:20.007167] [INFO ] [MAIN ] LITB: Full history saved. [2025-09-23T19:47:20.008486] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-23T19:47:20.008675] [INFO ] [MAIN ] Update Progress: 1260/2372 symbols completed. LITB took 19.0s. Estimated remaining: 2h 27m 38s. Rate: 7.5 symbols/min [2025-09-23T19:47:20.078821] [INFO ] [REMOTE ] LII: Full fetch complete (41241 records). [2025-09-23T19:47:20.106305] [DEBUG] [VALIDATOR ] LII: Validating primary data. [2025-09-23T19:47:20.203765] [INFO ] [REMOTE ] LLY: Fetching primary data for 2024-12. [2025-09-23T19:47:20.346106] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:47:20.611526] [DEBUG] [VALIDATOR ] LII: All expected trading days are present. [2025-09-23T19:47:20.611611] [DEBUG] [VALIDATOR ] LII: Primary data validation passed. [2025-09-23T19:47:20.612394] [INFO ] [MAIN ] LII: Fetched primary data is valid. [2025-09-23T19:47:20.612455] [DEBUG] [LOCAL ] LII: Saving primary data. [2025-09-23T19:47:20.613580] [DEBUG] [LOCAL ] LII: Trimmed 41241 records to 28428 (keeping 200 days of data) [2025-09-23T19:47:20.697878] [DEBUG] [LOCAL ] LMND: Loaded 51870 existing records from primary storage. [2025-09-23T19:47:20.728824] [INFO ] [MAIN ] LMND: Loaded 51870 existing records. [2025-09-23T19:47:20.989181] [WARN ] [MAIN ] LMND: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:47:21.002307] [INFO ] [MAIN ] LMND: Wiping existing primary data before full refresh. [2025-09-23T19:47:21.002734] [INFO ] [LOCAL ] LMND: Starting deletion of primary data. [2025-09-23T19:47:21.004799] [DEBUG] [LOCAL ] LII: Primary data saved (28428 records). [2025-09-23T19:47:21.005019] [INFO ] [MAIN ] LII: Full history saved. [2025-09-23T19:47:21.005140] [INFO ] [MAIN ] Update Progress: 1261/2372 symbols completed. LII took 37.7s. Estimated remaining: 2h 27m 24s. Rate: 7.5 symbols/min [2025-09-23T19:47:21.037520] [DEBUG] [LOCAL ] LMND: Deleted primary data file. [2025-09-23T19:47:21.061427] [INFO ] [MAIN ] LMND: Starting full primary refresh. [2025-09-23T19:47:21.315889] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:47:21.559825] [INFO ] [REMOTE ] LMND: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:47:21.560341] [INFO ] [REMOTE ] LMND: Fetching primary data for 2024-12. [2025-09-23T19:47:21.606466] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-23T19:47:21.638775] [DEBUG] [LOCAL ] LMT: Loaded 49955 existing records from primary storage. [2025-09-23T19:47:21.638928] [INFO ] [MAIN ] LMT: Loaded 49955 existing records. [2025-09-23T19:47:21.808837] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-08. [2025-09-23T19:47:21.822571] [WARN ] [MAIN ] LMT: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:47:21.822795] [INFO ] [MAIN ] LMT: Wiping existing primary data before full refresh. [2025-09-23T19:47:21.822843] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-09-23T19:47:21.824034] [DEBUG] [LOCAL ] LMT: Deleted primary data file. [2025-09-23T19:47:21.824095] [INFO ] [MAIN ] LMT: Starting full primary refresh. [2025-09-23T19:47:22.179131] [INFO ] [REMOTE ] LMT: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:47:22.328159] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-23T19:47:22.602207] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-01. [2025-09-23T19:47:23.171908] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-23T19:47:23.241519] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-23T19:47:23.402203] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-09. [2025-09-23T19:47:24.202186] [INFO ] [REMOTE ] LMT: Fetching primary data for 2024-12. [2025-09-23T19:47:24.762309] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-09-23T19:47:25.002196] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-02. [2025-09-23T19:47:25.212199] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-23T19:47:25.220090] [INFO ] [REMOTE ] LHX: Full fetch complete (70826 records). [2025-09-23T19:47:25.220255] [DEBUG] [VALIDATOR ] LHX: Validating primary data. [2025-09-23T19:47:25.608850] [DEBUG] [VALIDATOR ] LHX: All expected trading days are present. [2025-09-23T19:47:25.608935] [DEBUG] [VALIDATOR ] LHX: Primary data validation passed. [2025-09-23T19:47:25.609854] [INFO ] [MAIN ] LHX: Fetched primary data is valid. [2025-09-23T19:47:25.609919] [DEBUG] [LOCAL ] LHX: Saving primary data. [2025-09-23T19:47:25.611474] [DEBUG] [LOCAL ] LHX: Trimmed 70826 records to 48750 (keeping 200 days of data) [2025-09-23T19:47:25.807503] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-01. [2025-09-23T19:47:25.929083] [DEBUG] [LOCAL ] LHX: Primary data saved (48750 records). [2025-09-23T19:47:25.929492] [INFO ] [MAIN ] LHX: Full history saved. [2025-09-23T19:47:25.929733] [INFO ] [MAIN ] Update Progress: 1262/2372 symbols completed. LHX took 45.6s. Estimated remaining: 2h 27m 13s. Rate: 7.5 symbols/min [2025-09-23T19:47:26.104186] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:47:26.167415] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-23T19:47:26.192562] [DEBUG] [LOCAL ] LNC: Loaded 51637 existing records from primary storage. [2025-09-23T19:47:26.192707] [INFO ] [MAIN ] LNC: Loaded 51637 existing records. [2025-09-23T19:47:26.367879] [WARN ] [MAIN ] LNC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:47:26.368132] [INFO ] [MAIN ] LNC: Wiping existing primary data before full refresh. [2025-09-23T19:47:26.368188] [INFO ] [LOCAL ] LNC: Starting deletion of primary data. [2025-09-23T19:47:26.369281] [DEBUG] [LOCAL ] LNC: Deleted primary data file. [2025-09-23T19:47:26.369345] [INFO ] [MAIN ] LNC: Starting full primary refresh. [2025-09-23T19:47:26.610206] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-01. [2025-09-23T19:47:26.725155] [INFO ] [REMOTE ] LNC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:47:27.223304] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-09-23T19:47:27.327555] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-23T19:47:27.402144] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-02. [2025-09-23T19:47:28.202236] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-03. [2025-09-23T19:47:28.472071] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-23T19:47:28.844576] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-23T19:47:29.002158] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-03. [2025-09-23T19:47:29.802199] [INFO ] [REMOTE ] LNC: Fetching primary data for 2024-12. [2025-09-23T19:47:30.549003] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-09-23T19:47:30.602154] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-04. [2025-09-23T19:47:30.931285] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-23T19:47:31.408327] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-04. [2025-09-23T19:47:31.426187] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-23T19:47:32.202214] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-01. [2025-09-23T19:47:32.900906] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-23T19:47:32.964547] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-23T19:47:33.002182] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-05. [2025-09-23T19:47:33.802280] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-05. [2025-09-23T19:47:33.881745] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-23T19:47:34.575414] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-23T19:47:34.602153] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-06. [2025-09-23T19:47:35.402195] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-02. [2025-09-23T19:47:36.202227] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-02. [2025-09-23T19:47:36.651680] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-05 (2.85 seconds). [2025-09-23T19:47:36.799191] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-23T19:47:37.002242] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-07. [2025-09-23T19:47:37.056590] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-23T19:47:37.802245] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-03. [2025-09-23T19:47:37.862894] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-23T19:47:38.602238] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-06. [2025-09-23T19:47:39.115718] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-23T19:47:39.402192] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-08. [2025-09-23T19:47:40.028551] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-09-23T19:47:40.202201] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-03. [2025-09-23T19:47:40.911043] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-09-23T19:47:41.002533] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-07. [2025-09-23T19:47:41.524029] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-23T19:47:41.802228] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-09. [2025-09-23T19:47:42.206102] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-23T19:47:42.602222] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-04. [2025-09-23T19:47:43.402195] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-04. [2025-09-23T19:47:43.749563] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-07 (2.75 seconds). [2025-09-23T19:47:43.944424] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-23T19:47:43.953245] [INFO ] [REMOTE ] LMND: Full fetch complete (75269 records). [2025-09-23T19:47:43.953373] [DEBUG] [VALIDATOR ] LMND: Validating primary data. [2025-09-23T19:47:44.211544] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-08. [2025-09-23T19:47:44.364271] [DEBUG] [VALIDATOR ] LMND: All expected trading days are present. [2025-09-23T19:47:44.364378] [DEBUG] [VALIDATOR ] LMND: Primary data validation passed. [2025-09-23T19:47:44.365451] [INFO ] [MAIN ] LMND: Fetched primary data is valid. [2025-09-23T19:47:44.365531] [DEBUG] [LOCAL ] LMND: Saving primary data. [2025-09-23T19:47:44.367338] [DEBUG] [LOCAL ] LMND: Trimmed 75269 records to 51875 (keeping 200 days of data) [2025-09-23T19:47:44.490409] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-23T19:47:44.709127] [DEBUG] [LOCAL ] LMND: Primary data saved (51875 records). [2025-09-23T19:47:44.709267] [INFO ] [MAIN ] LMND: Full history saved. [2025-09-23T19:47:44.709353] [INFO ] [MAIN ] Update Progress: 1263/2372 symbols completed. LMND took 24.7s. Estimated remaining: 2h 27m 15s. Rate: 7.5 symbols/min [2025-09-23T19:47:44.879756] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:47:44.886478] [DEBUG] [LOCAL ] LND: Loaded 5026 existing records from primary storage. [2025-09-23T19:47:44.886594] [INFO ] [MAIN ] LND: Loaded 5026 existing records. [2025-09-23T19:47:45.007324] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-05. [2025-09-23T19:47:45.067866] [WARN ] [MAIN ] LND: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:47:45.068282] [INFO ] [MAIN ] LND: Wiping existing primary data before full refresh. [2025-09-23T19:47:45.068361] [INFO ] [LOCAL ] LND: Starting deletion of primary data. [2025-09-23T19:47:45.068850] [DEBUG] [LOCAL ] LND: Deleted primary data file. [2025-09-23T19:47:45.068911] [INFO ] [MAIN ] LND: Starting full primary refresh. [2025-09-23T19:47:45.435941] [INFO ] [REMOTE ] LND: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:47:45.465978] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-23T19:47:45.802194] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-05. [2025-09-23T19:47:46.569389] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-23T19:47:46.602146] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-06. [2025-09-23T19:47:47.119007] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-08 (2.91 seconds). [2025-09-23T19:47:47.402213] [INFO ] [REMOTE ] LND: Fetching primary data for 2024-12. [2025-09-23T19:47:47.862809] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-23T19:47:47.903895] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-23T19:47:48.202180] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-01. [2025-09-23T19:47:48.235801] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-23T19:47:48.687615] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-23T19:47:49.002221] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-07. [2025-09-23T19:47:49.802212] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-06. [2025-09-23T19:47:50.602198] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-09. [2025-09-23T19:47:50.762325] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-23T19:47:51.402327] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-08. [2025-09-23T19:47:51.848753] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-23T19:47:52.202195] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-02. [2025-09-23T19:47:52.891916] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-23T19:47:53.002194] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-07. [2025-09-23T19:47:53.142710] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-23T19:47:53.188483] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-09 (2.59 seconds). [2025-09-23T19:47:53.197555] [INFO ] [REMOTE ] LLY: Full fetch complete (77256 records). [2025-09-23T19:47:53.197752] [DEBUG] [VALIDATOR ] LLY: Validating primary data. [2025-09-23T19:47:53.614824] [DEBUG] [VALIDATOR ] LLY: All expected trading days are present. [2025-09-23T19:47:53.614910] [DEBUG] [VALIDATOR ] LLY: Primary data validation passed. [2025-09-23T19:47:53.615929] [INFO ] [MAIN ] LLY: Fetched primary data is valid. [2025-09-23T19:47:53.615994] [DEBUG] [LOCAL ] LLY: Saving primary data. [2025-09-23T19:47:53.617458] [DEBUG] [LOCAL ] LLY: Trimmed 77256 records to 53293 (keeping 200 days of data) [2025-09-23T19:47:53.804364] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-03. [2025-09-23T19:47:53.962275] [DEBUG] [LOCAL ] LLY: Primary data saved (53293 records). [2025-09-23T19:47:53.962418] [INFO ] [MAIN ] LLY: Full history saved. [2025-09-23T19:47:53.963636] [INFO ] [MAIN ] Update Progress: 1264/2372 symbols completed. LLY took 35.6s. Estimated remaining: 2h 27m 8s. Rate: 7.5 symbols/min [2025-09-23T19:47:54.133506] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:47:54.192041] [DEBUG] [LOCAL ] LNG: Loaded 51517 existing records from primary storage. [2025-09-23T19:47:54.192188] [INFO ] [MAIN ] LNG: Loaded 51517 existing records. [2025-09-23T19:47:54.369578] [WARN ] [MAIN ] LNG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:47:54.369835] [INFO ] [MAIN ] LNG: Wiping existing primary data before full refresh. [2025-09-23T19:47:54.369884] [INFO ] [LOCAL ] LNG: Starting deletion of primary data. [2025-09-23T19:47:54.371107] [DEBUG] [LOCAL ] LNG: Deleted primary data file. [2025-09-23T19:47:54.371168] [INFO ] [MAIN ] LNG: Starting full primary refresh. [2025-09-23T19:47:54.611848] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-09. [2025-09-23T19:47:54.657354] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-23T19:47:54.742858] [INFO ] [REMOTE ] LNG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:47:55.248546] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-23T19:47:55.402210] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-04. [2025-09-23T19:47:56.117753] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-23T19:47:56.202160] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-08. [2025-09-23T19:47:56.306447] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-23T19:47:56.315176] [INFO ] [REMOTE ] LNC: Full fetch complete (74007 records). [2025-09-23T19:47:56.315311] [DEBUG] [VALIDATOR ] LNC: Validating primary data. [2025-09-23T19:47:56.702766] [DEBUG] [VALIDATOR ] LNC: All expected trading days are present. [2025-09-23T19:47:56.702847] [DEBUG] [VALIDATOR ] LNC: Primary data validation passed. [2025-09-23T19:47:56.703795] [INFO ] [MAIN ] LNC: Fetched primary data is valid. [2025-09-23T19:47:56.703858] [DEBUG] [LOCAL ] LNC: Saving primary data. [2025-09-23T19:47:56.705255] [DEBUG] [LOCAL ] LNC: Trimmed 74007 records to 51637 (keeping 200 days of data) [2025-09-23T19:47:57.002986] [INFO ] [REMOTE ] LNG: Fetching primary data for 2024-12. [2025-09-23T19:47:57.024339] [DEBUG] [LOCAL ] LNC: Primary data saved (51637 records). [2025-09-23T19:47:57.024490] [INFO ] [MAIN ] LNC: Full history saved. [2025-09-23T19:47:57.024586] [INFO ] [MAIN ] Update Progress: 1265/2372 symbols completed. LNC took 31.1s. Estimated remaining: 2h 26m 56s. Rate: 7.5 symbols/min [2025-09-23T19:47:57.190509] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:47:57.203554] [DEBUG] [LOCAL ] LNN: Loaded 11247 existing records from primary storage. [2025-09-23T19:47:57.203701] [INFO ] [MAIN ] LNN: Loaded 11247 existing records. [2025-09-23T19:47:57.378918] [WARN ] [MAIN ] LNN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:47:57.379216] [INFO ] [MAIN ] LNN: Wiping existing primary data before full refresh. [2025-09-23T19:47:57.379274] [INFO ] [LOCAL ] LNN: Starting deletion of primary data. [2025-09-23T19:47:57.380008] [DEBUG] [LOCAL ] LNN: Deleted primary data file. [2025-09-23T19:47:57.380069] [INFO ] [MAIN ] LNN: Starting full primary refresh. [2025-09-23T19:47:57.733840] [INFO ] [REMOTE ] LNN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:47:57.802144] [INFO ] [REMOTE ] LNN: Fetching primary data for 2024-12. [2025-09-23T19:47:58.354578] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-23T19:47:58.454622] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-23T19:47:58.602154] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-01. [2025-09-23T19:47:58.744673] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-23T19:47:59.402215] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-05. [2025-09-23T19:48:00.044672] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-23T19:48:00.202166] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-01. [2025-09-23T19:48:00.385816] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-23T19:48:00.823691] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-23T19:48:01.002227] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-09. [2025-09-23T19:48:01.802264] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-06. [2025-09-23T19:48:02.602232] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-02. [2025-09-23T19:48:03.131893] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-23T19:48:03.402162] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-07. [2025-09-23T19:48:03.579974] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-09 (2.58 seconds). [2025-09-23T19:48:03.588300] [INFO ] [REMOTE ] LMT: Full fetch complete (72543 records). [2025-09-23T19:48:03.588422] [DEBUG] [VALIDATOR ] LMT: Validating primary data. [2025-09-23T19:48:03.986679] [DEBUG] [VALIDATOR ] LMT: All expected trading days are present. [2025-09-23T19:48:03.986849] [DEBUG] [VALIDATOR ] LMT: Primary data validation passed. [2025-09-23T19:48:03.987844] [INFO ] [MAIN ] LMT: Fetched primary data is valid. [2025-09-23T19:48:03.987911] [DEBUG] [LOCAL ] LMT: Saving primary data. [2025-09-23T19:48:03.989389] [DEBUG] [LOCAL ] LMT: Trimmed 72543 records to 49926 (keeping 200 days of data) [2025-09-23T19:48:04.213093] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-02. [2025-09-23T19:48:04.323554] [DEBUG] [LOCAL ] LMT: Primary data saved (49926 records). [2025-09-23T19:48:04.323748] [INFO ] [MAIN ] LMT: Full history saved. [2025-09-23T19:48:04.323849] [INFO ] [MAIN ] Update Progress: 1266/2372 symbols completed. LMT took 43.3s. Estimated remaining: 2h 26m 47s. Rate: 7.5 symbols/min [2025-09-23T19:48:04.447511] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-23T19:48:04.508441] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:48:04.548825] [DEBUG] [LOCAL ] LOAR: Loaded 41710 existing records from primary storage. [2025-09-23T19:48:04.548979] [INFO ] [MAIN ] LOAR: Loaded 41710 existing records. [2025-09-23T19:48:04.723699] [WARN ] [MAIN ] LOAR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:48:04.723983] [INFO ] [MAIN ] LOAR: Wiping existing primary data before full refresh. [2025-09-23T19:48:04.724031] [INFO ] [LOCAL ] LOAR: Starting deletion of primary data. [2025-09-23T19:48:04.725753] [DEBUG] [LOCAL ] LOAR: Deleted primary data file. [2025-09-23T19:48:04.725815] [INFO ] [MAIN ] LOAR: Starting full primary refresh. [2025-09-23T19:48:05.004852] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-08. [2025-09-23T19:48:05.073787] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-23T19:48:05.095561] [INFO ] [REMOTE ] LOAR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:48:05.407857] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-23T19:48:05.802190] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-03. [2025-09-23T19:48:06.149999] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-02 (3.55 seconds). [2025-09-23T19:48:06.596444] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-23T19:48:06.602154] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2024-12. [2025-09-23T19:48:07.402188] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-09. [2025-09-23T19:48:07.791292] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-23T19:48:08.202234] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-04. [2025-09-23T19:48:08.207760] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-23T19:48:08.208994] [INFO ] [REMOTE ] LND: Full fetch complete (8804 records). [2025-09-23T19:48:08.209062] [DEBUG] [VALIDATOR ] LND: Validating primary data. [2025-09-23T19:48:08.572335] [DEBUG] [VALIDATOR ] LND: All expected trading days are present. [2025-09-23T19:48:08.572425] [DEBUG] [VALIDATOR ] LND: Primary data validation passed. [2025-09-23T19:48:08.572667] [INFO ] [MAIN ] LND: Fetched primary data is valid. [2025-09-23T19:48:08.572729] [DEBUG] [LOCAL ] LND: Saving primary data. [2025-09-23T19:48:08.573195] [DEBUG] [LOCAL ] LND: Trimmed 8804 records to 4996 (keeping 200 days of data) [2025-09-23T19:48:08.605804] [DEBUG] [LOCAL ] LND: Primary data saved (4996 records). [2025-09-23T19:48:08.605959] [INFO ] [MAIN ] LND: Full history saved. [2025-09-23T19:48:08.606048] [INFO ] [MAIN ] Update Progress: 1267/2372 symbols completed. LND took 23.9s. Estimated remaining: 2h 26m 36s. Rate: 7.5 symbols/min [2025-09-23T19:48:08.777157] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:48:08.804826] [DEBUG] [LOCAL ] LOB: Loaded 27551 existing records from primary storage. [2025-09-23T19:48:08.804970] [INFO ] [MAIN ] LOB: Loaded 27551 existing records. [2025-09-23T19:48:08.981212] [WARN ] [MAIN ] LOB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:48:08.981470] [INFO ] [MAIN ] LOB: Wiping existing primary data before full refresh. [2025-09-23T19:48:08.981517] [INFO ] [LOCAL ] LOB: Starting deletion of primary data. [2025-09-23T19:48:08.982422] [DEBUG] [LOCAL ] LOB: Deleted primary data file. [2025-09-23T19:48:08.982510] [INFO ] [MAIN ] LOB: Starting full primary refresh. [2025-09-23T19:48:09.011347] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-01. [2025-09-23T19:48:09.329386] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-23T19:48:09.374446] [INFO ] [REMOTE ] LOB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:48:09.802193] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-05. [2025-09-23T19:48:10.317140] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-23T19:48:10.602249] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-02. [2025-09-23T19:48:10.695196] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-23T19:48:11.402276] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-03. [2025-09-23T19:48:11.843623] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-23T19:48:12.202223] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-06. [2025-09-23T19:48:13.002212] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-03. [2025-09-23T19:48:13.229672] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-23T19:48:13.259774] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-23T19:48:13.802207] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-07. [2025-09-23T19:48:14.223516] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-23T19:48:14.602182] [INFO ] [REMOTE ] LOB: Fetching primary data for 2024-12. [2025-09-23T19:48:14.738941] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-23T19:48:15.402202] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-04. [2025-09-23T19:48:15.762219] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-23T19:48:16.202193] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-08. [2025-09-23T19:48:17.002213] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-01. [2025-09-23T19:48:17.647173] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-23T19:48:17.802243] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-09. [2025-09-23T19:48:18.052345] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-04 (2.65 seconds). [2025-09-23T19:48:18.095661] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-23T19:48:18.602175] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-02. [2025-09-23T19:48:18.663082] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-23T19:48:18.665713] [INFO ] [REMOTE ] LNN: Full fetch complete (15543 records). [2025-09-23T19:48:18.665836] [DEBUG] [VALIDATOR ] LNN: Validating primary data. [2025-09-23T19:48:19.045128] [DEBUG] [VALIDATOR ] LNN: All expected trading days are present. [2025-09-23T19:48:19.045317] [DEBUG] [VALIDATOR ] LNN: Primary data validation passed. [2025-09-23T19:48:19.046183] [INFO ] [MAIN ] LNN: Fetched primary data is valid. [2025-09-23T19:48:19.046259] [DEBUG] [LOCAL ] LNN: Saving primary data. [2025-09-23T19:48:19.047218] [DEBUG] [LOCAL ] LNN: Trimmed 15543 records to 11243 (keeping 200 days of data) [2025-09-23T19:48:19.131620] [DEBUG] [LOCAL ] LNN: Primary data saved (11243 records). [2025-09-23T19:48:19.131797] [INFO ] [MAIN ] LNN: Full history saved. [2025-09-23T19:48:19.131905] [INFO ] [MAIN ] Update Progress: 1268/2372 symbols completed. LNN took 22.1s. Estimated remaining: 2h 26m 30s. Rate: 7.5 symbols/min [2025-09-23T19:48:19.313717] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:48:19.320130] [DEBUG] [LOCAL ] LOCL: Loaded 3572 existing records from primary storage. [2025-09-23T19:48:19.320252] [INFO ] [MAIN ] LOCL: Loaded 3572 existing records. [2025-09-23T19:48:19.409086] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-04. [2025-09-23T19:48:19.515676] [WARN ] [MAIN ] LOCL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:48:19.516059] [INFO ] [MAIN ] LOCL: Wiping existing primary data before full refresh. [2025-09-23T19:48:19.516136] [INFO ] [LOCAL ] LOCL: Starting deletion of primary data. [2025-09-23T19:48:19.531307] [DEBUG] [LOCAL ] LOCL: Deleted primary data file. [2025-09-23T19:48:19.532036] [INFO ] [MAIN ] LOCL: Starting full primary refresh. [2025-09-23T19:48:19.531968] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-23T19:48:19.906229] [INFO ] [REMOTE ] LOCL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:48:20.202191] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-05. [2025-09-23T19:48:21.002179] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-03. [2025-09-23T19:48:21.092786] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-23T19:48:21.704081] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-23T19:48:21.802229] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2024-12. [2025-09-23T19:48:22.428857] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-23T19:48:22.580035] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-23T19:48:22.602157] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-01. [2025-09-23T19:48:23.035310] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-23T19:48:23.402194] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-04. [2025-09-23T19:48:24.202183] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-06. [2025-09-23T19:48:24.819697] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-23T19:48:25.002223] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-05. [2025-09-23T19:48:25.802186] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-05. [2025-09-23T19:48:26.113262] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-23T19:48:26.141485] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-23T19:48:26.602197] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-06. [2025-09-23T19:48:27.246824] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-23T19:48:27.318792] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-23T19:48:27.402197] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-06. [2025-09-23T19:48:28.202179] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-07. [2025-09-23T19:48:29.002182] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-02. [2025-09-23T19:48:29.076071] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-23T19:48:29.140048] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-23T19:48:29.356410] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-23T19:48:29.802195] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-07. [2025-09-23T19:48:30.602411] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-08. [2025-09-23T19:48:31.402199] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-03. [2025-09-23T19:48:32.017247] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-23T19:48:32.202246] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-07. [2025-09-23T19:48:32.435783] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-23T19:48:32.936179] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-09-23T19:48:33.002174] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-09. [2025-09-23T19:48:33.802160] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-04. [2025-09-23T19:48:33.991383] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-23T19:48:34.033789] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-23T19:48:34.038717] [INFO ] [REMOTE ] LOB: Full fetch complete (37589 records). [2025-09-23T19:48:34.038859] [DEBUG] [VALIDATOR ] LOB: Validating primary data. [2025-09-23T19:48:34.411822] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-23T19:48:34.428586] [DEBUG] [VALIDATOR ] LOB: All expected trading days are present. [2025-09-23T19:48:34.428638] [DEBUG] [VALIDATOR ] LOB: Primary data validation passed. [2025-09-23T19:48:34.429334] [INFO ] [MAIN ] LOB: Fetched primary data is valid. [2025-09-23T19:48:34.429461] [DEBUG] [LOCAL ] LOB: Saving primary data. [2025-09-23T19:48:34.430344] [DEBUG] [LOCAL ] LOB: Trimmed 37589 records to 27535 (keeping 200 days of data) [2025-09-23T19:48:34.603048] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-08. [2025-09-23T19:48:34.610901] [DEBUG] [LOCAL ] LOB: Primary data saved (27535 records). [2025-09-23T19:48:34.610984] [INFO ] [MAIN ] LOB: Full history saved. [2025-09-23T19:48:34.611116] [INFO ] [MAIN ] Update Progress: 1269/2372 symbols completed. LOB took 26.0s. Estimated remaining: 2h 26m 29s. Rate: 7.5 symbols/min [2025-09-23T19:48:34.794244] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:48:34.834033] [DEBUG] [LOCAL ] LOMA: Loaded 31689 existing records from primary storage. [2025-09-23T19:48:34.834171] [INFO ] [MAIN ] LOMA: Loaded 31689 existing records. [2025-09-23T19:48:35.012504] [WARN ] [MAIN ] LOMA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:48:35.012872] [INFO ] [MAIN ] LOMA: Wiping existing primary data before full refresh. [2025-09-23T19:48:35.012939] [INFO ] [LOCAL ] LOMA: Starting deletion of primary data. [2025-09-23T19:48:35.013805] [DEBUG] [LOCAL ] LOMA: Deleted primary data file. [2025-09-23T19:48:35.013883] [INFO ] [MAIN ] LOMA: Starting full primary refresh. [2025-09-23T19:48:35.366229] [INFO ] [REMOTE ] LOMA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:48:35.402140] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2024-12. [2025-09-23T19:48:36.202206] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-08. [2025-09-23T19:48:36.500581] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-23T19:48:36.887001] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-23T19:48:37.002152] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-01. [2025-09-23T19:48:37.354399] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-23T19:48:37.802224] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-05. [2025-09-23T19:48:38.424259] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-23T19:48:38.450118] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-23T19:48:38.602203] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-09. [2025-09-23T19:48:39.402204] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-02. [2025-09-23T19:48:40.202171] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-09. [2025-09-23T19:48:40.643536] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-23T19:48:40.713346] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-23T19:48:40.722134] [INFO ] [REMOTE ] LNG: Full fetch complete (74690 records). [2025-09-23T19:48:40.722324] [DEBUG] [VALIDATOR ] LNG: Validating primary data. [2025-09-23T19:48:41.007321] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-06. [2025-09-23T19:48:41.132540] [DEBUG] [VALIDATOR ] LNG: All expected trading days are present. [2025-09-23T19:48:41.132635] [DEBUG] [VALIDATOR ] LNG: Primary data validation passed. [2025-09-23T19:48:41.133611] [INFO ] [MAIN ] LNG: Fetched primary data is valid. [2025-09-23T19:48:41.133692] [DEBUG] [LOCAL ] LNG: Saving primary data. [2025-09-23T19:48:41.135278] [DEBUG] [LOCAL ] LNG: Trimmed 74690 records to 51508 (keeping 200 days of data) [2025-09-23T19:48:41.487103] [DEBUG] [LOCAL ] LNG: Primary data saved (51508 records). [2025-09-23T19:48:41.487376] [INFO ] [MAIN ] LNG: Full history saved. [2025-09-23T19:48:41.489742] [INFO ] [MAIN ] Update Progress: 1270/2372 symbols completed. LNG took 47.5s. Estimated remaining: 2h 26m 20s. Rate: 7.5 symbols/min [2025-09-23T19:48:41.567233] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-23T19:48:41.675596] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:48:41.734112] [DEBUG] [LOCAL ] LOW: Loaded 52956 existing records from primary storage. [2025-09-23T19:48:41.734268] [INFO ] [MAIN ] LOW: Loaded 52956 existing records. [2025-09-23T19:48:41.807252] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-03. [2025-09-23T19:48:41.937820] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-23T19:48:41.941814] [WARN ] [MAIN ] LOW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:48:41.949600] [INFO ] [MAIN ] LOW: Wiping existing primary data before full refresh. [2025-09-23T19:48:41.949723] [INFO ] [LOCAL ] LOW: Starting deletion of primary data. [2025-09-23T19:48:41.949911] [INFO ] [REMOTE ] LOAR: Full fetch complete (56365 records). [2025-09-23T19:48:41.949992] [DEBUG] [VALIDATOR ] LOAR: Validating primary data. [2025-09-23T19:48:41.985333] [DEBUG] [LOCAL ] LOW: Deleted primary data file. [2025-09-23T19:48:42.031101] [INFO ] [MAIN ] LOW: Starting full primary refresh. [2025-09-23T19:48:42.625265] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-07. [2025-09-23T19:48:42.720134] [DEBUG] [VALIDATOR ] LOAR: All expected trading days are present. [2025-09-23T19:48:42.720286] [DEBUG] [VALIDATOR ] LOAR: Primary data validation passed. [2025-09-23T19:48:42.746318] [INFO ] [MAIN ] LOAR: Fetched primary data is valid. [2025-09-23T19:48:42.752311] [INFO ] [REMOTE ] LOW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:48:42.752407] [DEBUG] [LOCAL ] LOAR: Saving primary data. [2025-09-23T19:48:42.755426] [DEBUG] [LOCAL ] LOAR: Trimmed 56365 records to 41777 (keeping 200 days of data) [2025-09-23T19:48:43.027638] [DEBUG] [LOCAL ] LOAR: Primary data saved (41777 records). [2025-09-23T19:48:43.028123] [INFO ] [MAIN ] LOAR: Full history saved. [2025-09-23T19:48:43.028367] [INFO ] [MAIN ] Update Progress: 1271/2372 symbols completed. LOAR took 38.7s. Estimated remaining: 2h 26m 6s. Rate: 7.5 symbols/min [2025-09-23T19:48:43.212616] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-23T19:48:43.216007] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:48:43.237032] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-23T19:48:43.279673] [DEBUG] [LOCAL ] LPG: Loaded 40243 existing records from primary storage. [2025-09-23T19:48:43.279825] [INFO ] [MAIN ] LPG: Loaded 40243 existing records. [2025-09-23T19:48:43.417208] [INFO ] [REMOTE ] LOW: Fetching primary data for 2024-12. [2025-09-23T19:48:43.459227] [WARN ] [MAIN ] LPG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:48:43.459705] [INFO ] [MAIN ] LPG: Wiping existing primary data before full refresh. [2025-09-23T19:48:43.459786] [INFO ] [LOCAL ] LPG: Starting deletion of primary data. [2025-09-23T19:48:43.461242] [DEBUG] [LOCAL ] LPG: Deleted primary data file. [2025-09-23T19:48:43.461309] [INFO ] [MAIN ] LPG: Starting full primary refresh. [2025-09-23T19:48:43.832015] [INFO ] [REMOTE ] LPG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:48:44.202184] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-04. [2025-09-23T19:48:45.002175] [INFO ] [REMOTE ] LPG: Fetching primary data for 2024-12. [2025-09-23T19:48:45.291756] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-23T19:48:45.504403] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-23T19:48:45.802202] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-01. [2025-09-23T19:48:46.561892] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-23T19:48:46.602179] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-01. [2025-09-23T19:48:47.402183] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-08. [2025-09-23T19:48:47.689635] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-23T19:48:47.710905] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-23T19:48:48.135894] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-23T19:48:48.202138] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-02. [2025-09-23T19:48:49.002227] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-05. [2025-09-23T19:48:49.802206] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-02. [2025-09-23T19:48:49.948835] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-23T19:48:50.268492] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-23T19:48:50.602245] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-09. [2025-09-23T19:48:51.314424] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-23T19:48:51.319172] [INFO ] [REMOTE ] LOCL: Full fetch complete (4829 records). [2025-09-23T19:48:51.319049] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-23T19:48:51.328764] [DEBUG] [VALIDATOR ] LOCL: Validating primary data. [2025-09-23T19:48:51.407272] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-03. [2025-09-23T19:48:51.753038] [DEBUG] [VALIDATOR ] LOCL: All expected trading days are present. [2025-09-23T19:48:51.753127] [DEBUG] [VALIDATOR ] LOCL: Primary data validation passed. [2025-09-23T19:48:51.753265] [INFO ] [MAIN ] LOCL: Fetched primary data is valid. [2025-09-23T19:48:51.753301] [DEBUG] [LOCAL ] LOCL: Saving primary data. [2025-09-23T19:48:51.753711] [DEBUG] [LOCAL ] LOCL: Trimmed 4829 records to 3584 (keeping 200 days of data) [2025-09-23T19:48:51.777773] [DEBUG] [LOCAL ] LOCL: Primary data saved (3584 records). [2025-09-23T19:48:51.777867] [INFO ] [MAIN ] LOCL: Full history saved. [2025-09-23T19:48:51.777964] [INFO ] [MAIN ] Update Progress: 1272/2372 symbols completed. LOCL took 32.6s. Estimated remaining: 2h 25m 59s. Rate: 7.5 symbols/min [2025-09-23T19:48:51.961688] [INFO ] [MAIN ] LPL: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:48:51.996251] [DEBUG] [LOCAL ] LPL: Loaded 25401 existing records from primary storage. [2025-09-23T19:48:51.996395] [INFO ] [MAIN ] LPL: Loaded 25401 existing records. [2025-09-23T19:48:52.178438] [WARN ] [MAIN ] LPL: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:48:52.178771] [INFO ] [MAIN ] LPL: Wiping existing primary data before full refresh. [2025-09-23T19:48:52.178827] [INFO ] [LOCAL ] LPL: Starting deletion of primary data. [2025-09-23T19:48:52.179678] [DEBUG] [LOCAL ] LPL: Deleted primary data file. [2025-09-23T19:48:52.179741] [INFO ] [MAIN ] LPL: Starting full primary refresh. [2025-09-23T19:48:52.210628] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-03. [2025-09-23T19:48:52.544348] [INFO ] [REMOTE ] LPL: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:48:53.002172] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-06. [2025-09-23T19:48:53.335678] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-23T19:48:53.439001] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-23T19:48:53.802269] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-04. [2025-09-23T19:48:54.235631] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-23T19:48:54.602215] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-07. [2025-09-23T19:48:55.402251] [INFO ] [REMOTE ] LPL: Fetching primary data for 2024-12. [2025-09-23T19:48:55.697603] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-23T19:48:55.804029] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-23T19:48:56.199959] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-23T19:48:56.205369] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-01. [2025-09-23T19:48:57.002198] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-08. [2025-09-23T19:48:57.245499] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-23T19:48:57.802199] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-05. [2025-09-23T19:48:57.988064] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-23T19:48:58.602211] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-09. [2025-09-23T19:48:59.402200] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-04. [2025-09-23T19:48:59.740240] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-23T19:49:00.085493] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-23T19:49:00.092776] [INFO ] [REMOTE ] LOMA: Full fetch complete (48080 records). [2025-09-23T19:49:00.092918] [DEBUG] [VALIDATOR ] LOMA: Validating primary data. [2025-09-23T19:49:00.207271] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-06. [2025-09-23T19:49:00.481031] [DEBUG] [VALIDATOR ] LOMA: All expected trading days are present. [2025-09-23T19:49:00.481120] [DEBUG] [VALIDATOR ] LOMA: Primary data validation passed. [2025-09-23T19:49:00.481975] [INFO ] [MAIN ] LOMA: Fetched primary data is valid. [2025-09-23T19:49:00.482042] [DEBUG] [LOCAL ] LOMA: Saving primary data. [2025-09-23T19:49:00.483198] [DEBUG] [LOCAL ] LOMA: Trimmed 48080 records to 31837 (keeping 200 days of data) [2025-09-23T19:49:00.667976] [DEBUG] [LOCAL ] LOMA: Primary data saved (31837 records). [2025-09-23T19:49:00.668122] [INFO ] [MAIN ] LOMA: Full history saved. [2025-09-23T19:49:00.668222] [INFO ] [MAIN ] Update Progress: 1273/2372 symbols completed. LOMA took 26.1s. Estimated remaining: 2h 25m 52s. Rate: 7.5 symbols/min [2025-09-23T19:49:00.846292] [INFO ] [MAIN ] LPX: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:49:00.888274] [DEBUG] [LOCAL ] LPX: Loaded 39748 existing records from primary storage. [2025-09-23T19:49:00.888447] [INFO ] [MAIN ] LPX: Loaded 39748 existing records. [2025-09-23T19:49:01.002741] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-02. [2025-09-23T19:49:01.075514] [WARN ] [MAIN ] LPX: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:49:01.075901] [INFO ] [MAIN ] LPX: Wiping existing primary data before full refresh. [2025-09-23T19:49:01.076063] [INFO ] [LOCAL ] LPX: Starting deletion of primary data. [2025-09-23T19:49:01.085107] [DEBUG] [LOCAL ] LPX: Deleted primary data file. [2025-09-23T19:49:01.100581] [INFO ] [MAIN ] LPX: Starting full primary refresh. [2025-09-23T19:49:01.153854] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-23T19:49:01.506718] [INFO ] [REMOTE ] LPX: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:49:01.802295] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-05. [2025-09-23T19:49:02.190928] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-23T19:49:02.215212] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-23T19:49:02.602246] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-07. [2025-09-23T19:49:03.402225] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-03. [2025-09-23T19:49:03.467718] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-23T19:49:04.207520] [INFO ] [REMOTE ] LPX: Fetching primary data for 2024-12. [2025-09-23T19:49:04.219622] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-23T19:49:04.754109] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-23T19:49:05.002320] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-04. [2025-09-23T19:49:05.718117] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-23T19:49:05.802228] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-01. [2025-09-23T19:49:06.004981] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-23T19:49:06.602238] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-05. [2025-09-23T19:49:07.402216] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-06. [2025-09-23T19:49:07.662972] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-23T19:49:07.664971] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-23T19:49:08.202233] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-06. [2025-09-23T19:49:08.565144] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-23T19:49:08.845075] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-23T19:49:09.002212] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-07. [2025-09-23T19:49:09.802339] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-02. [2025-09-23T19:49:10.218168] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-23T19:49:10.602222] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-07. [2025-09-23T19:49:11.043301] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-23T19:49:11.402210] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-08. [2025-09-23T19:49:11.837752] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-23T19:49:12.202204] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-03. [2025-09-23T19:49:12.913060] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-23T19:49:13.002256] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-08. [2025-09-23T19:49:13.730164] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-23T19:49:13.802169] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-04. [2025-09-23T19:49:14.562438] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-23T19:49:14.602173] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-09. [2025-09-23T19:49:15.245672] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-23T19:49:15.402198] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-05. [2025-09-23T19:49:16.071477] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-23T19:49:16.078137] [INFO ] [REMOTE ] LPL: Full fetch complete (34464 records). [2025-09-23T19:49:16.078237] [DEBUG] [VALIDATOR ] LPL: Validating primary data. [2025-09-23T19:49:16.207269] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-08. [2025-09-23T19:49:16.464539] [DEBUG] [VALIDATOR ] LPL: All expected trading days are present. [2025-09-23T19:49:16.464666] [DEBUG] [VALIDATOR ] LPL: Primary data validation passed. [2025-09-23T19:49:16.465425] [INFO ] [MAIN ] LPL: Fetched primary data is valid. [2025-09-23T19:49:16.465488] [DEBUG] [LOCAL ] LPL: Saving primary data. [2025-09-23T19:49:16.466420] [DEBUG] [LOCAL ] LPL: Trimmed 34464 records to 25591 (keeping 200 days of data) [2025-09-23T19:49:16.620301] [DEBUG] [LOCAL ] LPL: Primary data saved (25591 records). [2025-09-23T19:49:16.620449] [INFO ] [MAIN ] LPL: Full history saved. [2025-09-23T19:49:16.620540] [INFO ] [MAIN ] Update Progress: 1274/2372 symbols completed. LPL took 24.8s. Estimated remaining: 2h 25m 51s. Rate: 7.5 symbols/min [2025-09-23T19:49:16.792069] [INFO ] [MAIN ] LRN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:49:16.838063] [DEBUG] [LOCAL ] LRN: Loaded 40065 existing records from primary storage. [2025-09-23T19:49:16.838293] [INFO ] [MAIN ] LRN: Loaded 40065 existing records. [2025-09-23T19:49:17.002982] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-09. [2025-09-23T19:49:17.056992] [WARN ] [MAIN ] LRN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:49:17.057392] [INFO ] [MAIN ] LRN: Wiping existing primary data before full refresh. [2025-09-23T19:49:17.057777] [INFO ] [LOCAL ] LRN: Starting deletion of primary data. [2025-09-23T19:49:17.061638] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-23T19:49:17.062067] [DEBUG] [LOCAL ] LRN: Deleted primary data file. [2025-09-23T19:49:17.071879] [INFO ] [MAIN ] LRN: Starting full primary refresh. [2025-09-23T19:49:17.425130] [INFO ] [REMOTE ] LRN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:49:17.802230] [INFO ] [REMOTE ] LRN: Fetching primary data for 2024-12. [2025-09-23T19:49:18.216900] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-23T19:49:18.607560] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-09. [2025-09-23T19:49:18.619977] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-23T19:49:18.627004] [INFO ] [REMOTE ] LPG: Full fetch complete (59993 records). [2025-09-23T19:49:18.627109] [DEBUG] [VALIDATOR ] LPG: Validating primary data. [2025-09-23T19:49:19.022135] [DEBUG] [VALIDATOR ] LPG: All expected trading days are present. [2025-09-23T19:49:19.022321] [DEBUG] [VALIDATOR ] LPG: Primary data validation passed. [2025-09-23T19:49:19.023319] [INFO ] [MAIN ] LPG: Fetched primary data is valid. [2025-09-23T19:49:19.023438] [DEBUG] [LOCAL ] LPG: Saving primary data. [2025-09-23T19:49:19.041757] [DEBUG] [LOCAL ] LPG: Trimmed 59993 records to 40171 (keeping 200 days of data) [2025-09-23T19:49:19.046524] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-23T19:49:19.306167] [DEBUG] [LOCAL ] LPG: Primary data saved (40171 records). [2025-09-23T19:49:19.306305] [INFO ] [MAIN ] LPG: Full history saved. [2025-09-23T19:49:19.306387] [INFO ] [MAIN ] Update Progress: 1275/2372 symbols completed. LPG took 36.3s. Estimated remaining: 2h 25m 38s. Rate: 7.5 symbols/min [2025-09-23T19:49:19.406002] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-06. [2025-09-23T19:49:19.477906] [INFO ] [MAIN ] LSPD: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:49:19.522036] [DEBUG] [LOCAL ] LSPD: Loaded 43453 existing records from primary storage. [2025-09-23T19:49:19.522265] [INFO ] [MAIN ] LSPD: Loaded 43453 existing records. [2025-09-23T19:49:19.700953] [WARN ] [MAIN ] LSPD: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:49:19.701208] [INFO ] [MAIN ] LSPD: Wiping existing primary data before full refresh. [2025-09-23T19:49:19.701257] [INFO ] [LOCAL ] LSPD: Starting deletion of primary data. [2025-09-23T19:49:19.702281] [DEBUG] [LOCAL ] LSPD: Deleted primary data file. [2025-09-23T19:49:19.702344] [INFO ] [MAIN ] LSPD: Starting full primary refresh. [2025-09-23T19:49:20.057932] [INFO ] [REMOTE ] LSPD: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:49:20.202247] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-01. [2025-09-23T19:49:20.350816] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-23T19:49:20.359559] [INFO ] [REMOTE ] LOW: Full fetch complete (76476 records). [2025-09-23T19:49:20.359733] [DEBUG] [VALIDATOR ] LOW: Validating primary data. [2025-09-23T19:49:20.752038] [DEBUG] [VALIDATOR ] LOW: All expected trading days are present. [2025-09-23T19:49:20.752146] [DEBUG] [VALIDATOR ] LOW: Primary data validation passed. [2025-09-23T19:49:20.753182] [INFO ] [MAIN ] LOW: Fetched primary data is valid. [2025-09-23T19:49:20.753288] [DEBUG] [LOCAL ] LOW: Saving primary data. [2025-09-23T19:49:20.755062] [DEBUG] [LOCAL ] LOW: Trimmed 76476 records to 52961 (keeping 200 days of data) [2025-09-23T19:49:20.886742] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-23T19:49:21.023136] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-07. [2025-09-23T19:49:21.144748] [DEBUG] [LOCAL ] LOW: Primary data saved (52961 records). [2025-09-23T19:49:21.144924] [INFO ] [MAIN ] LOW: Full history saved. [2025-09-23T19:49:21.145050] [INFO ] [MAIN ] Update Progress: 1276/2372 symbols completed. LOW took 39.7s. Estimated remaining: 2h 25m 25s. Rate: 7.5 symbols/min [2025-09-23T19:49:21.311833] [INFO ] [MAIN ] LTC: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:49:21.342636] [DEBUG] [LOCAL ] LTC: Loaded 29864 existing records from primary storage. [2025-09-23T19:49:21.342824] [INFO ] [MAIN ] LTC: Loaded 29864 existing records. [2025-09-23T19:49:21.531140] [WARN ] [MAIN ] LTC: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:49:21.531503] [INFO ] [MAIN ] LTC: Wiping existing primary data before full refresh. [2025-09-23T19:49:21.531585] [INFO ] [LOCAL ] LTC: Starting deletion of primary data. [2025-09-23T19:49:21.532480] [DEBUG] [LOCAL ] LTC: Deleted primary data file. [2025-09-23T19:49:21.532549] [INFO ] [MAIN ] LTC: Starting full primary refresh. [2025-09-23T19:49:21.812517] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2024-12. [2025-09-23T19:49:21.859425] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-23T19:49:21.951977] [INFO ] [REMOTE ] LTC: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:49:22.163502] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-23T19:49:22.602213] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-02. [2025-09-23T19:49:23.311332] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-23T19:49:23.402185] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-01. [2025-09-23T19:49:24.104247] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-23T19:49:24.202191] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-03. [2025-09-23T19:49:24.818444] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-23T19:49:25.002185] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-02. [2025-09-23T19:49:25.769325] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-23T19:49:25.802145] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-04. [2025-09-23T19:49:26.209851] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-23T19:49:26.602196] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-03. [2025-09-23T19:49:27.076792] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-23T19:49:27.402228] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-05. [2025-09-23T19:49:28.202263] [INFO ] [REMOTE ] LTC: Fetching primary data for 2024-12. [2025-09-23T19:49:28.261635] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-23T19:49:29.002221] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-04. [2025-09-23T19:49:29.039394] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-23T19:49:29.542240] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-23T19:49:29.802245] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-06. [2025-09-23T19:49:30.602202] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-08. [2025-09-23T19:49:31.402202] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-01. [2025-09-23T19:49:31.479859] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-23T19:49:32.202209] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-07. [2025-09-23T19:49:33.636066] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-23T19:49:33.645899] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-08. [2025-09-23T19:49:34.208707] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-04 (5.21 seconds). [2025-09-23T19:49:34.219422] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-05. [2025-09-23T19:49:35.188734] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-23T19:49:35.198151] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-09. [2025-09-23T19:49:36.090861] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-08 (5.49 seconds). [2025-09-23T19:49:36.100728] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-09. [2025-09-23T19:49:37.056386] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-01 (5.65 seconds). [2025-09-23T19:49:37.064180] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-02. [2025-09-23T19:49:37.619079] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-23T19:49:37.626759] [INFO ] [REMOTE ] LPX: Full fetch complete (58399 records). [2025-09-23T19:49:37.626978] [DEBUG] [VALIDATOR ] LPX: Validating primary data. [2025-09-23T19:49:38.054155] [DEBUG] [VALIDATOR ] LPX: All expected trading days are present. [2025-09-23T19:49:38.054462] [DEBUG] [VALIDATOR ] LPX: Primary data validation passed. [2025-09-23T19:49:38.055948] [INFO ] [MAIN ] LPX: Fetched primary data is valid. [2025-09-23T19:49:38.056048] [DEBUG] [LOCAL ] LPX: Saving primary data. [2025-09-23T19:49:38.087567] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-05 (3.87 seconds). [2025-09-23T19:49:38.097234] [DEBUG] [LOCAL ] LPX: Trimmed 58399 records to 39673 (keeping 200 days of data) [2025-09-23T19:49:38.098958] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-06. [2025-09-23T19:49:38.379212] [DEBUG] [LOCAL ] LPX: Primary data saved (39673 records). [2025-09-23T19:49:38.379474] [INFO ] [MAIN ] LPX: Full history saved. [2025-09-23T19:49:38.379596] [INFO ] [MAIN ] Update Progress: 1277/2372 symbols completed. LPX took 37.7s. Estimated remaining: 2h 25m 25s. Rate: 7.5 symbols/min [2025-09-23T19:49:38.542185] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-09 (3.34 seconds). [2025-09-23T19:49:38.551185] [INFO ] [REMOTE ] LRN: Full fetch complete (58396 records). [2025-09-23T19:49:38.551391] [DEBUG] [VALIDATOR ] LRN: Validating primary data. [2025-09-23T19:49:38.988980] [DEBUG] [VALIDATOR ] LRN: All expected trading days are present. [2025-09-23T19:49:38.988771] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-23T19:49:38.995100] [DEBUG] [VALIDATOR ] LRN: Primary data validation passed. [2025-09-23T19:49:38.996017] [INFO ] [MAIN ] LRN: Fetched primary data is valid. [2025-09-23T19:49:38.996104] [DEBUG] [LOCAL ] LRN: Saving primary data. [2025-09-23T19:49:38.996580] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-03. [2025-09-23T19:49:38.998291] [DEBUG] [LOCAL ] LRN: Trimmed 58396 records to 40031 (keeping 200 days of data) [2025-09-23T19:49:39.253077] [DEBUG] [LOCAL ] LRN: Primary data saved (40031 records). [2025-09-23T19:49:39.253214] [INFO ] [MAIN ] LRN: Full history saved. [2025-09-23T19:49:39.253298] [INFO ] [MAIN ] Update Progress: 1278/2372 symbols completed. LRN took 22.6s. Estimated remaining: 2h 25m 11s. Rate: 7.5 symbols/min [2025-09-23T19:49:39.643182] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-23T19:49:39.652684] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-07. [2025-09-23T19:49:40.241113] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-23T19:49:40.247852] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-04. [2025-09-23T19:49:41.579290] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-23T19:49:41.586919] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-05. [2025-09-23T19:49:41.736705] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-23T19:49:41.746120] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-08. [2025-09-23T19:49:42.937037] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-23T19:49:42.944210] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-06. [2025-09-23T19:49:43.019193] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-23T19:49:43.028003] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-09. [2025-09-23T19:49:44.337465] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-23T19:49:44.343691] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-07. [2025-09-23T19:49:44.461425] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-23T19:49:44.468622] [INFO ] [REMOTE ] LSPD: Full fetch complete (61559 records). [2025-09-23T19:49:44.468792] [DEBUG] [VALIDATOR ] LSPD: Validating primary data. [2025-09-23T19:49:44.866335] [DEBUG] [VALIDATOR ] LSPD: All expected trading days are present. [2025-09-23T19:49:44.866446] [DEBUG] [VALIDATOR ] LSPD: Primary data validation passed. [2025-09-23T19:49:44.867485] [INFO ] [MAIN ] LSPD: Fetched primary data is valid. [2025-09-23T19:49:44.867552] [DEBUG] [LOCAL ] LSPD: Saving primary data. [2025-09-23T19:49:44.868972] [DEBUG] [LOCAL ] LSPD: Trimmed 61559 records to 43334 (keeping 200 days of data) [2025-09-23T19:49:45.126995] [DEBUG] [LOCAL ] LSPD: Primary data saved (43334 records). [2025-09-23T19:49:45.127148] [INFO ] [MAIN ] LSPD: Full history saved. [2025-09-23T19:49:45.127239] [INFO ] [MAIN ] Update Progress: 1279/2372 symbols completed. LSPD took 25.8s. Estimated remaining: 2h 25m 1s. Rate: 7.5 symbols/min [2025-09-23T19:49:45.584181] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-23T19:49:45.592190] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-08. [2025-09-23T19:49:46.689048] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-23T19:49:46.695982] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-09. [2025-09-23T19:49:48.066932] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-23T19:49:48.071864] [INFO ] [REMOTE ] LTC: Full fetch complete (42858 records). [2025-09-23T19:49:48.071967] [DEBUG] [VALIDATOR ] LTC: Validating primary data. [2025-09-23T19:49:48.446694] [DEBUG] [VALIDATOR ] LTC: All expected trading days are present. [2025-09-23T19:49:48.446781] [DEBUG] [VALIDATOR ] LTC: Primary data validation passed. [2025-09-23T19:49:48.447463] [INFO ] [MAIN ] LTC: Fetched primary data is valid. [2025-09-23T19:49:48.447505] [DEBUG] [LOCAL ] LTC: Saving primary data. [2025-09-23T19:49:48.448448] [DEBUG] [LOCAL ] LTC: Trimmed 42858 records to 29903 (keeping 200 days of data) [2025-09-23T19:49:48.636687] [DEBUG] [LOCAL ] LTC: Primary data saved (29903 records). [2025-09-23T19:49:48.636828] [INFO ] [MAIN ] LTC: Full history saved. [2025-09-23T19:49:48.636914] [INFO ] [MAIN ] Update Progress: 1280/2372 symbols completed. LTC took 27.5s. Estimated remaining: 2h 24m 49s. Rate: 7.5 symbols/min [2025-09-23T19:49:49.187240] [INFO ] [MAIN ] LTM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:49:49.289274] [INFO ] [MAIN ] LTH: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:49:49.359831] [INFO ] [MAIN ] LUCK: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:49:49.342473] [INFO ] [MAIN ] LU: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:49:49.360284] [DEBUG] [LOCAL ] LUCK: No existing data file found in primary storage. [2025-09-23T19:49:49.360610] [WARN ] [MAIN ] LUCK: No existing data found, performing full refresh instead. [2025-09-23T19:49:49.360776] [INFO ] [MAIN ] LUCK: Wiping existing primary data before full refresh. [2025-09-23T19:49:49.360819] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-09-23T19:49:49.360859] [DEBUG] [LOCAL ] LUCK: No primary data file found to delete. [2025-09-23T19:49:49.360893] [INFO ] [MAIN ] LUCK: Starting full primary refresh. [2025-09-23T19:49:49.684799] [DEBUG] [LOCAL ] LTM: Loaded 36009 existing records from primary storage. [2025-09-23T19:49:49.698365] [INFO ] [MAIN ] LTM: Loaded 36009 existing records. [2025-09-23T19:49:49.719767] [DEBUG] [LOCAL ] LU: Loaded 48994 existing records from primary storage. [2025-09-23T19:49:49.785085] [INFO ] [MAIN ] LU: Loaded 48994 existing records. [2025-09-23T19:49:49.844608] [DEBUG] [LOCAL ] LTH: Loaded 51890 existing records from primary storage. [2025-09-23T19:49:49.864086] [INFO ] [MAIN ] LTH: Loaded 51890 existing records. [2025-09-23T19:49:50.018069] [INFO ] [REMOTE ] LUCK: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:49:50.043986] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2024-12. [2025-09-23T19:49:50.302244] [WARN ] [MAIN ] LU: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:49:50.302107] [WARN ] [MAIN ] LTM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:49:50.302952] [INFO ] [MAIN ] LU: Wiping existing primary data before full refresh. [2025-09-23T19:49:50.303059] [INFO ] [LOCAL ] LU: Starting deletion of primary data. [2025-09-23T19:49:50.324163] [DEBUG] [LOCAL ] LU: Deleted primary data file. [2025-09-23T19:49:50.302894] [INFO ] [MAIN ] LTM: Wiping existing primary data before full refresh. [2025-09-23T19:49:50.343550] [INFO ] [MAIN ] LU: Starting full primary refresh. [2025-09-23T19:49:50.428077] [INFO ] [LOCAL ] LTM: Starting deletion of primary data. [2025-09-23T19:49:50.420803] [WARN ] [MAIN ] LTH: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:49:50.478919] [DEBUG] [LOCAL ] LTM: Deleted primary data file. [2025-09-23T19:49:50.469404] [INFO ] [MAIN ] LTH: Wiping existing primary data before full refresh. [2025-09-23T19:49:50.489124] [INFO ] [MAIN ] LTM: Starting full primary refresh. [2025-09-23T19:49:50.494486] [INFO ] [LOCAL ] LTH: Starting deletion of primary data. [2025-09-23T19:49:50.599883] [DEBUG] [LOCAL ] LTH: Deleted primary data file. [2025-09-23T19:49:50.629161] [INFO ] [MAIN ] LTH: Starting full primary refresh. [2025-09-23T19:49:51.422552] [INFO ] [REMOTE ] LU: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:49:51.453591] [INFO ] [REMOTE ] LU: Fetching primary data for 2024-12. [2025-09-23T19:49:51.519626] [INFO ] [REMOTE ] LTM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:49:51.599807] [INFO ] [REMOTE ] LTM: Fetching primary data for 2024-12. [2025-09-23T19:49:51.599496] [INFO ] [REMOTE ] LTH: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:49:51.600126] [INFO ] [REMOTE ] LTH: Fetching primary data for 2024-12. [2025-09-23T19:49:51.622030] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-23T19:49:51.627247] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-01. [2025-09-23T19:49:52.732004] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-23T19:49:52.736853] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-01. [2025-09-23T19:49:52.890843] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-23T19:49:52.899801] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-02. [2025-09-23T19:49:52.951089] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-23T19:49:52.961713] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-01. [2025-09-23T19:49:53.142046] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-23T19:49:53.151380] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-01. [2025-09-23T19:49:53.830181] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-23T19:49:53.835673] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-02. [2025-09-23T19:49:53.916324] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-23T19:49:53.923810] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-03. [2025-09-23T19:49:54.564401] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-23T19:49:54.602141] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-02. [2025-09-23T19:49:54.684698] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-23T19:49:54.712541] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-23T19:49:54.778636] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-23T19:49:55.402185] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-03. [2025-09-23T19:49:56.159008] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-23T19:49:56.202246] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-04. [2025-09-23T19:49:56.513531] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-23T19:49:57.002387] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-03. [2025-09-23T19:49:57.213318] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-23T19:49:57.802195] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-05. [2025-09-23T19:49:58.454488] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-23T19:49:58.602155] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-04. [2025-09-23T19:49:58.997504] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-23T19:49:59.402290] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-06. [2025-09-23T19:50:00.202181] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-02. [2025-09-23T19:50:00.421261] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-23T19:50:00.513282] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-23T19:50:01.002227] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-04. [2025-09-23T19:50:01.802295] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-07. [2025-09-23T19:50:02.010589] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-23T19:50:02.074419] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-23T19:50:02.602303] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-03. [2025-09-23T19:50:02.759061] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-23T19:50:03.402234] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-05. [2025-09-23T19:50:04.091905] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-23T19:50:04.202290] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-05. [2025-09-23T19:50:05.002258] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-08. [2025-09-23T19:50:05.157574] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-23T19:50:05.359620] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-23T19:50:05.802178] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-06. [2025-09-23T19:50:06.032035] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-23T19:50:06.602222] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-09. [2025-09-23T19:50:07.298700] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-23T19:50:07.402193] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-07. [2025-09-23T19:50:07.700101] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-23T19:50:07.705027] [INFO ] [REMOTE ] LUCK: Full fetch complete (40159 records). [2025-09-23T19:50:07.705156] [DEBUG] [VALIDATOR ] LUCK: Validating primary data. [2025-09-23T19:50:07.910831] [WARN ] [VALIDATOR ] LUCK: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-09-23T19:50:07.911412] [FATAL] [MAIN ] LUCK: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:50:07.911485] [WARN ] [MAIN ] LUCK: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:50:07.911559] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-09-23T19:50:07.911669] [DEBUG] [LOCAL ] LUCK: No primary data file found to delete. [2025-09-23T19:50:07.911732] [INFO ] [LOCAL ] LUCK: Starting deletion of derivative data. [2025-09-23T19:50:07.911793] [DEBUG] [LOCAL ] LUCK: No derivative data file found to delete. [2025-09-23T19:50:07.911890] [INFO ] [MAIN ] Update Progress: 1281/2372 symbols completed. LUCK took 19.3s. Estimated remaining: 2h 24m 51s. Rate: 7.5 symbols/min [2025-09-23T19:50:08.088321] [INFO ] [MAIN ] LUMN: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:50:08.144033] [DEBUG] [LOCAL ] LUMN: Loaded 53634 existing records from primary storage. [2025-09-23T19:50:08.144204] [INFO ] [MAIN ] LUMN: Loaded 53634 existing records. [2025-09-23T19:50:08.208563] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-06. [2025-09-23T19:50:08.329110] [WARN ] [MAIN ] LUMN: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:50:08.329347] [INFO ] [MAIN ] LUMN: Wiping existing primary data before full refresh. [2025-09-23T19:50:08.329397] [INFO ] [LOCAL ] LUMN: Starting deletion of primary data. [2025-09-23T19:50:08.331143] [DEBUG] [LOCAL ] LUMN: Deleted primary data file. [2025-09-23T19:50:08.331207] [INFO ] [MAIN ] LUMN: Starting full primary refresh. [2025-09-23T19:50:08.691615] [INFO ] [REMOTE ] LUMN: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:50:09.002216] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-04. [2025-09-23T19:50:09.089582] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-23T19:50:09.393849] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-23T19:50:09.802204] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2024-12. [2025-09-23T19:50:10.511508] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-23T19:50:10.602204] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-05. [2025-09-23T19:50:11.402223] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-07. [2025-09-23T19:50:11.759398] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-23T19:50:12.202260] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-01. [2025-09-23T19:50:12.239522] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-23T19:50:12.456476] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-23T19:50:13.002213] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-08. [2025-09-23T19:50:13.703759] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-23T19:50:13.802196] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-06. [2025-09-23T19:50:14.270256] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-23T19:50:14.602222] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-09. [2025-09-23T19:50:15.083030] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-23T19:50:15.402229] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-08. [2025-09-23T19:50:16.202198] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-02. [2025-09-23T19:50:17.002270] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-07. [2025-09-23T19:50:17.059700] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-23T19:50:17.276011] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-09 (2.67 seconds). [2025-09-23T19:50:17.284885] [INFO ] [REMOTE ] LU: Full fetch complete (70397 records). [2025-09-23T19:50:17.285067] [DEBUG] [VALIDATOR ] LU: Validating primary data. [2025-09-23T19:50:17.694031] [DEBUG] [VALIDATOR ] LU: All expected trading days are present. [2025-09-23T19:50:17.694208] [DEBUG] [VALIDATOR ] LU: Primary data validation passed. [2025-09-23T19:50:17.695425] [INFO ] [MAIN ] LU: Fetched primary data is valid. [2025-09-23T19:50:17.695538] [DEBUG] [LOCAL ] LU: Saving primary data. [2025-09-23T19:50:17.697237] [DEBUG] [LOCAL ] LU: Trimmed 70397 records to 48961 (keeping 200 days of data) [2025-09-23T19:50:17.805816] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-09. [2025-09-23T19:50:17.823855] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-23T19:50:18.031077] [DEBUG] [LOCAL ] LU: Primary data saved (48961 records). [2025-09-23T19:50:18.031278] [INFO ] [MAIN ] LU: Full history saved. [2025-09-23T19:50:18.031453] [INFO ] [MAIN ] Update Progress: 1282/2372 symbols completed. LU took 29.4s. Estimated remaining: 2h 24m 45s. Rate: 7.5 symbols/min [2025-09-23T19:50:18.214293] [INFO ] [MAIN ] LUV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:50:18.272875] [DEBUG] [LOCAL ] LUV: Loaded 53689 existing records from primary storage. [2025-09-23T19:50:18.273146] [INFO ] [MAIN ] LUV: Loaded 53689 existing records. [2025-09-23T19:50:18.457994] [WARN ] [MAIN ] LUV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:50:18.458519] [INFO ] [MAIN ] LUV: Wiping existing primary data before full refresh. [2025-09-23T19:50:18.458582] [INFO ] [LOCAL ] LUV: Starting deletion of primary data. [2025-09-23T19:50:18.471751] [DEBUG] [LOCAL ] LUV: Deleted primary data file. [2025-09-23T19:50:18.488854] [INFO ] [MAIN ] LUV: Starting full primary refresh. [2025-09-23T19:50:18.569513] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-23T19:50:18.604126] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-03. [2025-09-23T19:50:18.880232] [INFO ] [REMOTE ] LUV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:50:19.402205] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-08. [2025-09-23T19:50:19.582972] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-23T19:50:19.591210] [INFO ] [REMOTE ] LTM: Full fetch complete (46918 records). [2025-09-23T19:50:19.591342] [DEBUG] [VALIDATOR ] LTM: Validating primary data. [2025-09-23T19:50:19.983918] [DEBUG] [VALIDATOR ] LTM: All expected trading days are present. [2025-09-23T19:50:19.984042] [DEBUG] [VALIDATOR ] LTM: Primary data validation passed. [2025-09-23T19:50:19.984867] [INFO ] [MAIN ] LTM: Fetched primary data is valid. [2025-09-23T19:50:19.984958] [DEBUG] [LOCAL ] LTM: Saving primary data. [2025-09-23T19:50:19.986708] [DEBUG] [LOCAL ] LTM: Trimmed 46918 records to 36133 (keeping 200 days of data) [2025-09-23T19:50:20.202317] [INFO ] [REMOTE ] LUV: Fetching primary data for 2024-12. [2025-09-23T19:50:20.220214] [DEBUG] [LOCAL ] LTM: Primary data saved (36133 records). [2025-09-23T19:50:20.220887] [INFO ] [MAIN ] LTM: Full history saved. [2025-09-23T19:50:20.221031] [INFO ] [MAIN ] Update Progress: 1283/2372 symbols completed. LTM took 31.6s. Estimated remaining: 2h 24m 32s. Rate: 7.5 symbols/min [2025-09-23T19:50:20.398001] [INFO ] [MAIN ] LUXE: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:50:20.398224] [DEBUG] [LOCAL ] LUXE: No existing data file found in primary storage. [2025-09-23T19:50:20.398291] [WARN ] [MAIN ] LUXE: No existing data found, performing full refresh instead. [2025-09-23T19:50:20.398677] [INFO ] [MAIN ] LUXE: Wiping existing primary data before full refresh. [2025-09-23T19:50:20.398747] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-09-23T19:50:20.398816] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-09-23T19:50:20.398853] [INFO ] [MAIN ] LUXE: Starting full primary refresh. [2025-09-23T19:50:20.824466] [INFO ] [REMOTE ] LUXE: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:50:20.828706] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-23T19:50:21.002246] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2024-12. [2025-09-23T19:50:21.088256] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-23T19:50:21.211707] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:50:21.212045] [WARN ] [REMOTE ] LUXE: No data returned for month 2024-12 [2025-09-23T19:50:21.802154] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-01. [2025-09-23T19:50:22.123805] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-23T19:50:22.158208] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:50:22.158533] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-01 [2025-09-23T19:50:22.602187] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-09. [2025-09-23T19:50:23.402203] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-02. [2025-09-23T19:50:23.595127] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:50:23.595509] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-02 [2025-09-23T19:50:24.202198] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-03. [2025-09-23T19:50:24.351468] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-23T19:50:24.360140] [INFO ] [REMOTE ] LTH: Full fetch complete (73884 records). [2025-09-23T19:50:24.360274] [DEBUG] [VALIDATOR ] LTH: Validating primary data. [2025-09-23T19:50:24.436206] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:50:24.460545] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-03 [2025-09-23T19:50:24.764672] [DEBUG] [VALIDATOR ] LTH: All expected trading days are present. [2025-09-23T19:50:24.764829] [DEBUG] [VALIDATOR ] LTH: Primary data validation passed. [2025-09-23T19:50:24.766053] [INFO ] [MAIN ] LTH: Fetched primary data is valid. [2025-09-23T19:50:24.766188] [DEBUG] [LOCAL ] LTH: Saving primary data. [2025-09-23T19:50:24.768230] [DEBUG] [LOCAL ] LTH: Trimmed 73884 records to 51874 (keeping 200 days of data) [2025-09-23T19:50:25.009598] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-04. [2025-09-23T19:50:25.089129] [DEBUG] [LOCAL ] LTH: Primary data saved (51874 records). [2025-09-23T19:50:25.089261] [INFO ] [MAIN ] LTH: Full history saved. [2025-09-23T19:50:25.089441] [INFO ] [MAIN ] Update Progress: 1284/2372 symbols completed. LTH took 36.5s. Estimated remaining: 2h 24m 22s. Rate: 7.5 symbols/min [2025-09-23T19:50:25.257214] [INFO ] [MAIN ] LVS: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:50:25.312277] [DEBUG] [LOCAL ] LVS: Loaded 53567 existing records from primary storage. [2025-09-23T19:50:25.312419] [INFO ] [MAIN ] LVS: Loaded 53567 existing records. [2025-09-23T19:50:25.487969] [WARN ] [MAIN ] LVS: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:50:25.488218] [INFO ] [MAIN ] LVS: Wiping existing primary data before full refresh. [2025-09-23T19:50:25.488271] [INFO ] [LOCAL ] LVS: Starting deletion of primary data. [2025-09-23T19:50:25.489753] [DEBUG] [LOCAL ] LVS: Deleted primary data file. [2025-09-23T19:50:25.489833] [INFO ] [MAIN ] LVS: Starting full primary refresh. [2025-09-23T19:50:25.807265] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-01. [2025-09-23T19:50:25.845221] [INFO ] [REMOTE ] LVS: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:50:26.602231] [INFO ] [REMOTE ] LVS: Fetching primary data for 2024-12. [2025-09-23T19:50:27.030927] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-23T19:50:27.402248] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-04. [2025-09-23T19:50:27.591343] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-23T19:50:27.591732] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-04 [2025-09-23T19:50:27.730685] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-23T19:50:28.202227] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-02. [2025-09-23T19:50:29.002239] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-05. [2025-09-23T19:50:29.802181] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-05. [2025-09-23T19:50:30.117998] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-23T19:50:30.531734] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-23T19:50:30.602218] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-03. [2025-09-23T19:50:30.700941] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-23T19:50:31.402224] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-06. [2025-09-23T19:50:31.606589] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2024-12 (5.00 seconds). [2025-09-23T19:50:32.202172] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-01. [2025-09-23T19:50:32.300270] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-23T19:50:32.748688] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-23T19:50:33.002250] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-07. [2025-09-23T19:50:33.802175] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-04. [2025-09-23T19:50:34.039860] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-23T19:50:34.168024] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-23T19:50:34.602201] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-02. [2025-09-23T19:50:35.402204] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-06. [2025-09-23T19:50:35.947371] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-23T19:50:36.033214] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-23T19:50:36.202188] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-03. [2025-09-23T19:50:37.002246] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-08. [2025-09-23T19:50:37.414440] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-23T19:50:37.802187] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-07. [2025-09-23T19:50:37.975749] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-23T19:50:38.168085] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-23T19:50:38.602191] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-04. [2025-09-23T19:50:39.402222] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-09. [2025-09-23T19:50:39.435929] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-23T19:50:40.118500] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-23T19:50:40.204090] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-05. [2025-09-23T19:50:40.206055] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-23T19:50:40.210679] [INFO ] [REMOTE ] LUXE: Full fetch complete (13177 records). [2025-09-23T19:50:40.210766] [DEBUG] [VALIDATOR ] LUXE: Validating primary data. [2025-09-23T19:50:40.394634] [WARN ] [VALIDATOR ] LUXE: Validation failed - insufficient historical data. Have 100 unique days, need 200 days [2025-09-23T19:50:40.394927] [FATAL] [MAIN ] LUXE: Fetched primary data is invalid. Refusing to save it. [2025-09-23T19:50:40.395005] [WARN ] [MAIN ] LUXE: Deleting existing primary and derivative data due to validation failure. [2025-09-23T19:50:40.395124] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-09-23T19:50:40.395199] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-09-23T19:50:40.395248] [INFO ] [LOCAL ] LUXE: Starting deletion of derivative data. [2025-09-23T19:50:40.395314] [DEBUG] [LOCAL ] LUXE: No derivative data file found to delete. [2025-09-23T19:50:40.395400] [INFO ] [MAIN ] Update Progress: 1285/2372 symbols completed. LUXE took 20.2s. Estimated remaining: 2h 24m 20s. Rate: 7.5 symbols/min [2025-09-23T19:50:40.572755] [INFO ] [MAIN ] LVWR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:50:40.597112] [DEBUG] [LOCAL ] LVWR: Loaded 17418 existing records from primary storage. [2025-09-23T19:50:40.597275] [INFO ] [MAIN ] LVWR: Loaded 17418 existing records. [2025-09-23T19:50:40.777058] [WARN ] [MAIN ] LVWR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:50:40.777310] [INFO ] [MAIN ] LVWR: Wiping existing primary data before full refresh. [2025-09-23T19:50:40.777373] [INFO ] [LOCAL ] LVWR: Starting deletion of primary data. [2025-09-23T19:50:40.778138] [DEBUG] [LOCAL ] LVWR: Deleted primary data file. [2025-09-23T19:50:40.778201] [INFO ] [MAIN ] LVWR: Starting full primary refresh. [2025-09-23T19:50:41.010350] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-08. [2025-09-23T19:50:41.172339] [INFO ] [REMOTE ] LVWR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:50:41.802230] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-05. [2025-09-23T19:50:42.245735] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-23T19:50:42.602242] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2024-12. [2025-09-23T19:50:43.137610] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-23T19:50:43.133998] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-23T19:50:43.308210] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-23T19:50:43.402240] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-01. [2025-09-23T19:50:44.011233] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-23T19:50:44.202214] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-06. [2025-09-23T19:50:45.002210] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-06. [2025-09-23T19:50:45.802278] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-02. [2025-09-23T19:50:46.301722] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-23T19:50:46.386214] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-23T19:50:46.602174] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-07. [2025-09-23T19:50:46.816260] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-23T19:50:47.402268] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-03. [2025-09-23T19:50:47.816113] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-23T19:50:48.202178] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-09. [2025-09-23T19:50:48.347025] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-23T19:50:49.002223] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-07. [2025-09-23T19:50:49.802195] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-08. [2025-09-23T19:50:50.230980] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-23T19:50:50.240868] [INFO ] [REMOTE ] LUMN: Full fetch complete (77634 records). [2025-09-23T19:50:50.241061] [DEBUG] [VALIDATOR ] LUMN: Validating primary data. [2025-09-23T19:50:50.611876] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-04. [2025-09-23T19:50:50.664048] [DEBUG] [VALIDATOR ] LUMN: All expected trading days are present. [2025-09-23T19:50:50.664221] [DEBUG] [VALIDATOR ] LUMN: Primary data validation passed. [2025-09-23T19:50:50.665737] [INFO ] [MAIN ] LUMN: Fetched primary data is valid. [2025-09-23T19:50:50.665808] [DEBUG] [LOCAL ] LUMN: Saving primary data. [2025-09-23T19:50:50.670887] [DEBUG] [LOCAL ] LUMN: Trimmed 77634 records to 53634 (keeping 200 days of data) [2025-09-23T19:50:51.056535] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-23T19:50:51.073880] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-23T19:50:51.101398] [DEBUG] [LOCAL ] LUMN: Primary data saved (53634 records). [2025-09-23T19:50:51.101609] [INFO ] [MAIN ] LUMN: Full history saved. [2025-09-23T19:50:51.101778] [INFO ] [MAIN ] Update Progress: 1286/2372 symbols completed. LUMN took 43.2s. Estimated remaining: 2h 24m 14s. Rate: 7.5 symbols/min [2025-09-23T19:50:51.279762] [INFO ] [MAIN ] LW: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:50:51.342943] [DEBUG] [LOCAL ] LW: Loaded 51236 existing records from primary storage. [2025-09-23T19:50:51.343197] [INFO ] [MAIN ] LW: Loaded 51236 existing records. [2025-09-23T19:50:51.412359] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-05. [2025-09-23T19:50:51.547971] [WARN ] [MAIN ] LW: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:50:51.548605] [INFO ] [MAIN ] LW: Wiping existing primary data before full refresh. [2025-09-23T19:50:51.548842] [INFO ] [LOCAL ] LW: Starting deletion of primary data. [2025-09-23T19:50:51.550737] [DEBUG] [LOCAL ] LW: Deleted primary data file. [2025-09-23T19:50:51.550805] [INFO ] [MAIN ] LW: Starting full primary refresh. [2025-09-23T19:50:51.904489] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-23T19:50:52.009036] [INFO ] [REMOTE ] LW: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:50:52.202250] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-09. [2025-09-23T19:50:52.571851] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-23T19:50:53.002231] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-06. [2025-09-23T19:50:53.802222] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-08. [2025-09-23T19:50:54.172191] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-23T19:50:54.186126] [INFO ] [REMOTE ] LUV: Full fetch complete (77727 records). [2025-09-23T19:50:54.186289] [DEBUG] [VALIDATOR ] LUV: Validating primary data. [2025-09-23T19:50:54.495468] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-23T19:50:54.610271] [INFO ] [REMOTE ] LW: Fetching primary data for 2024-12. [2025-09-23T19:50:54.630168] [DEBUG] [VALIDATOR ] LUV: All expected trading days are present. [2025-09-23T19:50:54.630243] [DEBUG] [VALIDATOR ] LUV: Primary data validation passed. [2025-09-23T19:50:54.631279] [INFO ] [MAIN ] LUV: Fetched primary data is valid. [2025-09-23T19:50:54.631349] [DEBUG] [LOCAL ] LUV: Saving primary data. [2025-09-23T19:50:54.633065] [DEBUG] [LOCAL ] LUV: Trimmed 77727 records to 53689 (keeping 200 days of data) [2025-09-23T19:50:54.979978] [DEBUG] [LOCAL ] LUV: Primary data saved (53689 records). [2025-09-23T19:50:54.980132] [INFO ] [MAIN ] LUV: Full history saved. [2025-09-23T19:50:54.980236] [INFO ] [MAIN ] Update Progress: 1287/2372 symbols completed. LUV took 36.9s. Estimated remaining: 2h 24m 3s. Rate: 7.5 symbols/min [2025-09-23T19:50:55.150329] [INFO ] [MAIN ] LXFR: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:50:55.171331] [DEBUG] [LOCAL ] LXFR: Loaded 17038 existing records from primary storage. [2025-09-23T19:50:55.171449] [INFO ] [MAIN ] LXFR: Loaded 17038 existing records. [2025-09-23T19:50:55.359695] [WARN ] [MAIN ] LXFR: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:50:55.360004] [INFO ] [MAIN ] LXFR: Wiping existing primary data before full refresh. [2025-09-23T19:50:55.360060] [INFO ] [LOCAL ] LXFR: Starting deletion of primary data. [2025-09-23T19:50:55.360852] [DEBUG] [LOCAL ] LXFR: Deleted primary data file. [2025-09-23T19:50:55.360915] [INFO ] [MAIN ] LXFR: Starting full primary refresh. [2025-09-23T19:50:55.405875] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-07. [2025-09-23T19:50:55.756359] [INFO ] [REMOTE ] LXFR: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:50:55.772154] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-23T19:50:56.202187] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2024-12. [2025-09-23T19:50:56.389882] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-23T19:50:56.426501] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-23T19:50:57.002226] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-08. [2025-09-23T19:50:57.802173] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-09. [2025-09-23T19:50:57.878400] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-23T19:50:58.602195] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-01. [2025-09-23T19:50:59.402184] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-09. [2025-09-23T19:50:59.728123] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-23T19:50:59.737043] [INFO ] [REMOTE ] LVS: Full fetch complete (77515 records). [2025-09-23T19:50:59.737178] [DEBUG] [VALIDATOR ] LVS: Validating primary data. [2025-09-23T19:51:00.135629] [DEBUG] [VALIDATOR ] LVS: All expected trading days are present. [2025-09-23T19:51:00.135767] [DEBUG] [VALIDATOR ] LVS: Primary data validation passed. [2025-09-23T19:51:00.136792] [INFO ] [MAIN ] LVS: Fetched primary data is valid. [2025-09-23T19:51:00.136878] [DEBUG] [LOCAL ] LVS: Saving primary data. [2025-09-23T19:51:00.138375] [DEBUG] [LOCAL ] LVS: Trimmed 77515 records to 53568 (keeping 200 days of data) [2025-09-23T19:51:00.429750] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-23T19:51:00.438489] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2024-12 (4.24 seconds). [2025-09-23T19:51:00.444083] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-01. [2025-09-23T19:51:00.444529] [INFO ] [REMOTE ] LVWR: Full fetch complete (19804 records). [2025-09-23T19:51:00.447633] [DEBUG] [VALIDATOR ] LVWR: Validating primary data. [2025-09-23T19:51:00.446413] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-23T19:51:00.887418] [DEBUG] [VALIDATOR ] LVWR: All expected trading days are present. [2025-09-23T19:51:00.888132] [DEBUG] [VALIDATOR ] LVWR: Primary data validation passed. [2025-09-23T19:51:00.889302] [INFO ] [MAIN ] LVWR: Fetched primary data is valid. [2025-09-23T19:51:00.889626] [DEBUG] [LOCAL ] LVWR: Saving primary data. [2025-09-23T19:51:00.892537] [DEBUG] [LOCAL ] LVWR: Trimmed 19804 records to 17514 (keeping 200 days of data) [2025-09-23T19:51:01.006520] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-02. [2025-09-23T19:51:01.076833] [DEBUG] [LOCAL ] LVS: Primary data saved (53568 records). [2025-09-23T19:51:01.077612] [INFO ] [MAIN ] LVS: Full history saved. [2025-09-23T19:51:01.077988] [INFO ] [MAIN ] Update Progress: 1288/2372 symbols completed. LVS took 36.0s. Estimated remaining: 2h 23m 53s. Rate: 7.5 symbols/min [2025-09-23T19:51:01.187898] [DEBUG] [LOCAL ] LVWR: Primary data saved (17514 records). [2025-09-23T19:51:01.188115] [INFO ] [MAIN ] LVWR: Full history saved. [2025-09-23T19:51:01.193896] [INFO ] [MAIN ] Update Progress: 1289/2372 symbols completed. LVWR took 20.8s. Estimated remaining: 2h 23m 39s. Rate: 7.5 symbols/min [2025-09-23T19:51:01.352131] [INFO ] [MAIN ] LXP: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:51:01.457240] [INFO ] [MAIN ] LXU: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:51:01.520037] [DEBUG] [LOCAL ] LXU: Loaded 32066 existing records from primary storage. [2025-09-23T19:51:01.522017] [INFO ] [MAIN ] LXU: Loaded 32066 existing records. [2025-09-23T19:51:01.528438] [DEBUG] [LOCAL ] LXP: Loaded 50627 existing records from primary storage. [2025-09-23T19:51:01.570784] [INFO ] [MAIN ] LXP: Loaded 50627 existing records. [2025-09-23T19:51:01.865464] [WARN ] [MAIN ] LXU: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:51:01.926422] [WARN ] [MAIN ] LXP: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:51:01.922117] [INFO ] [MAIN ] LXU: Wiping existing primary data before full refresh. [2025-09-23T19:51:01.926934] [INFO ] [LOCAL ] LXU: Starting deletion of primary data. [2025-09-23T19:51:01.941626] [DEBUG] [LOCAL ] LXU: Deleted primary data file. [2025-09-23T19:51:01.944615] [INFO ] [MAIN ] LXP: Wiping existing primary data before full refresh. [2025-09-23T19:51:01.945747] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-23T19:51:01.950252] [INFO ] [LOCAL ] LXP: Starting deletion of primary data. [2025-09-23T19:51:01.945883] [INFO ] [MAIN ] LXU: Starting full primary refresh. [2025-09-23T19:51:01.951169] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-02. [2025-09-23T19:51:01.964906] [DEBUG] [LOCAL ] LXP: Deleted primary data file. [2025-09-23T19:51:01.971058] [INFO ] [MAIN ] LXP: Starting full primary refresh. [2025-09-23T19:51:02.764728] [INFO ] [REMOTE ] LXU: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:51:02.769318] [INFO ] [REMOTE ] LXU: Fetching primary data for 2024-12. [2025-09-23T19:51:02.797464] [INFO ] [REMOTE ] LXP: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:51:03.402266] [INFO ] [REMOTE ] LXP: Fetching primary data for 2024-12. [2025-09-23T19:51:03.769817] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-02 (2.76 seconds). [2025-09-23T19:51:04.202202] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-03. [2025-09-23T19:51:04.834811] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-02 (2.88 seconds). [2025-09-23T19:51:05.002192] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-03. [2025-09-23T19:51:05.026107] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-09-23T19:51:05.802179] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-01. [2025-09-23T19:51:06.078577] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-23T19:51:06.140741] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2024-12 (2.74 seconds). [2025-09-23T19:51:06.376749] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-23T19:51:06.602218] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-04. [2025-09-23T19:51:06.758135] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-23T19:51:07.402214] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-04. [2025-09-23T19:51:08.148531] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-23T19:51:08.188591] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-23T19:51:08.202148] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-05. [2025-09-23T19:51:09.002222] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-02. [2025-09-23T19:51:09.802272] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-05. [2025-09-23T19:51:09.966460] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-23T19:51:10.005537] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-23T19:51:10.602310] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-03. [2025-09-23T19:51:10.793193] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-23T19:51:11.402265] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-06. [2025-09-23T19:51:11.616007] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-23T19:51:12.202210] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-04. [2025-09-23T19:51:12.251628] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-23T19:51:13.002262] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-07. [2025-09-23T19:51:13.802188] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-06. [2025-09-23T19:51:13.863245] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-23T19:51:14.082113] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-23T19:51:14.602232] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-08. [2025-09-23T19:51:15.402199] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-01. [2025-09-23T19:51:15.431442] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-23T19:51:15.690300] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-23T19:51:16.202195] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-09. [2025-09-23T19:51:17.002196] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-05. [2025-09-23T19:51:17.109547] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-23T19:51:17.324750] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-23T19:51:17.327903] [INFO ] [REMOTE ] LXFR: Full fetch complete (25163 records). [2025-09-23T19:51:17.327982] [DEBUG] [VALIDATOR ] LXFR: Validating primary data. [2025-09-23T19:51:17.695210] [DEBUG] [VALIDATOR ] LXFR: All expected trading days are present. [2025-09-23T19:51:17.695301] [DEBUG] [VALIDATOR ] LXFR: Primary data validation passed. [2025-09-23T19:51:17.695897] [INFO ] [MAIN ] LXFR: Fetched primary data is valid. [2025-09-23T19:51:17.695959] [DEBUG] [LOCAL ] LXFR: Saving primary data. [2025-09-23T19:51:17.696606] [DEBUG] [LOCAL ] LXFR: Trimmed 25163 records to 17121 (keeping 200 days of data) [2025-09-23T19:51:17.802300] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-02. [2025-09-23T19:51:17.808365] [DEBUG] [LOCAL ] LXFR: Primary data saved (17121 records). [2025-09-23T19:51:17.808543] [INFO ] [MAIN ] LXFR: Full history saved. [2025-09-23T19:51:17.808636] [INFO ] [MAIN ] Update Progress: 1290/2372 symbols completed. LXFR took 22.8s. Estimated remaining: 2h 23m 38s. Rate: 7.5 symbols/min [2025-09-23T19:51:17.982254] [INFO ] [MAIN ] LYB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:51:18.035471] [DEBUG] [LOCAL ] LYB: Loaded 53598 existing records from primary storage. [2025-09-23T19:51:18.035630] [INFO ] [MAIN ] LYB: Loaded 53598 existing records. [2025-09-23T19:51:18.242551] [WARN ] [MAIN ] LYB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:51:18.242831] [INFO ] [MAIN ] LYB: Wiping existing primary data before full refresh. [2025-09-23T19:51:18.242908] [INFO ] [LOCAL ] LYB: Starting deletion of primary data. [2025-09-23T19:51:18.244313] [DEBUG] [LOCAL ] LYB: Deleted primary data file. [2025-09-23T19:51:18.244375] [INFO ] [MAIN ] LYB: Starting full primary refresh. [2025-09-23T19:51:18.621208] [INFO ] [REMOTE ] LYB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:51:18.621275] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-07. [2025-09-23T19:51:18.639599] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-23T19:51:19.402204] [INFO ] [REMOTE ] LYB: Fetching primary data for 2024-12. [2025-09-23T19:51:20.202330] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-06. [2025-09-23T19:51:20.840203] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-23T19:51:20.891248] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-02 (3.09 seconds). [2025-09-23T19:51:21.002185] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-08. [2025-09-23T19:51:21.417542] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-23T19:51:21.458260] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-23T19:51:21.802204] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-01. [2025-09-23T19:51:22.593938] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-23T19:51:22.604557] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-07. [2025-09-23T19:51:23.402177] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-09. [2025-09-23T19:51:23.574121] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-23T19:51:23.923013] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-23T19:51:24.202204] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-08. [2025-09-23T19:51:25.002240] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-02. [2025-09-23T19:51:25.108993] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-23T19:51:25.117487] [INFO ] [REMOTE ] LW: Full fetch complete (74602 records). [2025-09-23T19:51:25.117701] [DEBUG] [VALIDATOR ] LW: Validating primary data. [2025-09-23T19:51:25.519460] [DEBUG] [VALIDATOR ] LW: All expected trading days are present. [2025-09-23T19:51:25.519600] [DEBUG] [VALIDATOR ] LW: Primary data validation passed. [2025-09-23T19:51:25.520730] [INFO ] [MAIN ] LW: Fetched primary data is valid. [2025-09-23T19:51:25.520821] [DEBUG] [LOCAL ] LW: Saving primary data. [2025-09-23T19:51:25.544980] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-23T19:51:25.552113] [DEBUG] [LOCAL ] LW: Trimmed 74602 records to 51202 (keeping 200 days of data) [2025-09-23T19:51:25.802298] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-09. [2025-09-23T19:51:25.873970] [DEBUG] [LOCAL ] LW: Primary data saved (51202 records). [2025-09-23T19:51:25.874135] [INFO ] [MAIN ] LW: Full history saved. [2025-09-23T19:51:25.874230] [INFO ] [MAIN ] Update Progress: 1291/2372 symbols completed. LW took 34.8s. Estimated remaining: 2h 23m 30s. Rate: 7.5 symbols/min [2025-09-23T19:51:26.052729] [INFO ] [MAIN ] LYG: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:51:26.111714] [DEBUG] [LOCAL ] LYG: Loaded 52882 existing records from primary storage. [2025-09-23T19:51:26.111882] [INFO ] [MAIN ] LYG: Loaded 52882 existing records. [2025-09-23T19:51:26.318176] [WARN ] [MAIN ] LYG: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:51:26.318478] [INFO ] [MAIN ] LYG: Wiping existing primary data before full refresh. [2025-09-23T19:51:26.318534] [INFO ] [LOCAL ] LYG: Starting deletion of primary data. [2025-09-23T19:51:26.320023] [DEBUG] [LOCAL ] LYG: Deleted primary data file. [2025-09-23T19:51:26.320152] [INFO ] [MAIN ] LYG: Starting full primary refresh. [2025-09-23T19:51:26.619825] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-03. [2025-09-23T19:51:26.709190] [INFO ] [REMOTE ] LYG: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:51:26.726886] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-23T19:51:26.732724] [INFO ] [REMOTE ] LXU: Full fetch complete (44926 records). [2025-09-23T19:51:26.733044] [DEBUG] [VALIDATOR ] LXU: Validating primary data. [2025-09-23T19:51:26.880485] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-23T19:51:27.203201] [DEBUG] [VALIDATOR ] LXU: All expected trading days are present. [2025-09-23T19:51:27.203312] [DEBUG] [VALIDATOR ] LXU: Primary data validation passed. [2025-09-23T19:51:27.204166] [INFO ] [MAIN ] LXU: Fetched primary data is valid. [2025-09-23T19:51:27.204235] [DEBUG] [LOCAL ] LXU: Saving primary data. [2025-09-23T19:51:27.205565] [DEBUG] [LOCAL ] LXU: Trimmed 44926 records to 32069 (keeping 200 days of data) [2025-09-23T19:51:27.403482] [INFO ] [REMOTE ] LYG: Fetching primary data for 2024-12. [2025-09-23T19:51:27.403671] [DEBUG] [LOCAL ] LXU: Primary data saved (32069 records). [2025-09-23T19:51:27.405011] [INFO ] [MAIN ] LXU: Full history saved. [2025-09-23T19:51:27.405290] [INFO ] [MAIN ] Update Progress: 1292/2372 symbols completed. LXU took 26.2s. Estimated remaining: 2h 23m 17s. Rate: 7.5 symbols/min [2025-09-23T19:51:27.617367] [INFO ] [MAIN ] LYV: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:51:27.678452] [DEBUG] [LOCAL ] LYV: Loaded 51216 existing records from primary storage. [2025-09-23T19:51:27.678630] [INFO ] [MAIN ] LYV: Loaded 51216 existing records. [2025-09-23T19:51:27.876424] [WARN ] [MAIN ] LYV: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:51:27.876729] [INFO ] [MAIN ] LYV: Wiping existing primary data before full refresh. [2025-09-23T19:51:27.876785] [INFO ] [LOCAL ] LYV: Starting deletion of primary data. [2025-09-23T19:51:27.878353] [DEBUG] [LOCAL ] LYV: Deleted primary data file. [2025-09-23T19:51:27.878416] [INFO ] [MAIN ] LYV: Starting full primary refresh. [2025-09-23T19:51:28.202246] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-03. [2025-09-23T19:51:28.287400] [INFO ] [REMOTE ] LYV: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:51:28.348584] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-23T19:51:29.002172] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-04. [2025-09-23T19:51:29.256030] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-23T19:51:29.802200] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-01. [2025-09-23T19:51:29.948696] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-23T19:51:30.602218] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-04. [2025-09-23T19:51:30.641920] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-23T19:51:31.088947] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-23T19:51:31.402234] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-02. [2025-09-23T19:51:32.189932] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-23T19:51:32.202149] [INFO ] [REMOTE ] LYV: Fetching primary data for 2024-12. [2025-09-23T19:51:33.002199] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-05. [2025-09-23T19:51:33.066978] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-23T19:51:33.802265] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-03. [2025-09-23T19:51:33.940506] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-23T19:51:34.602192] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-01. [2025-09-23T19:51:34.654621] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-23T19:51:35.402221] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-05. [2025-09-23T19:51:35.450921] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-23T19:51:36.202224] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-06. [2025-09-23T19:51:37.002217] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-04. [2025-09-23T19:51:37.149473] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-01 (2.55 seconds). [2025-09-23T19:51:37.537605] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-23T19:51:37.801121] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-23T19:51:37.810563] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-02. [2025-09-23T19:51:38.498834] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-23T19:51:38.602160] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-05. [2025-09-23T19:51:39.402260] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-07. [2025-09-23T19:51:39.499214] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-23T19:51:40.202233] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-03. [2025-09-23T19:51:40.344944] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-23T19:51:40.738325] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-23T19:51:41.002229] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-08. [2025-09-23T19:51:41.641425] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-23T19:51:41.802215] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-04. [2025-09-23T19:51:42.602171] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-06. [2025-09-23T19:51:42.636943] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-23T19:51:43.234789] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-23T19:51:43.402240] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-09. [2025-09-23T19:51:44.202206] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-06. [2025-09-23T19:51:44.374227] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-23T19:51:45.010353] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-07. [2025-09-23T19:51:45.012206] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-23T19:51:45.021523] [INFO ] [REMOTE ] LXP: Full fetch complete (72425 records). [2025-09-23T19:51:45.021682] [DEBUG] [VALIDATOR ] LXP: Validating primary data. [2025-09-23T19:51:45.448220] [DEBUG] [VALIDATOR ] LXP: All expected trading days are present. [2025-09-23T19:51:45.448304] [DEBUG] [VALIDATOR ] LXP: Primary data validation passed. [2025-09-23T19:51:45.449232] [INFO ] [MAIN ] LXP: Fetched primary data is valid. [2025-09-23T19:51:45.449297] [DEBUG] [LOCAL ] LXP: Saving primary data. [2025-09-23T19:51:45.451012] [DEBUG] [LOCAL ] LXP: Trimmed 72425 records to 50647 (keeping 200 days of data) [2025-09-23T19:51:45.766733] [DEBUG] [LOCAL ] LXP: Primary data saved (50647 records). [2025-09-23T19:51:45.766889] [INFO ] [MAIN ] LXP: Full history saved. [2025-09-23T19:51:45.766979] [INFO ] [MAIN ] Update Progress: 1293/2372 symbols completed. LXP took 44.7s. Estimated remaining: 2h 23m 17s. Rate: 7.5 symbols/min [2025-09-23T19:51:45.807386] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-05. [2025-09-23T19:51:45.951424] [INFO ] [MAIN ] LZB: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:51:45.981967] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-23T19:51:46.023591] [DEBUG] [LOCAL ] LZB: Loaded 35557 existing records from primary storage. [2025-09-23T19:51:46.023781] [INFO ] [MAIN ] LZB: Loaded 35557 existing records. [2025-09-23T19:51:46.205482] [WARN ] [MAIN ] LZB: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:51:46.205775] [INFO ] [MAIN ] LZB: Wiping existing primary data before full refresh. [2025-09-23T19:51:46.205832] [INFO ] [LOCAL ] LZB: Starting deletion of primary data. [2025-09-23T19:51:46.206814] [DEBUG] [LOCAL ] LZB: Deleted primary data file. [2025-09-23T19:51:46.206876] [INFO ] [MAIN ] LZB: Starting full primary refresh. [2025-09-23T19:51:46.597327] [INFO ] [REMOTE ] LZB: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:51:46.602153] [INFO ] [REMOTE ] LZB: Fetching primary data for 2024-12. [2025-09-23T19:51:46.639310] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-23T19:51:47.402248] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-08. [2025-09-23T19:51:47.520781] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-23T19:51:47.573486] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-23T19:51:48.202217] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-07. [2025-09-23T19:51:49.002214] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-01. [2025-09-23T19:51:49.358799] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-23T19:51:49.802244] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-09. [2025-09-23T19:51:49.930559] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-23T19:51:50.373263] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-23T19:51:50.602198] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-06. [2025-09-23T19:51:51.402254] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-02. [2025-09-23T19:51:51.610077] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-23T19:51:51.619042] [INFO ] [REMOTE ] LYB: Full fetch complete (77456 records). [2025-09-23T19:51:51.619184] [DEBUG] [VALIDATOR ] LYB: Validating primary data. [2025-09-23T19:51:52.028149] [DEBUG] [VALIDATOR ] LYB: All expected trading days are present. [2025-09-23T19:51:52.028329] [DEBUG] [VALIDATOR ] LYB: Primary data validation passed. [2025-09-23T19:51:52.029386] [INFO ] [MAIN ] LYB: Fetched primary data is valid. [2025-09-23T19:51:52.029496] [DEBUG] [LOCAL ] LYB: Saving primary data. [2025-09-23T19:51:52.031194] [DEBUG] [LOCAL ] LYB: Trimmed 77456 records to 53599 (keeping 200 days of data) [2025-09-23T19:51:52.215930] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-08. [2025-09-23T19:51:52.291258] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-23T19:51:52.423429] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-23T19:51:52.442153] [DEBUG] [LOCAL ] LYB: Primary data saved (53599 records). [2025-09-23T19:51:52.442269] [INFO ] [MAIN ] LYB: Full history saved. [2025-09-23T19:51:52.442346] [INFO ] [MAIN ] Update Progress: 1294/2372 symbols completed. LYB took 34.6s. Estimated remaining: 2h 23m 8s. Rate: 7.5 symbols/min [2025-09-23T19:51:52.614623] [INFO ] [MAIN ] LZM: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:51:52.628722] [DEBUG] [LOCAL ] LZM: Loaded 13402 existing records from primary storage. [2025-09-23T19:51:52.628842] [INFO ] [MAIN ] LZM: Loaded 13402 existing records. [2025-09-23T19:51:52.812295] [WARN ] [MAIN ] LZM: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:51:52.812587] [INFO ] [MAIN ] LZM: Wiping existing primary data before full refresh. [2025-09-23T19:51:52.812636] [INFO ] [LOCAL ] LZM: Starting deletion of primary data. [2025-09-23T19:51:52.813336] [DEBUG] [LOCAL ] LZM: Deleted primary data file. [2025-09-23T19:51:52.813398] [INFO ] [MAIN ] LZM: Starting full primary refresh. [2025-09-23T19:51:53.007428] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-03. [2025-09-23T19:51:53.196538] [INFO ] [REMOTE ] LZM: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:51:53.802188] [INFO ] [REMOTE ] LZM: Fetching primary data for 2024-12. [2025-09-23T19:51:54.093281] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-23T19:51:54.583507] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-23T19:51:54.598359] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-23T19:51:54.602132] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-04. [2025-09-23T19:51:55.402223] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-09. [2025-09-23T19:51:55.984688] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-23T19:51:56.202246] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-07. [2025-09-23T19:51:57.002195] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-05. [2025-09-23T19:51:57.197724] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-23T19:51:57.206744] [INFO ] [REMOTE ] LYG: Full fetch complete (76050 records). [2025-09-23T19:51:57.206888] [DEBUG] [VALIDATOR ] LYG: Validating primary data. [2025-09-23T19:51:57.623358] [DEBUG] [VALIDATOR ] LYG: All expected trading days are present. [2025-09-23T19:51:57.623556] [DEBUG] [VALIDATOR ] LYG: Primary data validation passed. [2025-09-23T19:51:57.624708] [INFO ] [MAIN ] LYG: Fetched primary data is valid. [2025-09-23T19:51:57.624792] [DEBUG] [LOCAL ] LYG: Saving primary data. [2025-09-23T19:51:57.626839] [DEBUG] [LOCAL ] LYG: Trimmed 76050 records to 52873 (keeping 200 days of data) [2025-09-23T19:51:57.743631] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-23T19:51:57.837798] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-08. [2025-09-23T19:51:57.982872] [DEBUG] [LOCAL ] LYG: Primary data saved (52873 records). [2025-09-23T19:51:57.983050] [INFO ] [MAIN ] LYG: Full history saved. [2025-09-23T19:51:57.983189] [INFO ] [MAIN ] Update Progress: 1295/2372 symbols completed. LYG took 32.1s. Estimated remaining: 2h 22m 58s. Rate: 7.5 symbols/min [2025-09-23T19:51:58.166239] [INFO ] [MAIN ] M: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:51:58.232493] [DEBUG] [LOCAL ] M: Loaded 53536 existing records from primary storage. [2025-09-23T19:51:58.232735] [INFO ] [MAIN ] M: Loaded 53536 existing records. [2025-09-23T19:51:58.421543] [WARN ] [MAIN ] M: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:51:58.422008] [INFO ] [MAIN ] M: Wiping existing primary data before full refresh. [2025-09-23T19:51:58.422148] [INFO ] [LOCAL ] M: Starting deletion of primary data. [2025-09-23T19:51:58.429283] [DEBUG] [LOCAL ] M: Deleted primary data file. [2025-09-23T19:51:58.439326] [INFO ] [MAIN ] M: Starting full primary refresh. [2025-09-23T19:51:58.521213] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-23T19:51:58.607294] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-01. [2025-09-23T19:51:58.817898] [INFO ] [REMOTE ] M: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:51:59.402203] [INFO ] [REMOTE ] M: Fetching primary data for 2024-12. [2025-09-23T19:51:59.479368] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-23T19:51:59.588999] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-23T19:52:00.202245] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-09. [2025-09-23T19:52:01.002223] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-02. [2025-09-23T19:52:01.417915] [INFO ] [REMOTE ] M: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-23T19:52:01.476977] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-23T19:52:01.802215] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-03. [2025-09-23T19:52:02.131477] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-23T19:52:02.141509] [INFO ] [REMOTE ] LYV: Full fetch complete (73651 records). [2025-09-23T19:52:02.141705] [DEBUG] [VALIDATOR ] LYV: Validating primary data. [2025-09-23T19:52:02.574060] [DEBUG] [VALIDATOR ] LYV: All expected trading days are present. [2025-09-23T19:52:02.574150] [DEBUG] [VALIDATOR ] LYV: Primary data validation passed. [2025-09-23T19:52:02.575108] [INFO ] [MAIN ] LYV: Fetched primary data is valid. [2025-09-23T19:52:02.575173] [DEBUG] [LOCAL ] LYV: Saving primary data. [2025-09-23T19:52:02.576601] [DEBUG] [LOCAL ] LYV: Trimmed 73651 records to 51188 (keeping 200 days of data) [2025-09-23T19:52:02.630297] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-06. [2025-09-23T19:52:02.807788] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-23T19:52:02.940638] [DEBUG] [LOCAL ] LYV: Primary data saved (51188 records). [2025-09-23T19:52:02.940838] [INFO ] [MAIN ] LYV: Full history saved. [2025-09-23T19:52:02.940936] [INFO ] [MAIN ] Update Progress: 1296/2372 symbols completed. LYV took 35.5s. Estimated remaining: 2h 22m 48s. Rate: 7.5 symbols/min [2025-09-23T19:52:03.136413] [INFO ] [MAIN ] MA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:52:03.209860] [DEBUG] [LOCAL ] MA: Loaded 52581 existing records from primary storage. [2025-09-23T19:52:03.210089] [INFO ] [MAIN ] MA: Loaded 52581 existing records. [2025-09-23T19:52:03.412762] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-04. [2025-09-23T19:52:03.505967] [WARN ] [MAIN ] MA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:52:03.506351] [INFO ] [MAIN ] MA: Wiping existing primary data before full refresh. [2025-09-23T19:52:03.506426] [INFO ] [LOCAL ] MA: Starting deletion of primary data. [2025-09-23T19:52:03.508219] [DEBUG] [LOCAL ] MA: Deleted primary data file. [2025-09-23T19:52:03.508303] [INFO ] [MAIN ] MA: Starting full primary refresh. [2025-09-23T19:52:04.070402] [INFO ] [REMOTE ] MA: Fetching primary data covering 200 trading days from 2024-12-04 to 2025-09-23 (requires 10 months of data pull). [2025-09-23T19:52:04.099444] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-23T19:52:04.202276] [INFO ] [REMOTE ] MA: Fetching primary data for 2024-12. [2025-09-23T19:52:04.650151] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-23T19:52:05.002203] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-05. [2025-09-23T19:52:05.802165] [INFO ] [REMOTE ] M: Fetching primary data for 2025-01. [2025-09-23T19:52:05.881275] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-23T19:52:06.144814] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-23T19:52:06.602221] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-01. [2025-09-23T19:52:07.402171] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-06. [2025-09-23T19:52:07.565845] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-23T19:52:08.158228] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-23T19:52:08.202267] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-07. [2025-09-23T19:52:08.584629] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-23T19:52:09.002306] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-02. [2025-09-23T19:52:09.259055] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-23T19:52:09.802274] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-08. [2025-09-23T19:52:10.563988] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-23T19:52:10.602234] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-07. [2025-09-23T19:52:11.303902] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-23T19:52:11.324037] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-23T19:52:11.402194] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-08. [2025-09-23T19:52:12.180762] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-23T19:52:12.202189] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-03. [2025-09-23T19:52:13.002220] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-09. [2025-09-23T19:52:13.802182] [INFO ] [REMOTE ] M: Fetching primary data for 2025-02. [2025-09-23T19:52:14.178515] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-23T19:52:14.501942] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-23T19:52:14.508466] [INFO ] [REMOTE ] LZB: Full fetch complete (50158 records). [2025-09-23T19:52:14.508597] [DEBUG] [VALIDATOR ] LZB: Validating primary data. [2025-09-23T19:52:14.608387] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-09. [2025-09-23T19:52:14.906637] [DEBUG] [VALIDATOR ] LZB: All expected trading days are present. [2025-09-23T19:52:14.906774] [DEBUG] [VALIDATOR ] LZB: Primary data validation passed. [2025-09-23T19:52:14.908318] [INFO ] [MAIN ] LZB: Fetched primary data is valid. [2025-09-23T19:52:14.908383] [DEBUG] [LOCAL ] LZB: Saving primary data. [2025-09-23T19:52:14.912471] [DEBUG] [LOCAL ] LZB: Trimmed 50158 records to 35589 (keeping 200 days of data) [2025-09-23T19:52:15.148248] [DEBUG] [LOCAL ] LZB: Primary data saved (35589 records). [2025-09-23T19:52:15.148397] [INFO ] [MAIN ] LZB: Full history saved. [2025-09-23T19:52:15.148516] [INFO ] [MAIN ] Update Progress: 1297/2372 symbols completed. LZB took 29.4s. Estimated remaining: 2h 22m 43s. Rate: 7.5 symbols/min [2025-09-23T19:52:15.322410] [INFO ] [MAIN ] MAA: Starting incremental primary update from 2025-09-15 to 2025-09-23. [2025-09-23T19:52:15.352927] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-23T19:52:15.404203] [INFO ] [REMOTE ] M: Fetching primary data for 2025-03. [2025-09-23T19:52:15.406430] [DEBUG] [LOCAL ] MAA: Loaded 42917 existing records from primary storage. [2025-09-23T19:52:15.406701] [INFO ] [MAIN ] MAA: Loaded 42917 existing records. [2025-09-23T19:52:15.606611] [WARN ] [MAIN ] MAA: Insufficient historical data. Have data from 2025-03-06, but need from 2024-12-04 for 200 day retention. Performing full refresh. [2025-09-23T19:52:15.608686] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-23T19:52:15.612035] [INFO ] [MAIN ] MAA: Wiping existing primary data before full refresh. [2025-09-23T19:52:15.612109] [INFO ] [LOCAL ] MAA: Starting deletion of primary data. [2025-09-23T19:52:15.612492] [INFO ] [REMOTE ] LZM: Full fetch complete (17843 records). [2025-09-23T19:52:15.612564] [DEBUG] [VALIDATOR ] LZM: Validating primary data. [2025-09